Jin Liang, Software Engineer at Google, gives a brief overview on Googlebot and web hosting. Find out more about robots.txt, Google’s crawl rate, and how HTTP serving has evolved.
Change Googlebot crawl rate β
Watch all the recorded talks from WMConf MTV ’19 β
Subscribe to the Webmasters Channel β event: Webmaster Conference 2019; re_ty: Publish; product: Search Console – General; fullname: Jin Liang;