Bing Blogs

Bing Blogs

This is a place devoted to giving you deeper insight
into the news, trends, people and technology behind Bing.

FOLLOW BING

Browse by Tags

Tag Search Results - #robot.txt

View more results: All Community | Webmaster | General Questions & Feedback

  • Which File Crawl By Crawler First - Forum Thread

    http://www.bing.com/blogs/bingsearch/f/12244/t/666770.aspx

    Hi I wanna one question, in you directory suppose robot.txt file is present. when search engine crawler crawl this file, I mean which file will be crawl by crawler first, is it index.html or robot.txt.