This is a place devoted to giving you deeper insight
into the news, trends, people and technology behind Bing.
In keeping with our themes of rapid change and responding to input and feedback from the webmaster community, we are working on future feature planning for the Bing webmaster tools and we would like to hear your thoughts in a few areas. The first area is Crawl-Delay:
Today, we fully support crawl delay which is specified in robots.txt. We are considering creating a tool which allows you to directly control the frequency, and perhaps even the timing, of msnbot/bingbot. A few questions:
Do you prefer for us to continue to support crawl-delay in robots.txt?
Feel free to reply to this post, or send email to firstname.lastname@example.org.
We thank you in advance for your feedback.
I've tried so very hard to get my pages indexed by Bing but it seems to take forever. I have also individually sent each page in the submit url area and I still can't get Bing to index. I have a sitemap set up as well that is automatically sent to Bing with each update and still it does not happen. The Bing tools at this point don't mean much to me because until I can get my site indexed so it is not worth it for me. The funny thing about the indexing is that you would think my recent pages would be there but for some reason it is the opposite for me. It is like Bing is 1 to 2 months behind in crawling and indexing my site. I am a new site with a good amount of traffic and it is disappointing that Bing will not recognize my site and index it. Yahoo and Google are both set up like Bing to be updated every time I add a new post, almost immediately the posts (within 1/2 hour) the page is in the index. Why can't Bing do the same? The nice thing that I find when I do receive visitors from Bing search they spend a good amount of time on my site and the bounce rate is quite low. The quality of the visitor is very good. The unfortunate part is if my site isn't indexed quickly those visitors won't know about my pages until 2 to 3 months in the future. If I am doing something incorrectly I would love to know about it.
from my experience the web hosting companies have same nice tool for helping with robots.txt, you can see this web site for the best web hosting companies - http://www.webguideinfo.com
Crawl rate based on time of day would be great.
1. No preference but would like the option available to so it can be added to the robots.txt
2. Time of day would be nice
a) range by hours would be good
b) rates by time of day
3) Not sure but having the option would be good
4) output for inclusion in robots.txt
I have setup http://tamilrelax.com seems bing not crawled frequent updates , so crawl delay must support by bing
So is there any general crawl schedule or not? I looked in the FAQs and saw old info from 2009 that crawls happen based on site rank and such, but am wondering if this is still valid? Also, does Bing tend to crawl blog sites more often than standard html sites?
Easily, the post is really the greatest on this laudable topic. I concur with your conclusions and will thirstily look forward to your future updates. Saying thanks will not just be sufficient, for the fantastic c lucidity in your writing. I will instantly grab your rss feed to stay privy of any updates. Solid work and much success in your business enterprise!
thanks for all
Just having the crawler actually come back and crawl when requested would be a great improvement. The crawl rate on Bing is horrible compared to Google.
My site is up for ~3 months now with all meta details its still not being crawled fully by bing. Submitted sitemap but still the same. Is there any way to let bing know that there is a site waiting to be crawled since last ~3 months.
i am having problem with crawling, my website is http://pixfav.com
website contains aprox.50000 pages and bing is crawling 20-50 pages per day.So please tell me how can i increase my crawling rate.
Your help will be appreciate
© 2013 Microsoft