http://www.websitemagazine.com/content/blogs/posts/archive/tags/google+search/default.aspxTags: google searchenCommunityServer 2008 SP2 (Build: 31104.93)http://www.websitemagazine.com/content/blogs/posts/archive/2009/11/02/google-using-rss-atom-feeds-to-discover-new-urls.aspxMon, 02 Nov 2009 15:17:00 GMT1e469e21-c924-44fa-a132-47b5d0a8ad47:10918Pete Prestipino0http://www.websitemagazine.com/content/blogs/posts/rsscomments.aspx?PostID=10918http://www.websitemagazine.com/content/blogs/posts/archive/2009/11/02/google-using-rss-atom-feeds-to-discover-new-urls.aspx#comments<hr /> <p> <b>Google announced a new feature last week that uses RSS and Atom feeds for the discovery of new webpages. </b><br /><br /> Using feeds for discovery allows Google to index new pages more quickly than traditional crawling methods. According to the announcement, Google may use &ldquo;many potential sources to access updates from feeds including Reader, notifications services, or direct crawls of feeds. <br /><br /> If you&rsquo;re publishing an RSS/Atom feed, make sure that those files are not disallowed by your robots.txt file. If you&rsquo;re unsure whether your feeds are crawlable, use the <a href="http://www.google.com/support/webmasters/bin/answer.py?answer=156449">robots.txt tester</a> in Google Webmaster Tools.</p> <p>&nbsp;</p> <hr /> <p> <img src="http://www.websitemagazine.com/images/blog/wm-pro.gif" style="float:left;margin:3px;" width="40" height="41" alt="" /><b>Stay up to date on the latest Internet trends:</b><br /> Request a professional <a href="http://websitemagazine.com/pro/">subscription to Website Magazine</a>,<br /> the most popular print publication on Web success.</p><div style="clear:both;"></div><img src="http://www.websitemagazine.com/content/aggbug.aspx?PostID=10918" width="1" height="1">googlerss discoveryatomgoogle search110209