Google Using RSS/Atom Feeds To Discover New URLs

Posted on

  • email
  • twitter
  • facebook
  • share this

share this

Google announced a new feature last week that uses RSS and Atom feeds for the discovery of new webpages.

Using feeds for discovery allows Google to index new pages more quickly than traditional crawling methods. According to the announcement, Google may use “many potential sources to access updates from feeds including Reader, notifications services, or direct crawls of feeds.

If you’re publishing an RSS/Atom feed, make sure that those files are not disallowed by your robots.txt file. If you’re unsure whether your feeds are crawlable, use the robots.txt tester in Google Webmaster Tools.


Stay up to date on the latest Internet trends:
Request a professional subscription to Website Magazine,
the most popular print publication on Web success.

Login To Comment

Become a Member

Not already a part of our community? Sign up to participate in the discussion. It's free and quick.

Sign Up

Be the first to comment on this article

999 E Touhy Ave
Des Plaines, IL 60018

Toll Free: 1.800.817.1518
International: 1.773.628.2779
Fax: 1.773.272.0920