Google's Robots.txt Sitemap

Posted on

  • email
  • twitter
  • facebook
  • share this

share this

advertisement

Via the Google Blog, more stats and analysis of robots.txt files were released in Google's Sitemaps feature. Some of the details and features now provided include analysis of the cached robots.txt file, the ability to enter a list to see if the robots.txt file allows or blocks spider agents, the page of your site with the highest PageRank a list of the most common words in your site's content and in external links to your site.

Read more about Google's new robots.txt sitemap now.

Technorati Tags: google sitemaps, google robots, google agent

 

Custom WordPress Design Themes at 99designs.com. Get the most designs for your buck when you start a design project!


Login To Comment

forget your login information?

Become a Member

Not already a part of our community? Sign up to participate in the discussion. It’s free and quick.

Sign Up

Add to the discussion!

advertisement

999 E Touhy Ave
Des Plaines, IL 60018

Toll Free: 1.800.817.1518
International: 1.773.628.2779
Fax: 1.773.272.0920
Email: info@websitemagazine.com

Facebook


Twitter