New (Google) Meta Tag unavailable_after and Alternatives
Last week at the SEMNE event in Rhode Island,
Jill Whalen reported that Google
introduced a new META tag. The impact could be far reaching for SEO's and
marketers in many industries - ecommerce, affiliate and beyond.
The "unavailable_after" tag will allow websites to notify Google that a particular page will not be available for crawling after a certain date. If you are using special offers that expire or have content that was free and is now behind a subscription wall for example, the META tag is a good way to let the search engine know that the page should no longer be indexed.
Unfortunately for those that want to implement this on their own sites, their is little in the way of information on the proper syntax of the tag - so there will be a lot of discussion on how to validate the code in the future. Until there is a formal announcement from Google however, you may just want to try another method, commonly called the "410 Gone" - an HTTP status code.
If you simply want to inform Google (or any search engine) that a page has been removed, the "410 Gone" status code indicates to the spider/bot that the requested resource is no longer available at the server and no forwarding address was provided (source - W3.org). The 410 response assists in the process of web maintenance by notifying the recipient that the resource is intentionally unavailable and that the server owners desire that remote links to that resource be removed. Such an event is common for limited-time, promotional services (e.g. affiliate programs).