I am wondering how can I issue a HTTP Status code, that will cause crawlers to try later for that content, as the system currently is running on high load.
Does a 304 status and no content display resolves this issue?
I am wondering how can I issue a HTTP Status code, that will cause crawlers to try later for that content, as the system currently is running on high load.
Does a 304 status and no content display resolves this issue?
You should issue a 503
(Service Unavailable) with the Retry-Later
option set. This seems to be an accurate solution.
See: http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html and http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html