50 poster thread or secure

[whatapain]

<META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">
<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

---

<META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">
<META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

---

header('X-Robots-Tag: noindex,nofollow');     (for php)

• Don't display a cache link or snippet for this item in the Google search results:
  

X-Robots-Tag: noarchive, nosnippet

• Don't include this document in the Google search results:
  

X-Robots-Tag: noindex

• Tell us that a document will be unavailable after 7th July 2007, 4:30pm GMT:
  

X-Robots-Tag: unavailable_after: 7 Jul 2007 16:30:00 GMT

You can combine multiple directives in the same document. For example:

• Do not show a cached link for this document, and remove it from the index after 23rd July 2007, 3pm PST:
  

X-Robots-Tag: noarchive
X-Robots-Tag: unavailable_after: 23 Jul 2007 15:00:00 PST



For the

Code:

noindex

meta tag to be effective, the page must not be blocked by a robots.txt file. If the page is blocked by a robots.txt file, the crawler will never see the

Code:

noindex

tag, and the page can still appear in search results, for example if other pages link to it.

This example tells all robots to stay out of a website:
User-agent: *
Disallow: /


User-agent: googlebot        # all Google services

Disallow: /private/          # disallow this directory



User-agent: googlebot-news   # only the news service

Disallow: /                  # disallow everything



User-agent: *                # any robot

Disallow: /something/        # disallow this directory




Hope this helps a bit. I am sure you already know all of this. but makes for easy cut and paste