What does a robot meta tag do? Are they easy to set up?
Printable View
What does a robot meta tag do? Are they easy to set up?
You can use a special HTML <META> tag to tell robots not to index the content of a page, and/or not scan it for links to follow.
For example:
Official Google Webmaster Central Blog: Using the robots meta tagCode:<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
</head>