Dismiss Notice
Welcome to Our Community
Wanting to join the rest of our members? Feel free to sign up today.

Robots Exclusion Protocol: now with even more flexibility

Discussion in 'General Webmaster Helpdesk' started by temi, Jul 28, 2007.

  1. temi

    temi Facilitator Webmaster

    This is the third and last in my series of blog posts about the Robots Exclusion Protocol (REP). In the first post, I introduced robots.txt and the robots META tags, giving an overview of when to use them. In the second post, I shared some examples of what you can do with the REP. Today, I'll introduce two new features that we have recently added to the protocol.

    As a product manager, I'm always talking to content providers to learn about your needs for REP. We are constantly looking for ways to improve the control you have over how your content is indexed. These new features will give you flexible and convenient ways to improve the detailed control you have with Google.

    full story
  2. mrcrowley

    mrcrowley New Member Webmaster

    Some cool new features. Well done google!

Featured Resources (View All)

Share This Page