How to prevent Google from indexing and spidering specific pages

If you don't want your job seeker profiles to be indexed/spidered by Google, you will need to create a robots.txt file in your root web directory. If you're not familiar with robots.txt, learn how it works to help you understand these instructions.

If you want to disallow spidering for all profiles, add this code in your robots.txt:

Disallow: /person/

If you want to block a particular person's profile, add:

Disallow: /person/username/

Browse Space

- Pages
- News
- Labels
- Attachments
- Bookmarks
- Mail
- Advanced
- Activity

Explore Confluence

- Popular Labels
- Notation Guide

Your Account

Log In

 

Other Features

Add Content


Web Scribble makes job board software, classifieds software, and social network software.