How to Block Robots, Bots, Spiders, or Web Crawlers that Crawl Site Studio or Content Publisher Sites (Doc ID 730296.1)

Last updated on MARCH 03, 2017

Applies to:

Oracle WebCenter Content - Version 6.5.0 and later
Information in this document applies to any platform.
bots, robots, web crawlers, googlebot, spiders
Update Date 30-NOV-20011: Changed product name from UCM to WebCenter Content. Refer to Product Name Changes for WebCenter and Former ECM products for more information.

***Checked for relevance on 01-May-2013***

Goal

How to block web crawlers that produce errors, cause excessive web site slowness, etc.

Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms