Robot.properties Update for New Crawlers (Doc ID 1037645.1)

Last updated on JUNE 15, 2017

Applies to:

Oracle Commerce Platform - Version 2006.3 and later
Information in this document applies to any platform.

Goal

The Robots file shipped with the ATG platform allows you to identify search engine bots visiting your site. This is important for performing search engine optimization (SEO) correctly.
 
This file is an addendum to the Robots.properties file shipped with the base products and includes many of the best known search engine crawlers and robots.

Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms