Why do Changes in the Default Crawl Workspace crawl-urlfilter.txt Not Affect the Results of a WebCrawl? (Doc ID 2254416.1)

Last updated on APRIL 18, 2017

Applies to:

Oracle Commerce Guided Search / Oracle Commerce Experience Manager - Version 11.2 and later
Information in this document applies to any platform.

Goal

On an Oracle Commerce 11.2 CAS WebCrawler crawl, exclusions have been added to the crawl-urlfilter.txt file in the default crawl directory.

However, the exclusions are not applied during a non-default crawl.

Does the CAS WebCrawler require a crawl-urlfilter.txt per-crawl, or is it sufficient to edit the crawl-urlfilter.txt in the default directory?

Why do Changes in the Default Crawl Workspace crawl-urlfilter.txt Not Affect the Results of a WebCrawl?

Solution

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms