What Are the Max URL Length For OOTB Web Crawler Before It Will Fail With Data Truncation Error?

(Doc ID 2077674.1)

Last updated on JULY 06, 2018

Applies to:

Oracle Knowledge - Version 8.2.3 and later
Information in this document applies to any platform.

Symptoms

the OOTB OK/InQuira Web crawler fails at content update step (shows 100%) but failed with Data truncation errors as below:

[1977920 Local Workclient-default-taskrun (686)] UNKNOWN MESSAGE ID "HTTP_CRAWLER_DOC_UPDATE_FAILED" called with: "[Ljava.lang.Object;@74f4ccd5" "com.inquira.content.ContentStoreException: [Local Workclient-default-taskrun @ Thu Sep 24 20:54:33 EDT 2015 - ContentUpdate] (SQL_ERROR insert into doc_meta_info [SQLSERVER_PLACE_HOLDER] ( collection_id,doc_id,uuid,doc_language,doc_encoding,doc_type_id,cs_type_id,display_url,fetch_url,startpt_id,parent_id,checksum,status_code,doc_size_k,indexing_allowed,is_deleted,etag,creation_time,last_modified_time,valid_start_time,valid_end_time,recency, ranking, doc_level, direct_iqxml, crawl_rule_info, crawl_event_id, prep_event_id ) values (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,? ) com.inquira.content.javahttp.httpDocument@17edacf0(51d2c417-9901-4111-b401-c8db1bacef39,46031))"
java.sql.DataTruncation: Data truncation

or

[99842 Local Workclient-default-taskrun (71)] UNKNOWN MESSAGE ID "HTTP_CRAWLER_DOC_UPDATE_FAILED" called with: "[Ljava.lang.Object;@2d6f8ec6" "java.sql.SQLException: ORA-12899: value too large for column "OK_SEARCHX"."DOC_META_INFO"."DISPLAY_URL" (actual: 1166, maximum: 1024)

at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:450)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:399)
at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:1059)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:522)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:257)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:587)
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:225)
at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedS

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms