OCI Data Integration Service (DIS) - Considerations for Incremental DIS-BICC Extracts
(Doc ID 2950577.1)
Last updated on NOVEMBER 27, 2023
Applies to:
Oracle Cloud Infrastructure Data Integration - Version N/A and laterInformation in this document applies to any platform.
Goal
When using OCI-DIS for incremental BICC extraction, every extraction run will include an extra 24h of data before the last extraction date. This data window is a Oracle Business Intelligence Cloud Connector (BICC) feature and is called prune-time. For more information, see Configure Extract Preferences. (Creating a Business Intelligence Cloud Extract > Configure Extract Preferences > Prune Time in Minutes):
To ensure data dependencies across objects are maintained during incremental extracts, you can set a prune time that determines how long before the last extract date to extract data from. The default, 1,440 minutes or 24 hours, ensures a look-back that works best for extracts with daily or higher reoccurrence. You should adjust prune time to a smaller window if your extracts are scheduled more frequently or if any downstream system can handle objects extracted in any order. In general, use prune time in accordance with the frequency of your extracts. If you run extracts hourly, set the prune time to 60 minutes. If you run daily, leave it as the default of 1,440 minutes. If you don't need overlapping data to manage early or late dependancies across data stores, you can set the prune time to zero.
Solution
To view full details, sign in with your My Oracle Support account. |
|
Don't have a My Oracle Support account? Click to get started! |
In this Document
Goal |
Solution |
References |