Kafka Stream On Oracle Stream Analytics (Doc ID 2907179.1)

Last updated on APRIL 01, 2024

Applies to:

Goal

We installed ORACLE GOLDEN GATE STREAM ANALYTICS from marketplace on an OCI instance.

We built pipelines that read a data stream from an external Kafka cluster. The configuration obviously involves user-id and group-id.
The pipelines are working correctly.
However, we have a doubt about building different pipelines that read from the same Kafka topic: is it possible to build two pipelines that use the same user-id and group-id and consume data from the same topic kafka? Or are messages consumed by only one of the two pipelines?

Reading from the Kafka documentation we see that:
- within same group is not possible: two consumers (Consumer 1, 2) within the same group (Group 1) can't consume the same message from partition (Partition 0).
- between different groups is possible: two consumers in two groups (Consumer 1 from Group 1, Consumer 1 from Group 2) can consume the same message from partition (Partition 0).

Is this also true for data consumption from topics via OSA pipelines?
 

Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.