Skip to content

Commit 6c4ec84

Browse files
biniona-mongodbChris Cho
authored andcommitted
Docsp 15402 qlik replicate cdc (#89)
Docsp 15402 qlik replicate cdc Co-authored-by: Chris Cho <[email protected]> Co-authored-by: Robert Walters
1 parent c42a804 commit 6c4ec84

File tree

2 files changed

+61
-9
lines changed

2 files changed

+61
-9
lines changed
Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
To create a CDC handler, specify the following configuration information:
2+
3+
- Full class name of the CDC handler in the
4+
``change.data.capture.handler`` property. Once this configuration
5+
setting is specified, the connector will run in **CDC operation mode**.
6+
- Topics on which the connector should listen for data in the ``topics``
7+
property.
8+
- MongoDB collection to write data to in the ``collection`` property.

source/kafka-sink-cdc.txt

Lines changed: 53 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ delete operations to a destination MongoDB cluster.
2323
You can also handle CDC using the following event producers:
2424

2525
- :ref:`Debezium <cdc-debezium>`
26-
- Qlik Replicate (coming soon)
26+
- :ref:`Qlik Replicate <cdc-qlik>`
2727

2828
Change Data Capture Using the MongoDB Sink Connector
2929
----------------------------------------------------
@@ -95,15 +95,10 @@ You can configure the sink connector to process data from a CDC stream
9595
using one of the included handlers for Debezium or a custom handler that
9696
extends the abstract class `CdcHandler
9797
<https://github.com/mongodb/mongo-kafka/blob/master/src/main/java/com/mongodb/kafka/connect/sink/cdc/CdcHandler.java>`__.
98+
The included handlers for Debezium can be found in the
99+
`MongoDB Kafka connector repository here <https://github.com/mongodb/mongo-kafka/tree/master/src/main/java/com/mongodb/kafka/connect/sink/cdc/debezium>`__.
98100

99-
To create a CDC handler, specify the following configuration information:
100-
101-
- Full class name of the CDC handler in the
102-
``change.data.capture.handler`` property. Once this configuration
103-
setting is specified, the connector will run in **CDC operation mode**.
104-
- Topics on which the connector should listen for data in the ``topics``
105-
property.
106-
- MongoDB collection to write data to in the ``collection`` property.
101+
.. include:: /includes/create-cdc-handler.rst
107102

108103
.. _cdc-debezium-example:
109104

@@ -133,3 +128,52 @@ Debezium with a specified CDC configuration when posted to the
133128

134129
.. include:: /includes/externalize-secrets.rst
135130

131+
.. _cdc-qlik:
132+
133+
Change Data Capture Using Qlik Replicate
134+
----------------------------------------
135+
136+
The MongoDB Kafka sink connector can also process event streams using
137+
`Qlik Replicate <https://www.qlik.com/us/products/qlik-replicate>`__ as an event
138+
producer for several of data sources including:
139+
140+
- Oracle
141+
- Postgres
142+
- Microsoft SQL Server
143+
144+
For a complete list of supported sources for Qlik Replicate CDC events, see the
145+
`Qlik Replicate Source Endpoint Support Matrix <https://help.qlik.com/en-US/replicate/November2020-SR1/Content/Replicate/Main/Support%20Matrix/supported_source_endpoints.htm>`__.
146+
147+
You can configure the sink connector to process data from a CDC stream
148+
using the included handler for Qlik Replicate or a custom handler that
149+
extends the abstract class
150+
`CdcHandler <https://github.com/mongodb/mongo-kafka/blob/master/src/main/java/com/mongodb/kafka/connect/sink/cdc/CdcHandler.java>`__.
151+
The included handler for Qlik Replicate can be found in the
152+
`MongoDB Kafka connector repository here <https://github.com/mongodb/mongo-kafka/tree/master/src/main/java/com/mongodb/kafka/connect/sink/cdc/qlik>`__.
153+
154+
.. include:: /includes/create-cdc-handler.rst
155+
156+
.. _cdc-qlik-example:
157+
158+
Qlik Replicate Example
159+
~~~~~~~~~~~~~~~~~~~~~~
160+
161+
The following sample JSON payload instantiates a new connector using
162+
Qlik Replicate with a specified CDC configuration when posted to the
163+
`Kafka Connect REST endpoint <https://docs.confluent.io/current/connect/references/restapi.html>`__:
164+
165+
.. code-block:: json
166+
167+
{
168+
"name": "mongo-sink-qlik-replicate-cdc",
169+
"config": {
170+
"connector.class": "com.mongodb.kafka.connect.sink.MongoSinkConnector",
171+
"connection.uri": "mongodb://<mongodb-hostname>:27017/kafkaconnect?w=1&journal=true",
172+
"collection": "mongosink",
173+
"topics": "myreplset.kafkaconnect.rdbmssrc",
174+
"change.data.capture.handler": "com.mongodb.kafka.connect.sink.cdc.qlik.rdbms.RdbmsHandler",
175+
"value.converter": "org.apache.kafka.connect.json.JsonConverter"
176+
}
177+
}
178+
179+
.. include:: /includes/externalize-secrets.rst

0 commit comments

Comments
 (0)