Skip to content

Commit be4d65c

Browse files
authored
DOCSP-32096: use id in tombstone events (#143)
* DOCSP-32096: use id in tombstone events * CC suggestions * CC discussion * formatting
1 parent 19ce24a commit be4d65c

File tree

2 files changed

+43
-4
lines changed

2 files changed

+43
-4
lines changed

source/source-connector/configuration-properties/change-stream.txt

Lines changed: 22 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,8 @@ with the {+source-connector+}.
2323

2424
.. include:: /includes/source-config-link.rst
2525

26+
.. _source-configuration-change-stream-list:
27+
2628
Settings
2729
--------
2830

@@ -113,10 +115,11 @@ Settings
113115
|
114116
| **Description:**
115117
| Whether to return only the ``fullDocument`` field from the
116-
change stream event document produced by any update event. The ``fullDocument`` field
117-
contains the most current version of the updated document. To
118-
learn more about the ``fullDocument`` field, see the :rapid:`Server
119-
manual page on update events </reference/change-events/update/>`.
118+
change stream event document produced by any update event. The
119+
``fullDocument`` field contains the most current version of the
120+
updated document. To learn more about the ``fullDocument``
121+
field, see the :manual:`update Event
122+
</reference/change-events/update/>` in the Server manual.
120123

121124
| When set to ``true``, the connector overrides the
122125
``change.stream.full.document`` setting and sets it to
@@ -138,6 +141,21 @@ Settings
138141
| **Default**: ``false``
139142
| **Accepted Values**: ``true`` or ``false``
140143

144+
* - | **change.stream.document.key.as.key**
145+
- | **Type:** boolean
146+
|
147+
| **Description:**
148+
| Whether to use the document key for the source record key if
149+
the document key is present.
150+
151+
| When set to ``true``, the connector adds keys of the deleted
152+
documents to the tombstone events. When set to ``false``,
153+
the connector uses the resume token as the source key for
154+
the tombstone events.
155+
156+
| **Default**: ``true``
157+
| **Accepted Values**: ``true`` or ``false``
158+
141159
* - | **collation**
142160
- | **Type:** string
143161
|

source/whats-new.txt

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,17 @@ Learn what's new by version:
3434
What's New in 1.11
3535
--------------------
3636

37+
.. important:: Breaking Changes in Tombstone Event Creation
38+
39+
This release adds the ``change.stream.document.key.as.key`` source
40+
connector configuration property and sets it to ``true`` by default.
41+
42+
Now, tombstone events use the keys of deleted documents as source record
43+
keys. To revert the tombstone event behavior, set
44+
``change.stream.document.key.as.key`` to ``false``. To learn more
45+
about this property, see the list of :ref:`Change Stream Properties
46+
<source-configuration-change-stream-list>`.
47+
3748
- Added support for regular expressions in the ``topic.namespace.map`` property.
3849

3950
- Added support for setting a custom delete write model strategy by using the
@@ -42,6 +53,16 @@ What's New in 1.11
4253
- Added the ``UpdateOneDefaultStrategy`` write model strategy. To learn
4354
more, see the list of :ref:`Write Model Strategies <sink-connector-write-model-strategies>`.
4455

56+
- Added the ``change.stream.document.key.as.key`` source
57+
connector configuration property. When set to ``true``, the
58+
connector adds keys of the deleted documents to the tombstone events.
59+
When set to ``false``, the connector uses the resume token as the source key
60+
for the tombstone events.
61+
62+
Because this property is set to ``true`` by
63+
default, this might be a breaking change for some users. To learn more,
64+
see the list of :ref:`Change Stream Properties <source-configuration-change-stream-list>`.
65+
4566
- DDL events from Debezium are recorded as no-ops and no longer cause an error.
4667

4768
.. _kafka-connector-whats-new-1.10.1:

0 commit comments

Comments
 (0)