|
| 1 | +.. _kafka-installation: |
| 2 | + |
| 3 | +=================================== |
| 4 | +Install the MongoDB Kafka Connector |
| 5 | +=================================== |
| 6 | + |
| 7 | +.. default-domain:: mongodb |
| 8 | + |
| 9 | +.. contents:: On this page |
| 10 | + :local: |
| 11 | + :backlinks: none |
| 12 | + :depth: 2 |
| 13 | + :class: singlecol |
| 14 | + |
| 15 | +Overview |
| 16 | +-------- |
| 17 | + |
| 18 | +Learn how to install the {+mkc+}. The {+mkc+} is available for Confluent Platform and |
| 19 | +{+ak+} deployments. To see installation instructions for your deployment type, |
| 20 | +navigate to one of the following sections: |
| 21 | + |
| 22 | +- :ref:`Install the Connector on Confluent Platform <kafka-connector-install-confluent>` |
| 23 | +- :ref:`Install the Connector on {+ak+} <kafka-connector-install-apache>` |
| 24 | + |
| 25 | +.. _kafka-connector-install-confluent: |
| 26 | + |
| 27 | +Install the Connector on Confluent Platform |
| 28 | +------------------------------------------- |
| 29 | + |
| 30 | +Click the following tabs to see instructions for how to install the |
| 31 | +connector on Confluent Platform: |
| 32 | + |
| 33 | +.. tabs:: |
| 34 | + |
| 35 | + .. tab:: |
| 36 | + :tabid: Install with Confluent Hub Client |
| 37 | + |
| 38 | + 1. `Install the Confluent Hub Client <https://docs.confluent.io/home/connect/confluent-hub/client.html#installing-c-hub-client>`__. |
| 39 | + |
| 40 | + 2. Follow the installation instructions for the |
| 41 | + `{+connector-long+} <https://www.confluent.io/hub/mongodb/kafka-connect-mongodb>`__ |
| 42 | + using the Confluent Hub Client. |
| 43 | + |
| 44 | + .. tab:: |
| 45 | + :tabid: Install from JAR |
| 46 | + |
| 47 | + 1. Follow the directions on the Confluent page for |
| 48 | + `Manually Installing Community Connectors |
| 49 | + <https://docs.confluent.io/home/connect/community.html>`__. |
| 50 | + |
| 51 | + 2. Use the connector GitHub URL and uber JAR locations in the |
| 52 | + :ref:`installation reference table <kafka-connector-installation-reference>` |
| 53 | + when appropriate in the Confluent manual installation instructions. |
| 54 | + |
| 55 | +.. _kafka-connector-install-apache: |
| 56 | + |
| 57 | +Install the Connector on Apache Kafka |
| 58 | +------------------------------------- |
| 59 | + |
| 60 | +1. Locate and download the uber JAR to get all the dependencies required |
| 61 | + for the connector. Refer to the |
| 62 | + :ref:`installation reference table <kafka-connector-installation-reference>` |
| 63 | + to find the uber JAR. |
| 64 | + |
| 65 | + .. note:: |
| 66 | + |
| 67 | + If you are unable to use the uber JAR or prefer to manage your own |
| 68 | + dependencies, download the JAR that contains the minimum required |
| 69 | + dependencies and resolve any runtime dependencies. You can use |
| 70 | + a plugin such as `Maven dependency:tree |
| 71 | + <https://maven.apache.org/plugins/maven-dependency-plugin/tree-mojo.html>`__ |
| 72 | + to generate the dependency tree. |
| 73 | + |
| 74 | +2. Copy the JAR and any dependencies into the Kafka plugins directory |
| 75 | + which you can specify in your |
| 76 | + `plugin.path <https://kafka.apache.org/documentation/#connectconfigs_plugin.path>`__ |
| 77 | + configuration setting (e.g. ``plugin.path=/usr/local/share/kafka/plugins``). |
| 78 | + |
| 79 | +.. note:: |
| 80 | + |
| 81 | + If you intend to run the connector as distributed worker processes, you |
| 82 | + must repeat this process for each server or virtual machine. |
| 83 | + |
| 84 | +.. _kafka-connector-installation-reference: |
| 85 | + |
| 86 | +Installation Reference Table |
| 87 | +---------------------------- |
| 88 | + |
| 89 | +You can download the {+mkc+} source and JAR files from the following locations: |
| 90 | + |
| 91 | +.. list-table:: |
| 92 | + :widths: 55 45 |
| 93 | + :stub-columns: 1 |
| 94 | + |
| 95 | + * - Kafka Connector GitHub repository (source code) |
| 96 | + - :github:`mongodb/mongo-kafka <mongodb/mongo-kafka>` |
| 97 | + |
| 98 | + * - Maven Central repository (JAR files) |
| 99 | + - `mongo-kafka-connect <https://search.maven.org/artifact/org.mongodb.kafka/mongo-kafka-connect>`__ |
| 100 | + |
| 101 | +You can identify the contents of the JAR files by the suffix in the |
| 102 | +filename. Consult the following table for a description of each suffix: |
| 103 | + |
| 104 | +.. list-table:: |
| 105 | + :widths: 25 75 |
| 106 | + |
| 107 | + * - Suffix |
| 108 | + - Description |
| 109 | + |
| 110 | + * - **all** |
| 111 | + - The uber JAR that contains the connector, MongoDB dependencies, and |
| 112 | + Apache Avro |
| 113 | + |
| 114 | + * - **confluent** |
| 115 | + - Contains the minimum requirements for the connector and Confluent |
| 116 | + Platform |
| 117 | + |
| 118 | + * - **javadoc** |
| 119 | + - Contains the Javadoc documentation for the connector classes |
| 120 | + |
| 121 | + * - **sources** |
| 122 | + - Contains the source code that corresponds to the compiled connector |
| 123 | + classes |
| 124 | + |
| 125 | +For example, ``mongo-kafka-connect-{+connector_version+}-all.jar`` is the uber JAR for the |
| 126 | +version {+connector_version+} connector. |
| 127 | + |
0 commit comments