Articles in this section

Set up a connection to Confluent Kafka

Confluent Kafka is a real-time data streaming technology capable of handling trillions of events per day.

Set up a connection

This video demonstrates creating a Confluent Kafka connection.

After you start the connection, configure it in the Create connection panel and complete all of the required * authentication settings:

Setting

Instructions

Name your connection * 

Enter a clear and distinguishable name. Throughout integrator.io imports and exports, you will have the option to choose this new connection. A unique identifier will prove helpful later when selecting it from a list of the connections in your account.

REST endpoint * 

Enter your Confluent Kafka REST endpoint.

dataLoad.svg​​ How to retrieve REST endpoint 

API key * 

Enter your Confluent Kafka account API key.

dataLoad.svg​​ How to retrieve API key 

API secret * 

Enter your Confluent Kafka API secret.

Multiple layers of protection are in place, including AES 256 encryption, to keep your connection’s API secret safe. When editing this form later, you must enter this value again; it is stored only for a saved connection.

dataLoad.svg​​ How to retrieve API secret 

Cluster ID * 

Enter your Confluent Kafka account cluster ID.

dataLoad.svg​​ How to retrieve cluster ID 

Tip

This connector documentation describes only the settings shown for the Simple view. For the corresponding HTTP settings, see basic universal connector documentation.

How to retrieve REST endpoint

  1. Sign in to your Confluent Kafka account.

  2. Navigate to Settings > Admistrator > Environments and select the environment.

  3. Select the required Cluster. The Cluster overview page opens. For more information on how to create a cluster, see  Create clusters.

  4. Navigate to Cluster settings > General > Endpoints.

  5. Copy REST endpoint.

Kafka1.png

How to retrieve API key and API secret

  1. Sign in to your Confluent Kafka account.

  2. Navigate to Settings > Admistrator > Environments and select the environment.

  3. Select the required Cluster. The Cluster overview page opens.

  4. Navigate to API keys.

  5. Click +Add key, select the required access, and click Next.

  6. Copy API key and Secret.

Kafka2.png

Note

Click Download and continue to save the key and secret. If you do not download your new secret, you cannot see it again.

How to retrieve the Cluster ID

  1. Sign in to your Confluent Kafka account.

  2. Navigate to Settings > Admistrator > Environments and select the environment.

  3. Select the required Cluster. The Cluster overview page opens. For more information on how to create a cluster, see Create clusters, see  Create clusters.

  4. Navigate to Cluster settings > General > Identification.

  5. Copy Cluster ID.

Kafka3.png