Skip to main content

Set up a connection to Confluent Kafka

Rachel Shanthi Bijja
  • Updated

Confluent Kafka is a real-time data streaming technology capable of handling trillions of events per day.

Set up a connection

This video demonstrates creating a Confluent Kafka connection.

After you start the connection, configure it in the Create connection panel and complete all of the required * authentication settings:

Setting Instructions
Name your connection * Enter a clear and distinguishable name. Throughout integrator.io imports and exports, you will have the option to choose this new connection. A unique identifier will prove helpful later when selecting it from a list of the connections in your account.
REST
endpoint *		 Enter your Confluent Kafka REST endpoint.

Fetch data How to retrieve REST endpoint
API key * Enter your Confluent Kafka account API key.
Fetch dataHow to retrieve API key
API secret * Enter your Confluent Kafka API secret.
Multiple layers of protection are in place, including AES 256 encryption, to keep your connection’s API secret safe. When editing this form later, you must enter this value again; it is stored only for a saved connection.
Fetch dataHow to retrieve API secret
Cluster ID * Enter your Confluent Kafka account cluster ID.
Fetch data How to retrieve cluster ID
  1. Sign in to your Confluent Kafka account.
  2. Navigate to Settings > Admistrator > Environments and select the environment.
  3. Select the required Cluster. The Cluster overview page opens. For more information on how to create a cluster, see Create clusters.
  4. Navigate to Cluster settings > General > Endpoints.
  5. Copy REST endpoint.
Kafka1.png
  1. Sign in to your Confluent Kafka account.
  2. Navigate to Settings > Admistrator > Environments and select the environment.
  3. Select the required Cluster. The Cluster overview page opens. 
  4. Navigate to API keys.
  5. Click +Add key, select the required access, and click Next.
  6. Copy API key and Secret.
Kafka2.png

Note: Click Download and continue to save the key and secret. If you do not download your new secret, you cannot see it again.

 

  1. Sign in to your Confluent Kafka account.
  2. Navigate to Settings > Admistrator > Environments and select the environment.
  3. Select the required Cluster. The Cluster overview page opens. For more information on how to create a cluster, see Create clusters, see Create clusters.
  4. Navigate to Cluster settings > General > Identification.
  5. Copy Cluster ID.
Kafka3.png

Tip: This connector documentation describes only the settings shown for the Simple view. For the corresponding HTTP settings, see basic universal connector documentation.

Related articles

Comments

0 comments

Please sign in to leave a comment.