In this section we will show you how to set up a Kafka Connection Manager to access an Apache Kafka broker.
Configure Basic connectivity settings
- Once the connection manager dialog opens in General tab enter Broker Server(s).
The value would look like:
- Enter Authentication.
- Select SASL SSL for Security Protocol .
- Select Plain for SASL Mechanism.
- Enter Username.
- Enter Password.
Configure Advanced connectivity settings
- In tab Advanced tab enter Additional Options. The syntax of Additional Options is
name=value1[;name2=value2]...[;nameN=valueN]. The value would look like:
reconnect.backoff.ms=1000;retry.backoff.ms=50.You can see available options in Available Options text field.
Congratulations! You have successfully configured a Kafka Connection Manager.
Use the General page of the Kafka Connection Manager dialog to specify properties for connecting to the Kafka broker
The broker server name(s) and an optional port (default is 9092) using the syntax
localhost:9092). When connecting to bootstrap servers set, its members should be enumerated like this:
The security protocol:
Value Description Plaintext Don't use any authentication or encryption method. SSL Authenticate via SSL certificate SASL Plaintext Authenticate by unencrypted username and password. SASL SSL Authenticate with a username and password that are encrypted with an SSL certificate.
The SASL mechanism:
Value Description GSSAPI Use Generic Security Service Application Program Interface. Plain Use unencrypted authentication mechanism SCRAM-SHA-256 Use Salted Challenge Response Authentication Mechanism with SHA-256 encryption. SCRAM-SHA-512 Use Salted Challenge Response Authentication Mechanism with SHA-512 encryption. OAuth Bearer Use OAuth 2 Authorization Framework.
The username to authenticate with (SASL Plaintext, SASL SSL security protocol when using Plain, SCRAM-SHA-256, SCRAM-SHA-512 SASL mechanism).
The password to authenticate with (SASL Plaintext, SASL SSL security protocol when using Plain, SCRAM-SHA-256, SCRAM-SHA-512 SASL mechanism).
Тhe timeout to attempt a connection before timing out.
Use the Advanced page of the Kafka Connection Manager dialog to specify advanced options
Specify additional connection options, when necessary, via the syntax:
name=value1[&name2=value2]...[&nameN=valueN]. Refer to Kafka documentation for detailed explanation of each option.
Path to client's private key (PEM) used for authentication.
The passphrase for the client certificate private key
The location of the client certificate PEM file.
The passphrase for the client certificate key store
Path to client's PKCS#12 keystore used for authentication (usually a .pfx file that is generated from a .jks file).
File or directory path to CA certificate(s) for verifying the broker's key. If empty, the default Windows Certificate Store is used
Specify whether to check for certificate revocation
Path to CRL for verifying broker's certificate validity.
- Where can I find the documentation for the Kafka Connection?
- Does the Kafka connector work with Kafka that is backended by Azure Event Hub?
- New: Additional SSL parameters.
- New: Introduced connection.