...
| Setting | Description | |||||
|---|---|---|---|---|---|---|
| Kafka Version | The Kafka agents supports support Kafka client 0.8 to 2.4.1. Since there are compatibility issues between versions 0.9 and 0.10, as well as 2.4.0 and 2.4.1, you have three options; 0.8 - 0.9, 0.10 - 2.4.0 or 2.4.1.
| |||||
Kafka Topic | Enter the Kafka topic that you want to use for your configuration. For information on how to create a Kafka topic, refer to MZSH Command Line Tool User's Guide. | |||||
Use Embedded Kafka | If you want to use the Kafka Service which is the Kafka embedded in
| |||||
Kafka Service Key | If you have selected to use Kafka Service, you must complete the Kafka Service Key. To determine which service key to use for Kafka Services, refer to | |||||
Host | If you are using external Kafka, enter the host name hostname for Zookeeper. | |||||
Port | If you are using external Kafka, enter the port for Zookeeper. | |||||
| Kafka Brokers | A Broker is a node in a Kafka cluster. If you are using external Kafka, you must add Kafka Brokers. Use the Add button to enter the addresses of the Kafka Brokers that you want to connect to. |
...
Compression for messages to be sent to Kafka brokers can now be enabled from the Advanced producer properties. The compression codec utilized by follows the standard Kafka library, where Gzip, Lz4, and Snappy are supported.
To enable compression, just add the property compression.type into the to Advanced producer properties. Followed by the value, gzip, lz4, snappy or none.
...
| Note | ||
|---|---|---|
| ||
When using the Lz4 compression codec, additional steps are required when running the embedded kafka Kafka solution. First, ensure that the lz4-1.2.0.jar file is located in the $MZ_HOME/3pp/ directory. Next, run the following topo commands:
|
...