-
Notifications
You must be signed in to change notification settings - Fork 803
Cluster Kafka
aseev-xx edited this page Dec 4, 2017
·
3 revisions
The "kafka" cluster module connects to a single Kafka cluster and continuously retrieves information about the topics in the cluster. The offsets for each partition (and therefore the topic list and partition counts) are sent to the Storage subsystem for use in group status evaluations.
The subheading must be a unique name, such as [cluster.myclustername]. The "myclustername" part is the name by which this cluster will be referred to in other parts of the configuration, as well as in HTTP requests and notifications.
[cluster.myclustername]
class-name="kafka"
servers=[ "kafka01.example.com:10251", "kafka02.example.com:10251", "kafka03.example.com:10251" ]
client-profile="profile-name"
topic-refresh=120
offset-refresh=30
| Key | Value Type | Required | Default Value | Description |
|---|---|---|---|---|
| class-name | string | yes | (empty) | This is the name of the cluster module type. For this module, it must be "kafka" |
| servers | list of hostname:port | yes | (none) | A list of strings in the form "hostname:port" that point to the servers in the Kafka cluster. At least one is required. |
| client-profile | string | no | (empty) | The name of a configured client-profile section. If no profile is specified, a default configuration for the client will be used. |
| topic-refresh | integer | no | 60 | How often to refresh the list of all topics in the cluster, in seconds. |
| offset-refresh | integer | no | 10 | How often to refresh the broker offset for each partition, in seconds. |