安装包下载:http://archive.apache.org/dist/kafka/1.0.0/kafka_2.11-1.0.0.tgz

Kafka集群部署

http://kafka.apache.org/ 

http://kafka.apachecn.org/

(已经安装好了zookeeper集群)

1、上传安装包解压

Kafka集群部署

Kafka集群部署

Kafka集群部署

Kafka集群部署

2、修改Kafka server.properties的配置连接zookeeper集群

Kafka集群部署

Kafka集群部署

修改broker.id、listeners、zookeeper.connet

broker.id必须保证不重复,zookeeper为集群地址

Kafka集群部署

Kafka集群部署

Kafka集群部署

Kafka集群部署

配置修改完成,启动服务

3、 sh kafka-server-start.sh -daemon ../config/server.properties

Kafka集群部署

日志文件

Kafka集群部署

Kafka集群部署

启动遇到问题:原因:broker.id重复,listeners配置错误

Kafka集群部署

Kafka集群部署

Kafka集群部署

Kafka集群部署

java.lang.IllegalArgumentException: Error creating broker listeners from '192.168.179.112://:9092': No security protocol defined for listener 192.168.179.112

Configured broker.id 1 doesn't match stored broker.id 0 in meta.properties

原因:tmp/kafka-logs/meta.properties和server.properties的broker.id不一致

 Failed to acquire lock on file .lock in /tmp/kafka-logs. A Kafka instance in another process or thread is using this directory.

解决办法:删除目录tmp/kafka-logs或者修改server.properties中的log.dirs地址

启动成功

查看zookeeper

Kafka集群部署

Kafka集群部署

Kafka集群部署

Kafka启动时在zookeeper上注册的节点信息

cluster, controller, controller_epoch, brokers, zookeeper, admin, isr_change_notification, consumers, latest_producer_id_block, config

 

controller – 控制节点

brokers  – kafka集群的broker信息 。

consumer 

 

 

 

 

 

 

相关文章: