单节点Kafka部署 zookeeper安装
Zookeeper启动:zkServer.sh start

Kafka单节点broker的部署及使用
安装zookeeper和Scala 配置到系统环境变量中

Kafka配置文件

  1. server.properties broker.id=0

Listeners:9092
host.name
log.dirs
zookeeper.connect=localhost:2181

启动kafka bin/kafka-server-start.sh config/server.properties
提示信息:USAGE: /app/kafka_2.11-0.9.0.0/bin/kafka-server-start.sh [-daemon] server.properties [–override property=value]*

kafka-server-start.sh $KAFKA_HOME/config/server.properties

创建一个topic
kafka-topics.sh –create –zookeeper localhost:2181 -–replication-factor 1 –partitions 1 –topic test

kafka-topics.sh --create --zookeeper hadoop000:2181 --replication-factor 1 --partitions 1 --topic hello_topic

查看所有topic
bin/kafka-topics.sh --list --bootstrap-server localhost:9092

kafka-topics.sh --list --zookeeper hadoop000:2181

发送消息 :broker
kafka-console-producer.sh --broker-list hadoop000:9092 --topic hello_topic
9092是监听端口(Listeners)

消费消息:zk
kafka-console-consumer.sh --zookeeper hadoop000:2181 --topic hello_topic --from-beginning

spark streaming 实时流处理实战笔记五

–from being的使用

Describe的使用(查看所有topic的详细信息)
kafka-topics.sh --describe --zookeeper hadoop000:2181

查看制定topic的详细信息:kafka-topics.sh --describe --zookeeper hadoop000:2181 --topic hello_topic

相关文章:

  • 2021-05-06
  • 2021-12-27
  • 2021-10-14
  • 2021-12-09
  • 2021-10-31
猜你喜欢
  • 2021-11-16
  • 2021-04-02
  • 2021-05-26
  • 2022-12-23
  • 2021-05-09
  • 2021-09-12
  • 2021-04-10
相关资源
相似解决方案