windows单节点配置

下载地址

https://dlcdn.apache.org/kafka/3.9.0/kafka_2.13-3.9.0.tgz

启动文件配置

call bin/windows/zookeeper-server-start.bat config/zookeeper.properties
call bin/windows/kafka-server-start.bat config/server.properties

Linux6节点配置

3台服务器，每台2个节点

下载地址

Zookeeper下载地址

https://dlcdn.apache.org/zookeeper/zookeeper-3.9.3/apache-zookeeper-3.9.3-bin.tar.gz

Kafka下载地址

https://dlcdn.apache.org/kafka/3.9.0/kafka_2.13-3.9.0.tgz

配置防火墙

firewall-cmd --zone=public --add-port=9092/tcp --permanent
firewall-cmd --zone=public --add-port=3888/tcp --permanent
firewall-cmd --zone=public --add-port=2888/tcp --permanent
firewall-cmd --zone=public --add-port=8080/tcp --permanent
firewall-cmd --zone=public --add-port=2181/tcp --permanent
firewall-cmd --zone=public --add-port=80/tcp –permanent
firewall-cmd --zone=public --add-port=6379/tcp --permanent
firewall-cmd --zone=public --add-port=6380/tcp --permanent
firewall-cmd --zone=public --add-port=6381/tcp --permanent
systemctl restart firewalld
firewall-cmd --zone=public --list-ports

服务器环境配置

vim ~/.bashrc 或 vim /etc/profile
# .bashrc
# User specific aliases and functions

alias rm='rm -i'
alias cp='cp -i'
alias mv='mv -i'

# Source global definitions
if [ -f /etc/bashrc ]; then
    . /etc/bashrc
fi

# jdk
export JAVA_HOME=/usr/java/jdk-11
export CLASSPATH=.:${JAVA_HOME}/lib

# zk
export ZOOKEEPER_HOME=/home/programs/apache-zookeeper-3.9.3-bin_01

# KAFKA
export KAFKA_HOME=/home/programs/kafka_2.12-3.5.0_01

# redis
# export REDIS_HOME=/home/programs/redis-7.0.12

# PATH
export PATH=${JAVA_HOME}/bin:$PATH:${ZOOKEEPER_HOME}/bin:$PATH:${KAFKA_HOME}/bin:$PATH:${REDIS_HOME}/src
   启用配置：source ~/.bashrc 或 source /etc/profile

安装Zookeeper

程序放到 /home/programs
软件放到 /home/soft
解压缩文件：

tar -zxf apache-zookeeper-3.9.3-bin.tar.gz -C /home/programs/

配置数据文件保存目录

/home/programs/apache-zookeeper-3.9.3-bin_01/zkdata

配置日志目录

/home/programs/apache-zookeeper-3.9.3-bin_01/zklog

配置MyId文件

vim /home/programs/apache-zookeeper-3.9.3-bin_01/zkdata/myid
输入1或2或3后保存（分别代表3台服务器）

修改配置文件

生成配置文件：cp conf/zoo_sample.cfg  zoo.cfg
修改配置文件：vim conf/zoo.cfg
添加参数：
dataDir=/home/programs/apache-zookeeper-3.9.3-bin_01/zkdata
dataLogDir=/home/programs/apache-zookeeper-3.9.3-bin_01/zklog

admin.serverPort=8080

server.1=172.20.0.27:2888:3888
server.2=172.20.0.28:2888:3888
server.3=172.20.0.29:2888:3888

quorumListenOnAllIPs=true

启动Zookeeper

   启动中：zkServer.sh start
   查看运行状态：zkServer.sh status
显示 Mode: leader/ Mode: follower 代表配置成功
   查看错误信息：zkServer.sh start-foreground

安装Kafka

程序放到 /home/programs
软件放到 /home/soft

配置参数

vim /home/programs/kafka_2.13-3.9.0_01/config/server.properties

zookeeper.connect=172.20.0.27:2181, 172.20.0.28:2181, 172.20.0.29:2181
log.retention.hours=72
log.dirs= /home/programs/kafka_2.13-3.9.0_01/log
listeners=PLAINTEXT:// 172.20.0.27:9092

启动

kafka-server-start.sh -daemon /home/programs/kafka_2.13-3.9.0_01/config/server.properties
kafka-server-start.sh -daemon /home/programs/kafka_2.13-3.9.0_02/config/server.properties

Kafka-ui安装配置

下载地址

Releases · provectus/kafka-ui

配置文件参数地址

Misc configuration properties | UI for Apache Kafka

配置文件样例

kafka:
  clusters:
    -
      name: local
      bootstrapServers: localhost:29091
      schemaRegistry: http://localhost:8085
      schemaRegistryAuth:
        username: username
        password: password
#     schemaNameTemplate: "%s-value"
      metrics:
        port: 9997
        type: JMX

启动

java -Dspring.config.additional-location=<path-to-application-local.yml> -jar <path-to-jar>.jar

Docker 下运行Kafka-ui

docker run -it -p 8080:8080 -e DYNAMIC_CONFIG_ENABLED=true provectuslabs/kafka-ui