作这个前要先把https://www.jianshu.com/p/bece7236b4e0这个跑起来。
1、上传脚本
agent1.sources = s1
agent1.channels = c1
agent1.sinks = k1
agent1.sources.s1.type=exec
agent1.sources.s1.command=tail -F /root/20190623/word.txt
agent1.sources.s1.channels=c1
agent1.channels.c1.type=memory
agent1.channels.c1.capacity=10000
agent1.channels.c1.transactionCapacity=100
agent1.sinks.k1.type= org.apache.flume.sink.kafka.KafkaSink
agent1.sinks.k1.brokerList=teradata1:9092
agent1.sinks.k1.topic=kftest
agent1.sinks.k1.serializer.class=kafka.serializer.StringEncoder
agent1.sinks.k1.channel=c1
2、进入flume的bin目录执行命令:
flume-ng agent --conf ../conf/ -f /root/20190623/flume/flume_to_kafka.txt -Dflume.root.logger=DEBUG,console -n agent1
3、新建修改源文件
建
查看kafka的消费端
