一、下载地址:
官方:
百度云盘:
二、安装
tar zxvf filebeat-6.2.1-linux-x86_64.tar.gzmv filebeat-6.2.1-linux-x86_64 filebeat
也可yum安装
下载和安装key文件
rpm --import https://packages.elastic.co/GPG-KEY-elasticsearch
创建yum源文件
vi /etc/yum.repos.d/elastic.repo
[elastic-6.x]name=Elastic repository for 6.x packagesbaseurl=https://artifacts.elastic.co/packages/6.x/yumgpgcheck=1gpgkey=https://artifacts.elastic.co/GPG-KEY-elasticsearchenabled=1autorefresh=1type=rpm-md
开始安装
yum install filebeat
三、配置
vi kafka.yml
filebeat.prospectors:- input_type: log paths: - /usr/local/openresty/nginx/logs/access.logoutput.kafka: hosts: ["10.10.6.225:9092"] topic: need_process_nginx_access_log partition.round_robin: reachable_only: false required_acks: 1
注:output到kafka的partitions策略:分为random、round_robin、hash,默认是hash
具体说明:
运行
./filebeat -e -c kafka.yml
后台运行
nohup /usr/local/filebeat/filebeat -e -c /usr/local/filebeat/kafka.yml >/dev/null 2>&1 &