丿|一口亅皓桀 2023-03-28 15:35 采纳率: 0%
浏览 13

Filebeat如何采集同一目录下多个以服务命名的日志

这样的日志，如何采集并发送到kafka

[root@master install]# ls /date/bkce/logs/gse/system/ 
alarm-system-20230322-00000.log  btsvr-system-20230322-00000.log   config-system-20230325-00005.log  dba-system-20230322-00000.log      procmgr-system-20230328-00007.log
alarm-system-20230322-00001.log  btsvr-system-20230322-00001.log   config-system-20230326-00006.log  dba-system-20230324-00001.log      procmgr-system-20230328-00008.log
alarm-system-20230324-00002.log  btsvr-system-20230322-00002.log   config-system-20230327-00007.log  dba-system-20230324-00002.log      task-system-20230322-00000.log
alarm-system-20230324-00003.log  btsvr-system-20230324-00003.log   config-system-20230328-00008.log  dba-system-20230324-00003.log      task-system-20230322-00001.log
alarm-system-20230324-00004.log  btsvr-system-20230324-00004.log   config-system-20230328-00009.log  dba-system-20230328-00004.log      task-system-20230324-00002.log
alarm-system-20230328-00005.log  btsvr-system-20230324-00005.log   data-system-20230322-00000.log    procmgr-system-20230322-00000.log  task-system-20230324-00003.log
api-system-20230322-00000.log    btsvr-system-20230328-00006.log   data-system-20230324-00001.log    procmgr-system-20230322-00001.log  task-system-20230324-00004.log
api-system-20230322-00001.log    config-system-20230322-00000.log  data-system-20230324-00002.log    procmgr-system-20230322-00002.log  task-system-20230328-00005.log
api-system-20230324-00002.log    config-system-20230323-00001.log  data-system-20230324-00003.log    procmgr-system-20230324-00003.log
api-system-20230324-00003.log    config-system-20230324-00002.log  data-system-20230326-00004.log    procmgr-system-20230324-00004.log
api-system-20230324-00004.log    config-system-20230324-00003.log  data-system-20230328-00005.log    procmgr-system-20230324-00005.log
api-system-20230328-00005.log    config-system-20230324-00004.log  data-system-20230328-00006.log    procmgr-system-20230326-00006.log

filebeat.inputs:
- type: log
  tail_files: true
  backoff: "1s"
  paths:
      - /date/bkce/logs/gse/system/alarm-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/api-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/btsvr-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/config-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/data-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/dba-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/procmgr-system-`date +%Y%m%d`-*.log
      - /date/bkce/logs/bkiam/task-system-`date +%Y%m%d`-*.log
  fields:
    type: gse
  fields_under_root: true
output:
  kafka:
    hosts: ["10.0.1.163:9092"]
    topic: hosts_10-0-1-108
  • 写回答

1条回答 默认 最新

  • x10n9 2023-03-29 17:04
    关注
    
paths:
      - /date/bkce/logs/*/*/*.log
      - /date/bkce/logs/*/*.log
    评论 编辑记录

报告相同问题？

问题事件

  • 创建了问题 3月28日

悬赏问题

  • ¥30 SQL 数组，游标，递归覆盖原值
  • ¥15 为什么我的数据接收的那么慢呀有没有完整的 hal 库并 代码呀有的话能不能发我一份并且我用 printf 函数显示处理之后的数据，用 debug 就不能运行了呢
  • ¥15 有关于推荐系统jupyter
  • ¥20 gitlab 中文路径，无法下载
  • ¥15 用动态规划算法均分纸牌
  • ¥30 udp socket，bind 0.0.0.0 ，如何自动选取用户访问的服务器IP来回复数据
  • ¥15 关于树的路径求解问题
  • ¥15 yolo在训练时候出现File "D:\yolo\yolov5-7.0\train.py"line 638,in <module>
  • ¥30 戴尔inspiron独显直连
  • ¥15 进行一项代码设计遇到问题