本人初学大数据,启动flume时发现错误,请各位帮下忙,谢谢!
在测试通过flume采集网络端口数据时,启动flume后,发现报错。报错日志如下:
[root@node03 apache-flume-1.7.0-bin]# bin/flume-ng agent --conf conf --conf-file conf/netcat_logger.conf --name a1
Info: Sourcing environment configuration script /opt/software/apache-flume-1.7.0-bin/conf/flume-env.sh
Info: Including Hadoop libraries found via (/opt/software/hadoop-2.7.0/bin/hadoop) for HDFS access
Info: Including Hive libraries found via (/opt/software/apache-hive-2.3.0-bin) for Hive access
+ exec /usr/java/jdk1.7.0_79/bin/java -Xmx20m -cp '/opt/software/apache-flume-1.7.0-bin/conf:/opt/software/apache-flume-1.7.0-bin/lib/*:/opt/software/hadoop-2.7.0/etc/hadoop:/opt/software/hadoop-2.7.0/share/hadoop/common/lib/*:/opt/software/hadoop-2.7.0/share/hadoop/common/*:/opt/software/hadoop-2.7.0/share/hadoop/hdfs:/opt/software/hadoop-2.7.0/share/hadoop/hdfs/lib/*:/opt/software/hadoop-2.7.0/share/hadoop/hdfs/*:/opt/software/hadoop-2.7.0/share/hadoop/yarn/lib/*:/opt/software/hadoop-2.7.0/share/hadoop/yarn/*:/opt/software/hadoop-2.7.0/share/hadoop/mapreduce/lib/*:/opt/software/hadoop-2.7.0/share/hadoop/mapreduce/*:/opt/software/hadoop-2.7.0/contrib/capacity-scheduler/*.jar:/opt/software/apache-hive-2.3.0-bin/lib/*' -Djava.library.path=:/opt/software/hadoop-2.7.0/lib/native org.apache.flume.node.Application --conf-file conf/netcat_logger.conf --name a1
2021-10-02T11:26:07,283 INFO [lifecycleSupervisor-1-0] org.apache.flume.node.PollingPropertiesFileConfigurationProvider - Configuration provider starting
2021-10-02T11:26:07,293 INFO [conf-file-poller-0] org.apache.flume.node.PollingPropertiesFileConfigurationProvider - Reloading configuration file:conf/netcat_logger.conf
2021-10-02T11:26:07,306 INFO [conf-file-poller-0] org.apache.flume.conf.FlumeConfiguration - Added sinks: k1 Agent: a1
2021-10-02T11:26:07,307 INFO [conf-file-poller-0] org.apache.flume.conf.FlumeConfiguration - Processing:k1
2021-10-02T11:26:07,307 INFO [conf-file-poller-0] org.apache.flume.conf.FlumeConfiguration - Processing:k1
2021-10-02T11:26:07,325 INFO [conf-file-poller-0] org.apache.flume.conf.FlumeConfiguration - Post-validation flume configuration contains configuration for agents: [a1]
2021-10-02T11:26:07,325 INFO [conf-file-poller-0] org.apache.flume.node.AbstractConfigurationProvider - Creating channels
2021-10-02T11:26:07,337 INFO [conf-file-poller-0] org.apache.flume.channel.DefaultChannelFactory - Creating instance of channel c1 type memory
2021-10-02T11:26:07,344 INFO [conf-file-poller-0] org.apache.flume.node.AbstractConfigurationProvider - Created channel c1
2021-10-02T11:26:07,345 INFO [conf-file-poller-0] org.apache.flume.source.DefaultSourceFactory - Creating instance of source r1, type netcat
2021-10-02T11:26:07,364 INFO [conf-file-poller-0] org.apache.flume.sink.DefaultSinkFactory - Creating instance of sink: k1, type: logger
2021-10-02T11:26:07,373 INFO [conf-file-poller-0] org.apache.flume.node.AbstractConfigurationProvider - Channel c1 connected to [r1, k1]
2021-10-02T11:26:07,383 INFO [conf-file-poller-0] org.apache.flume.node.Application - Starting new configuration:{ sourceRunners:{r1=EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} }} sinkRunners:{k1=SinkRunner: { policy:org.apache.flume.sink.DefaultSinkProcessor@2fca747e counterGroup:{ name:null counters:{} } }} channels:{c1=org.apache.flume.channel.MemoryChannel{name: c1}} }
2021-10-02T11:26:07,397 INFO [conf-file-poller-0] org.apache.flume.node.Application - Starting Channel c1
2021-10-02T11:26:07,398 INFO [lifecycleSupervisor-1-0] org.apache.flume.instrumentation.MonitoredCounterGroup - Monitored counter group for type: CHANNEL, name: c1: Successfully registered new MBean.
2021-10-02T11:26:07,398 INFO [lifecycleSupervisor-1-0] org.apache.flume.instrumentation.MonitoredCounterGroup - Component type: CHANNEL, name: c1 started
2021-10-02T11:26:07,399 INFO [conf-file-poller-0] org.apache.flume.node.Application - Starting Sink k1
2021-10-02T11:26:07,401 INFO [conf-file-poller-0] org.apache.flume.node.Application - Starting Source r1
2021-10-02T11:26:07,402 INFO [lifecycleSupervisor-1-2] org.apache.flume.source.NetcatSource - Source starting
2021-10-02T11:26:07,419 ERROR [lifecycleSupervisor-1-2] org.apache.flume.source.NetcatSource - Unable to bind to socket. Exception follows.
java.net.BindException: 无法指定被请求的地址
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.7.0_79]
at sun.nio.ch.Net.bind(Net.java:444) ~[?:1.7.0_79]
at sun.nio.ch.Net.bind(Net.java:436) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67) ~[?:1.7.0_79]
at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167) [flume-ng-core-1.7.0.jar:1.7.0]
at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44) [flume-ng-core-1.7.0.jar:1.7.0]
at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249) [flume-ng-core-1.7.0.jar:1.7.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [?:1.7.0_79]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [?:1.7.0_79]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [?:1.7.0_79]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_79]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
2021-10-02T11:26:07,429 ERROR [lifecycleSupervisor-1-2] org.apache.flume.lifecycle.LifecycleSupervisor - Unable to start EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} } - Exception follows.
org.apache.flume.FlumeException: java.net.BindException: 无法指定被请求的地址
at org.apache.flume.source.NetcatSource.start(NetcatSource.java:173) ~[flume-ng-core-1.7.0.jar:1.7.0]
at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44) ~[flume-ng-core-1.7.0.jar:1.7.0]
at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:249) [flume-ng-core-1.7.0.jar:1.7.0]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [?:1.7.0_79]
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [?:1.7.0_79]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [?:1.7.0_79]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_79]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_79]
at java.lang.Thread.run(Thread.java:745) [?:1.7.0_79]
Caused by: java.net.BindException: 无法指定被请求的地址
at sun.nio.ch.Net.bind0(Native Method) ~[?:1.7.0_79]
at sun.nio.ch.Net.bind(Net.java:444) ~[?:1.7.0_79]
at sun.nio.ch.Net.bind(Net.java:436) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) ~[?:1.7.0_79]
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67) ~[?:1.7.0_79]
at org.apache.flume.source.NetcatSource.start(NetcatSource.java:167) ~[flume-ng-core-1.7.0.jar:1.7.0]
... 9 more