搭建完spark HA 集群后执行任务显示master拒绝访问
集群的两台slaves都是这种情况，求解决
下面为查看spark日志所显示的信息
2020-03-12 15:00:13 INFO ZooKeeper:438 - Initiating client connection, connectString=Hadoop01:2181,Hadoop02:2181,Hadoop03:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@54ff5e34
2020-03-12 15:00:13 INFO ClientCnxn:975 - Opening socket connection to server Hadoop01/192.168.128.151:2181. Will not attempt to authenticate using SASL (unknown error)
2020-03-12 15:00:13 INFO ClientCnxn:852 - Socket connection established to Hadoop01/192.168.128.151:2181, initiating session
2020-03-12 15:00:14 INFO ClientCnxn:1235 - Session establishment complete on server Hadoop01/192.168.128.151:2181, sessionid = 0x170cd8aa81b0000, negotiated timeout = 40000
2020-03-12 15:00:14 INFO ConnectionStateManager:228 - State change: CONNECTED
2020-03-12 15:00:16 INFO ZooKeeperLeaderElectionAgent:54 - Starting ZooKeeper LeaderElection agent
2020-03-12 15:00:16 INFO CuratorFrameworkImpl:224 - Starting
2020-03-12 15:00:16 INFO ZooKeeper:438 - Initiating client connection, connectString=Hadoop01:2181,Hadoop02:2181,Hadoop03:2181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@1a1c9fb4
2020-03-12 15:00:16 INFO ClientCnxn:975 - Opening socket connection to server Hadoop01/192.168.128.151:2181. Will not attempt to authenticate using SASL (unknown error)
2020-03-12 15:00:16 INFO ClientCnxn:852 - Socket connection established to Hadoop01/192.168.128.151:2181, initiating session
2020-03-12 15:00:16 INFO ClientCnxn:1235 - Session establishment complete on server Hadoop01/192.168.128.151:2181, sessionid = 0x170cd8aa81b0001, negotiated timeout = 40000
2020-03-12 15:00:16 INFO ConnectionStateManager:228 - State change: CONNECTED
2020-03-12 15:00:20 INFO ZooKeeperLeaderElectionAgent:54 - We have gained leadership
2020-03-12 15:00:20 INFO Master:54 - I have been elected leader! New state: RECOVERING
2020-03-12 15:00:20 INFO Master:54 - Trying to recover worker: worker-20200311210734-192.168.128.152-53095
2020-03-12 15:00:20 INFO Master:54 - Trying to recover worker: worker-20200311210734-192.168.128.153-51359
2020-03-12 15:00:21 WARN OneWayOutboxMessage:87 - Failed to send one-way RPC.
java.io.IOException: Failed to connect to /192.168.128.152:53095
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: /192.168.128.152:53095
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
... 1 more
Caused by: java.net.ConnectException: 拒绝连接
... 11 more
2020-03-12 15:00:21 WARN OneWayOutboxMessage:87 - Failed to send one-way RPC.
java.io.IOException: Failed to connect to /192.168.128.153:51359
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: /192.168.128.153:51359
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
... 1 more
Caused by: java.net.ConnectException: 拒绝连接
... 11 more
2020-03-12 15:00:24 INFO Master:54 - Registering worker 192.168.128.152:46027 with 2 cores, 1024.0 MB RAM
2020-03-12 15:00:26 INFO Master:54 - Registering worker 192.168.128.153:59036 with 2 cores, 1024.0 MB RAM
2020-03-12 15:01:21 INFO Master:54 - Removing worker worker-20200311210734-192.168.128.152-53095 on 192.168.128.152:53095
2020-03-12 15:01:21 INFO Master:54 - Telling app of lost worker: worker-20200311210734-192.168.128.152-53095
2020-03-12 15:01:21 INFO Master:54 - Removing worker worker-20200311210734-192.168.128.153-51359 on 192.168.128.153:51359
2020-03-12 15:01:21 INFO Master:54 - Telling app of lost worker: worker-20200311210734-192.168.128.153-51359
2020-03-12 15:01:21 INFO Master:54 - Recovery complete - resuming operations!
2020-03-12 15:05:05 INFO Master:54 - Registering app Spark Pi
2020-03-12 15:05:05 INFO Master:54 - Registered app Spark Pi with ID app-20200312150505-0000
2020-03-12 15:05:05 INFO Master:54 - Launching executor app-20200312150505-0000/0 on worker worker-20200312150020-192.168.128.153-59036
2020-03-12 15:05:16 INFO Master:54 - Received unregister request from application app-20200312150505-0000
2020-03-12 15:05:16 INFO Master:54 - Removing app app-20200312150505-0000
2020-03-12 15:05:16 WARN OneWayOutboxMessage:87 - Failed to send one-way RPC.
java.io.IOException: Failed to connect to /192.168.128.153:51359
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: /192.168.128.153:51359
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
... 1 more
Caused by: java.net.ConnectException: 拒绝连接
... 11 more
2020-03-12 15:05:16 WARN OneWayOutboxMessage:87 - Failed to send one-way RPC.
java.io.IOException: Failed to connect to /192.168.128.152:53095
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:245)
at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:187)
at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:198)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:194)
at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: /192.168.128.152:53095
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:323)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:633)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:580)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:497)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858)
at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138)
... 1 more
Caused by: java.net.ConnectException: 拒绝连接
... 11 more
2020-03-12 15:05:16 INFO Master:54 - 192.168.128.151:55888 got disassociated, removing it.
2020-03-12 15:05:16 INFO Master:54 - Hadoop01:39679 got disassociated, removing it.
2020-03-12 15:05:16 WARN Master:66 - Got status update for unknown executor app-20200312150505-0000/0
