016-05-18 13:16:26,751 INFO [master:master2:60000-EventThread] zookeeper.ClientCnxn: EventThread shut down
2016-05-18 13:16:26,752 INFO [master:master2:60000-SendThread(master1:2181)] zookeeper.ClientCnxn: Unable to reconnect to ZooKeeper service, session 0x354c2044e44000d has expired, closing socket connection
2016-05-18 13:16:27,154 INFO [main-SendThread(master3:2181)] zookeeper.ClientCnxn: Opening socket connection to server master3/10.219.83.213:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration)
2016-05-18 13:16:27,155 INFO [main-SendThread(master3:2181)] zookeeper.ClientCnxn: Socket connection established to master3/10.219.83.213:2181, initiating session
2016-05-18 13:16:27,158 INFO [main-SendThread(master3:2181)] zookeeper.ClientCnxn: Unable to reconnect to ZooKeeper service, session 0x254c2058c80001d has expired, closing socket connection
2016-05-18 13:16:27,159 FATAL [main-EventThread] master.HMaster: Master server abort: loaded coprocessors are: []
2016-05-18 13:16:27,159 INFO [main-EventThread] master.HMaster: Primary Master trying to recover from ZooKeeper session expiry.
2016-05-18 13:16:27,160 INFO [main-EventThread] zookeeper.RecoverableZooKeeper: Closing dead ZooKeeper connection, session was: 0x254c2058c80001d
2016-05-18 13:16:27,160 INFO [main-EventThread] zookeeper.ZooKeeper: Initiating client connection, connectString=DBmaster1:2181,master2:2181,master3:2181,master1:2181,master4:2181 sessionTimeout=30000 watcher=master:60000-0x254c2058c80001d, quorum=DBmaster1:2181,master2:2181,master3:2181,master1:2181,master4:2181, baseZNode=/hbase-unsecure
2016-05-18 13:16:27,163 INFO [main-EventThread] zookeeper.RecoverableZooKeeper: Recreated a ZooKeeper, session is: 0x0
WARN [master:master2:60000-EventThread] client.ConnectionManager$HConnectionImplementation: This client just lost it's session with ZooKeeper, closing it. It will be recreated next time someone needs it
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired
at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.connectionEvent(ZooKeeperWatcher.java:448)
at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.process(ZooKeeperWatcher.java:366)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
2016-05-18 13:16:27,190 INFO [master:master2:60000-EventThread] client.ConnectionManager$HConnectionImplementation: Closing zookeeper sessionid=0x454c2044d0d0017
2016-05-18 13:16:27,190 INFO [master:master2:60000-EventThread] zookeeper.ClientCnxn: EventThread shut down
2016-05-18 13:16:27,203 ERROR [main-EventThread] master.HMaster: Primary master encountered unexpected exception while trying to recover from ZooKeeper session expiry. Proceeding with server abort.
java.util.concurrent.ExecutionException: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby
at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:87)
at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1719)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1352)
