Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Never finishes launching #36

Closed
yepher opened this issue Apr 26, 2013 · 2 comments
Closed

Never finishes launching #36

yepher opened this issue Apr 26, 2013 · 2 comments

Comments

@yepher
Copy link

yepher commented Apr 26, 2013

I have an HBase instance configured in h-rider that is not accessible on the network I am on. It appears when this happens h-rider will never get past the splash screen. It just sits spinning and says "Connecting to 192.168.200.138...".

Here is the information from the log:

2013-04-26 11:27:21.796 java[25978:11a03] Unable to load realm info from SCDynamicStore
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.3-1240972, built on 02/06/2012 10:48 GMT
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:host.name=192.168.200.131
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_43
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Apple Inc.
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.class.path=h-rider-1.0.5.0.jar
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/var/folders/9l/_q4mmgkj53x580kbw5ff_fdw0000gn/T/
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.arch=x86_64
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:os.version=10.8.3
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.name=chris
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.home=/Users/chris
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Client environment:user.dir=/Users/chris/Software/hrider/target
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /127.0.0.1:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1:2181, initiating session
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x13e4709ff1d001a, negotiated timeout = 40000
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=b2bimsrv01:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /10.200.2.107:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Socket connection established to 10.200.2.107/10.200.2.107:2181, initiating session
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Session establishment complete on server 10.200.2.107/10.200.2.107:2181, sessionid = 0x13d7f723bb30447, negotiated timeout = 40000
13/04/26 11:27:22 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.200.138:2181 sessionTimeout=180000 watcher=hconnection
13/04/26 11:27:22 INFO zookeeper.ClientCnxn: Opening socket connection to server /192.168.200.138:2181
13/04/26 11:27:22 INFO zookeeper.RecoverableZooKeeper: The identifier of this process is 25978@Chriss-MacBook-Air.local
13/04/26 11:27:22 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:27:22 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:28:38 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:28:38 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:28:38 INFO util.RetryCounter: Sleeping 2000ms before retry #1...
13/04/26 11:28:39 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:28:39 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:28:39 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:29:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:29:56 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:29:56 INFO util.RetryCounter: Sleeping 4000ms before retry #2...
13/04/26 11:29:57 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:29:57 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:29:57 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:31:12 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:31:12 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:31:12 INFO util.RetryCounter: Sleeping 8000ms before retry #3...
13/04/26 11:31:13 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:31:13 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:31:13 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
13/04/26 11:32:29 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Operation timed out
    at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
    at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
    at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
13/04/26 11:32:29 WARN zookeeper.RecoverableZooKeeper: Possibly transient ZooKeeper exception: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
13/04/26 11:32:29 ERROR zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 3 retries
13/04/26 11:32:29 WARN zookeeper.ZKUtil: hconnection Unable to set watcher on znode /hbase/master
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
    at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:150)
    at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:230)
    at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
    at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:591)
    at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:633)
    at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:109)
    at hrider.hbase.Connection.<init>(Connection.java:87)
    at hrider.hbase.ConnectionManager.create(ConnectionManager.java:23)
    at hrider.config.ConnectionDetails.canConnect(ConnectionDetails.java:48)
    at hrider.ui.forms.Window$4.run(Window.java:181)
    at java.lang.Thread.run(Thread.java:680)
13/04/26 11:32:29 ERROR zookeeper.ZooKeeperWatcher: hconnection Received unexpected KeeperException, re-throwing exception
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/master
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
    at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
    at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1021)
    at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.exists(RecoverableZooKeeper.java:150)
    at org.apache.hadoop.hbase.zookeeper.ZKUtil.watchAndCheckExists(ZKUtil.java:230)
    at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.start(ZooKeeperNodeTracker.java:82)
    at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.ensureZookeeperTrackers(HConnectionManager.java:591)
    at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:633)
    at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:109)
    at hrider.hbase.Connection.<init>(Connection.java:87)
    at hrider.hbase.ConnectionManager.create(ConnectionManager.java:23)
    at hrider.config.ConnectionDetails.canConnect(ConnectionDetails.java:48)
    at hrider.ui.forms.Window$4.run(Window.java:181)
    at java.lang.Thread.run(Thread.java:680)
13/04/26 11:32:29 INFO client.HConnectionManager$HConnectionImplementation: This client just lost it's session with ZooKeeper, will automatically reconnect when needed.
13/04/26 11:32:30 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.200.138/192.168.200.138:2181
13/04/26 11:32:30 WARN client.ZooKeeperSaslClient: SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
13/04/26 11:32:30 INFO client.ZooKeeperSaslClient: Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
1
@icher-g
Copy link

icher-g commented Apr 28, 2013

The hbase client usually tries to reconnect a number of times before it gives up. I think the default is 10.
Maybe it is a good idea to decrease this number in hrider.

@icher-g icher-g closed this as completed Apr 28, 2013
@icher-g icher-g reopened this Apr 28, 2013
@icher-g
Copy link

icher-g commented May 19, 2013

The timeout has been introduced while connecting to the hbase.

@icher-g icher-g closed this as completed May 19, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@yepher @icher-g