NodeShutdownSpec failed
http://scalable1:8080/job/akka-multi-node/80/
[info] * akka.cluster.NodeShutdown
[JVM-Node1] [INFO] [06/05/2012 11:46:28.507] [main] [ActorSystem(NodeShutdownSpec)] RemoteServerStarted@akka://NodeShutdownSpec@scalable2-01:54548
[JVM-Node2] [INFO] [06/05/2012 11:46:28.563] [main] [ActorSystem(NodeShutdownSpec)] RemoteServerStarted@akka://NodeShutdownSpec@scalable2-02:49181
[JVM-Node1] [INFO] [06/05/2012 11:46:28.756] [main] [NodeShutdownMultiJvmNode1(akka://NodeShutdownSpec)] Role [first] started
[JVM-Node2] [INFO] [06/05/2012 11:46:28.820] [main] [NodeShutdownMultiJvmNode2(akka://NodeShutdownSpec)] Role [second] started
[first] NodeShutdownMultiJvmNode1:
[first] A cluster of 2 nodes
[second] NodeShutdownMultiJvmNode2:
[second] A cluster of 2 nodes
[first] [INFO] [06/05/2012 11:46:28.896] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - is starting up...
[first] [INFO] [06/05/2012 11:46:28.986] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - registering cluster JMX MBean [akka:type=Cluster]
[first] [INFO] [06/05/2012 11:46:28.987] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - has started up successfully
[second] [INFO] [06/05/2012 11:46:29.075] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@second] - is starting up...
[second] [INFO] [06/05/2012 11:46:29.104] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@second] - registering cluster JMX MBean [akka:type=Cluster]
[second] [INFO] [06/05/2012 11:46:29.104] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@second] - has started up successfully
[second] [INFO] [06/05/2012 11:46:29.123] [main] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@second] - Trying to send JOIN to [akka://NodeShutdownSpec@first] through connection [Actor[akka://NodeShutdownSpec@first/system/cluster/commands]]
[second] [INFO] [06/05/2012 11:46:29.218] [main] [ActorSystem(NodeShutdownSpec)] RemoteClientStarted@akka://NodeShutdownSpec@first
[first] [INFO] [06/05/2012 11:46:29.264] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientStarted@akka://NodeShutdownSpec@second
[first] [INFO] [06/05/2012 11:46:29.290] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - Node [akka://NodeShutdownSpec@second] is JOINING
[first] [INFO] [06/05/2012 11:46:29.338] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - Leader is moving node [akka://NodeShutdownSpec@first] from JOINING to UP
[first] [INFO] [06/05/2012 11:46:29.341] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [Node(akka://NodeShutdownSpec)] Cluster Node [akka://NodeShutdownSpec@first] - Leader is moving node [akka://NodeShutdownSpec@second] from JOINING to UP
[first] - must not be singleton cluster when joined
[second] - must not be singleton cluster when joined
[first] [ERROR] [06/05/2012 11:46:30.024] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteServerError@akka://NodeShutdownSpec@first] Error[java.io.IOException: Connection reset by peer]
[first] [INFO] [06/05/2012 11:46:30.027] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:30.252] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:30.255] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:30.256] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:30.535] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:30.535] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:30.536] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:30.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:30.836] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:30.839] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:31.135] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:31.135] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:31.136] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:31.435] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:31.435] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:31.437] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:31.736] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:31.738] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:31.739] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:32.035] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:32.037] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:32.040] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:32.337] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:32.338] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:32.339] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:32.636] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:32.639] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:32.642] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:32.938] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:32.939] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:32.941] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:33.235] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:33.235] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:33.238] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:33.535] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:33.537] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:33.538] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:33.835] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:33.835] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:33.838] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:34.135] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:34.135] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:34.137] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:34.434] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:34.435] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:34.437] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:34.735] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:34.736] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:34.737] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:35.034] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:35.035] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:35.037] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:35.335] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:35.335] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:35.337] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:35.634] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:35.635] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:35.636] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:35.935] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:35.936] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:35.939] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:36.235] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:36.236] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:36.237] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:36.535] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:36.536] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:36.537] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:36.835] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:36.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:36.839] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:37.135] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:37.136] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:37.141] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:37.436] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:37.437] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:37.438] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:37.735] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:37.735] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:37.737] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:38.035] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:38.036] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:38.038] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:38.336] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:38.336] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:38.339] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:38.635] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:38.636] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:38.637] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:38.936] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:38.936] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:38.939] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:39.243] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:39.243] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:39.245] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:39.534] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:39.535] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:39.537] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:39.835] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:39.836] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:39.838] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:40.135] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:40.136] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:40.139] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:40.435] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:40.441] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:40.442] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:40.736] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:40.736] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:40.738] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:41.036] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:41.036] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:41.038] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:41.339] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:41.342] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:41.343] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:41.635] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:41.636] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:41.638] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:41.935] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:41.936] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:41.938] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:42.235] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:42.236] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:42.239] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:42.536] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:42.537] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:42.538] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:42.835] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:42.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:42.838] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:43.135] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:43.135] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:43.138] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:43.435] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:43.436] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:43.438] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:43.735] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:43.735] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:43.737] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:44.037] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:44.037] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:44.038] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:44.335] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:44.336] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:44.338] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:44.635] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:44.636] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:44.638] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:44.936] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:44.939] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:44.940] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:45.234] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:45.235] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:45.236] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:45.534] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:45.535] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:45.536] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:45.834] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:45.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:45.836] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:46.135] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:46.136] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:46.137] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:46.435] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:46.435] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:46.436] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:46.734] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:46.735] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:46.736] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:47.034] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:47.037] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:47.038] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:47.335] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:47.336] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:47.337] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:47.634] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:47.635] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:47.635] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:47.934] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:47.935] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:47.936] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:48.234] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:48.235] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:48.236] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:48.535] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:48.535] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:48.537] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:48.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:48.835] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:48.837] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:49.135] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:49.135] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:49.137] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:49.436] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:49.437] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:49.438] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:49.735] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:49.735] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:49.737] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:50.035] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:50.035] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:50.037] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:50.334] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:50.335] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:50.337] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:50.634] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:50.634] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:50.636] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:50.935] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:50.937] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:50.946] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:51.235] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:51.236] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:51.238] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:51.535] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:51.536] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:51.538] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:51.835] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:51.836] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:51.838] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:52.135] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:52.136] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:52.138] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:52.437] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:52.437] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:52.441] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:52.734] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:52.735] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:52.736] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:53.035] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:53.035] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:53.037] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:53.334] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:53.335] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:53.337] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:53.636] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:53.636] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:53.637] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:53.934] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:53.935] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:53.936] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:54.234] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:54.235] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:54.235] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:54.534] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:54.535] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:54.535] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:54.835] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:54.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:54.837] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:55.135] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:55.135] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:55.137] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:55.434] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:55.435] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:55.440] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:55.734] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:55.735] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:55.736] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:56.034] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:56.035] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:56.036] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:56.335] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:56.335] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:56.336] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:56.634] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:56.634] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:56.635] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:56.934] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:56.934] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:56.935] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:57.235] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:57.237] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:57.237] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:57.535] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:57.536] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:57.537] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:57.834] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:57.835] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:57.839] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:58.134] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:58.135] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:58.136] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:58.434] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:58.434] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:58.435] [NodeShutdownSpec-akka.actor.default-dispatcher-1] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:58.735] [NodeShutdownSpec-2] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:58.735] [NodeShutdownSpec-akka.actor.default-dispatcher-6] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:58.737] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:59.034] [NodeShutdownSpec-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:59.035] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:59.037] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:59.335] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:59.336] [NodeShutdownSpec-5] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:59.337] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] [ERROR] [06/05/2012 11:46:59.634] [NodeShutdownSpec-3] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [ERROR] [06/05/2012 11:46:59.637] [NodeShutdownSpec-akka.actor.default-dispatcher-4] [ActorSystem(NodeShutdownSpec)] RemoteClientError@akka://NodeShutdownSpec@second: Error[java.net.ConnectException: Connection refused]
[first] [INFO] [06/05/2012 11:46:59.637] [NodeShutdownSpec-akka.actor.default-dispatcher-5] [ActorSystem(NodeShutdownSpec)] RemoteClientShutdown@akka://NodeShutdownSpec@second
[first] - become singleton cluster when one node is shutdown *** FAILED ***
[first] java.lang.AssertionError: assertion failed: timeout 29999978420 nanoseconds expired
[first] at scala.Predef$.assert(Predef.scala:160)
[first] at akka.testkit.TestKitBase$class.poll$1(TestKit.scala:185)
[first] at akka.testkit.TestKitBase$class.awaitCond(TestKit.scala:191)
[first] at akka.testkit.TestKit.awaitCond(TestKit.scala:600)
[first] at akka.cluster.MultiNodeClusterSpec$$anonfun$awaitUpConvergence$1.apply$mcV$sp(MultiNodeClusterSpec.scala:78)
[first] at akka.cluster.MultiNodeClusterSpec$$anonfun$awaitUpConvergence$1.apply(MultiNodeClusterSpec.scala:77)
[first] at akka.cluster.MultiNodeClusterSpec$$anonfun$awaitUpConvergence$1.apply(MultiNodeClusterSpec.scala:77)
[first] at akka.testkit.TestKitBase$class.within(TestKit.scala:222)
[first] at akka.testkit.TestKit.within(TestKit.scala:600)
[first] at akka.testkit.TestKitBase$class.within(TestKit.scala:236)
[first] at akka.testkit.TestKit.within(TestKit.scala:600)
[first] at akka.cluster.MultiNodeClusterSpec$class.awaitUpConvergence(MultiNodeClusterSpec.scala:77)
[first] at akka.cluster.NodeShutdownSpec.awaitUpConvergence(NodeShutdownSpec.scala:30)
[first] at akka.cluster.NodeShutdownSpec$$anonfun$1$$anonfun$apply$mcV$sp$4$$anonfun$apply$mcV$sp$5.apply$mcV$sp(NodeShutdownSpec.scala:58)
[first] at akka.remote.testkit.MultiNodeSpec.runOn(MultiNodeSpec.scala:172)
[first] at akka.cluster.NodeShutdownSpec$$anonfun$1$$anonfun$apply$mcV$sp$4.apply$mcV$sp(NodeShutdownSpec.scala:55)
[first] at akka.cluster.NodeShutdownSpec$$anonfun$1$$anonfun$apply$mcV$sp$4.apply(NodeShutdownSpec.scala:54)
[first] at akka.cluster.NodeShutdownSpec$$anonfun$1$$anonfun$apply$mcV$sp$4.apply(NodeShutdownSpec.scala:54)
[first] at org.scalatest.WordSpec$$anon$2.apply(WordSpec.scala:2161)
[first] at org.scalatest.Suite$class.withFixture(Suite.scala:1968)
[first] at akka.testkit.AkkaSpec.withFixture(AkkaSpec.scala:60)
[first] at org.scalatest.WordSpec$class.invokeWithFixture$1(WordSpec.scala:2158)
[first] at org.scalatest.WordSpec$$anonfun$runTest$1.apply(WordSpec.scala:2167)
[first] at org.scalatest.WordSpec$$anonfun$runTest$1.apply(WordSpec.scala:2167)
[first] at org.scalatest.SuperEngine.runTestImpl(Engine.scala:168)
[first] at org.scalatest.WordSpec$class.runTest(WordSpec.scala:2167)
[first] at akka.testkit.AkkaSpec.runTest(AkkaSpec.scala:60)
[first] at org.scalatest.WordSpec$$anonfun$runTests$1.apply
Leave a comment
on 2012-06-05 10:38 *
By Jonas Bonér
Fails on my laptop as well.
on 2012-06-05 10:40 *
By Jonas Bonér
I also think the test should be renamed. It is not shutdown it is testing (that is the *Remove tests I'm working on doing),
but should be called SingletonClusterSpec or similar.
but should be called SingletonClusterSpec or similar.
on 2012-06-08 09:03 *
By Patrik Nordwall
http://scalable1:8080/job/akka-local/40/
http://scalable1:8080/job/akka-local/36/
http://scalable1:8080/job/akka-nightly/47/
http://scalable1:8080/job/akka-nightly/41/
Never detects failure, never moved to unreachable
http://scalable1:8080/job/akka-local/36/
http://scalable1:8080/job/akka-nightly/47/
http://scalable1:8080/job/akka-nightly/41/
Never detects failure, never moved to unreachable
on 2012-06-08 09:03 *
By Patrik Nordwall
Assigned to set to Patrik Nordwall
Status changed from New to Accepted
on 2012-06-08 09:06 *
By Patrik Nordwall
This failure in ConvergenceSpec might be related: http://scalable1:8080/job/akka-local/35/
on 2012-06-08 09:41 *
By Jonas Bonér
So if they are related should I look into this one along side ConvergenceSpec? If so reassign ticket.
on 2012-06-08 09:45 *
By Patrik Nordwall
No, we had two different types of failures in ConvergenceSpec. I will look at this, related to unreachable / failure detection. I think #2204 is due to something else, if you find it due to failure detection it should wait until this is fixed.
on 2012-06-08 10:19 *
By Patrik Nordwall
The problem is that the failure detector doesn't get enough heartbeats before the second node is shutdown, and therefore mean remains 0.0 (phi = 0.0).
First heartbeat initiates the intervals (empty).
Second heartbeat is "ignored" (newIntervalsForConnection.size > 1), which I don't understand why.
Third heartbeat result in first mean.
When this fails there are never 3 heartbeats.
I'll think about a solution.
First heartbeat initiates the intervals (empty).
Second heartbeat is "ignored" (newIntervalsForConnection.size > 1), which I don't understand why.
Third heartbeat result in first mean.
When this fails there are never 3 heartbeats.
I'll think about a solution.
on 2012-06-08 11:48 *
By Patrik Nordwall
(In revision:dcae863f7fbe4de0b57c0634daeb4e99de0416a9) Use all heartbeats in failure detector, see #2182
becomes unavailble, the guess corresponds to 1 second interval
which results in phi > 8 after 18 seconds
Branch: wip-2182-unreachable-patriknw
- Failure detector didn't use hearbeat 1 and 2
- Included heartbeat 2 in ordinary stats
- For heartbeat 1 use guess stats,
becomes unavailble, the guess corresponds to 1 second interval
which results in phi > 8 after 18 seconds
- Improved AccrualFailureDetectorSpec
Branch: wip-2182-unreachable-patriknw
on 2012-06-08 12:16 *
By Patrik Nordwall
(In revision:f6fb742fcf2ef9200c4589812e6fd09f53955d66) Incorparated improvements/cleanup based on feedback, see #2182
Branch: wip-2182-unreachable-patriknw
Branch: wip-2182-unreachable-patriknw
on 2012-06-08 12:18 *
By Patrik Nordwall
(In revision:dcae863f7fbe4de0b57c0634daeb4e99de0416a9) Use all heartbeats in failure detector, see #2182
becomes unavailble, the guess corresponds to 1 second interval
which results in phi > 8 after 18 seconds
Branch: master
- Failure detector didn't use hearbeat 1 and 2
- Included heartbeat 2 in ordinary stats
- For heartbeat 1 use guess stats,
becomes unavailble, the guess corresponds to 1 second interval
which results in phi > 8 after 18 seconds
- Improved AccrualFailureDetectorSpec
Branch: master
on 2012-06-08 12:18 *
By Patrik Nordwall
(In revision:f6fb742fcf2ef9200c4589812e6fd09f53955d66) Incorparated improvements/cleanup based on feedback, see #2182
Branch: master
Branch: master
on 2012-06-08 12:18 *
By Patrik Nordwall
(In revision:eae184d1170d3e568289d1e65ce7a1ff3d14274c) Merge pull request #526 from akka/wip-2182-unreachable-patriknw
Use all heartbeats in failure detector, see #2182
Branch: master
Use all heartbeats in failure detector, see #2182
Branch: master
on 2012-06-08 12:35 *
By Jonas Bonér
Can you rename it also. It has nothing to do with shutdown, but singleton cluster.
on 2012-06-08 13:03 *
By Patrik Nordwall
(In revision:fb62311f49f4e0155d080fcbcf788e932bb75757) Rename NodeShutdownSpec to SingletonClusterSpec, see #2182
Branch: master
Branch: master
on 2012-06-08 13:03 *
By Patrik Nordwall
rename fixed
on 2012-06-08 13:12 *
By Jonas Bonér
Thanks
on 2012-06-11 14:54 *
By Patrik Nordwall
(In revision:fb62311f49f4e0155d080fcbcf788e932bb75757) Rename NodeShutdownSpec to SingletonClusterSpec, see #2182
Branch: wip-failure-detector-puppet-jboner
Branch: wip-failure-detector-puppet-jboner
Updating tickets (#620, #679, #725, #750, #752, #753, #754, #763, #789, #870, #893, #922, #953, #954, #971, #977, #983, #985, #987, #991, #1026, #1045, #1051, #1060, #1061, #1084, #1098, #1099, #1133, #1134, #1135, #1136, #1137, #1194, #1225, #1226, #1243, #1245, #1247, #1248, #1254, #1261, #1300, #1317, #1391, #1412, #1791, #1793, #1901, #1908, #1911, #1912, #1913, #1914, #1915, #1916, #1917, #1922, #1983, #1987, #1996, #1997, #1998, #2066, #2077, #2105, #2117, #2133, #2143, #2149, #2151, #2152, #2153, #2155, #2157, #2158, #2159, #2160, #2161, #2162, #2163, #2164, #2165, #2167, #2171, #2175, #2176, #2177, #2180, #2182, #2184, #2185, #2193, #2199, #2202, #2204, #2206, #2207, #2209, #2210)