JPPF, java, parallel computing, distributed computing, grid computing, parallel, distributed, cluster, grid, cloud, open source, android, .net
JPPF

The open source
grid computing
solution

 Home   About   Features   Download   Documentation   On Github   Forums 
April 14, 2021, 10:10:00 PM *
Welcome,
Please login or register.

Login with username, password and session length
Advanced search  
News: New users, please read this message. Thank you!
  Home Help Search Login Register  
Pages: [1]   Go Down

Author Topic: JPPF Tasks are timing out on the nodes.  (Read 1480 times)

dblair

  • JPPF Padawan
  • *
  • Posts: 4
JPPF Tasks are timing out on the nodes.
« on: September 12, 2013, 05:56:30 AM »

Good Evening -

I have a fairly small grid 2 Nodes 1 Driver and 1 Client.

The nodes and driver are all run on Windows XP boxes
  • Java 1.7.0 JPPF 3.3.0
  • JPPF version information: Version: 3.3, Build number: 1107, Build date: 2013-04-08 09:27 CEST

The client that is feeding this beast of a processing powerhouse is a Centos 64 bit
  • java version "1.7.0_25" OpenJDK Runtime Environment (rhel-2.3.10.4.el6_4-x86_64) OpenJDK 64-Bit Server VM (build 23.7-b01, mixed mode)
  • The same version of JPPF 3.3.0
  • Tomcat 6 Spring 3.1.1

The client makes Jobs full of Command Line tasks for the nodes based off of tasks created in this earlier link.
http://www.jppf.org/forums/index.php/topic,4661.0.html

The task work correctly when tested from a JPPF sample application that is launched on a windows machine.

There are a few differences on the way things are packaged however.
The Jobs are created with some metadata that makes identifying things later easier.

Code: [Select]
                        JPPFJob job = new JPPFJob();

                        JobMetadata metadata = job.getMetadata();
metadata.setParameter("case", config.getClientCase());
metadata.setParameter("ecid", config.getExportCollectionId());
metadata.setParameter("id", config.getId());
                       
                        job.addTask(_taskFactory.createCommandLineTask(config));
                       
                        JPPFResultCollector collector = new JPPFResultCollector(job);
job.setResultListener(collector);
job.setBlocking(false);

_gridClient.submit(job);

I don't set a timeout as far as I can tell. 

Now on the node when I look at the logs there seems to be a thousand lines of initialization debugging information.  [Oddly I find that reassuring]

And then I get to the first set of tasks coming over to the node.

Quote
2013-09-11 19:12:32,904 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.deserializeObjects(71)]: got bundle JPPFTaskBundle[name=72F6F0A8-0547-490F-0B18-94A099BF1E0C, uuid=72F6F0A8-0547-490F-0B18-94A099BF1E0C, initialTaskCount=115, taskCount=10, bundleUuid=11FD049E-9A17-DFCC-4CC1-917B2BEA5560-97, uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560]]
2013-09-11 19:12:32,904 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.deserializeObjects(85)]: bundle task count = 10, state = EXECUTION_BUNDLE
2013-09-11 19:12:32,904 [DEBUG][org.jppf.server.node.AbstractClassLoaderManager.getContainer(130)]: Creating new container for appuuid=9097C40B-6B1C-A3B4-1ED7-3133C23B97AD
2013-09-11 19:12:32,904 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.node.AbstractClassLoaderManager$1] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,904 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.node.AbstractClassLoaderManager$1] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,904 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.node.AbstractClassLoaderManager$1]
2013-09-11 19:12:32,904 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/node/AbstractClassLoaderManager$1.class]
2013-09-11 19:12:32,904 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/AbstractClassLoaderManager$1.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/AbstractClassLoaderManager$1.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/node/AbstractClassLoaderManager$1.class] found
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.node.AbstractClassLoaderManager$1, definitionLength=1652]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/node/remote/RemoteClassLoaderManager$1.class]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/remote/RemoteClassLoaderManager$1.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/remote/RemoteClassLoaderManager$1.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/node/remote/RemoteClassLoaderManager$1.class] found
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1, definitionLength=1698]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1$1] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1$1] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1$1]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/node/remote/RemoteClassLoaderManager$1$1.class]
2013-09-11 19:12:32,936 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/remote/RemoteClassLoaderManager$1$1.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/remote/RemoteClassLoaderManager$1$1.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/node/remote/RemoteClassLoaderManager$1$1.class] found
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.node.remote.RemoteClassLoaderManager$1$1, definitionLength=1592]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.server.node.JPPFContainer.<init>(80)]: bew JPPFContainer with uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560], classLoader=JPPFClassLoader[id=2, type=client, uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560], classpath=]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(86)]: looking up resource [org.jppf.utils.SerializationHelperImpl]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(90)]: resource [org.jppf.utils.SerializationHelperImpl] not already loaded
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.utils.SerializationHelperImpl]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/utils/SerializationHelperImpl.class]
2013-09-11 19:12:32,951 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=org/jppf/utils/SerializationHelperImpl.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=org/jppf/utils/SerializationHelperImpl.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/utils/SerializationHelperImpl.class] found
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.utils.SerializationHelperImpl, definitionLength=1858]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(93)]: definition for resource [org.jppf.utils.SerializationHelperImpl] : class org.jppf.utils.SerializationHelperImpl
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.node.JPPFContainer$ObjectDeserializationTask] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.node.JPPFContainer$ObjectDeserializationTask] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.node.JPPFContainer$ObjectDeserializationTask]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/node/JPPFContainer$ObjectDeserializationTask.class]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/JPPFContainer$ObjectDeserializationTask.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/JPPFContainer$ObjectDeserializationTask.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/node/JPPFContainer$ObjectDeserializationTask.class] found
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.node.JPPFContainer$ObjectDeserializationTask, definitionLength=2809]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(86)]: looking up resource [org.jppf.utils.ObjectSerializerImpl]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(90)]: resource [org.jppf.utils.ObjectSerializerImpl] not already loaded
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.utils.ObjectSerializerImpl]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/utils/ObjectSerializerImpl.class]
2013-09-11 19:12:32,967 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=org/jppf/utils/ObjectSerializerImpl.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=org/jppf/utils/ObjectSerializerImpl.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/utils/ObjectSerializerImpl.class] found
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.utils.ObjectSerializerImpl, definitionLength=3362]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.loadJPPFClass(93)]: definition for resource [org.jppf.utils.ObjectSerializerImpl] : class org.jppf.utils.ObjectSerializerImpl
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [com.foo.node.ExportCommandLineTask] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [com.foo.node.ExportCommandLineTask] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [com.foo.node.ExportCommandLineTask]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [com/foo/node/ExportCommandLineTask.class]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=com/foo/node/ExportCommandLineTask.class, state=NODE_REQUEST]]]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=com/foo/node/ExportCommandLineTask.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [com/foo/node/ExportCommandLineTask.class] not found
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(149)]: definition for resource [com.foo.node.ExportCommandLineTask] not found
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [com.foo.node.ExportCommandLineTask] in the URL classpath for JPPFClassLoader[id=2, type=client, uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560], classpath=]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [com.foo.node.ExportCommandLineTask] not found in the URL classpath for JPPFClassLoader[id=2, type=client, uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560], classpath=]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [com.foo.node.ExportCommandLineTask]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [com/foo/node/ExportCommandLineTask.class]
2013-09-11 19:12:32,998 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=com/foo/node/ExportCommandLineTask.class, state=NODE_REQUEST]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=true, name=com/foo/node/ExportCommandLineTask.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [com/foo/node/ExportCommandLineTask.class] found
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [com.foo.node.ExportCommandLineTask, definitionLength=1427]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.protocol.CommandLineTask] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.protocol.CommandLineTask] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.protocol.CommandLineTask]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/protocol/CommandLineTask.class]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/protocol/CommandLineTask.class, state=NODE_REQUEST]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/protocol/CommandLineTask.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/protocol/CommandLineTask.class] found
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.protocol.CommandLineTask, definitionLength=5631]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.protocol.JPPFTaskListener] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.protocol.JPPFTaskListener] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.protocol.JPPFTaskListener]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/protocol/JPPFTaskListener.class]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/protocol/JPPFTaskListener.class, state=NODE_REQUEST]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/protocol/JPPFTaskListener.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/protocol/JPPFTaskListener.class] found
2013-09-11 19:12:33,014 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.protocol.JPPFTaskListener, definitionLength=264]


And then the tasks start to execute, and the tasks timeout nearly instantly (Well within the same millisecond anyway).


Quote
2013-09-11 19:12:33,029 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.deserializeObjects(98)]: got all data
2013-09-11 19:12:33,029 [DEBUG][org.jppf.server.node.JPPFNode.perform(163)]: received a bundle with 10 tasks
2013-09-11 19:12:33,029 [DEBUG][org.jppf.server.node.NodeExecutionManagerImpl.execute(177)]: executing 10 tasks
2013-09-11 19:12:33,029 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.server.node.NodeTaskWrapper] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,029 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.server.node.NodeTaskWrapper] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,029 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.server.node.NodeTaskWrapper]
2013-09-11 19:12:33,029 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/server/node/NodeTaskWrapper.class]
2013-09-11 19:12:33,029 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/NodeTaskWrapper.class, state=NODE_REQUEST]]]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/server/node/NodeTaskWrapper.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/server/node/NodeTaskWrapper.class] found
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.server.node.NodeTaskWrapper, definitionLength=6728]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@19b8858, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(409)]: looking up up resource [org.jppf.management.JPPFNodeTaskMonitor$NotificationSender] in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClassInURLClasspath(422)]: resource [org.jppf.management.JPPFNodeTaskMonitor$NotificationSender] not found in the URL classpath for JPPFClassLoader[id=1, type=server, uuidPath=[], classpath=]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(138)]: looking up definition for resource [org.jppf.management.JPPFNodeTaskMonitor$NotificationSender]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(136)]: loading remote definition for resource [org/jppf/management/JPPFNodeTaskMonitor$NotificationSender.class]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(145)]: sending batch of 1 class loading requests: CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/management/JPPFNodeTaskMonitor$NotificationSender.class, state=NODE_REQUEST]]]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.ClassLoaderRequestHandler.run(151)]: got response CompositeResourceWrapper[resources=[JPPFResourceWrapper[dynamic=false, name=org/jppf/management/JPPFNodeTaskMonitor$NotificationSender.class, state=NODE_RESPONSE]]]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoaderLifeCycle.loadResource(138)]: remote definition for resource [org/jppf/management/JPPFNodeTaskMonitor$NotificationSender.class] found
2013-09-11 19:12:33,045 [DEBUG][org.jppf.classloader.AbstractJPPFClassLoader.findClass(154)]: found definition for resource [org.jppf.management.JPPFNodeTaskMonitor$NotificationSender, definitionLength=1198]
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@1011f1f, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@6a16d4, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@15e10ab, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@115272a, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@1c617e0, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@1026e12, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@faf9c1, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@11be6b9, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.scheduling.JPPFScheduleHandler.cancelAction(132)]: Task Timeout Timer : cancelling action for key=java.util.concurrent.FutureTask@18a9e64, future=null
2013-09-11 19:12:33,045 [DEBUG][org.jppf.management.JPPFNodeAdmin.setTaskCounter(166)]: node tasks counter reset to 10 requested
2013-09-11 19:12:33,061 [DEBUG][org.jppf.server.node.JPPFNode.processResults(206)]: processing      10 task results for job '72F6F0A8-0547-490F-0B18-94A099BF1E0C'
2013-09-11 19:12:33,061 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.writeResults(132)]: writing results for JPPFTaskBundle[name=72F6F0A8-0547-490F-0B18-94A099BF1E0C, uuid=72F6F0A8-0547-490F-0B18-94A099BF1E0C, initialTaskCount=115, taskCount=10, bundleUuid=11FD049E-9A17-DFCC-4CC1-917B2BEA5560-97, uuidPath=[9097C40B-6B1C-A3B4-1ED7-3133C23B97AD, 11FD049E-9A17-DFCC-4CC1-917B2BEA5560]]
2013-09-11 19:12:33,061 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.writeResults(146)]: wrote full results
2013-09-11 19:12:33,061 [DEBUG][org.jppf.server.node.remote.RemoteNodeIO.deserializeObjects(69)]: waiting for next request

Any ideas on the cause of this or where to start looking?

Regards,
Dan
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2268
    • JPPF Web site
Re: JPPF Tasks are timing out on the nodes.
« Reply #1 on: September 12, 2013, 06:35:33 AM »

Hi Dan,

Indeed, the distributed class loader debug is very verbose :) If you want to filter those lines out, you can add the following in the log4j-node.properties: "log4j.logger.org.jppf.classloader=INFO".

In fact, the traces you are seeing, "Task Timeout Timer : cancelling action ...", indicate that the tasks actually do not time out. The node uses a ScheduledThreadPoolExecutor to schedule timeouts for the tasks that have a timeout set. Upon completion of the tasks, the node cleans up all the timeout actions, if any, to actually prevent the tasks from timing out after completion. So I believe the debug message is a little misleading, or it could be made less ambiguous. In any case it is harmless and can be ignored.

If you want to be sure, you can have your tasks override the "public void onTimeout()" callback and add traces in it. This callback is invoked for each task that times out.

I hope this clarifies.

Sincerely,
-Laurent
Logged

dblair

  • JPPF Padawan
  • *
  • Posts: 4
Re: JPPF Tasks are timing out on the nodes.
« Reply #2 on: September 13, 2013, 12:00:23 AM »

Hi Laurent -

That does clarify quite a bit, so I would guess from the logs that it is the task that is completing immediately.  I'll see if I can confirm that behavior.  I didn't suspect that was the issue because I had such a great log message to blame and things ran so well in another environment.   ;D

Regards,
Dan
Logged
Pages: [1]   Go Up
 
JPPF Powered by SMF 2.0 RC5 | SMF © 2006–2011, Simple Machines LLC Get JPPF at SourceForge.net. Fast, secure and Free Open Source software downloads