Topic: JBoss JPPF JCA connector issue (Read 16442 times)

anand6998 · « **on:** January 17, 2012, 02:23:23 AM »

I am getting the following error after deploying
jppf_ra_JBoss.war and jppf-ra-JBoss-4.0-ds.xml to server/default/deploy. I am running JBoss 4.2.2 GA on windows 7.

20:13:47,783 ERROR [URLDeploymentScanner] Incomplete Deployment listing:

--- MBeans waiting for other MBeans ---
ObjectName: jboss.jca:service=NoTxCM,name=eis/JPPFConnectionFactory
State: CONFIGURED
I Depend On:
jboss.jca:service=ManagedConnectionPool,name=eis/JPPFConnectionFactory
jboss.jca:service=CachedConnectionManager
Depends On Me:
jboss.jca:service=ConnectionFactoryBinding,name=eis/JPPFConnectionFactory

ObjectName: jboss.jca:service=ManagedConnectionPool,name=eis/JPPFConnectionFacto
ry
State: CONFIGURED
I Depend On:
jboss.jca:service=ManagedConnectionFactory,name=eis/JPPFConnectionFactory
Depends On Me:
jboss.jca:service=NoTxCM,name=eis/JPPFConnectionFactory

ObjectName: jboss.jca:service=ManagedConnectionFactory,name=eis/JPPFConnectionFa
ctory
State: CONFIGURED
I Depend On:
jboss.jca:service=RARDeployment,name='jppf_ra_JBoss-4.0.rar'
Depends On Me:
jboss.jca:service=ManagedConnectionPool,name=eis/JPPFConnectionFactory

ObjectName: jboss.jca:service=ConnectionFactoryBinding,name=eis/JPPFConnectionFa
ctory
State: CONFIGURED
I Depend On:
jboss.jca:service=NoTxCM,name=eis/JPPFConnectionFactory

--- MBEANS THAT ARE THE ROOT CAUSE OF THE PROBLEM ---
ObjectName: jboss.jca:service=RARDeployment,name='jppf_ra_JBoss-4.0.rar'
State: NOTYETINSTALLED
Depends On Me:
jboss.jca:service=ManagedConnectionFactory,name=eis/JPPFConnectionFactory

Then, when I make a web service call to my code I get this stack trace

20:19:34,237 ERROR [STDERR] javax.naming.NameNotFoundException: eis not bound
20:19:34,237 ERROR [STDERR] at org.jnp.server.NamingServer.getBinding(Naming
Server.java:529)
20:19:34,238 ERROR [STDERR] at org.jnp.server.NamingServer.getBinding(Naming
Server.java:537)
20:19:34,238 ERROR [STDERR] at org.jnp.server.NamingServer.getObject(NamingS
erver.java:543)
20:19:34,238 ERROR [STDERR] at org.jnp.server.NamingServer.lookup(NamingServ
er.java:267)
20:19:34,239 ERROR [STDERR] at sun.reflect.NativeMethodAccessorImpl.invoke0(
Native Method)

The jppf-ra-JBoss-4.0-ds.xml was copied from the jppf website.

<?xml version="1.0" encoding="UTF-8"?>
<connection-factories>
   <no-tx-connection-factory>
      <jndi-name>eis/JPPFConnectionFactory</jndi-name>
      <application-managed-security/>
      <rar-name>jppf_ra_JBoss-4.0.rar</rar-name>
      <connection-definition>javax.resource.cci.ConnectionFactory</connection-definition>
      <adapter-display-name>JPPF</adapter-display-name>
      <min-pool-size>0</min-pool-size>
      <max-pool-size>10</max-pool-size>
      <blocking-timeout-millis>50000</blocking-timeout-millis>
      <idle-timeout-minutes>15</idle-timeout-minutes>
   </no-tx-connection-factory>
</connection-factories>

The calling code is

InitialContext ctx = new InitialContext();
         Object objref = ctx.lookup("eis/JPPFConnectionFactory");
         ConnectionFactory factory =
           (ConnectionFactory) PortableRemoteObject.narrow(objref, ConnectionFactory.class);
          //Obtain a JPPF Connection from the connection factory
          JPPFConnection connection = (JPPFConnection) factory.getConnection();

JPPFJob job = new JPPFJob();
job.addTask(new OptionValuationTask(option));
         String submitID = connection.submitNonBlocking(job, null);
          //close the connection
          connection.close();

Any help much appreciated.

Thanks
Amit

lolo · « **Reply #1 on:** January 17, 2012, 07:00:20 AM »

Hello Amit,

The jppf-ra-JBoss-4.0-ds.xml you got from the site is quite old, my apologies for that.

You should have the real name of the .rar in it, as outlined below:

<?xml version="1.0" encoding="UTF-8"?>
<connection-factories>
<no-tx-connection-factory>
<jndi-name>eis/JPPFConnectionFactory</jndi-name>
<application-managed-security/>
<rar-name>jppf_ra_JBoss.rar</rar-name>
<connection-definition>javax.resource.cci.ConnectionFactory</connection-definition>
<adapter-display-name>JPPF</adapter-display-name>
<min-pool-size>0</min-pool-size>
<max-pool-size>10</max-pool-size>
<blocking-timeout-millis>50000</blocking-timeout-millis>
<idle-timeout-minutes>15</idle-timeout-minutes>
</no-tx-connection-factory>
</connection-factories>

Also, on JBoss you should use "java:eis/JPPFConnectionFactory" for the JNDI name of the connection factory, instead of "eis/JPPFConnectionFactory".
To get a connection from the connection factory, I use the following code:

Code: [Select]

public JPPFConnection getConnection() throws Exception
{
  Object objref = ctx.lookup("java:eis/JPPFConnectionFactory");
  JPPFConnectionFactory cf;
  if (objref instanceof JPPFConnectionFactory) cf = (JPPFConnectionFactory) objref;
  else cf = (JPPFConnectionFactory) javax.rmi.PortableRemoteObject.narrow(objref, ConnectionFactory.class);
  return (JPPFConnection) cf.getConnection();
}

Can you try this and let us know if that works?

Thanks,
-Laurent

anand6998 · « **Reply #2 on:** January 17, 2012, 03:41:16 PM »

Laurent

Thank you for your prompt reply. I got through these problems yest night, exactly as you described.
I am getting a curious error now

I have the following code
JPPFConnection connection = (JPPFConnection) factory.getConnection();

and it throws the following error

java.lang.ClassCastException org.jppf.jca.cci.JPPFConnectionImpl cannot be cast to org.jppf.jca.cci.JPPFConnection

I have the following files in my application war file
jppf-j2ee-client.jar
jppf-jca.jar

and
jppf_ra_JBoss.rar
in server/default/deploy

I have tried a few things - but it doesn't go away.

Thanks
Amit

lolo · « **Reply #3 on:** January 17, 2012, 04:39:11 PM »

Hi Amit,

You should remove jppf-jca.jar from your war file, this is what's causing the ClassCastException, because the class JPPFConnectionImpl is already loaded by the class loaded of the resource adapter.

Sincerely,
-Laurent

anand6998 · « **Reply #4 on:** January 17, 2012, 05:07:03 PM »

I tried that. It's complaining about not finding JcaSerializationHelperImpl. I do have jppf-j2ee-client.jar in the following structure
OptionPricingService.war
- WEB-INF/lib
- jppf-j2ee-client.jar

I have tried putting this in the manifest.mf file
- META-INF/
- MANIFEST.MF
Class-Path: lib/jppf-j2ee-client.jar

Seems not to be helping

Thanks a lot
Amit

lolo · « **Reply #5 on:** January 17, 2012, 08:32:59 PM »

AMit,

The packaging you describe should work (apart from the Class-Path in the mamnifest, which is not needed).
I have attached a .war that works in my environment (I used JBoss 5.1), and which should work the same in yours. It's the same thing as the demo .ear file in the JPPF distribution, except that it's packaged as a webapp.

Can you try it and lety us know if it works for you?

It that still doesn't work, could you please post the full stack trace of the exception you are getting? You should have it in the server.log file of your JBoss server.

Thanks,
-Laurent

anand6998 · « **Reply #6 on:** January 18, 2012, 12:32:37 AM »

Laurent

The jppftest.war app works fine. I am at a loss as to what the issue is - I have tried multiple ways of specifying the jppf-j2ee-client dependency. I would like to send you my .war file for examination. However, its 12 MB in size so I cannot attach it here.

The architecture looks like this

web service client (soap) -> web service (apache cxf ) -> jppf grid.

Thanks
Amit

anand6998 · « **Reply #7 on:** January 18, 2012, 12:41:27 AM »

server log attached

lolo · « **Reply #8 on:** January 18, 2012, 05:59:38 AM »

Amit,

In the server log, I'm seeing the following at line 100:

18:37:47,717 ERROR [STDERR] log4j:ERROR A "org.jboss.logging.appender.FileAppender" object is not assignable to a "org.apache.log4j.Appender" variable.
18:37:47,717 ERROR [STDERR] log4j:ERROR The class "org.apache.log4j.Appender" was loaded by
18:37:47,717 ERROR [STDERR] log4j:ERROR [WebappClassLoader
delegate: false
repositories:
/WEB-INF/classes/
----------> Parent Classloader:
java.net.FactoryURLClassLoader@4bb8d481
] whereas object of type
18:37:47,717 ERROR [STDERR] log4j:ERROR "org.jboss.logging.appender.FileAppender" was loaded by [org.jboss.system.server.NoAnnotationURLClassLoader@2586db54].
18:37:47,717 ERROR [STDERR] log4j:ERROR Could not instantiate appender named "FILE".

This shows you have a log4j.jar in your WEB-INF/lib, but there is already one in JBOSS_HOME/server/default/lib. So I believe you should remove log4j from your .war if you want logging to work in your application.

So this leads me to think there is yet another class loder issue with the jppf deployment. Could you confirm that you do not have any jppf jar in your server's lib directory?
Also, could you configure additional logging for the JPPF classes, as follows:
- open the file "JBOSS_HOME/server/default/conf/jboss-log4j.xml"
- add the following:

Code: [Select]

<category name="org.jppf">
   <priority value="INFO"/>
</category>

<category name="org.jppf.client">
   <priority value="DEBUG"/>
</category>

<category name="org.jppf.jca">
   <priority value="DEBUG"/>
</category>

- restart JBoss, test and send the resulting server.log

Lastly, while I was at I also saw this at line 99:

18:37:47,492 INFO [WebappClassLoader] validateJarFile(C:\Amit\Programs\jboss-4.2.2.GA\server\default\.\tmp\deploy\tmp7616427474526753763OptionPricingService-exp.war\WEB-INF\lib\geronimo-servlet_2.5_spec-1.2.jar) - jar not loaded. See Servlet Spec 2.3, section 9.7.2. Offending class: javax/servlet/Servlet.class

This means you shouldn't include geronimo-servlet_2.5_spec-1.2.jar in your war. I believe it is a build-time dependency, but it doesn't have to be deployed with your application because it's already provided by the server.

Sincerely,
-Laurent

anand6998 · « **Reply #9 on:** January 19, 2012, 01:53:56 AM »

Hi Laurent

I made the suggested changes. The server log is attached.

In WEB-INF/lib I have the following jars
cxf-api-2.4.0
cxf-common-utilities-2.4.0
cxf-rt-bindings-soap-2.4.0
cxf-rt-core-2.4.0
cxf-rt-databinding-jaxb-2.4.0
cxf-rt-frontend-jaxws-2.4.0
cxf-rt-frontend-simple-2.4.0
cxf-rt-transports-common-2.4.0
cxf-rt-ws-addr-2.4.0
cxf-tools-common-2.4.0
jppf-j2ee-client
neethi-3.0.0
spring-aop-3.0.5.RELEASE
spring-asm-3.0.5.RELEASE
spring-beans-3.0.5.RELEASE
spring-context-3.0.5.RELEASE
spring-core-3.0.5.RELEASE
spring-expression-3.0.5.RELEASE
spring-web-3.0.5.RELEASE
xml-resolver-1.2
xmlschema-core-2.0

Thank you very much for your help
Amit

lolo · « **Reply #10 on:** January 19, 2012, 05:45:40 AM »

Hello Amit,

Thank you for sending the log.
From this log, I can see the following each time a job is submitted:

2012-01-18 19:50:54,502 DEBUG [org.jppf.client.loadbalancer.LoadBalancer] adding request class loader=org.jboss.mx.loading.UnifiedClassLoader3@5ca3ce3f{ url=file:/C:/Amit/Programs/jboss-4.2.2.GA/server/default/tmp/deploy/tmp6530266190984327047jppf_ra_JBoss.rar ,addedOrder=38} for uuid=0d5c1c2e386fe534c7a6731982bf0ae6

This shows that the classes of your task(s) are loaded by the class loader of the JPPF resource adapter, which is not right. They should be loaded by the class loader for your web app.
Did you package your classes in the .rar file, or deploy them in C:/Amit/Programs/jboss-4.2.2.GA/server/default/lib?

Thanks,
-Laurent

anand6998 · « **Reply #11 on:** January 20, 2012, 03:29:55 PM »

I did the following steps
- deleted existing jboss deployment
- redeployed jboss (unzipped jboss-4.2.2.GA.zip
- added extra jppf logging to server/default/conf/jboss-log4j.xml
<category name="org.jppf">
<priority value="INFO"/>
</category>

<category name="org.jppf.client">
<priority value="DEBUG"/>
</category>

<category name="org.jppf.jca">
<priority value="DEBUG"/>
</category>
- deployed these files to server/default/deploy
a. jppf_ra_JBoss.rar
contents
jppf-client.jar
jppf-common.jar
jppf-common-node.jar
jppf-jca.jar
slf4j-api-1.6.1.jar
slf4j-log4j12-1.6.1.jar
jndi.properties

b. jppf-ra-JBoss-4.0-ds.xml
c. OptionPricingService.war (This is my application)

It throws the same error.
The server log is attached.

Thanks
Amit

lolo · « **Reply #12 on:** January 21, 2012, 08:43:00 AM »

Hi Amit,

Thanks for sending the files.

I'm seeing two potential issues in your class TemplateApplicationRunner

1) you have the following:

Code: [Select]

private JPPFClient client = null;

public TemplateApplicationRunner()
{
  client = new JPPFClient();
}

This initializes a J2SE client, which you don't need, since the JPPF .rar includes its own implementation of the JPPF client for J2EE managed environments.
So I would remove this part of the code and just have an empty no-args constructor.

2) In the code that submits the job, I can see:

Code: [Select]

...
String submitID = connection.submitNonBlocking(job, null);
//close the connection
connection.close();

connection = getConnection();
SubmissionStatus status = connection.getSubmissionStatus(submitID);
...

Here, you are submitting the job properly, but you process the results immediately thereafter. The problem is that the job submission is asynchronous, so the job status will probably be PENDING or EXECUTING and your code will process the results and exit the method before the job is actually executed. I believe this is what's causing the class loader problem.

So instead, I would wait for the results of the job and then process the results, as follows:

Code: [Select]

...
String submitID = connection.submitNonBlocking(job, null);
// wait until the job has finished executing and returned the results
List<JPPFTask> results = connection.waitForResults(submitID);
SubmissionStatus status = connection.getSubmissionStatus(submitID);
//... now process the results ...

Could you please make this change and let us know if this resolves the problem?

Thanks,
-Laurent

anand6998 · « **Reply #13 on:** January 21, 2012, 06:19:38 PM »

Hi Laurent

Thanks very much for taking a look. I have made the necessary changes. However, it still seems to be throwing the same error. The relevant files are attached.

Thanks
Amit

lolo · « **Reply #14 on:** January 23, 2012, 11:28:41 AM »

Hi Amit,

I finally identified this as a bug in the JPPF client: 3477658 - Client uses wrong classloader when task is JPPFAnnotatedTask

Basically, what happens is that your task is actually a Callable. However in the JPPF job it is wrapped as a JPPFAnnotatedTask. The problem is that the client uses the class loader for JPPFAnnotatedTask (which is the .rar class loader) instead of the one for the actual wrapped task object.

I have implemented a fix, would you mind giving it a try? Just download this file: http://www.jppf.org/private/jppf_ra_JBoss.rar , and replace your existing JPPF .rar in your JBoss deployment folder with it, then restart the server.

I tested on my side and could check that your web service works when invoking it from SoapUI.

Upon your confirmation that it works, I will publish an official patch.

Sincerely,
-Laurent

anand6998 · « **Reply #15 on:** January 24, 2012, 02:11:50 AM »

Hi Laurent

Thank you very much for identifying the issue. I am seeing the following error when I install your .rar file.

2012-01-23 20:05:59,876 DEBUG [org.jppf.client.JPPFMulticastReceiverThread] Found connection information: JPPFConnectionInformation[uuid=A24EC7D26B2189A80BEAE404AB691338, host=192.168.1.65, management=11198, recoveryPort=-1]
2012-01-23 20:05:59,882 ERROR [org.jppf.client.JPPFMulticastReceiverThread]
java.lang.NullPointerException
   at org.jppf.jca.work.JPPFJcaClientConnection.<init>(JPPFJcaClientConnection.java:62)
   at org.jppf.jca.work.JPPFJcaClient.createConnection(JPPFJcaClient.java:122)
   at org.jppf.client.AbstractGenericClient.newConnection(AbstractGenericClient.java:206)
   at org.jppf.client.AbstractGenericClient$1.onNewConnection(AbstractGenericClient.java:142)
   at org.jppf.client.JPPFMulticastReceiverThread.onNewConnection(JPPFMulticastReceiverThread.java:120)
   at org.jppf.client.JPPFMulticastReceiverThread.run(JPPFMulticastReceiverThread.java:98)
   at java.lang.Thread.run(Thread.java:619)

The server log is attached.

Thanks
Amit

lolo · « **Reply #16 on:** January 24, 2012, 07:43:33 AM »

Hi Amit,

I'm so sorry, I uploaded the .rar for the upcoming JPPF 3.0 instead of the one I fixed for v2.5.5 (you can check the version in the META-INF/MANIFEST.MF of the rar file)
I've replaced it with the correct version and you can download it from the same location.

-Laurent

anand6998 · « **Reply #17 on:** January 24, 2012, 04:41:06 PM »

Hi Laurent

I am still getting the class loading error. However, it seems to work if I copy jppf-j2ee-client.jar into server/default/lib. After this the communication works correclty but while the option value computes correctly on the grid node - I never see that value come back from TemplateApplicationRunner. I tried putting some logging statements into TemplateApplicationRunner and I see that after connection.waitForResults() the call to connection.getSubmissionStatus() returns PENDING. Not sure why this is happening because after waitForResults() I expect only COMPLETE and FAILED.

Thanks a lot
Amit

lolo · « **Reply #18 on:** January 25, 2012, 08:46:16 AM »

Hi Amit,

I don't see why you're still getting the error. Can you confirm that you downloaded the .rar again? Could you check that its META-INF/MANIFEST.MF has the following information:
JPPF-Version: 2.5.5
JPPF-Build: 0615
JPPF-BuildDate: 2012-01-23 11:14 CET

Also, could you try with my version of the web service? I have uploaded it here: http://www.jppf.org/private/x-testoptionpricer.zip. It's the initial version of your code, with the modifications I was suggesting earlier.

To build the war file: unzip, open a command prompt at the root, then run the Ant script: "ant build"
On my machine, once the server is started, I import the WSDL into SoapUI from this URL: http://localhost:8080/OptionPricingService/service/optionPricerService?wsdl
Then I can send a request and get a response from the service.

Can you try this and let us know of the outcome?

Thanks,
-Laurent

anand6998 · « **Reply #19 on:** January 25, 2012, 04:34:14 PM »

Hi Laurent

Using the files provided by you I am still getting the same error. I noticed you were using JBoss 4.2.3 so I upgraded to that version but still get the error.

The server log is attached.

Thanks
Amit

lolo · « **Reply #20 on:** January 25, 2012, 06:55:45 PM »

Amit,

It looks like you're still using the old version of the jppf_ra_JBoss.rar. Could you check that, as I recommended in my previous post (looking in the manifest file)?
I'm also attaching:
- the jboss-log4.xml I use (removes DEBUG info for JBoss and Arjuna classes, and adds method names and line numbers)
- a server log that shows a successful web service invocation in my environment, so you can compare

Thanks,
-Laurent

anand6998 · « **Reply #21 on:** January 25, 2012, 07:13:01 PM »

Hi Laurent

I created a fresh install on a different PC today morning and downloaded all the files from your messages, and still get the same error. I have shared my jppf_ra_JBoss.rar file on google docs with you

Thanks
Amit

anand6998 · « **Reply #22 on:** January 25, 2012, 08:12:36 PM »

Hi Laurent

I cannot make out if you are getting a valid option value from your log file (the value is 0 in your log file)

can you use S=10, K=10, riskfreerate = 0.05, TimeToExpiry = 1, Volatility=.3

and see the value you get in the response.

Thanks
Amit

lolo · « **Reply #23 on:** January 25, 2012, 08:49:18 PM »

Hi Amit,

I tried with the vvalues you specified. I also added a few print statements to see what's going on.
In the web service response, the option value is 0, but I can see that the the task is executed in the node and it computes a value of 1.1342020640681252.
Another thing I can see is that upon returning from connection.waitForResults() the job status is PENDING, but it should be COMPLETE. I'm looking into that and will update you soon.

-Laurent

anand6998 · « **Reply #24 on:** January 25, 2012, 08:51:25 PM »

I get this exact behavior when I copy the jppf-j2ee-client.jar into server/default/lib directory which I outlined in my earlier post.

Thanks
Amit

The open sourcegrid computingsolution

Author Topic: JBoss JPPF JCA connector issue (Read 16442 times)

The open source
grid computing
solution