adequate
adequate
adequate
adequate
 

JPPF, java, parallel computing, distributed computing, grid computing, parallel, distributed, cluster, grid, cloud, open source, android, .net
JPPF

The open source
grid computing
solution

 Home   About   Features   Download   Documentation   Forums 
November 22, 2017, 11:42:02 AM *
Welcome,
Please login or register.

Login with username, password and session length
Advanced search  
News: New users, please read this message. Thank you!
  Home Help Search Login Register  
Pages: [1]   Go Down

Author Topic: JPPF Nodes Jobs execution are not in SYNC.  (Read 20 times)

kaala

  • JPPF Padawan
  • *
  • Posts: 4
JPPF Nodes Jobs execution are not in SYNC.
« on: November 07, 2017, 08:54:50 PM »

Hi,

I have configured one driver and six nodes for executing task paralley. Divided almost equal six task to six nodes, driver job is just to submit task to nodes and once done sent combined response to server. I have oracle coherence cache to hold data required for each nodes while executing task(each node reading data paralley from cache while executing task).

I'm facing issue nodes task execution are not in sync causing delay in overall JOB, some nodes are taking 30 minutes to finish task and some nodes are taking 5-6 hours(all nodes configuration is same).

Is there I'm missing any configuration or any settings from JPPF configuration side?

Thanks for your help in advance...
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2207
    • JPPF Web site
Re: JPPF Nodes Jobs execution are not in SYNC.
« Reply #1 on: November 08, 2017, 07:38:51 AM »

Hello,

Without knowing more about your tasks, and assuming all your nodes have a similar configuration and run on equivalent hardware, I would suggest to profile the "slow" nodes while they are executing tasks, using a Java profiler such as JProfiler or YourKit, to find out what is taking time during task execution (i.e. what are the execution hotspots).

If you do not have the possibility to perform profiling, then maybe you could instrument the code of the tasks to print or log timestamps or time measurements at meaningful points of their execution.

The goal is to be able to narrow down the performance bottleneck and figure out which component is causing it, either JPPF, Coherence, your code, Java, etc ...

Sincerely,
-Laurent
Logged

kaala

  • JPPF Padawan
  • *
  • Posts: 4
Re: JPPF Nodes Jobs execution are not in SYNC.
« Reply #2 on: November 08, 2017, 05:33:19 PM »

Hi,

Thanks for quick reply, I will check with most possible way to identify component causing performance issue.

I have one more question, currently I have configured heap size to 4GB using this property max.memory.option =4096 in jppf-node.properties. But when I'm starting the node it is taking only 2GB as max heap size. May I know whether this property is used or not while starting node.

Node build.xml (No change in start scripts)

<!-- to run a single node -->
   <target name="run.node">
      <java fork="yes" classname="org.jppf.node.NodeLauncher" classpathref="run.classpath">
         <jvmarg value="-server" />
         <jvmarg value="-Xmx16m" />
         <jvmarg value="-XX:+UseLargePages" />
         <jvmarg value="-Dlog4j.configuration=log4j-node.properties" />
         <jvmarg value="-Djppf.config=jppf-node.properties" />
      </java>       
   </target>

If I'm passing max memory option as other.jvm.options = -Xms4096m -Xmx4096m in same property file it is taking max heap size as 4GB.

Thanks for your help in advance...

Thanks,
Kaala
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2207
    • JPPF Web site
Re: JPPF Nodes Jobs execution are not in SYNC.
« Reply #3 on: November 08, 2017, 05:55:22 PM »

Hi,

"max.memory.option" is not used any more. It was used in a very old version of JPPF years ago ...
You are correct that passing the -Xmx via the "jppf.jvm.options" property is now the proper way to do it.

Sincerely,
-Laurent
Logged
Pages: [1]   Go Up
 
JPPF Powered by SMF 2.0 RC5 | SMF © 2006–2011, Simple Machines LLC Get JPPF at SourceForge.net. Fast, secure and Free Open Source software downloads