JPPF, java, parallel computing, distributed computing, grid computing, parallel, distributed, cluster, grid, cloud, open source, android, .net
JPPF

The open source
grid computing
solution

 Home   About   Features   Download   Documentation   On Github   Forums 
May 30, 2023, 06:32:43 AM *
Welcome,
Please login or register.

Login with username, password and session length
Advanced search  
News: New users, please read this message. Thank you!
  Home Help Search Login Register  
Pages: [1]   Go Down

Author Topic: Loading balance strategy  (Read 4696 times)

ygzx_114

  • Guest
Loading balance strategy
« on: December 22, 2011, 08:43:45 AM »

hello
     1.  I found the default algorithm is proportional whit strategy "test". it will calc 1 tasks first, and according to the calc time,  distribute tasks to different nodes. if I want each node calc 2 tasks first, then evalute the calc ability. which parameter can I adjust?
    2.  when I ran a job with 4 nodes connects to the server, I found that one node calc half of the tasks, and some nodes calc only a few tasks.  how can I adjust the profile to improve this situation. or where can I find the document abount adjust the Loading balance strategy profile.
    3.  When I change the  load balancing algorithm to manual and ant the drive,then restart the drive, but at the JPPF Monitoring and Administration tools, I can see that the algorithm is still proportional, How can I change the  load balancing algorithm ?

    Thanks for your time,
    DoubleT
   
« Last Edit: December 28, 2011, 03:53:25 AM by ygzx_114 »
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2272
    • JPPF Web site
Re: Loading balance strategy
« Reply #1 on: December 29, 2011, 08:02:55 AM »

Hello,


Quote
1.  ... if I want each node calc 2 tasks first, then evalute the calc ability. which parameter can I adjust?

This is not yet possible in JPPF 2.5. It will be in JPPf 3.0 which is due soon, see this feature request: 3315028 - Configurable initial bundle size for proportional algorithm

Quote
2.  ...  how can I adjust the profile to improve this situation. or where can I find the document abount adjust the Loading balance strategy profile.

You can take a look at this old section of the documentation: http://www.jppf.org/doc/v2/index.php?title=JPPF_Performance
It's a little out of date, but the description of the "manual", "proportional" and "autotuning" algorithms is still valid.
Don't forget that for "proportional", the number of tasks sent to each node is computed based on the past performance of the node. This implicitly includes the node's hardware capabilities (CPU/cores) as well as the quality of the network connection between node and server. For instance if you have 2 identical node, but the network connection is slow between one of them and the server, then the server will send more tasks to the node with the fastest connection.

Quote
3. ... but at the JPPF Monitoring and Administration tools, I can see that the algorithm is still proportional, How can I change the  load balancing algorithm ?

In the load balancing panel, there is a "Refresh settings" button, have you used it? It should refresh the values in the admin console with those in the server.

Sincerely,
-Laurent
Logged

ygzx_114

  • Guest
Re: Loading balance strategy
« Reply #2 on: December 30, 2011, 08:52:47 AM »

Hello Laurent,
   Thanks for your replying.
     the third question. I have used the "Refresh settings" button in the load balancing panel.
      I tried to restart the JPPF Monitoring and Administration tools, It's also no used.
     Additional, I changed the  load balancing algorithm  to "manual" in the load balancing panel, and used "Apply settings" button, then "Refresh settings", the load balancing algorithm back to "proportional".

    Sincerely,
 -DoubleT
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2272
    • JPPF Web site
Re: Loading balance strategy
« Reply #3 on: January 02, 2012, 07:43:53 AM »

Hi DoubleT,

Indeed, this is a bug in the server's management MBean, which always returns the load-balancing parameters read from the server's configuration, instead of those set from the admin console.
So the information displayed in the console in incorrect, however the new parameters you set from the console are really taken into account by the server.
I registered a bug for this:  3468321 - JMX does not return the latest load-balancer information.
I will let you know when it is fixed, and make a patch for JPPF 2.5.5.

Sincerely,
-Laurent
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2272
    • JPPF Web site
Re: Loading balance strategy
« Reply #4 on: January 02, 2012, 08:02:10 AM »

Hello again,

This bug has now been fixed, and a patch is available there.
Please let us know if this works for you.

Sincerely,
-Laurent
Logged

ygzx_114

  • Guest
Re: Loading balance strategy
« Reply #5 on: January 04, 2012, 02:44:41 AM »

Hello Laurent,
      Thanks for fix the bug so quickly.
      I used the patch and it works now.
     There still two questions, I changed the  parameters in the load balancing panel, and used "Apply settings" button, then "Refresh settings", I can see it's changed in the console. But It's not change in the driver config file, when I restart the driver and "Refresh settings", the parameters will go back. Does this normally?
     In the Topology panel of the console, the number of Task Executed is always 0, while it record task executed before.
       Sincerely,
 -DoubleT




« Last Edit: January 04, 2012, 04:23:56 AM by ygzx_114 »
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2272
    • JPPF Web site
Re: Loading balance strategy
« Reply #6 on: January 09, 2012, 07:20:51 AM »

Hi DoubleT

For you first question, yes it is normal. The configuration file is never changed. This si the way the code is designed, because there are cases when it's not possible to change it, for instance when the config file is within a jar file (or a war file for the Tomcat connector), or when you use a configuration plugin (with -Djppf.config.plugin=my.own.ConfigurationSource).

For the other issue, I cannot reproduce this behavior. Are you seeing any error or exception in the admin console log file or in the node log file?

Thanks,
-Laurent
Logged

ygzx_114

  • Guest
Re: Loading balance strategy
« Reply #7 on: January 10, 2012, 07:45:23 AM »

Hello Laurent,
      I don't see any error and exception in the admin console log file and in the node log file. I'm confused about this these days.

      There is another question about load-balancing algorithm, In my opinion, the algorithm which can makes all nodes work until the job end is best. So the "Manual" algorithm with the "size = 1" is the best algorithm. Dose this right?
      I had a try with the  "Manual" and "proportional" algorithm, "proportional" algorithm took 2720 seconds. more then "Manual"  algorithm, the Statistical data of "Manual"  algorithm as follows:
      strategy.test.size       1         2             5           10         15          20
             time               1610s   2049s     2102s     2377s      2350s      2439s
     
Sincerely,
 -DoubleT
« Last Edit: January 16, 2012, 11:31:32 AM by ygzx_114 »
Logged
Pages: [1]   Go Up
 
JPPF Powered by SMF 2.0 RC5 | SMF © 2006–2011, Simple Machines LLC Get JPPF at SourceForge.net. Fast, secure and Free Open Source software downloads