adequate
adequate
adequate
adequate
 

JPPF, java, parallel computing, distributed computing, grid computing, parallel, distributed, cluster, grid, cloud, open source, android, .net
JPPF

The open source
grid computing
solution

 Home   About   Features   Download   Documentation   Forums 
November 22, 2017, 09:11:23 PM *
Welcome,
Please login or register.

Login with username, password and session length
Advanced search  
News: New users, please read this message. Thank you!
  Home Help Search Login Register  
Pages: [1]   Go Down

Author Topic: Job execution statistic persistance  (Read 510 times)

arefaydi

  • JPPF Master
  • ***
  • Posts: 27
Job execution statistic persistance
« on: June 22, 2017, 03:54:14 PM »

Hello,
Adaptive algorithms use statistics but when driver restarts or hardware failure, statistics will be gone and load balancing algorithm adaptation will be return to beginning.
  • Is it possible (and logical?) to save job execution statistics periodically and load them to same driver while restart or to another driver which already running?
  • Another idea, maybe sharing these statistics with peer drivers, so when one of them down, informations still exist on other peers and when it restarts or a new driver added as peer, it will start with existing statistics.
We are planning to use p2p because of the risk of a single point of failure, but progress of algorithm's learning important and it shouldn't reset each time the server reset. Maybe I'm wrong, but using common statistics between all peer drivers (even with drivers added lately) make sense to me.
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2208
    • JPPF Web site
Re: Job execution statistic persistance
« Reply #1 on: July 08, 2017, 06:38:42 AM »

Hello,

I apologize for this late answer.
I believe that being able to persist and reuse the state of the adapative load-balancers is an excellent idea. However, this feature is very far from trivial and I cannot promise an ETA any time soon. I registered this as a feature request for the upcoming JPPF 6.0: JPPF-511 Ability to persist and reuse the state of adaptive load-balancers

Thank you very much,
-Laurent
Logged
Pages: [1]   Go Up
 
JPPF Powered by SMF 2.0 RC5 | SMF © 2006–2011, Simple Machines LLC Get JPPF at SourceForge.net. Fast, secure and Free Open Source software downloads