JPPF, java, parallel computing, distributed computing, grid computing, parallel, distributed, cluster, grid, cloud, open source, android, .net
JPPF

The open source
grid computing
solution

 Home   About   Features   Download   Documentation   Forums 
October 18, 2019, 03:29:37 PM *
Welcome,
Please login or register.

Login with username, password and session length
Advanced search  
News: New users, please read this message. Thank you!
  Home Help Search Login Register  
Pages: [1]   Go Down

Author Topic: Rate Limiting?  (Read 541 times)

leftwing47

  • JPPF Padawan
  • *
  • Posts: 2
Rate Limiting?
« on: July 16, 2015, 03:47:53 PM »

Hi,

I'm a JPPF newbie, but have had some grid experience in the past. Do you have any tips or suggestions on rate-limiting requests to nodes? I've a use case that requires quite strict control over how many requests are sent from a particular node IP address over a period of time. Basically, let's say I wanted to send 1 http request through a particular node IP address with a minimum 5 second gap?

I understand the load balancing angle, so assume this would be managed somehow through that, but wondered if anyone else has come across this kind of requirement?

Congratulations though: JPPF looks like a great project and I'm looking forward to investigating its potential!
Logged

lolo

  • Administrator
  • JPPF Council Member
  • *****
  • Posts: 2256
    • JPPF Web site
Re: Rate Limiting?
« Reply #1 on: July 22, 2015, 06:55:16 AM »

Hello,

The load-balancing merely determines how many tasks from a job can be sent at once to a node, thus I believe it is way too coarse for your requirement. It seems to me that the rate-limiting would best be done in your own code and invoked explicitely from your tasks. For example, you could implement a service based on an executor that will queue the HTTP requests and execute them at the desired rate, even when multiple tasks execute in parallel in the same node. This doesn't require any specific configuration of the grid and provides the most flexibility.

Sincerely,
-Laurent
Logged

leftwing47

  • JPPF Padawan
  • *
  • Posts: 2
Re: Rate Limiting?
« Reply #2 on: August 06, 2015, 08:33:38 AM »

Thanks for the reply Laurent - very helpful!
Logged
Pages: [1]   Go Up
 
JPPF Powered by SMF 2.0 RC5 | SMF © 2006–2011, Simple Machines LLC Get JPPF at SourceForge.net. Fast, secure and Free Open Source software downloads