Daisuke Maki
and 1 contributors

NAME

Gungho::Component::Throttle::Provider - Throttle Calls To The Provider

SYNOPSIS

  components:
    - Throttle::Provider
  throttle:
    provider:
      max_requests: 10

DESCRIPTION

This module is still experimental. Use at your own peril.

Often times it is more conveinient to throttle the number of times the Provider is invoked to fetch the next request than for the provider to keep tabs of how many requests it has sent so far.

This component keeps track of how many URLs have gone through send_request() and back to handle_response(), and will prevent Gungho from calling the provider to fetch the next request.

METHODS

setup

dispatch_requests

Averts calling the actual dispatch_requests when there are more requests than specified by max_requests in the system.

send_request

handle_response

increment_request_count

decrement_request_count