NAME

Wubot::Reactor::WebFetch - fetch data from a URL

VERSION

version 0.2_002

SYNOPSIS

    - name: fetch 'body' field from the 'link' field
      plugin: WebFetch
      config:
        field: body
        url_field: link

DESCRIPTION

A reactor plugin that can fetch data from a URL and store the retrieved content on a field on the message.

This plugin is great for fetching the complete article for the body of an RSS feed when the feed only provides a summary of the article.

The 'url' may be defined in the config, or else a 'url_field' may be configured so that the link can be pulled from the message. The retrieved content is stored on the message in the configured 'field'.

If an error occurs, the error will be logged at 'error' level.

The retrieved content will be utf8 decoded.