The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

Changes for version 7.9

  • Change: f386e7003a442a0419fc62aa30d576312afa9efa Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-30 11:19:09 +0000
    • Release 7.9
    • Fix timeout handling * Allow for connection preferences into the `meta` settings section * Allow `_id` to be shown by `es-search.pl` * Look in `~/.config` for `es-utils.yaml` * Started some work on library for handling aggregation queries
  • Change: ba56db091ef15fd365100e034b17a8de530333e6 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-14 15:07:21 +0000
    • WIP: Substantial progress on the multi level aggregation script
  • Change: 5c2517a1264b4a381b11387125e63dada6fcef2a Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-08 14:50:45 +0000
    • Adding es-aggregate.pl script
    • `es-search.pl` has a lot of cruft. Creating `es-aggregate.pl` as a proof-of-concept starting from a clean slate to see if I can make the code more readable and more reusable. The idea being to push this code back into the library to make working with aggregations easier and cleaner.
  • Change: cfd98ad2e84ee1ea8791debe7f6e1809bd6a9af6 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-08 07:34:21 +0000
    • Move the aggregation parsing out to it's own sub
    • This is a long time coming, the handling of aggregations needs a major cleanup. First step is to break things up into more parseable blocks.
  • Change: ea453e9190173af63adce15b684dcad13e3b13c5 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-08 07:15:14 +0000
    • Pass timeout to the object creation
    • When converting to `App::ElasticSearch::Utilities::Connection`, I mistakenly removed the pass through of the `--timeout` parameter to the object creation. This restores the timeout capability.
  • Change: c8f664cfb09b928831945f82607eab5830faa066 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-08 07:14:50 +0000
    • Allow HTTP username/password in meta
    • The previous commit allowed overriding the destination for the connection. This allows users to override the HTTP basic auth username/password.
    • ```yaml host: es-main.int.example.com meta:
    • access:
    • timestamp: t
    • security:
    • timestamp: @timestamp
    • host: es-security.int.example.com
    • proto: https
    • http-username: bob
    • password-exec: ~/bin/get-es-security-password.sh ```
  • Change: 7c56813974cc069a6214daef8667551a8d31de65 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-07-08 06:55:14 +0000
    • Added connection details to the meta section
    • This update allows the metadata in the `~/.es-utils.yaml` file to include the `host`, `port`, and `proto`.
    • Example:
    • ```yaml host: es-main.int.example.com port: 80 meta:
    • security:
    • host: es-security.int.example.com
    • port: 443
    • proto: https ```
  • Change: 797199f7af436597ffa67c486d5ea275b825e471 Author: Matthew Feinberg <mattf@intex.com> Date : 2021-06-24 14:03:07 +0000
    • For es-search.pl allow _id to be shown as a column when using --show and display _id when showing full result records.
  • Change: 6547b9893ad05e7cef565f4a2caf51b321091de0 Author: Andrei Grechkin <andrei.grechkin@booking.com> Date : 2021-06-11 10:11:34 +0000
    • Add support for the XDG Base Directory Specification
    • Support configuration file placed in `$XDG_CONFIG_HOME/es-utils/config.yaml`
  • Change: 0f799636f22bf8bff51c25a890f12341f6f7b9d7 Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-06-05 14:57:35 +0000
    • Fix warning in es_request()
    • When the index is undefined, the code throws a warning.
  • Change: fa084386a44bbda1a75ee961f8ea6228ab62fe0c Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2021-03-20 17:17:13 +0000
    • The GitHub::Meta plugin stopped working and needed configuration
  • Change: c118b27b05d5e5e75b444b9537362d78e099176f Author: Brad Lhotsky <brad@divisionbyzero.net> Date : 2020-10-08 13:42:10 +0000
    • Fix warnings when we encounter an unallocated shard

Documentation

Allow easy alias management for daily indexes
Run to apply a JSON list of settings to indexes matching a pattern
Copy an index from one cluster to another
Run to prune old indexes and optimize existing
Dynamically gather metrics and send to graphite
Report and manage index blocks
ElasticSearch Nagios Checks
Listing the nodes in a cluster with some details
Open any closed indices matching your paramters.
Provides a CLI for quick searches of data in ElasticSearch daily indexes
Simple ElaticSearch Status Checks
Index Storage Overview by Index Name without Dates

Modules

Utilities for Monitoring ElasticSearch
Code to simplify creating and working with Elasticsearh aggregations
Abstract the connection element
Allow for strange content elements for Elasticsearch APIs
Object representing ES Queries
Provides a prefix of '=' to use the term filter
Mostly fixing case and tracking dangling words
Build a terms query from unique values in a column of a file
Expand IP CIDR Notation to ES ranges
Implement the proposed Elasticsearch nested query syntax
Moo::Role for implementing QueryString Plugins
Implement parsing comparison operators to Equivalent Lucene syntax
Fix version issues to support all the things
Types for working with ElasticSearch