Logsearch

A scalable stack of Elasticsearch, Logstash, and Kibana for your own BOSH-managed infrastructure.

BREAKING CHANGES

Logsearch < v23.0.0 was based on Elasticsearch 1.x and Kibana 3.

Logsearch > v200 is based on Elasticsearch 2.x and Kibana 4.

There is NO upgrade path. Sorry :(

Getting Started

This repo contains Logsearch Core; which deploys an ELK cluster that can recieve and parse logs via syslog that contain JSON.

Most users will want to combine Logsearch Core with a Logsearch Addon to customise their cluster for a particular type of logs. Its likely you want to be following an Addon installation guides - see below for a list of the common Addons:

• Logsearch for CloudFoundry

If you are sure you want install just Logsearch Core, read on...

Installing Logsearch Core

0. Upload the latest logsearch release from bosh.io...

    $ bosh upload release https://bosh.io/d/github.com/logsearch/logsearch-boshrelease
   

1. Customise your deployment stub:

   • Make a copy of templates/stub.$INFRASTRUCTURE.example.yml
   • Edit to match your IAAS settings

2. Generate a manifest

    $ scripts/generate_deployment_manifest $INFRASTRUCTURE logsearch-stub.yml > logsearch.yml
   

3. Deploy!

   $ bosh -d logsearch.yml deploy

Common customisations:

0. Adding new parsing rules:

    logstash_parser:
      filters: |
         # Put your additional Logstash filter config here, eg:
         json {
            source => "@message"
            remove_field => ["@message"]
         }
   

Release Channels

• The latest stable, final release is available on bosh.io
• develop - The develop branch in this repo is deployed to our test environments. It is occasionally broken - use with care!

License

Apache License 2.0