GitHub - plinde/elastic-compare-index-data: Mix of bash/python scripts to compare arbitrary field values between two time-series indices

plinde / elastic-compare-index-data Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Mix of bash/python scripts to compare arbitrary field values between two time-series indices

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
.gitignore		.gitignore
README		README
json-compare-engine.props		json-compare-engine.props
json-compare-engine.py		json-compare-engine.py
requirements.txt		requirements.txt
run.sh		run.sh
setenv.sh.template		setenv.sh.template

Repository files navigation

pre-reqs:
curl
jq - https://stedolan.github.io/jq/
jo - https://github.com/jpmens/jo

1. populate your Elasticsearch cluster connection info in your shell's env vars OR run setenv.sh
2. ./run.sh (currently hard-coded to use 'index' and 2016-04.10, 2016.04.11 as hard-coded values)

setenv.sh - environment variables for run.sh and descedents. this file does NOT go into source control, see .gitignore
setenv.sh.template - template kept in source control, copy this to setenv.sh and populate with your environment
run.sh - main shell script to execute the comparison job
requirements.txt - for 'python pip install -f;
json-compare-engine.props - properties file, using Python ConfigParser format
json-compare-engine.py - main python comparison class
data - temporary data workspace, gets auto-created if it doesn't exist