Skip to content

Parseable is a log analytics system written in Rust. It is built for high throughput log ingestion cases.

License

Notifications You must be signed in to change notification settings

nikhilsinhaparseable/parseable

 
 

Repository files navigation

Parseable
Cloud native log analytics

Parseable is a log analytics platform, built for the modern, cloud native era. Parseable uses a index-free mechanism to organize and query data allowing low latency, and high throughput ingestion and query.

To get started, download the Parseable binary from releases page ↗︎ and run it on your machine.

For comparison, Parseable consumes up to ~80% lower memory and ~50% lower CPU than Elastic for similar ingestion throughput. Read more in the benchmarks directory ↗︎.

For 🩺 commercial support and consultation, please reach out to us at sales@parseable.io ↗︎.

Parseable Console

⚡ Quickstart

Deploy Parseable in local storage mode with Docker.

docker run -p 8000:8000 \
  parseable/parseable:latest \
  parseable local-store

Once this runs successfully, you'll see dashboard at http://localhost:8000 ↗︎. You can login to the dashboard default credentials admin, admin.

To ingest data, run the below command. This will send logs to the demo stream. You can see the logs in the dashboard.

curl --location --request POST 'http://localhost:8000/api/v1/ingest' \
--header 'X-P-Stream: demo' \
--header 'Authorization: Basic YWRtaW46YWRtaW4=' \
--header 'Content-Type: application/json' \
--data-raw '[
    {
        "id": "434a5f5e-2f5f-11ed-a261-0242ac120002",
        "datetime": "24/Jun/2022:14:12:15 +0000",
        "host": "153.10.110.81"
    }
]'

🚀 Highlights

  • Choose storage backend - local drive or S3 (or compatible) object store.
  • Ingestion API compatible with HTTP + JSON output of log agents.
  • Query log data with PostgreSQL compatible SQL.
  • Single binary includes all components - ingestion, store and query. Built-in UI.

Enterprise ready

🎯 Motivation

Traditionally, logging has been seen as a text search problem. Log volumes were not high, and data ingestion or storage were not really issues. This led us to today, where all the logging platforms are primarily text search engines.

But with log data growing exponentially, today's log data challenges involve whole lot more – Data ingestion, storage, and observation, all at scale. We are building Parseable to address these challenges.

🏆 Contributing

Contribution guide ↗︎.

Alt

Contributors

Supported by

About

Parseable is a log analytics system written in Rust. It is built for high throughput log ingestion cases.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Rust 98.9%
  • Other 1.1%