Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

any benchmarks against mysql / redis / rocksdb etc? #939

Open
superdolt opened this issue Aug 12, 2021 · 1 comment
Open

any benchmarks against mysql / redis / rocksdb etc? #939

superdolt opened this issue Aug 12, 2021 · 1 comment

Comments

@superdolt
Copy link

just curious, any benchmarks for disk space size used, memory used, and processing time compared with some popular databases?

what differentiates mldb from the other mainstream dbs?

@jeremybarnes
Copy link
Contributor

MLDB is designed for machine learning workloads, it's not a general purpose DB. It is designed to run in parallel with the systems you mention, not to replace them as a primary database or caching mechanism.

The system design has connectors for these kinds of DBs, but very few have been implemented yet. Currently, it's best to loosely couple the systems, by appending transaction deltas or updates or logs to a file which is them imported into MLDB for the machine learning part, or by using a live dataset which appends as you go.

That being said, for storing the kind of data you run on in machine learning (logs of all of the state changes of a system), it can be highly efficient, especially the behavior and tabular storage engines.

Do you have a use-case or is it a more general question?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants