This is a demo script with a self-contained and tested Matlab script showing the power of D4M on historical Baseball data. There are three parts:
- Parsing data into a form ready for ingestion
- Ingesting data into memory or an Accumulo Table
- Querying data to answer several questions of interest
The goal is to provide a complete, well-documented example demonstrating how to use D4M for data analysis on a data set of manageable size. The techniques presented will scale to true big data scenarios.
Please check out David's project here for a lower level perspective of how the D4M Schema works from Accumulo mutation logs.
D4M is available open source under the GPLv2 license.
The data source is the Sean Lehman baseball data set, 2012 version, released under the CC BY-SA 3.0 license.