Data Loading and Processing

Project χ (via the chi-datapackage module) uses a loose implementation of the Open Knowledge Labs’s Data Packages specifications as a common format for loading and preprocessing datasets. The OKFN’s Data Package, Tabular Data Package, and JSON Table Schema allow storage of data sets in various formats with defined data transformations in order to get data into a Project χ application in a usable form. In fact, for the most part, using the chi-datapackage services for data loading and type inference, data visualizations or applications developed within the Project χ framework don’t need to know anything about the format of the source data, be it CSV, TSV, JSON, or even YAML.