Skip to content

A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.

Notifications You must be signed in to change notification settings

lukasnalezenec/hive-json

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hive JSON Schema Finder

This project is a rough prototype that I've written to analyze large collections of JSON documents and discover their Apache Hive schema. I've used it to anaylyze the githubarchive.org's log data.

To build the project, use Maven (3.0.x) from http://maven.apache.org/.

Building the jar:

% mvn package

Run the program:

% bin/find-json-schema *.json.gz

I've uploaded the discovered schema for githubarchive.org to https://gist.github.com/omalley/5125691.

About

A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 93.0%
  • Python 7.0%