gis-spark

Spark extension for normal spatio-temporal data analysis.

This project aims to make the most out of spark framework for professional GIS operations.

Unlike the previous framework (like GeoSpark, SpatialHadoop, etc), we hope that our framework's semantics are more in line with the world view of GIS.

This repository is still under developing.

Spatio-temporal Data Reader and Writer for Layer (JavaPairRDD actually)：

• Postgis

• CSV File(geometry in wkt)

• Shp (only reader yet)

• MongoDB (only writer yet)

• ES

• MySQL

• Platform Reader (api for read data for our big spatio-temporal data analysis cloud platform)

• layer transform to Dataset

Gis Functions：

1. Layer type preserved function

• Transformation
• Layer shift
• Polygon makevalid

2. Layer type changed funcion

• Buffer

3. Layer interaction function

• clip
• intersect
• erase

4. Layer visualization

• Pyramid Tile Set (Static)
• Vector Pyramid Tile Set
• Heatmap

5. Models

• Clip Model
• Intersection Model
• Erase Model

6. StorageHelper

Stream Reader for multiple data storage backend

• MysqlHelper
• PgHelper
• Local File Data Reader
• Local Shp File Data Reader

7. Spatial Index

Distribute Spatial Index (RDD Partitioner)

• QuadTree

Inner Spatial Index (RDD Parition's Index)

• RTree