The converter refines metadata and transforms it into 5-Star Linked Open Data. This is a publish-subscribe microservice design project via Spring Cloud and Java. The deployment of the project is based on docker-compose. Scaling can be configured manually.
The converter integrates the following OPAL components:
- Catfish (data-cleaner-service)
- Civet (quality-metrics-service)
- Metadata-Refinement (opal-confirm-conversion-service)
To build the project you must create a .env file and specify the required environment variables. Afterwards, by running the run.sh file it will build and setup the project. The configuration also includes the converter-configuration repository. For details, take a look into the wiki.
# Triplestore to read data
CRAWLER_TRIPLESTORE_URL=
CRAWLER_TRIPLESTORE_USERNAME=
CRAWLER_TRIPLESTORE_PASSWORD=
# Triplestore to write data
OPAL_TRIPLESTORE_URL=
OPAL_TRIPLESTORE_USERNAME=admin
OPAL_TRIPLESTORE_PASSWORD=
# Free to choose
RABBITMQ_USERNAME=
RABBITMQ_PASSWORD=
H2_DB_PASSWORD=
# Elasticsearch configuration for logging
ELASTICSEARCH_JAVA_OPTS=-Xms512m -Xmx512m
# Address to all files that need to be converted such as /opal-data/edp_20-04-2020
DATASET_FOLDER=
# Elasticsearch index name such as opal_test
ES_INDEX=
Data Science Group (DICE) at Paderborn University
This work has been supported by the German Federal Ministry of Transport and Digital Infrastructure (BMVI) in the project Open Data Portal Germany (OPAL) (funding code 19F2028A).