Skip to content

Data Science project during my time in NERC as a data engineer - Requested features were hourly reporting of Irradiance levels on the given day, with a reference data set containing standard Irradiance. Data was stored and maintained on Postgres containers.

Notifications You must be signed in to change notification settings

nicknav98/EKO-Visualiser

Repository files navigation

Solar Irradiance Eko Station Graphs

This package of scripts controls the function of pushing updated data extracted from the EKO station.

Pre-Requisites

  • Pandas
  • Numpy
  • Plotly
  • Psycopg Binary
  • Postgres Database holding EKO station data.

CRON JOBS

It is important to use cron jobs to regularly clean data - the isolated CSV folder can be a point of breaking if more than one file is stored there, therefore it's recommended to wipe the directory clean every 24 hours.

Docker images

PostgreSQL 14 container is used to store EKO station data.

HOW TO DELETE OLD ROWS - based on current date. DELETE FROM radiance WHERE "Timestamp" LIKE '%current_date%';

Expected Output, Graphs and Console Logs

[Graph Output]

-- VisualizePlotly Output

[am1-5-Script-Output.png]

-- AM1.5 Script Output

About

Data Science project during my time in NERC as a data engineer - Requested features were hourly reporting of Irradiance levels on the given day, with a reference data set containing standard Irradiance. Data was stored and maintained on Postgres containers.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages