Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

update loader for new hurricane json data #349

Merged
merged 1 commit into from
Aug 2, 2024
Merged

update loader for new hurricane json data #349

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions debian/msc-pygeoapi.cron.d
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,9 @@ MAILTO=""
# every day at 0700h, clean metnotes data older than 7 days
0 7 * * * geoadm . /local/home/geoadm/.profile && msc-pygeoapi data metnotes clean-indexes --days 7 --yes

# every day at 0800h clean hurricanes data older than 7 days
0 8 * * * geoadm . /local/home/geoadm/.profile && msc-pygeoapi data hurricanes clean-indexes --days 7 --dataset all --yes

# every day at 0300h, clean out empty MetPX directories
0 3 * * * geoadm . /local/home/geoadm/.profile && /usr/bin/find $MSC_PYGEOAPI_CACHEDIR -type d -empty -delete > /dev/null 2>&1

Expand Down
156 changes: 156 additions & 0 deletions deploy/default/msc-pygeoapi-config.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1541,6 +1541,162 @@ resources:
data: ${MSC_PYGEOAPI_ES_URL}/aqhi_stations
id_field: id

hurricanes-cyclone-realtime:
type: collection
title:
en: Hurricane Tracks - cyclone
fr: Trajectoires d'ouragans - cyclone
description:
en: "Hurricane tracks and response zone are issued by the Canadian Hurricane Centre as part of the regular hurricane season forecast."
fr: "Les trajectoires d'ouragans et la zone de réaction aux ouragans sont émises par le Centre canadien de prévision des ouragans, dans le cadre des prévisions régulières lors de la saison des ouragans."
keywords:
en: [Weather warnings, Precipitation, Wind, Storms, Floods]
fr: [Alerte météorologique, Précipitation, Vent, Tempête, Inondation]
crs:
- CRS84
links:
- type: text/html
rel: canonical
title:
en: Hurricane prediction data and products
fr: Données et produits de prévision des ouragans
href:
en: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_en/
fr: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_fr/
hreflang:
en: en-CA
fr: fr-CA
extents:
spatial:
bbox: [-180, -90, 180, 90]
crs: http://www.opengis.net/def/crs/OGC/1.3/CRS84
temporal:
begin: 2011-06-01T00:00:00Z
end: null # or empty
providers:
- type: feature
name: Elasticsearch
data: ${MSC_PYGEOAPI_ES_URL}/hurricanes-cyclone.*
id_field: id
time_field: validity_datetime

hurricanes-track-realtime:
type: collection
title:
en: Hurricane Tracks - track
fr: Trajectoires d'ouragans - trajectoire
description:
en: "Hurricane tracks and response zone are issued by the Canadian Hurricane Centre as part of the regular hurricane season forecast."
fr: "Les trajectoires d'ouragans et la zone de réaction aux ouragans sont émises par le Centre canadien de prévision des ouragans, dans le cadre des prévisions régulières lors de la saison des ouragans."
keywords:
en: [Weather warnings, Precipitation, Wind, Storms, Floods]
fr: [Alerte météorologique, Précipitation, Vent, Tempête, Inondation]
crs:
- CRS84
links:
- type: text/html
rel: canonical
title:
en: Hurricane prediction data and products
fr: Données et produits de prévision des ouragans
href:
en: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_en/
fr: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_fr/
hreflang:
en: en-CA
fr: fr-CA
extents:
spatial:
bbox: [-180, -90, 180, 90]
crs: http://www.opengis.net/def/crs/OGC/1.3/CRS84
temporal:
begin: 2011-06-01T00:00:00Z
end: null # or empty
providers:
- type: feature
name: Elasticsearch
data: ${MSC_PYGEOAPI_ES_URL}/hurricanes-track.*
id_field: id
time_field: validity_datetime

hurricanes-error_cone-realtime:
type: collection
title:
en: Hurricane Tracks - error cone
fr: Trajectoires d'ouragans - cone d'erreur
description:
en: "Hurricane tracks and response zone are issued by the Canadian Hurricane Centre as part of the regular hurricane season forecast."
fr: "Les trajectoires d'ouragans et la zone de réaction aux ouragans sont émises par le Centre canadien de prévision des ouragans, dans le cadre des prévisions régulières lors de la saison des ouragans."
keywords:
en: [Weather warnings, Precipitation, Wind, Storms, Floods]
fr: [Alerte météorologique, Précipitation, Vent, Tempête, Inondation]
crs:
- CRS84
links:
- type: text/html
rel: canonical
title:
en: Hurricane prediction data and products
fr: Données et produits de prévision des ouragans
href:
en: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_en/
fr: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_fr/
hreflang:
en: en-CA
fr: fr-CA
extents:
spatial:
bbox: [-180, -90, 180, 90]
crs: http://www.opengis.net/def/crs/OGC/1.3/CRS84
temporal:
begin: 2011-06-01T00:00:00Z
end: null # or empty
providers:
- type: feature
name: Elasticsearch
data: ${MSC_PYGEOAPI_ES_URL}/hurricanes-error_cone.*
id_field: id
time_field: validity_datetime

hurricanes-wind_radii-realtime:
type: collection
title:
en: Hurricane Tracks - wind raddi
fr: Trajectoires d'ouragans - radius de vent
description:
en: "Hurricane tracks and response zone are issued by the Canadian Hurricane Centre as part of the regular hurricane season forecast."
fr: "Les trajectoires d'ouragans et la zone de réaction aux ouragans sont émises par le Centre canadien de prévision des ouragans, dans le cadre des prévisions régulières lors de la saison des ouragans."
keywords:
en: [Weather warnings, Precipitation, Wind, Storms, Floods]
fr: [Alerte météorologique, Précipitation, Vent, Tempête, Inondation]
crs:
- CRS84
links:
- type: text/html
rel: canonical
title:
en: Hurricane prediction data and products
fr: Données et produits de prévision des ouragans
href:
en: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_en/
fr: https://eccc-msc.github.io/open-data/msc-data/hurricanes/readme_hurricanes_fr/
hreflang:
en: en-CA
fr: fr-CA
extents:
spatial:
bbox: [-180, -90, 180, 90]
crs: http://www.opengis.net/def/crs/OGC/1.3/CRS84
temporal:
begin: 2011-06-01T00:00:00Z
end: null # or empty
providers:
- type: feature
name: Elasticsearch
data: ${MSC_PYGEOAPI_ES_URL}/hurricanes-wind_radii.*
id_field: id
time_field: validity_datetime

umos-gdps-realtime:
type: collection
title:
Expand Down
11 changes: 6 additions & 5 deletions deploy/default/sarracenia/hurricanes.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@
broker amqps://MSC-GEOMET@hpfx.collab.science.gc.ca
queue_name q_${BROKER_USER}.${PROGRAM}.${CONFIG}.${HOSTNAME}
directory /data/geomet/feeds/hpfx
directory ${MSC_PYGEOAPI_CACHEDIR}
instances 2
subtopic *.WXO-DD.trajectoires.hurricanes.shapefile.#
subtopic *.WXO-DD.hurricanes.#
mirror True
strip 3
discard True
slip 3
accept .*
plugin ${MSC_PYGEOAPI_METPX_EVENT_FILE_PY}
chmod_log 0644

plugin ${MSC_PYGEOAPI_METPX_EVENT_FILE_PY}
Loading
Loading