COVID-19 Data Fetcher

Message from https://github.com/CSSEGISandData/COVID-19:

On March 10, 2023, the Johns Hopkins Coronavirus Resource Center ceased its collecting and reporting of global COVID-19 data.

• Fetch and save data of each country to a MongoDB database.
• Fetch and save articles related to COVID-19 to a MongoDB database.

Source of data: CSSEGISandData & News API.

Dependencies

• MongoDB

Install & run

Copy the file config.ini.example to config.ini and fill in the environment variables.

pip install -r requirements.txt
python app.py

An example of a country document:

{
    "_id": {
        "$oid": "60250f5b1ae25397d00c706c"
    },
    "name": "Netherlands",
    "confirmed": 1027023,
    "deaths": 14710,
    "last_updated_by_source_at": {
        "$date": "2021-02-11T05:23:55.000Z"
    }
}

An example of an article document:

{
    "_id": {
        "$oid": "60252065ac79b69102f2183c"
    },
    "title": "Coping With COVID Redundancy",
    "source_name": "Mindtools.com",
    "author": "Steven Edwards",
    "description": "If we fail to pivot and transition successfully through...",
    "url": "https://www.mindtools.com/blog/coping-with-covid-redundancy/",
    "published_at": "2021-02-11T12:01:00Z"
}

Crontab

At minute 0 and 30:

0,30 * * * * cd ~/covid19-data-fetcher && /usr/local/bin/pipenv run python app.py