Crawl Repos #7
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: Crawl Repos | |
| on: | |
| schedule: | |
| - cron: '0 7 * * *' | |
| workflow_dispatch: | |
| env: | |
| DB_NAME: metadata.sqlite3 | |
| METADATA_DIR: metadata | |
| jobs: | |
| crawl: | |
| runs-on: ubuntu-latest | |
| steps: | |
| - uses: actions/checkout@v4 | |
| - name: Crawl | |
| id: crawl | |
| env: | |
| GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} | |
| run: | | |
| ./scripts/crawl.sh ${{ env.DB_NAME }} ${{ env.METADATA_DIR }} | |
| - name: Generate products | |
| run: | | |
| ./scripts/generate-products.sh | |
| - name: Create PR | |
| uses: peter-evans/create-pull-request@v6 | |
| with: | |
| token: ${{ secrets.GITHUB_TOKEN }} | |
| add-paths: | | |
| ${{ env.DB_NAME }} | |
| ${{ env.METADATA_DIR }} | |
| products | |
| branch: "metadata-update" | |
| title: "feat: update SDK metadata" | |
| commit-message: "feat: update SDK metadata" | |
| body: | | |
| SDK metadata has changed. This PR updates the existing `metadata.sqlite3` database and associated | |
| data products. |