github-scanner-local

Locally scan all the repositories of a github organization.

Setup

Clone below repositories as same location as github-scanner-local
- gh-crawl
- bash-scripts
Install npm-name-cli globally
Install get-dependencies globally
Install pip-name

$ npm i npm-name-cli -g

$ npm i get-dependencies -g

$ pip install pip-name

$ sh run.sh {GITHUB_ORGANIZATION_NAME}

$ sh runNpmDeps.sh {FOLDER_NAME}

$ sh runPipDeps.sh {FOLDER_NAME}

Uses clone.sh, grepURL.sh and broken.sh

Clones all the repositories of the organanization (Note: It does not clones archived repositories)

Find all the urls from all the repositories of the organization (Searches in the cloned folder) and stores in results directory

Checks all the urls found by grepURL.sh and captures the status code of the URL

ls -d -1 target/* | grep -v target.txt | xargs -I {} sh search.sh {} "{{STRING_TO_SEARCH}}"

grep -r -o "{{STRING_TO_SEARCH}}" target/.