feat: httpx results dashboard

[tarunKoyalwar]

Proposed Changes

Probe and Upload

$ chaos  -silent -d hackerone.com | ./httpx -pd -aname 'h1-httpx'               

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

		projectdiscovery.io

[INF] Current chaos version 0.5.2 (latest)
[INF] Current httpx version v1.6.6 (latest)
[INF] To view results on UI dashboard, visit https://cloud.projectdiscovery.io/assets upon completion
http://b.ns.hackerone.com
https://mta-sts.managed.hackerone.com
http://a.ns.hackerone.com
https://mta-sts.hackerone.com
https://mta-sts.forwarding.hackerone.com
https://www.hackerone.com
https://api.hackerone.com
https://resources.hackerone.com
https://docs.hackerone.com
https://gslink.hackerone.com
https://support.hackerone.com
[INF] Found 11 results, View found results in dashboard : https://cloud.projectdiscovery.io/assets/cqdtislcjsac738c26cg

Upload Already Existing JSONL output file

$ ./httpx -pdu targets.jsonl -aname "pdu flag upload x 2"

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

		projectdiscovery.io

[INF] Current httpx version v1.6.6 (latest)
[INF] To view results in UI dashboard, visit https://cloud.projectdiscovery.io/assets upon completion.
[INF] Found 11 results, View found results in dashboard : https://cloud.projectdiscovery.io/assets/cqh4u1e3s8ks7394gu0g

jsonlinesfile is generated when -output targets.jsonl -j flags are used

Available Flags

$ ./httpx -h cloud
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.

Usage:
  ./httpx [flags]

Flags:
CLOUD:
   -auth                           configure projectdiscovery cloud (pdcp) api key (default true)
   -pd, -dashboard                 upload / view output in projectdiscovery cloud (pdcp) UI dashboard
   -aid, -asset-id string          upload new assets to existing asset id (optional)
   -aname, -asset-name string      assets group name to set (optional)
   -pdu, -dashboard-upload string  upload httpx output file (jsonl) in projectdiscovery cloud (pdcp) UI dashboard

• closes Support for -dashboard option #1833

[ehsandeep]

• Allow user to configure if missing / invalid API key upon -dashboard option in use.

echo example.com | httpx -pd 

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

		projectdiscovery.io

[INF] Current httpx version v1.6.6 (latest)
[ERR] ProjectDiscovery Cloud Platform (pdcp) API key is missing or invalid api key.
[INF] Get your free api key from https://cloud.projectdiscovery.io/?ref=api_key
[*] Enter PDCP API Key (exit to abort):
[INF] Successfully configured API as (@sandeep)

• PDCP_API_SERVER env is not configurable, below example still make api call to prod api.

PDCP_API_SERVER=https://api.dev.projectdisocvery.io HTTPS_PROXY=http://127.0.0.1:8080  ./httpx -pd -l test.txt

• Add option to upload local httpx output file (jsonl only)

-pdu, -dashboard-upload  upload httpx output file (jsonl) in projectdiscovery cloud (pdcp) UI dashboard

Example:

htttpx -dashboard-upload output_file -silent
[INF] Uploaded 11 results, View uploaded results in UI dashboard : https://cloud.projectdiscovery.io/assets/cqed72mbh6us73bj4o3g

[ehsandeep]

$ PDCP_API_KEY=XXX PDCP_API_SERVER=https://api.dev.projectdiscovery.io ./httpx -pdu test_output

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

		projectdiscovery.io

[INF] Current httpx version v1.6.6 (latest)
[INF] To view results in UI dashboard, visit https://cloud.projectdiscovery.io/assets upon completion.
[INF] Found 11 results, View found results in dashboard : https://cloud.projectdiscovery.io/assets/cqh57m9htlrs73be80og

$ chaos -d hackerone.com | PDCP_API_KEY=XXX PDCP_API_SERVER=https://api.dev.projectdiscovery.io ./httpx -dashboard

    __    __  __       _  __
   / /_  / /_/ /_____ | |/ /
  / __ \/ __/ __/ __ \|   /
 / / / / /_/ /_/ /_/ /   |
/_/ /_/\__/\__/ .___/_/|_|
             /_/

		projectdiscovery.io

[INF] Current httpx version v1.6.6 (latest)
[INF] To view results in UI dashboard, visit https://cloud.projectdiscovery.io/assets upon completion.
https://mta-sts.managed.hackerone.com
https://mta-sts.forwarding.hackerone.com
https://mta-sts.hackerone.com
http://a.ns.hackerone.com
https://api.hackerone.com
https://www.hackerone.com
https://docs.hackerone.com
https://gslink.hackerone.com
https://support.hackerone.com
http://b.ns.hackerone.com
https://resources.hackerone.com
[INF] Found 11 results, View found results in dashboard : https://cloud.projectdiscovery.io/assets/cqh56s9htlrs73be80o0