Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] error: thread 'tokio-runtime-worker' panicked at .../into_url.rs a parsed Url should always be a valid Uri: InvalidUri(TooLong) #1049

Closed
dirhamgithub opened this issue Jan 3, 2024 · 11 comments

Comments

@dirhamgithub
Copy link

dirhamgithub commented Jan 3, 2024

This error is facing me after i have provided the url and word list it finds for me some hidden pages and then it throws me this error, I don't know if the websites made this url to prevent from finding thier hidden files or it is just from Feroxbuster tool.
Here is a screenshot of the error:

feroxbuster

@dirhamgithub dirhamgithub added the bug Something isn't working label Jan 3, 2024
@epi052
Copy link
Owner

epi052 commented Jan 17, 2024

sorry for the late reply, didn't see this one.

that looks to be coming from a library that ferox relies on to do url parsing. at best, id be able to check to make sure we don't trigger the underlying core dump...

thanks for the bug report! ill take a look at a fix

@epi052
Copy link
Owner

epi052 commented Jan 20, 2024

ok, following up on this: the underlying library has a pull request to turn this panic into an Error. Once that lands, i can make sure i handle the Error (it may already be handled cleanly, if not ill update).

for anyone wondering, the max URI length is u16::MAX or 65,535. In the meantime @dirhamgithub you can use --dont-scan to prevent that particular folder from being scanned OR if the url is being picked up during link extraction, you can try --dont-extract-links. Happy hunting!

pinning this til i get an upstream fix

@Sh4d0wHunt3rX
Copy link

Hey, thanks for the interesting tool. I installed feroxbuster for the first time today. I tried it on 3 different domains, and for all of them I got the error. It seems feroxbuster is not functional at the moment, am I right?

image

@epi052 epi052 changed the title [BUG] error: thread 'tokio-runtime-worker' panicked at /cargo/registry/src/index.crates.io-6f17d22bba15001f/reqwest-0.11.18/src/into_url.rs:80:14: a parsed Url should always be a valid Uri: InvalidUri(TooLong) [BUG] error: thread 'tokio-runtime-worker' panicked at .../into_url.rs a parsed Url should always be a valid Uri: InvalidUri(TooLong) Feb 20, 2024
@epi052
Copy link
Owner

epi052 commented Feb 21, 2024

@amiremami no, that's not correct. you're encountering what i consider an edge case. that you found it on three separate targets is pretty impressive to me, lol. parsing a url over 65,535 characters is not what i would consider the norm.

at any rate, thank you for pinging this thread. the upstream fix was merged and i can push a fix for this on my end. expect an update soon!

@epi052
Copy link
Owner

epi052 commented Feb 28, 2024

@all-contributors add @amiremami and @dirhamgithub for bug

Copy link
Contributor

@epi052

I've put up a pull request to add @amiremami! 🎉

@epi052
Copy link
Owner

epi052 commented Feb 28, 2024

@epi052
Copy link
Owner

epi052 commented Feb 28, 2024

@all-contributors add @dirhamgithub for bug

Copy link
Contributor

@epi052

I've put up a pull request to add @dirhamgithub! 🎉

@epi052
Copy link
Owner

epi052 commented Feb 28, 2024

fixed in main, new release soon

@epi052 epi052 closed this as completed Feb 28, 2024
@Sh4d0wHunt3rX
Copy link

fixed in main, new release soon

Thanks a lot, it works now 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants