Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parsing build log could be faster #40

Open
vincentdephily opened this issue Jun 29, 2023 · 0 comments
Open

Parsing build log could be faster #40

vincentdephily opened this issue Jun 29, 2023 · 0 comments

Comments

@vincentdephily
Copy link
Owner

For long builds logs (for example firefox: 1.4M lines, with the last >>> near the start at line 700), read_buildlog() can take over 1s (and it used to be close to 2s with the privious release of the rev_lines crate). Timings are longer during a build (either due to cpu use or file fragmentation). Given that b3sum or ripgrep can process the same file in under 100ms, we should be able to speed emlop up here.

Perhaps parsing the file front to back is the right thing to do. Could hopefully use fast string search algos.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant