Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bulk sources downloader #6270

Closed
wants to merge 3 commits into from

Conversation

antonlacon
Copy link
Contributor

This is a proof of concept bulk sources downloader.

It extends scripts/genbuildplan.py with switches to output a package list needed by the specified project/device/arch to build.

It then adds a new script, tools/download-sources (based on tools/viewplan), which passes the package list through scripts/get to populate $SOURCES_DIR with a collection of package tarballs.

If this was extended further:

  • Be able to specify the directory the tarballs end up, so you could just have build/sources/$LIBREELEC_VERSION, without gathering tarballs into a likely already populated $SOURCES_DIR.

@lrusak
Copy link
Member

lrusak commented Feb 27, 2022

You can already do a bulk threaded download using distro-tool. The only thing it doesn't provide is the ability to download packages from a specific build plan (it just grabs all packages iirc).

Signed-off-by: Ian Leonard <antonlacon@gmail.com>
Looking for unique packages (eg grub:host and grub:target both
being the package grub) is the responsibility of the caller.

Signed-off-by: Ian Leonard <antonlacon@gmail.com>
Signed-off-by: Ian Leonard <antonlacon@gmail.com>
@antonlacon antonlacon force-pushed the source-downloader branch from 6956f52 to db1d7c8 Compare May 21, 2022 20:53
@antonlacon
Copy link
Contributor Author

Starts multiple downloads if gnu parallel is installed. It's been awhile since I used parallel, so if there is a better way to use it, let me know.

@antonlacon
Copy link
Contributor Author

Replacing with #9341.

@antonlacon antonlacon closed this Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants