Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check that files are not half downloaded #45

Open
garezana opened this issue Aug 8, 2022 · 3 comments
Open

Check that files are not half downloaded #45

garezana opened this issue Aug 8, 2022 · 3 comments

Comments

@garezana
Copy link
Collaborator

garezana commented Aug 8, 2022

No description provided.

@colinsauze
Copy link
Member

If the offlinedatasci process is stopped halfway through downloading a file, running it a second time doesn't cause the rest of the file to be downloaded. There needs to be a check of each file's downloaded size and the size of source file to see if it the download should be redone (or better still continued).

@abhidg
Copy link
Contributor

abhidg commented Apr 20, 2023

wget calls are using -c so continuation should work, will check

@ethanwhite
Copy link
Collaborator

@abhidg - yes, that's true for lessons, but not for other things. @garezana & I have discussed plans for not writing incomplete downloads and retrying (see also #46) that should work for everything except miniCRAN.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

4 participants