-
Notifications
You must be signed in to change notification settings - Fork 137
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add support for Alipan Storage backend (#651)
* Add support for Alipan Storage backend * Add `download_from_alipan` function and `AlipanUploader` class * Add tests for both download and upload * Add docs for configure Alipan Storage Credentials * Add `AliPCS-Py` to setup.py as extra dependence * * Raise a `FileNotFoundError` when the remote path doesn't exist * Use accurate `download_file` instead of the general `download` when download a remote file * Raise a `ValueError` when the remote is `None` at uploading * Format code * Fix syntax * Fix syntax * Restrict the version of `AliPCS-Py` to be `AliPCS-Py>=0.8,<1` * Correct grammar Co-authored-by: Saaketh Narayan <saaketh@mosaicml.com> --------- Co-authored-by: Saaketh Narayan <saaketh.narayan@databricks.com> Co-authored-by: Saaketh Narayan <saaketh@mosaicml.com>
- Loading branch information
1 parent
8140d93
commit 9eaa26a
Showing
8 changed files
with
289 additions
and
6 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters