Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rechunk xarray #45

Closed
tomwhite opened this issue Aug 31, 2020 · 2 comments
Closed

Rechunk xarray #45

tomwhite opened this issue Aug 31, 2020 · 2 comments

Comments

@tomwhite
Copy link
Collaborator

It would be useful to be able to use rechunker directly on an xarray Dataset (or DataArray), similar to the xarray chunk method.
@rabernat
Copy link
Member

Yes absolutely. This is in fact the most likely way users would want to interact with rechunker.

One challenge is that xarray does not (easily) expose the underlying stores that were used to create the Dataset objects. (Those may not even exist if the data has been modified from its on-disk version.) What we could easily do in the short term would be to work with the dask arrays (as implemented in #27) for each variable.

@eric-czech eric-czech mentioned this issue Sep 8, 2020
Open
eric-czech added a commit to eric-czech/rechunker that referenced this issue Sep 22, 2020
@eric-czech
Add rechunking for Xarray datasets pangeo-data#45
fd3994c
@eric-czech eric-czech mentioned this issue Sep 22, 2020
Merged
eric-czech added a commit to eric-czech/rechunker that referenced this issue Sep 22, 2020
@eric-czech
Add rechunking for Xarray datasets pangeo-data#45
e43c200
eric-czech added a commit to eric-czech/rechunker that referenced this issue Sep 22, 2020
@eric-czech
Add rechunking for Xarray datasets pangeo-data#45
48c0883
eric-czech added a commit to eric-czech/rechunker that referenced this issue Sep 22, 2020
@eric-czech
Add rechunking for Xarray datasets pangeo-data#45
7a90792
eric-czech added a commit to eric-czech/rechunker that referenced this issue Sep 22, 2020
@eric-czech
Add rechunking for Xarray datasets pangeo-data#45
8d0efc4
@tomwhite
Copy link
Collaborator Author

Fixed in #52

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tomwhite @rabernat