Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better reliability of lazy_read_iiasa() #703

Open
danielhuppmann opened this issue Sep 14, 2022 · 0 comments
Open

Better reliability of lazy_read_iiasa() #703

danielhuppmann opened this issue Sep 14, 2022 · 0 comments

Comments

@danielhuppmann
Copy link
Member

#696 added a top-level function lazy_read_iiasa() which tries to load from file before querying the database. One problem with the current implementation is that the file does not "remember" the filters applied for querying an existing file.

For example, if you

df = lazy_read_iiasa("some/file.csv", TEST_API, model="model_a")

and later

df = lazy_read_iiasa("some/file.csv", TEST_API, model="model_b")

you will get a different result for the second call depending on whether any data in model_b changed in the database in the meantime.

I think that @phackstock implemented some smart solutions for such a problem in the downscaling-package...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant