Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✨ parallelize readers (GCS first) #1613

Closed
7 tasks
joocer opened this issue Apr 28, 2024 · 0 comments · Fixed by #1619
Closed
7 tasks

✨ parallelize readers (GCS first) #1613

joocer opened this issue Apr 28, 2024 · 0 comments · Fixed by #1619

Comments

@joocer
Copy link
Contributor

joocer commented Apr 28, 2024

  • Create a "async" capability for the connectors
  • Ensure the async read uses the buffer and remote caches
  • Extensive testing of :
  • predicate pushdown
  • projection pushdown
  • cache hits
  • premature termination (LIMIT)
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
#1613
ab38e6a
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge pull request #1615 from mabel-dev/#1613/1
777ff33 
#1613
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
#1613
da80c02
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
#1613
ff1f823
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge branch 'main' into #1613/2
d014d2b
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge pull request #1616 from mabel-dev/#1613/2
3116e23 
#1613
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
#1613
da337cb
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge branch 'main' into #1613/3
5db4f57
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge pull request #1617 from mabel-dev/#1613/3
9e43621 
#1613
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
#1613
0da7cc9
@joocer joocer mentioned this issue Apr 28, 2024
Merged
4 tasks
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge branch 'main' into #1613/4
105a4e9
joocer added a commit that referenced this issue Apr 28, 2024
@joocer
Merge pull request #1619 from mabel-dev/#1613/4
43c223f 
#1613/4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

#1613/4 mabel-dev/opteryx
1 participant
@joocer