We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FlatMapGroupInPandas
Actually it should be an improvment more than a bug. The code snip is as below,
.map { groupBatch => // Cache the input batches for release after writing done. queue.add(groupBatch, spillCallback) groupBatch }
The Python runner will close the batches after writing them to Python, so no need to cache them in the queue for release. Need to clean this.
The text was updated successfully, but these errors were encountered:
MapInPandas has the similar issue. Code snip
MapInPandas
Sorry, something went wrong.
firestarman
Successfully merging a pull request may close this issue.
Actually it should be an improvment more than a bug.
The code snip is as below,
The Python runner will close the batches after writing them to Python, so no need to cache them in the queue for release.
Need to clean this.
The text was updated successfully, but these errors were encountered: