-
Notifications
You must be signed in to change notification settings - Fork 914
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Free temp memory no longer needed in multibyte_split processing #16091
Free temp memory no longer needed in multibyte_split processing #16091
Conversation
…nto stream-mutlibyte-split
…nto stream-mutlibyte-split
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like most of the diff is code movement/indentation. It looks like the only relevant change is scoping, to allow freeing the temporaries. This looks fine.
cpp/src/io/text/multibyte_split.cu
Outdated
namespace cudf { | ||
namespace io { | ||
namespace text { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like combining these, it tells me more about the scope of this file (specifically that we won't be putting things into cudf::io
or cudf
, just cudf::io::text
.
namespace cudf { | |
namespace io { | |
namespace text { | |
namespace cudf::io::text { |
I saw this comment just a bit too late! Thanks for the heads-up. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Only comment I have is that this function is fairly bulky. Might be cleaner to separate this code out into it's own function instead of embedded as a lambda. Minor point though.
Yes, I usually prefer that approach myself but the number of parameters passed in and out seemed like too much here. |
/merge |
Description
Updates the
multibyte_split
logic to free temporary memory once the chars and offsets have been resolved. This gives room to the remaining processing if more temp memory is required.Checklist