Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Warn and cast to cudf, when the C++ impl for MessageMeta receives a pandas DF #985

Merged

Conversation

dagardner-nv
Copy link
Contributor

@dagardner-nv dagardner-nv commented Jun 13, 2023

Description

  • Current C++ impl for MessageMeta only supports cudf DataFrames, passing it a Pandas DF creates unexpected behavior.
  • This change warns and converts the DF to cudf.
  • Fixes bug in morpheus/modules/from_control_message.py, ControlMessage.payload() returns a MessageMeta not a Dataframe.
  • Fix bug in tests/modules/test_to_control_message.py fixtures don't work as values in pytest.mark.parametrize
  • Fix bug concatenating bash arrays in ci/scripts/cpp_checks.sh

fixes #811

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@dagardner-nv dagardner-nv requested a review from a team as a code owner June 13, 2023 23:52
@dagardner-nv dagardner-nv added bug Something isn't working non-breaking Non-breaking change 3 - Ready for Review labels Jun 13, 2023
Copy link
Contributor

@mdemoret-nv mdemoret-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Merge after the 2 comments have been resolved

morpheus/_lib/src/messages/meta.cpp Outdated Show resolved Hide resolved
morpheus/_lib/src/messages/meta.cpp Outdated Show resolved Hide resolved
@dagardner-nv
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit 8472c85 into nv-morpheus:branch-23.07 Jun 21, 2023
@dagardner-nv dagardner-nv deleted the david-cpp-msg-pandas-811 branch June 21, 2023 23:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working non-breaking Non-breaking change
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

[BUG]: Creating a C++ instance of MessageMeta with a Pandas DataFrame should not be possible
2 participants