Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA]: Add ElasticSearch sink stage and module #902

Closed
2 tasks done
bsuryadevara opened this issue Apr 21, 2023 · 1 comment · Fixed by #1163
Closed
2 tasks done

[FEA]: Add ElasticSearch sink stage and module #902

bsuryadevara opened this issue Apr 21, 2023 · 1 comment · Fixed by #1163
Assignees
@bsuryadevara
Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components
Milestone
23.11 - Sherlock

Comments

@bsuryadevara
Copy link
Contributor

bsuryadevara commented Apr 21, 2023 •
edited
Loading

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Medium

Please provide a clear description of problem this feature solves

Add write_to_elasticsearch and monitor and multiplexer modules.

Describe your ideal solution

@register_module(MONITOR, MODULE_NAMESPACE)
def monitor(builder: mrc.Builder):

@register_module(WRITE_TO_ELASTICSEARCH, MODULE_NAMESPACE)
def write_to_elasticsearch(builder: mrc.Builder):

Describe any alternatives you have considered

No response

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
  • I have searched the open feature requests and have found no duplicates for this feature request
@bsuryadevara bsuryadevara added the feature request New feature or request label Apr 21, 2023
@bsuryadevara bsuryadevara self-assigned this Apr 21, 2023
@bsuryadevara bsuryadevara mentioned this issue Aug 30, 2023
Merged
@bsuryadevara
Copy link
Contributor Author

The implementation of the Monitor module is included in the context of DFP modules' example. Presently, utilizing the Monitor module alongside the monitoring stage could result in irregular monitor formatting, leading to uneven representation in the console logs.

@mdemoret-nv mdemoret-nv changed the title [FEA]: Add sink and monitor modules [FEA]: Add ElasticSearch sink stage and module Sep 8, 2023
@mdemoret-nv mdemoret-nv added the sherlock Issues/PRs related to Sherlock workflows and components label Sep 8, 2023
@mdemoret-nv mdemoret-nv added this to the 23.11 - Sherlock milestone Sep 8, 2023
rapids-bot bot pushed a commit that referenced this issue Sep 19, 2023
@bsuryadevara
Elasticsearch Sink Module (#1163)
9174cec 
- Added Elasticsearch controller to establish client connection and read and write to Elasticsearch.
- Added tests

Closes #902

Authors:
  - Bhargav Suryadevara (https://github.com/bsuryadevara)

Approvers:
  - Michael Demoret (https://github.com/mdemoret-nv)

URL: #1163
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bsuryadevara bsuryadevara

Labels
feature request New feature or request sherlock Issues/PRs related to Sherlock workflows and components
Projects
Morpheus Boards
Status: Done
Milestone
23.11 - Sherlock
3 participants
@bsuryadevara @mdemoret-nv @jarmak-nv