Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dry-run API for event ingestion #4415

Closed
sunng87 opened this issue Jul 23, 2024 · 1 comment · Fixed by #4667
Closed

Dry-run API for event ingestion #4415

sunng87 opened this issue Jul 23, 2024 · 1 comment · Fixed by #4667
Assignees
@paomian
Labels
C-enhancement Category Enhancements

Comments

@sunng87
Copy link
Member

sunng87 commented Jul 23, 2024

What type of enhancement is this?

API improvement

What does the enhancement do?

The idea is to provide a dry-run API for user to test their pipeline and input data.

Features we need from this API:

  • Accepts saved pipeline name or raw pipeline definition (without saving)
  • Accepts all formats that supported by ingest API
  • Output data just like select * from <table>
  • Provide error information of pipeline or data

This API will be the key for our pipeline manager/editor

Implementation challenges

No response
@sunng87 sunng87 added the C-enhancement Category Enhancements label Jul 23, 2024
@sunng87 sunng87 changed the title Dry-run option/api for event ingestion Dry-run API for event ingestion Jul 23, 2024
@paomian
Copy link
Contributor

paomian commented Sep 4, 2024

relate #4667

@sunng87 sunng87 linked a pull request Sep 4, 2024 that will close this issue
feat: add test pipeline api #4667
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@paomian paomian

Labels
C-enhancement Category Enhancements
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat: add test pipeline api paomian/greptimedb
2 participants
@sunng87 @paomian