Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Zeta][Imap store] support S3,OSS #4014

Open
2 of 3 tasks
liugddx opened this issue Jan 31, 2023 · 8 comments
Open
2 of 3 tasks

[Improve][Zeta][Imap store] support S3,OSS #4014

liugddx opened this issue Jan 31, 2023 · 8 comments
Assignees

Comments

@liugddx
Copy link
Member

liugddx commented Jan 31, 2023

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

At present, Imap has supported the hdfs persistence method, and now it needs to support OSS/S3.

You can refer to
https://github.com/apache/incubator-seatunnel/blob/6a4a850b4c92a3b01beba5e1686024a51fdd507e/seatunnel-engine/seatunnel-engine-storage/checkpoint-storage-plugins/checkpoint-storage-hdfs/src/main/java/org/apache/seatunnel/engine/checkpoint/storage/hdfs/HdfsStorage.java#L63

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@sunnyzhuzhu
Copy link
Contributor

can you assign it to me please? thanks very much!

@liugddx
Copy link
Member Author

liugddx commented Jan 31, 2023

can you assign it to me please? thanks very much!

Already assigned to you, please enjoy!

@github-actions
Copy link

github-actions bot commented Mar 3, 2023

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Mar 3, 2023
@liugddx liugddx removed the stale label Mar 3, 2023
@github-actions
Copy link

github-actions bot commented Apr 3, 2023

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Apr 3, 2023
@liugddx liugddx removed the stale label Apr 3, 2023
@tc-gaoxiong
Copy link

about support oss/s3,is hdfs on oss/s3? or write to oss/s3 directly.

@liugddx
Copy link
Member Author

liugddx commented Oct 27, 2023

about support oss/s3,is hdfs on oss/s3? or write to oss/s3 directly.

Does it make any difference?

@tc-gaoxiong
Copy link

about support oss/s3,is hdfs on oss/s3? or write to oss/s3 directly.

Does it make any difference?

imap -> oss; or imap -> hdfs, but hdfs data storage in oss

@tc-gaoxiong
Copy link

#4683, maybe this issue has fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants