Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support more configuration in TOS #18628

Merged
merged 10 commits into from
Jun 19, 2024
Merged

Support more configuration in TOS #18628

merged 10 commits into from
Jun 19, 2024

Conversation

thu-david
Copy link
Contributor

What changes are proposed in this pull request?

This update includes several configuration options for TOS and adds the functionality to clean up expired redundant multipart upload files.

Why are the changes needed?

  1. Previously, users could not specify the number of threads, timeout durations, etc. Now, all these options can be configured when connecting to TOS.
  2. Fixed the issue where expired files were not automatically cleaned up.

Does this PR introduce any user facing changes?

There are now more configuration options available, which need to be specified in the conf file.

*/
public static TransportConfig initializeTOSClientConfig(
AlluxioConfiguration alluxioConf) {
int readTimeoutMills = (int) alluxioConf.getMs(PropertyKey.UNDERFS_TOS_READ_TIMEOUT);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if you want to use alluxioConf.getMs, use the durationBuilder instead of intBuilder.
if you use the intBuilder, please use getInt.

Copy link
Contributor

@Jackson-Wang-7 Jackson-Wang-7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Jackson-Wang-7 Jackson-Wang-7 added the type-feature This issue is a feature request label Jun 19, 2024
@Jackson-Wang-7
Copy link
Contributor

alluxio-bot, merge this please

@alluxio-bot alluxio-bot merged commit c3a7e78 into Alluxio:master-2.x Jun 19, 2024
19 checks passed
Xenorith pushed a commit that referenced this pull request Jun 24, 2024
### What changes are proposed in this pull request?

This update includes several configuration options for TOS and adds the functionality to clean up expired redundant multipart upload files.

### Why are the changes needed?

1. Previously, users could not specify the number of threads, timeout durations, etc. Now, all these options can be configured when connecting to TOS.
2. Fixed the issue where expired files were not automatically cleaned up.

### Does this PR introduce any user facing changes?

There are now more configuration options available, which need to be specified in the conf file.

			pr-link: #18628
			change-id: cid-53fa0171172eed54edb077b8af0d1d62b23d7bee
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type-feature This issue is a feature request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants