Bump hadoop version to 3.3.4 #17002
Bump hadoop version to 3.3.4 #17002
Conversation
Signed-off-by: fengshunli <1171313930@qq.com>
|
@Xenorith can you take a look? |
|
i think this should be okay to bump. @dbw9580 you were the previous committer to bump the hadoop version from 3.3.0 to 3.3.1; wondering if you have any opinions on this? |
|
cc @dbw9580 can you take a look? |
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions. |
github-actions
bot
added
the
stale
|
Hey, I see this PR got stale. That's a pity since this fix would have fixed also CVE-2019-175710 (critical log4j vulnerability). @elega, @Xenorith, @maobaolong, @dbw9580 is there any chance for this PR to be merged soon? |
this CVE should have no impact on the codebase as it only affects log4j 1.x. all modules are using log4j 2.x and dependencies that pull in other versions of log4j should have the these log4j versions excluded, therefore the problematic code should not be taking any effect. on the other hand i have no major issues with this upgrade from a code perspective, but would appreciate to have some real workload testing and validation that uses a tarball published with this change before merging |
|
Hadoop releases 3.3.2 through 3.3.4 seem relatively small: https://hadoop.apache.org/docs/r3.3.2/hadoop-project-dist/hadoop-common/release/3.3.2/RELEASENOTES.3.3.2.html 3.3.3 and 3.3.4 are all housekeeping changes. @Xenorith considering this targeting the |
|
@Xenorith, I can help with the workload testing on an Alluxio cluster, but I need to understand first what scale (e.g. volume of data, requests per second, etc.) we are targeting for these tests. Additionally, is there any specific output that these tests should yield, other than maybe some screenshots and a report? |
|
after some simple testing, i am good to merge this. @cosminnicula i'm not particularly concerned about testing at scale since the changes listed by @dbw9580 are relatively minor. any functional testing that you could run would be great. |
Xenorith
removed
the
stale
|
alluxio-bot, merge this please |
|
merge failed: |
|
alluxio-bot, merge this please |
|
@Xenorith do we need this in |
|
nice to have but not strictly required |
### What changes are proposed in this pull request? Merge missing commits from master-2.x to main. The commits in 2023/07/01~2023/11/08 from main...master-2.x will be included by this PR. We do this merge to catch missing fixes from `master-2.x` and catch the train before `main` cuts a release. #17747 is not cherry picked because tencent cloud EMR doc is removed #17755 is not cherry picked because DistLoadCliRunner has been removed in 3.x #17758 is not cherry picked because MonoBlockStore has been removed in 3.x #17641 is not cherry picked because the PR has already been in main #17781 is not cherry picked because the PR has already been in main #17722 is not cherry picked because the alluxio-fuse command has been changed a lot #17489 is not cherry picked because audit log on master is no longer in 3.x #17865 is not cherry picked because replication on job service is no longer in 3.x #17858 is not cherry picked because it is already in main #18090 is not cherry picked because generate-tarball has been rewritten in 3.x #18091 is not cherry picked because the change is already in main #17474 is not cherry picked because reconfiguration feature is not defined in 3.x #17735 is not cherry picked because MonoBlockStore is no longer in 3.x #18133 is not cherry picked because the issue is about master metadata and no longer relevant in 3.x #17910 is not cherry picked because I prefer to do that manually #17983 is not cherry picked because the web UI has been reworked #17984 is not cherry picked because Mount/Unmount commands have been reworked in 3.x #18103 is not cherry picked because worker cache metrics have been reworked in 3.x #18185 is not cherry picked because the report command has been reworked in 3.x #18222 is not cherry picked because Mount/Unmount operations have been reworked in 3.x #18143 is not cherry picked because the change is already in main #18303 is not cherry picked because the change is already in main #18208 is not cherry picked because cache metrics have been reworked in 3.x #17002 is not cherry picked because the owner has been notified separately #18334 is not cherry picked because the bash scripts have been reworked in 3.x #18326 is not cherry picked because the owner has been notified separately pr-link: #18397 change-id: cid-dbf8cbb2d9e721a5a0a1e5028a3c9577438a2ac0
### What changes are proposed in this pull request? Bump Hadoop version from `3.3.1` to `3.3.4`. ### Why are the changes needed? Fix hadoop CVE-2021-37404. ### Does this PR introduce any user facing changes? Hadoop version bump. pr-link: Alluxio#17002 change-id: cid-fd12eec84b42efd3112c3c71039702dca92ca775
What changes are proposed in this pull request?
Bump Hadoop version from
3.3.1to3.3.4.Why are the changes needed?
Fix hadoop CVE-2021-37404.
Does this PR introduce any user facing changes?
Hadoop version bump.