Skip to content
Java CI

[HUDI-7567] Add schema evolution to the filegroup reader #33125

Sign in to view logs

[HUDI-7567] Add schema evolution to the filegroup reader

[HUDI-7567] Add schema evolution to the filegroup reader #33125

Triggered via pull request May 14, 2024 22:06
@jonvexjonvex
synchronize #10957
jonvex:add_schema_evolution_to_fg_reader
Status Failure
Total duration 44m 6s
Artifacts –

bot.yml

on: pull_request
validate-source
22s
validate-source
Matrix: docker-java17-test
Matrix: integration-tests
Matrix: test-flink
Matrix: test-hudi-hadoop-mr-and-hudi-java-client
Matrix: test-spark-java-tests
Matrix: test-spark-java17-java-tests
Matrix: test-spark-java17-scala-tests
Matrix: test-spark-scala-tests
Matrix: validate-bundles
Fit to window
Zoom out
Zoom in

Annotations

68 errors and 50 warnings
test-spark-java-tests (scala-2.12, spark3.1, hudi-spark-datasource/hudi-spark3.1.x)
Process completed with exit code 1.
test-spark-java-tests (scala-2.11, spark2.4, hudi-spark-datasource/hudi-spark2)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.11, spark2.4, hudi-spark-datasource/hudi-spark2)
The operation was canceled.
test-spark-java-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The operation was canceled.
test-spark-java-tests (scala-2.12, spark3.2, hudi-spark-datasource/hudi-spark3.2.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.12, spark3.2, hudi-spark-datasource/hudi-spark3.2.x)
The operation was canceled.
test-spark-java-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
The operation was canceled.
test-spark-java-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-java-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-java-tests (scala-2.12, spark3.0, hudi-spark-datasource/hudi-spark3.0.x)
The job was canceled because "scala-2_12_spark3_1_hudi-" failed.
test-spark-java-tests (scala-2.12, spark3.0, hudi-spark-datasource/hudi-spark3.0.x)
The operation was canceled.
test-spark-java17-java-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
Process completed with exit code 1.
test-spark-java17-java-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
The job was canceled because "scala-2_12_spark3_3_hudi-" failed.
test-spark-java17-java-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
Process completed with exit code 1.
test-spark-java17-java-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_3_hudi-" failed.
test-spark-java17-java-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-java17-java-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_3_hudi-" failed.
test-spark-java17-java-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
validate-bundles (scala-2.13, flink1.18, spark3.5, spark3.5.0)
Process completed with exit code 1.
validate-bundles (scala-2.12, flink1.17, spark3.3, spark3.3.2)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.17, spark3.3, spark3.3.2)
The operation was canceled.
validate-bundles (scala-2.12, flink1.18, spark3.5, spark3.5.0)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.18, spark3.5, spark3.5.0)
The operation was canceled.
validate-bundles (scala-2.12, flink1.14, spark2.4, spark2.4.8)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.14, spark2.4, spark2.4.8)
The operation was canceled.
validate-bundles (scala-2.12, flink1.16, spark3.3, spark3.3.1)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.16, spark3.3, spark3.3.1)
The operation was canceled.
validate-bundles (scala-2.12, flink1.14, spark3.0, spark3.0.2)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.14, spark3.0, spark3.0.2)
The operation was canceled.
validate-bundles (scala-2.12, flink1.14, spark3.1, spark3.1.3)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.14, spark3.1, spark3.1.3)
The operation was canceled.
validate-bundles (scala-2.12, flink1.18, spark3.4, spark3.4.0)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.18, spark3.4, spark3.4.0)
The operation was canceled.
validate-bundles (scala-2.12, flink1.15, spark3.2, spark3.2.3)
The job was canceled because "scala-2_13_flink1_18_spar" failed.
validate-bundles (scala-2.12, flink1.15, spark3.2, spark3.2.3)
The operation was canceled.
test-spark-scala-tests (scala-2.12, spark3.0, hudi-spark-datasource/hudi-spark3.0.x)
Process completed with exit code 1.
test-spark-scala-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
Failed to create marker type file file:/tmp/spark-0cfd1e1d-877d-46e2-93e7-3b3f505d0546/h104/.hoodie/.temp/20240514222111950/MARKERS.type; java.lang.InterruptedException
test-spark-scala-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-scala-tests (scala-2.12, spark3.1, hudi-spark-datasource/hudi-spark3.1.x)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.12, spark3.1, hudi-spark-datasource/hudi-spark3.1.x)
Failed to create marker type file file:/tmp/spark-b29ee035-e8b5-4999-bf9f-b02628c9b718/h104/.hoodie/.temp/20240514221926575/MARKERS.type; java.lang.InterruptedException
test-spark-scala-tests (scala-2.12, spark3.1, hudi-spark-datasource/hudi-spark3.1.x)
The operation was canceled.
test-spark-scala-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
Failed to create marker type file file:/tmp/spark-33df0923-9d0e-4afb-b6d6-f4b3800f3f0f/h104/.hoodie/.temp/20240514222111696/MARKERS.type; java.lang.InterruptedException
test-spark-scala-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
The operation was canceled.
test-spark-scala-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The operation was canceled.
test-spark-scala-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-scala-tests (scala-2.11, spark2.4, hudi-spark-datasource/hudi-spark2)
The job was canceled because "scala-2_12_spark3_0_hudi-" failed.
test-spark-scala-tests (scala-2.11, spark2.4, hudi-spark-datasource/hudi-spark2)
The operation was canceled.
test-spark-java17-scala-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
Process completed with exit code 1.
test-spark-java17-scala-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_4_hudi-" failed.
test-spark-java17-scala-tests (scala-2.13, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
test-spark-java17-scala-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The job was canceled because "scala-2_12_spark3_4_hudi-" failed.
test-spark-java17-scala-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
The operation was canceled.
test-spark-java17-scala-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The job was canceled because "scala-2_12_spark3_4_hudi-" failed.
test-spark-java17-scala-tests (scala-2.12, spark3.5, hudi-spark-datasource/hudi-spark3.5.x)
The operation was canceled.
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
Failed to upsert for commit time 20240514224030479
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
"null"
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
"null"
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
"null"
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
"null"
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
Process completed with exit code 1.
validate-source
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-flink (flink1.15)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-flink (flink1.14)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-flink (flink1.16)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-flink (flink1.17)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-spark-scala-tests (scala-2.12, spark3.2, hudi-spark-datasource/hudi-spark3.2.x)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-spark-java-tests (scala-2.12, spark3.1, hudi-spark-datasource/hudi-spark3.1.x)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-spark-java17-java-tests (scala-2.12, spark3.3, hudi-spark-datasource/hudi-spark3.3.x)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Building Hudi with Java 8
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Done building Hudi with Java 8
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh copying hadoop conf
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting hadoop hdfs
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:1
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:2
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:3
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting hadoop hdfs, hdfs report
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Running tests with Java 17
docker-java17-test (scala-2.13, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh run_docker_tests Running Hudi maven tests on Docker
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Building Hudi with Java 8
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Done building Hudi with Java 8
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh copying hadoop conf
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting hadoop hdfs
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:1
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:2
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting datanode:3
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh starting hadoop hdfs, hdfs report
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh Running tests with Java 17
docker-java17-test (scala-2.12, flink1.18, spark3.5, spark3.5.0)
docker_test_java17.sh run_docker_tests Running Hudi maven tests on Docker
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh Building Hudi with Java 8
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh Done building Hudi with Java 8
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh copying hadoop conf
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh starting hadoop hdfs
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh starting datanode:1
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh starting datanode:2
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh starting datanode:3
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh starting hadoop hdfs, hdfs report
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh Running tests with Java 17
docker-java17-test (scala-2.12, flink1.18, spark3.4, spark3.4.0)
docker_test_java17.sh run_docker_tests Running Hudi maven tests on Docker
validate-bundles (scala-2.13, flink1.18, spark3.5, spark3.5.0)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
validate-bundles (scala-2.13, flink1.18, spark3.5, spark3.5.0)
validate.sh validating spark & hadoop-mr bundle
validate-bundles (scala-2.13, flink1.18, spark3.5, spark3.5.0)
validate.sh setting up hive metastore for spark & hadoop-mr bundles validation
validate-bundles (scala-2.13, flink1.18, spark3.5, spark3.5.0)
validate.sh Writing sample data via Spark DataSource and run Hive Sync...
test-hudi-hadoop-mr-and-hudi-java-client (scala-2.12, spark3.2, flink1.18)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-spark-scala-tests (scala-2.12, spark3.0, hudi-spark-datasource/hudi-spark3.0.x)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-spark-java17-scala-tests (scala-2.12, spark3.4, hudi-spark-datasource/hudi-spark3.4.x)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
integration-tests (spark2.4, spark-2.4.4/spark-2.4.4-bin-hadoop2.7.tgz)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
test-flink (flink1.18)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/setup-java@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.