Skip to content

[GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 #11190

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
jinchengchenghh wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

[GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 #11190

jinchengchenghh wants to merge 4 commits into from

Conversation

@jinchengchenghh
Copy link
Contributor

@jinchengchenghh jinchengchenghh commented Nov 25, 2025 •
edited by github-actions bot
Loading

Related issue: #11088

@github-actions github-actions bot added the CORE works for Gluten Core label Nov 25, 2025
@github-actions
Copy link

github-actions bot commented Nov 25, 2025

Run Gluten ClickHouse CI on ARM

@github-actions
Copy link

github-actions bot commented Nov 26, 2025

Run Gluten ClickHouse CI on ARM

@zhouyuan
Copy link
Contributor

zhouyuan commented Nov 26, 2025

Run Gluten ClickHouse CI on x86

@zhouyuan zhouyuan changed the title [GLUTEN-11088][VL] Enable CSV suite [GLUTEN-11088][VL] Enable CSV suite in Spark-4.0 Nov 26, 2025
@github-actions
Copy link

github-actions bot commented Nov 26, 2025

Run Gluten ClickHouse CI on ARM

@jinchengchenghh
Copy link
Contributor Author

jinchengchenghh commented Nov 26, 2025 •
edited
Loading

Passed the tests one time, but after rerun CSV failed by /arrow/java/dataset/src/main/cpp/jni_util.cc:79: Failed to update reservation while freeing bytes: Java Exception: java.lang.NullPointerException

@jinchengchenghh
Copy link
Contributor Author

jinchengchenghh commented Nov 26, 2025

There is existing issue https://github.com/apache/arrow-java/blob/main/dataset/src/main/cpp/jni_util.cc#L76 https://issues.apache.org/jira/browse/ARROW-11143 CC @zhztheplayer

@github-actions
Copy link

github-actions bot commented Nov 26, 2025

Run Gluten ClickHouse CI on ARM

@jinchengchenghh
Copy link
Contributor Author

jinchengchenghh commented Nov 27, 2025

Trigger the flaky test

2025-11-26T21:18:55.4968782Z #
2025-11-26T21:18:55.4981909Z # A fatal error has been detected by the Java Runtime Environment:
2025-11-26T21:18:55.4983467Z #
2025-11-26T21:18:55.4983914Z #  SIGSEGV (0xb) at pc=0x00007f5170655120, pid=82017, tid=107720
2025-11-26T21:18:55.4984658Z #
2025-11-26T21:18:55.4986579Z # JRE version: OpenJDK Runtime Environment 21.9 (17.0.1+12) (build 17.0.1+12-LTS)
2025-11-26T21:18:55.4996055Z # Java VM: OpenJDK 64-Bit Server VM 21.9 (17.0.1+12-LTS, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
2025-11-26T21:18:55.4997760Z # Problematic frame:
2025-11-26T21:18:55.4998099Z # C  0x00007f5170655120
2025-11-26T21:18:55.4998416Z #
2025-11-26T21:18:55.5003611Z # Core dump will be written. Default location: Core dumps may be processed with "/lib/systemd/systemd-coredump %P %u %g %s %t 9223372036854775808 %h %d" (or dumping to /__w/incubator-gluten/incubator-gluten/gluten-ut/spark40/core.82017)
2025-11-26T21:18:55.5005320Z #
2025-11-26T21:18:55.5005948Z # An error report file with more information is saved as:
2025-11-26T21:18:55.5006859Z # /__w/incubator-gluten/incubator-gluten/gluten-ut/spark40/hs_err_pid82017.log

@jinchengchenghh jinchengchenghh mentioned this pull request Nov 27, 2025
Open
50 tasks
zhztheplayer
zhztheplayer reviewed Nov 28, 2025
View reviewed changes
Copy link
Member

@zhztheplayer zhztheplayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems the CI is still failing

@jinchengchenghh jinchengchenghh marked this pull request as draft November 28, 2025 13:10
@jinchengchenghh
Copy link
Contributor Author

jinchengchenghh commented Nov 28, 2025

Maybe we need to compile the arrow, flaky test may cause by platform difference

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zhztheplayer zhztheplayer zhztheplayer left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

CORE works for Gluten Core

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@jinchengchenghh @zhouyuan @zhztheplayer