GH-51638: [CI][C++][Parquet] Update expected JSON output in parquet-reader-test for simdjson 5.0 - #51661
Conversation
There was a problem hiding this comment.
Copilot review overview
🟢 Approval recommended
The version-specific expectations match the generated field order, and relevant C++ CI checks pass.
Review effort: Balanced
Findings: None
What changed in this PR
Updates Parquet reader test expectations for simdjson 5.0 formatting while preserving compatibility with 4.x.
Changes:
- Selects expected JSON formatting by simdjson major version.
- Updates four affected JSON-output tests.
| File | Description |
|---|---|
cpp/src/parquet/reader_test.cc |
Adds simdjson 5.x expected output variants. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
|
I think that we can skip these tests with simdjson < 5 to reduce maintenance costs. |
|
Or perhaps we can make those tests whitespace-insensitive? |
| if constexpr (simdjson::SIMDJSON_VERSION_MAJOR < 5) { | ||
| GTEST_SKIP() << "Test requires simdjson >= 5"; | ||
| } |
|
Alright, I've reworked this to skip four @pitrou as mentioned on the issue, I have a demo by 🤖 on my fork tadeja#2 (that checks only the content... but might be radical :)) |
To be honest the diff on that one is smaller than the one here 🤣 |
raulcd
left a comment
There was a problem hiding this comment.
I am happy with this fix (and improving the validation to skip formatting differences on a different PR) to solve the current failures for the release.
…eader-test for simdjson 5.0 (#51661) ### Rationale for this change See #51638 - `fractured_json` formatting changes with the new simdjson version 5.0 (whitespace, line breaks, key order in tables), cause `parquet-reader-test` to fail on four of its tests `TestJSONWithLocalFile.JSONOutput...` ### What changes are included in this PR? Check `simdjson::SIMDJSON_VERSION_MAJOR`, and for `>= 5` use the new expected formatting (JSON content hasn't changed). Keep existing expected output formatting for simdjson 4.x ### Are these changes tested? Yes, CI runs pass. ### Are there any user-facing changes? No, only test changes. ### Was AI used for this PR? **PR code and description written by:** - [x] Human - [x] AI **Reviewed before submission by:** - [x] Human - [ ] AI - [ ] Not reviewed * GitHub Issue: #51638 Authored-by: Tadeja Kadunc <tadeja.kadunc@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>

Rationale for this change
See #51638 -
fractured_jsonformatting changes with the new simdjson version 5.0 (whitespace, line breaks, key order in tables),cause
parquet-reader-testto fail on four of its testsTestJSONWithLocalFile.JSONOutput...What changes are included in this PR?
Check
simdjson::SIMDJSON_VERSION_MAJOR, and for>= 5use the new expected formatting (JSON content hasn't changed).Keep existing expected output formatting for simdjson 4.x
Are these changes tested?
Yes, CI runs pass.
Are there any user-facing changes?
No, only test changes.
Was AI used for this PR?
PR code and description written by:
Reviewed before submission by:
parquet-reader-testwith simdjson 5.x #51638