Skip to content

[spark] Fix analyze failure for timestamp ntz columns - #9485

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/tz-analyze
Open

[spark] Fix analyze failure for timestamp ntz columns#9485
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/tz-analyze

Conversation

@ArnavBalyan

@ArnavBalyan ArnavBalyan commented Aug 31, 2026

Copy link
Copy Markdown
Member

Purpose

  • Analyzing a table with timestamp ntz columns causes ClassCastException.
  • Spark reports timestamp ntz statistics as microsecond long values, but converter attempts to serialize them directly as timestamps.
  • Convert the statistics to Paimon timestamps before persisting them.

Tests

  • UT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant

@ArnavBalyan