Skip to content

[format] Introduce byte stream split for writing to parquet - #9499

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/paimon-bss
Open

[format] Introduce byte stream split for writing to parquet#9499
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/paimon-bss

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Paimon exposes the Parquet byte stream split option, but this is never used even if configured.
  • Forward the option to Parquet writer so bss can be enabled on the required columns.

Tests

  • UT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

1 participant