Skip to content

Conversation

@CTTY
Copy link
Collaborator

@CTTY CTTY commented Jan 6, 2026

Which issue does this PR close?

What changes are included in this PR?

  • When writing in clustered mode, use sort_by_partition to sort the data so the clustered writer can comsume it

Are these changes tested?

  • Added simple uts to verify that the SortExec is applied correctly

@CTTY CTTY changed the title feat(datafusion): Apply SortExec when writing in non-fanout mode feat(datafusion): Apply SortExec when writing in clustered mode Jan 6, 2026
Copy link
Contributor

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @CTTY for this pr!

@liurenjie1024 liurenjie1024 merged commit 6fa8785 into apache:main Jan 8, 2026
17 checks passed
@CTTY CTTY deleted the ctty/apply-sort branch January 8, 2026 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement insert_into for IcebergTableProvider

2 participants