Skip to content

Conversation

@cofin
Copy link
Member

@cofin cofin commented Jan 29, 2026

More adjustments to address concurrency issues and inefficient implementations

cofin added 4 commits January 29, 2026 21:00
…rage backends

- Fix AsyncArrowBatchIterator to use sentinel pattern instead of catching
  StopIteration, which cannot propagate through asyncio Futures
- Make async_() limiter truly optional (None = no semaphore)
- Remove storage_limiter usage from all backends to avoid event loop
  binding issues with pytest-asyncio
- Rename all sync methods to *_sync pattern (breaking change)
Tests were using old method names (write_bytes, write_text) that no
longer match the ObjectStoreProtocol after the API unification.
@cofin cofin changed the title fix(arrow): in-memory streaming fix(arrow)!: in-memory streaming Jan 30, 2026
@cofin cofin merged commit edeaf68 into main Jan 30, 2026
12 checks passed
@cofin cofin deleted the fix/buffer-2 branch January 30, 2026 01:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants