Struct ChunkSender 

pub struct ChunkSender { /* private fields */ }

ChunkSender sends data as RecordBatch chunks through a channel. It accumulates data until reaching a threshold size, then sends it as a chunk.

Implementations

impl ChunkSender

pub fn new( chunk_sender: Sender<Result<RecordBatch, Error>>, chunk_threshold: usize, ) -> ChunkSender

Creates a new ChunkSender with specified chunk size threshold

pub async fn write(&mut self, buf: &[u8]) -> Result<(), Error>

Writes data to the chunk buffer, automatically flushing when threshold is reached

pub async fn flush(&mut self) -> Result<(), Error>

Flushes the current chunk as a RecordBatch to the channel

Trait Implementations

impl AsyncWriter for ChunkSender

Implementation of AsyncWriter for ChunkSender

fn write<'life0, 'life1, 'async_trait>( &'life0 mut self, buf: &'life1 [u8], ) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, ChunkSender: 'async_trait,

fn flush<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, ChunkSender: 'async_trait,