PartitionSpec

Trait PartitionSpec 

Source
pub trait PartitionSpec:
    Send
    + Sync
    + Debug {
    // Required methods
    fn is_empty(&self) -> bool;
    fn get_source_data_hash(&self) -> Vec<u8> ;
    fn write<'life0, 'async_trait>(
        &'life0 self,
        lake: Arc<DataLakeConnection>,
        logger: Arc<dyn Logger>,
    ) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>
       where 'life0: 'async_trait,
             Self: 'async_trait;
}
Expand description

A trait for defining a partition specification.

Required Methods§

Source

fn is_empty(&self) -> bool

Returns true if the partition is empty.

Source

fn get_source_data_hash(&self) -> Vec<u8>

Returns a hash of the source data.

Source

fn write<'life0, 'async_trait>( &'life0 self, lake: Arc<DataLakeConnection>, logger: Arc<dyn Logger>, ) -> Pin<Box<dyn Future<Output = Result<(), Error>> + Send + 'async_trait>>
where 'life0: 'async_trait, Self: 'async_trait,

Writes the partition to the data lake.

Implementors§