Collection.sink_parquet

Collection.sink_parquet(directory: str | Path, **kwargs: Any) → None

Stream the members of this collection into parquet files in a directory.

This method writes one parquet file per member into the provided directory. Each parquet file is named <member>.parquet. No file is written for optional members which are not provided in the current collection.

Parameters:

• directory – The directory where the Parquet files should be written to. If the directory does not exist, it is created automatically, including all of its parents.

• kwargs – Additional keyword arguments passed to polars.LazyFrame.sink_parquet(). metadata may only be provided if it is a dictionary.

Attention

This method suffers from the same limitations as serialize().