FailureInfo#

class dataframely.FailureInfo[source]

A container carrying information about rows failing validation in Schema.filter().

Inspection#

FailureInfo.invalid()

The rows of the original data frame containing the invalid rows.

FailureInfo.counts()

The number of validation failures for each individual rule.

FailureInfo.cooccurrence_counts()

The number of validation failures per co-occurring rule validation failure.

FailureInfo.__len__()

I/O#

FailureInfo.write_parquet(file, **kwargs)

Write the failure info to a parquet file.

FailureInfo.sink_parquet(file, **kwargs)

Stream the failure info to a parquet file.

FailureInfo.read_parquet(source, **kwargs)

Read a parquet file with the failure info.

FailureInfo.scan_parquet(source, **kwargs)

Lazily read a parquet file with the failure info.

FailureInfo.write_delta(target, **kwargs)

Write the failure info to a delta lake table.

FailureInfo.read_delta(source, **kwargs)

Read a delta lake table with the failure info.

FailureInfo.scan_delta(source, **kwargs)

Lazily read a delta lake table with the failure info.