Transformation support matrix

Welcome to the transformation support matrix!

This is a Quarto dashboard that shows the IbisML transformations each backend supports.

Due to differences in SQL dialects and upstream support for different operations in different backends, support for the full breadth of the IbisML transfromations varies:

✅ Fully supported
🚫 Not supported
🟡 Partial support (hover over for more information)
🔍 Support varies by operation or data type across different backends (check the Ibis operation support matrix for details)

Number of backends

Number of SQL backends

Search:

Showing 21 entries

	Backend	bigquery	clickhouse	dask	datafusion	druid	duckdb	exasol	flink	impala	mssql	mysql	oracle	pandas	polars	postgres	pyspark	risingwave	snowflake	sqlite	trino
	Full coverage	17 (81%)	19 (90%)	17 (81%)	18 (86%)	9 (43%)	21 (100%)	14 (67%)	14 (67%)	15 (71%)	14 (67%)	17 (81%)	18 (86%)	17 (81%)	20 (95%)	21 (100%)	4 (19%)	20 (95%)	21 (100%)	14 (67%)	17 (81%)
	Partial coverage	2 (10%)	1 (5%)	2 (10%)	1 (5%)	5 (24%)	0 (0%)	3 (14%)	3 (14%)	4 (19%)	3 (14%)	2 (10%)	3 (14%)	2 (10%)	0 (0%)	0 (0%)	1 (5%)	0 (0%)	0 (0%)	4 (19%)	2 (10%)
Category	Step
common	Cast	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍
common	Drop	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅
common	Mutate	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍
common	MutateAt	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍	🔍
discretize	DiscretizeKBins	🟡	✅	✅	🟡	🟡	✅	✅	🟡	🟡	🟡	🟡	✅	✅	✅	✅	🚫	✅	✅	🟡	🟡
encode	CountEncode	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
encode	OneHotEncode	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
encode	OrdinalEncode	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
encode	TargetEncode	✅	✅	🚫	✅	🚫	✅	🚫	🚫	✅	🚫	✅	✅	🚫	🚫	✅	🚫	✅	✅	🚫	✅
generate_features	CreatePolynomialFeatures	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
handle_outliers	HandleUnivariateOutliers	🟡	✅	✅	🚫	🚫	✅	✅	🟡	🟡	🟡	🟡	✅	✅	✅	✅	🚫	✅	✅	🟡	🟡
impute	FillNA	✅	✅	✅	✅	🟡	✅	🟡	🟡	✅	🟡	✅	✅	✅	✅	✅	🚫	✅	✅	🟡	✅
impute	ImputeMean	✅	✅	✅	✅	🚫	✅	🚫	🚫	✅	🚫	✅	✅	✅	✅	✅	🚫	✅	✅	🚫	✅
impute	ImputeMedian	🚫	✅	✅	✅	🚫	✅	🚫	🚫	🚫	🚫	🚫	✅	✅	✅	✅	🚫	✅	✅	🚫	🚫
impute	ImputeMode	🚫	🚫	✅	🚫	🚫	✅	🚫	🚫	🚫	🚫	🚫	✅	✅	✅	✅	🚫	🚫	✅	🟡	🚫
select_features	DropZeroVariance	✅	✅	✅	✅	🟡	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🟡	✅	✅	✅	✅
standardize	ScaleMinMax	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
standardize	ScaleStandard	✅	✅	✅	✅	🚫	✅	✅	✅	✅	✅	✅	✅	✅	✅	✅	🚫	✅	✅	✅	✅
temporal	ExpandDate	✅	✅	🟡	✅	🟡	✅	🟡	✅	🟡	✅	✅	🟡	🟡	✅	✅	🚫	✅	✅	✅	✅
temporal	ExpandTime	✅	🟡	🚫	✅	🚫	✅	✅	✅	✅	✅	✅	🟡	🚫	✅	✅	🚫	✅	✅	✅	✅
temporal	ExpandTimestamp	✅	✅	🟡	✅	🟡	✅	🟡	✅	🟡	✅	✅	🟡	🟡	✅	✅	🚫	✅	✅	✅	✅