We actually baked a rule to catch UDF usage into our Python linter. Almost alway...

		jellyfishbeaver 3 months ago \| parent \| context \| favorite \| on: 650GB of Data (Delta Lake on S3). Polars vs. DuckD... We actually baked a rule to catch UDF usage into our Python linter. Almost always, a UDF can be refactored to use only native PySpark functions.