when should we use datafusion over etl data flows


when should we use data fusion over ETL data flows and what are the differences between them.

thank you

Best Answer

  • AS
    AS πŸ”΅
    Accepted Answer

    Datafusion is primarily used for the simplest of use cases when you want to just join or union datasets together.Β  It also runs VERY fast.

    ETL has much more functionality and is better for most use cases involving conditional logic, column filtering, custom calculations, grouping, filtering, formatting, etc.Β