Category: Data Engineering & Pipelines
Azure Data Factory, Fabric Data Factory, Prefect, dbt and the orchestration patterns that keep data moving reliably.
-
Azure Data Factory to Fabric Data Factory: Pipelines That Survive Change
Microsoft calls Fabric Data Factory the next generation of Azure Data Factory. The concepts carry over; the operating habits that make pipelines survive source changes, failed runs and staff turnover are what most teams are missing. Here they are.
-
Prefect + dbt: Code-First Orchestration and Transformation for Small Data Teams
A two-person data team can run a tested, scheduled, observable analytics stack with two open-source tools: Prefect to orchestrate Python, dbt to transform in SQL. The division of labor, a working layout, and the places teams get it wrong.
