Fully managed orchestration service for data engineering and ML pipelines with DAG-based scheduling, dependency tracking, alerting, and multi-task jobs across notebooks, JARs, and Python scripts
FluffyStack toolsJurisdictional exposure
Sub-services (3)
Jobs
Multi-task orchestrated jobs with retries and conditional logic
Delta Live Tables
Declarative ETL framework for building reliable data pipelines
SQL Alerts
Threshold-based alerts triggered by SQL query results
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Sovereign regions (1)
- AWS GovCloud (US-West) · San Francisco Bay AreaDatabricks on AWS GovCloud (FedRAMP High)
Commercial regions (56)
Europe (15)
- Europe West 1 (Belgium)
- EU (Paris)
- France Central (Paris)
- EU (Frankfurt)
- Europe West 3 (Frankfurt)
- Germany West Central (Frankfurt)
- EU (Ireland)
- North Europe (Ireland)
- West Europe (Netherlands)
- Sweden Central (Gävle)
- Switzerland North (Zurich)
- UK West (Cardiff)
- EU (London)
- UK South (London)
- Europe West 2 (London)
North America (18)
- Canada (Central)
- North America Northeast 1 (Montréal)
- Canada East (Quebec)
- Canada Central
- Mexico Central (Querétaro)
- US East (N. Virginia)
- US East 4 (Virginia)
- East US (Virginia)
- East US 2 (Virginia)
- US East (Ohio)
- US Central 1 (Iowa)
- Central US (Iowa)
- US West (Oregon)
- US West 4 (Nevada)
- US East 1 (South Carolina)
- West US 3 (Arizona)
- West US 2 (Washington)
- US West 1 (Oregon)
South America (3)
- South America (São Paulo)
- Brazil South (São Paulo)
- South America East 1 (São Paulo)
Asia (13)
- East Asia (Hong Kong)
- Asia Pacific (Mumbai)
- Asia South 1 (Mumbai)
- Central India (Pune)
- Asia Pacific (Jakarta)
- Asia Pacific (Tokyo)
- Japan East (Tokyo)
- Asia Northeast 1 (Tokyo)
- Asia Pacific (Singapore)
- Southeast Asia (Singapore)
- Asia Southeast 1 (Singapore)
- Asia Pacific (Seoul)
- Korea Central (Seoul)
Oceania (3)
- Asia Pacific (Sydney)
- Australia East (Sydney)
- Australia Southeast 1 (Sydney)
Middle East (3)
- Qatar Central (Doha)
- Middle East Central 2 (Dammam)
- UAE North (Dubai)
Africa (1)
- South Africa North (Johannesburg)
Tags
Equivalent services on other platforms
Visual workflow orchestration for distributed applications with Standard (long-running) and Express (high-volume) workflows, Amazon States Language (ASL), and 220+ service integrations
Hosted Apache Airflow for data-pipeline orchestration — DAGs in Python, scheduler plus worker autoscaling, and direct VPC access to private data sources, without operating the Airflow control plane yourself
Managed ETL and ELT service for data integration at scale with 100+ connectors, visual pipeline designer, mapping data flows, and triggers for event-driven orchestration
Managed Apache Airflow service (formerly Cloud Composer) for authoring, scheduling and monitoring data pipelines, supporting Airflow 2 and Airflow 3 (GA since April 2026), with IAM, VPC and integrations with BigQuery, Dataflow and Spark.