Declarative ETL framework for streaming and batch pipelines on the lakehouse — define tables in SQL or Python, DLT handles dependency graph, retries, data quality, and observability
FluffyStack toolsJurisdictional exposure
Sub-services (3)
Expectations (data quality)
Inline assertions that quarantine, drop, or fail rows that violate
Apply Changes (CDC)
SCD Type 1 and 2 merge logic against source change feeds
Auto Loader Integration
Incremental ingestion of cloud-storage files with schema evolution
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Sovereign regions (1)
- AWS GovCloud (US-West) · San Francisco Bay AreaDatabricks on AWS GovCloud (FedRAMP High)
Commercial regions (25)
Europe (7)
- EU (Frankfurt)
- Europe West 3 (Frankfurt)
- EU (Ireland)
- North Europe (Ireland)
- West Europe (Netherlands)
- EU (London)
- UK South (London)
North America (11)
- Canada (Central)
- Canada Central
- US East (N. Virginia)
- US East 4 (Virginia)
- East US (Virginia)
- East US 2 (Virginia)
- US East (Ohio)
- US Central 1 (Iowa)
- Central US (Iowa)
- US West (Oregon)
- West US 2 (Washington)
South America (1)
- South America (São Paulo)
Asia (4)
- Asia Pacific (Mumbai)
- Asia Pacific (Tokyo)
- Asia Pacific (Singapore)
- Southeast Asia (Singapore)
Oceania (2)
- Asia Pacific (Sydney)
- Australia East (Sydney)
Tags
Equivalent services on other platforms
End-to-end data development platform over MaxCompute, EMR, and Hologres with visual and SQL-based task authoring, scheduled pipelines, data quality rules, data lineage, and a built-in business-glossary catalog
Serverless data integration platform with visual ETL authoring via Glue Studio, a Hive-compatible Data Catalog, automatic crawlers, DataBrew visual prep, and Glue Data Quality for declarative rule-based validation across Spark and Python jobs
Managed ETL and ELT service for data integration at scale with 100+ connectors, visual pipeline designer, mapping data flows, and triggers for event-driven orchestration
Unified stream and batch data processing service running Apache Beam pipelines with autoscaling, exactly-once semantics, and native sinks to BigQuery and Cloud Storage
Intelligent data fabric and catalog that unifies distributed data across Cloud Storage, BigQuery, and third-party lakes with automatic discovery, quality scoring, data lineage, attribute-based access control, and generative AI-powered metadata enrichment
Serverless change-data-capture (CDC) and replication service that continuously streams change events from MySQL, PostgreSQL, Oracle, and SQL Server sources into BigQuery, Cloud Storage, Spanner, and Cloud SQL with minimal source-side impact
Fully managed enterprise data integration service built on open-source CDAP, with a visual drag-and-drop pipeline builder, 150+ pre-built connectors and transformations, and GitOps-friendly pipeline export for hybrid ETL across Google Cloud and third-party data sources