Declarative ETL framework (formerly Delta Live Tables) for streaming and batch pipelines, built on Apache Spark Declarative Pipelines — define tables in SQL or Python and Databricks manages dependencies, retries, data-quality expectations and observability.
FluffyStack toolsJurisdictional exposure
Sub-services (3)
Expectations (data quality)
Inline assertions that quarantine, drop, or fail rows that violate
Apply Changes (CDC)
SCD Type 1 and 2 merge logic against source change feeds
Auto Loader Integration
Incremental ingestion of cloud-storage files with schema evolution
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Sovereign regions (1)
- AWS GovCloud (US-West) · San Francisco Bay AreaDatabricks on AWS GovCloud (FedRAMP High)
Commercial regions (56)
Europe (15)
- Europe West 1 (Belgium)
- EU (Paris)
- France Central (Paris)
- EU (Frankfurt)
- Europe West 3 (Frankfurt)
- Germany West Central (Frankfurt)
- EU (Ireland)
- North Europe (Ireland)
- West Europe (Netherlands)
- Sweden Central (Gävle)
- Switzerland North (Zurich)
- UK West (Cardiff)
- EU (London)
- UK South (London)
- Europe West 2 (London)
North America (18)
- Canada (Central)
- North America Northeast 1 (Montréal)
- Canada East (Quebec)
- Canada Central
- Mexico Central (Querétaro)
- US East (N. Virginia)
- US East 4 (Virginia)
- East US (Virginia)
- East US 2 (Virginia)
- US East (Ohio)
- US Central 1 (Iowa)
- Central US (Iowa)
- US West (Oregon)
- US West 4 (Nevada)
- US East 1 (South Carolina)
- West US 3 (Arizona)
- West US 2 (Washington)
- US West 1 (Oregon)
South America (3)
- South America (São Paulo)
- Brazil South (São Paulo)
- South America East 1 (São Paulo)
Asia (13)
- East Asia (Hong Kong)
- Asia Pacific (Mumbai)
- Asia South 1 (Mumbai)
- Central India (Pune)
- Asia Pacific (Jakarta)
- Asia Pacific (Tokyo)
- Japan East (Tokyo)
- Asia Northeast 1 (Tokyo)
- Asia Pacific (Singapore)
- Southeast Asia (Singapore)
- Asia Southeast 1 (Singapore)
- Asia Pacific (Seoul)
- Korea Central (Seoul)
Oceania (3)
- Asia Pacific (Sydney)
- Australia East (Sydney)
- Australia Southeast 1 (Sydney)
Middle East (3)
- Qatar Central (Doha)
- Middle East Central 2 (Dammam)
- UAE North (Dubai)
Africa (1)
- South Africa North (Johannesburg)
Tags
Equivalent services on other platforms
End-to-end data development platform over MaxCompute, EMR, and Hologres with visual and SQL-based task authoring, scheduled pipelines, data quality rules, data lineage, and a built-in business-glossary catalog
Serverless data integration platform with visual ETL authoring via Glue Studio, a Hive-compatible Data Catalog, automatic crawlers, DataBrew visual prep, and Glue Data Quality for declarative rule-based validation across Spark and Python jobs
Managed SaaS-to-AWS data-integration — pre-built connectors for Salesforce, ServiceNow, Slack, Google Analytics, Jira, and 50+ others sync data on schedules or events into S3 / Redshift / Snowflake without custom pipelines
Managed ETL and ELT service for data integration at scale with 100+ connectors, visual pipeline designer, mapping data flows, and triggers for event-driven orchestration
Unified stream and batch data processing service running Apache Beam pipelines with autoscaling, exactly-once semantics, and native sinks to BigQuery and Cloud Storage
Serverless workflow orchestration service for SQL transformations in BigQuery with Git-based version control, declarative SQLX models, dependency graph, assertions (data tests), and scheduled execution — the BigQuery-native alternative to dbt
Fully managed enterprise data integration service built on open-source CDAP, with a visual drag-and-drop pipeline builder, 150+ pre-built connectors and transformations, and GitOps-friendly pipeline export for hybrid ETL across Google Cloud and third-party data sources
Bidirectional sync between a Salesforce org and Heroku Postgres — schema mapping UI, real-time triggers, and back-pressure handling for million-row syncs
Managed ETL / ELT service for building visual pipelines that move and transform data between OCI Object Storage, Autonomous Database, ADW, and external sources — with Spark-based execution, incremental loads, and DataOps CI/CD via version-controlled workspaces
Cloud data management platform (now 'Informatica from Salesforce') — data and application integration, data quality and observability, enterprise catalogue and lineage, and master data management, with CLAIRE AI automation
Developer framework for building data applications in Python, Java, and Scala that run inside Snowflake
Declarative materialised tables with target lag scheduling — define a SELECT statement and Snowflake refreshes downstream tables automatically as inputs change
Managed data integration service built on Apache NiFi for batch and streaming movement of structured and unstructured data into Snowflake, deployable inside Snowflake (all clouds) or in the customer VPC (BYOC, AWS only).