Dataflow
GCPAnalyticsUnified stream and batch data processing service running Apache Beam pipelines with autoscaling, exactly-once semantics, and native sinks to BigQuery and Cloud Storage
FluffyStack toolsAttributes
- Auto Scaling
- Yes
- Apache Beam
- Yes
- Exactly Once Processing
- Yes
Sub-services (2)
Batch Pipelines
Large-scale batch data processing jobs
Streaming Pipelines
Real-time stream processing with auto-scaling
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Sovereign regions (2)
- T-Systems Sovereign Cloud · FrankfurtT-Systems Sovereign Cloud powered by Google Cloud
- S3NS Sovereign Cloud · ParisS3NS — Google Cloud + Thales joint venture
Commercial regions (42)
Europe (13)
- Belgium
- Finland
- Paris
- Berlin
- Frankfurt
- Milan
- Turin
- Netherlands
- Warsaw
- Madrid
- Stockholm
- Zurich
- London
North America (12)
- Montréal
- Toronto
- Querétaro
- Northern Virginia
- Columbus
- Iowa
- Dallas
- Las Vegas
- Los Angeles
- South Carolina
- Salt Lake City
- Oregon
South America (2)
- São Paulo
- Santiago
Asia (9)
- Hong Kong
- Delhi
- Mumbai
- Jakarta
- Osaka
- Tokyo
- Singapore
- Seoul
- Taiwan
Oceania (2)
- Melbourne
- Sydney
Middle East (3)
- Tel Aviv
- Doha
- Dammam
Africa (1)
- Johannesburg
Tags
Equivalent services on other platforms
Real-time streaming data collection, processing, and analytics platform with Data Streams, Data Firehose, Video Streams, and Kinesis Data Analytics sub-services
Real-time data stream processing and analytics engine with SQL-based queries, windowing functions, and native inputs from Event Hubs, IoT Hub, and Blob Storage
Fully managed orchestration service for data engineering and ML pipelines with DAG-based scheduling, dependency tracking, alerting, and multi-task jobs across notebooks, JARs, and Python scripts