Databricks Model Serving

DatabricksAI & ML

Serverless real-time endpoints for custom ML models, agents and hosted foundation models (pay-per-token or provisioned throughput), with autoscaling, gateway guardrails and Unity Catalog governance.

Jurisdictional exposure

Provider HQ
USSan Francisco, USA

Subject to CLOUD Act, FISA-702, DPF

Region locations
APACCNEEAEUUKUSOther57 regions across 7 jurisdictions
Sovereign option
Yes — 1 sovereign-flagged region available

Sub-services (4)

Foundation Model APIs

Pay-per-token and provisioned-throughput access to hosted LLMs

Custom Model Serving

Real-time endpoints for MLflow models and agents

External Models

Govern and route calls to third-party model providers

AI Gateway

Rate limits, guardrails, usage tracking and payload logging for endpoints

Compliance & Certifications

This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.

Where this runs

57 regions
23 countries
1sovereign
Sovereign regions (1)
  • AWS GovCloud (US-West) · San Francisco Bay AreaDatabricks on AWS GovCloud (FedRAMP High)
Commercial regions (56)

Europe (15)

  • Europe West 1 (Belgium)
  • EU (Paris)
  • France Central (Paris)
  • EU (Frankfurt)
  • Europe West 3 (Frankfurt)
  • Germany West Central (Frankfurt)
  • EU (Ireland)
  • North Europe (Ireland)
  • West Europe (Netherlands)
  • Sweden Central (Gävle)
  • Switzerland North (Zurich)
  • UK West (Cardiff)
  • EU (London)
  • UK South (London)
  • Europe West 2 (London)

North America (18)

  • Canada (Central)
  • North America Northeast 1 (Montréal)
  • Canada East (Quebec)
  • Canada Central
  • Mexico Central (Querétaro)
  • US East (N. Virginia)
  • US East 4 (Virginia)
  • East US (Virginia)
  • East US 2 (Virginia)
  • US East (Ohio)
  • US Central 1 (Iowa)
  • Central US (Iowa)
  • US West (Oregon)
  • US West 4 (Nevada)
  • US East 1 (South Carolina)
  • West US 3 (Arizona)
  • West US 2 (Washington)
  • US West 1 (Oregon)

South America (3)

  • South America (São Paulo)
  • Brazil South (São Paulo)
  • South America East 1 (São Paulo)

Asia (13)

  • East Asia (Hong Kong)
  • Asia Pacific (Mumbai)
  • Asia South 1 (Mumbai)
  • Central India (Pune)
  • Asia Pacific (Jakarta)
  • Asia Pacific (Tokyo)
  • Japan East (Tokyo)
  • Asia Northeast 1 (Tokyo)
  • Asia Pacific (Singapore)
  • Southeast Asia (Singapore)
  • Asia Southeast 1 (Singapore)
  • Asia Pacific (Seoul)
  • Korea Central (Seoul)

Oceania (3)

  • Asia Pacific (Sydney)
  • Australia East (Sydney)
  • Australia Southeast 1 (Sydney)

Middle East (3)

  • Qatar Central (Doha)
  • Middle East Central 2 (Dammam)
  • UAE North (Dubai)

Africa (1)

  • South Africa North (Johannesburg)

Tags

Equivalent services on other platforms

Alibaba Platform for AI (PAI)Alibaba

Enterprise ML and AI platform covering PAI-Studio visual workflow builder, PAI-DSW Jupyter notebooks, PAI-EAS elastic inference serving, PAI-Blade inference optimisation, and integration with Alibaba's Qwen foundation models

Alibaba Qwen (Tongyi Qianwen)Alibaba

Alibaba's Qwen model family, from proprietary API models (Qwen-Max, Qwen-Plus, Qwen-Flash) to open-weight Qwen releases, served through Alibaba Cloud Model Studio's OpenAI-compatible API for chat, vision, audio, coding, embeddings and function calling

Aruba AI ModelsAruba

OpenAI-compatible API to open-weight models (e.g. gpt-oss-120b, Llama 3.1 8B, Mistral Small 3.2, Qwen3 Coder, bge-m3 embeddings, Qwen image models) hosted in Aruba's Italian data centres, billed per token or per image.

Amazon SageMaker AIAWS

Fully managed ML platform (formerly Amazon SageMaker) for building, training and deploying models: Studio notebooks, managed training jobs, HyperPod clusters for foundation-model training, hosted inference endpoints, Canvas AutoML and Feature Store.

Amazon BedrockAWS

Build generative AI applications with foundation models from Anthropic (Claude Opus 4.7 from April 2026), Cohere, Meta, Mistral, Stability AI, TwelveLabs (video understanding), and Amazon's own Nova family — accessed via a single API with fine-tuning, knowledge bases, agents, and a model marketplace for discovery and easy onboarding

Amazon NovaAWS

AWS-built foundation model family covering text (Micro, Lite, Pro, Premier), image generation (Canvas), and video generation (Reel) — accessed through the Bedrock runtime with tight pricing and low-latency streaming, launched at re:Invent 2024

Azure OpenAI ServiceAzure

Enterprise access to OpenAI models (GPT-5 family, reasoning, image, audio and embedding models) through Microsoft Foundry, with Entra ID auth, private networking, global, data-zone or regional deployments, and pay-as-you-go or provisioned throughput.

Azure Machine LearningAzure

End-to-end platform for building and deploying ML models with automated ML, designer (drag-and-drop), managed compute clusters, MLflow tracking, and responsible AI dashboards

Microsoft FoundryAzure

Platform for building, deploying and governing AI apps and agents (formerly Azure AI Studio and Azure AI Foundry): model catalogue spanning OpenAI and partner models, Foundry Agent Service with MCP support, Foundry IQ knowledge, evaluation, tracing and a control plane.

relaxAICivo

UK-hosted AI assistant and OpenAI-compatible API from Civo, with chat subscriptions per user and per-token API pricing; data processed in UK data centres

Cloudflare Workers AICloudflare

Serverless GPU-backed AI inference at the edge running a catalogue of open-source text, image, speech, and embedding models (Llama, Mistral, Stable Diffusion, Whisper, BGE) with pricing per Neuron (Workers AI's billing unit) and direct binding from Workers code

Cloud Temple LLM-as-a-ServiceCloud Temple

Hosted large-language-model inference endpoints on SecNumCloud-qualified GPUs. Positioned as the French sovereign alternative to hosted OpenAI / Anthropic APIs for regulated workloads — health data (HDS-qualified), public-sector, defence-adjacent

InferenceDigitalOcean

Managed model inference with a catalogue of DigitalOcean-hosted and third-party models, serverless and dedicated deployments, and request routing across providers

Exoscale Dedicated InferenceExoscale

Concrete AI service that deploys public, gated or private Hugging Face models on dedicated NVIDIA GPUs in European data centres as OpenAI-compatible API endpoints, billed per second of GPU time plus Object Storage, with scale-to-zero

Gcore Everywhere InferenceGcore

Serverless AI inference platform that deploys open-source or custom containerised models on NVIDIA GPUs in chosen regions, with smart routing across 210+ PoPs to the nearest endpoint and per-second GPU billing

Gcore Everywhere AIGcore

AI platform for managing training and inference across on-premises, hybrid and cloud GPU environments, including air-gapped deployments, with JupyterLab, Slurm and MLflow tooling

Gemini Enterprise Agent PlatformGCP

Google Cloud's AI development platform (formerly Vertex AI): Model Garden access to Gemini and 200+ models, Agent Studio and ADK for building agents, Agent Runtime, managed training and tuning on TPUs/GPUs, pipelines, model registry and Vector Search.

Gemini APIGCP

Direct API access to Google's most capable multimodal AI models with text, image, audio, and video understanding, long context windows, and function calling support

Managed Inference and AgentsHeroku

Heroku add-on giving OpenAI-style API access to chat, embedding, rerank and image models hosted on Amazon Bedrock, with tool execution on dynos and MCP server support; US and EU model sets

ModelArtsHuawei

End-to-end AI development platform with AutoML, data labelling, distributed training on Ascend and GPU clusters, and one-click deployment to cloud or edge

Pangu ModelsHuawei

Huawei's Pangu family of large models for NLP, multimodal, prediction and scientific computing, with model development, fine-tuning and deployment on Ascend infrastructure

IBM watsonx.aiIBM

Enterprise AI studio for training, validating, tuning, and deploying foundation models and traditional ML models, with IBM's Granite model family, Hugging Face integration, prompt lab, synthetic data generation, and governance via watsonx.governance

Infomaniak AI ServicesInfomaniak

OpenAI-compatible API to open-weight models hosted in Infomaniak's Swiss data centres: LLMs (e.g. Qwen 3.5, Mistral Small 4, Kimi K2.6, Apertus, Gemma 4), embeddings, rerankers, Whisper transcription and image generation; billed per token or per minute.

IONOS AI Model HubIONOS

Serverless inference API for a curated catalogue of open-weight models (e.g. Llama, Mistral, Qwen, gpt-oss, FLUX image and BGE embedding models) hosted in Berlin, with an OpenAI-compatible API, built-in vector stores for RAG, and per-token or per-image billing.

Advanced AI SpaceKakao

Deploys built-in catalogue or custom AI models to dedicated GPU-backed inference endpoints called via API key; available to pre-approved customers

CLOVA StudioNaver

Naver's HyperCLOVA X foundation-model platform for Korean-language LLM workloads — chat completion, embeddings, function calling, RAG over Korean text with strong native-language performance

Nscale Serverless InferenceNscale

Self-serve, prepaid serverless inference API for open-weight chat, vision, embedding and image-generation models on Nscale GPU infrastructure, with OpenAI-compatible endpoints and token-based pay-as-you-go pricing.

NumSpot Mistral AI PlatformNumSpot

Managed generative AI platform hosting Mistral AI models, operated end to end in France on NumSpot's sovereign cloud; access on request through sales rather than self-service

Red Hat OpenShift AIOpenShift

Self-managed AI/ML platform for OpenShift (formerly Red Hat OpenShift Data Science), built on the upstream Open Data Hub project, with workbenches, pipelines, model registry and KServe model serving; the managed Cloud Service edition ended in October 2025

OCI Generative AIOracle

OCI's managed generative AI platform: on-demand and dedicated-cluster access to Cohere, Meta Llama, Google Gemini, OpenAI gpt-oss and xAI Grok models, fine-tuning, OpenAI-compatible APIs, and Enterprise AI features for building and deploying agents.

OCI Data ScienceOracle

Fully managed machine learning platform with JupyterLab notebooks, conda-environment library, job orchestration, model deployments as HTTPS endpoints, feature store, and model catalog — integrated with Autonomous Database and Object Storage for end-to-end ML workflows

ModelArtsT Cloud

AI development platform covering data preparation, Jupyter notebooks, CPU/GPU training (including automated ExeML) and deployment of models as online APIs, batch jobs or edge services

Outscale AI StudioOutscale

AI Studio (optionally with Le Chat and Vibe agent tooling) delivered on dedicated 8x H200 GPU capacity in the SecNumCloud cloudgouv-eu-west-1 region, giving access to a library of sovereign LLMs; sold on quotation

Outscale LLM as a ServiceOutscale

Dedicated Mistral AI model deployments (Ministral 8B, Mistral Small, Medium 3, Codestral, Voxtral, Embed) on reserved L40, H100 or H200 GPUs, sold as fixed monthly bundles in the SecNumCloud cloudgouv-eu-west-1 region

OVHcloud AI EndpointsOVHcloud

Serverless API access to 20+ open-weight models (LLMs, speech-to-text and text-to-speech, document and image analysis) through an OpenAI-compatible API. Billed per input and output token and hosted in the EU, with a free sandbox and a Batch mode in beta.

OVHcloud AI TrainingOVHcloud

Managed GPU-backed training jobs for custom ML models, with H100 / H200 / L40s / L4 GPU options, distributed-training orchestration, and Jupyter integration

OVHcloud AI DeployOVHcloud

Managed serverless deployment of containerised AI/ML inference workloads with autoscaling and per-second billing, for hosting custom models built outside the LLM-focused AI Endpoints product

OVHcloud AI NotebooksOVHcloud

Managed Jupyter and VS Code notebooks with dedicated CPU or GPU resources, pre-installed frameworks (PyTorch, TensorFlow, Scikit-learn, Hugging Face) and per-minute billing.

Scaleway Generative APIsScaleway

OpenAI-compatible inference for open-weight models (e.g. gpt-oss, Mistral, Qwen) hosted in Paris: Serverless billed per million tokens with 1M free tokens, plus Dedicated Deployment (formerly Managed Inference) billed hourly

Snowflake CortexSnowflake

Fully managed AI and ML service offering hosted LLMs, vector search, and ML functions inside Snowflake SQL

Snowflake MLSnowflake

Integrated machine-learning platform inside Snowflake — feature store, model registry, distributed training on warehouses or the container runtime, model serving and ML observability.

STACKIT AI Model ServingSTACKIT

Managed inference API for shared open-weight chat and embedding models (e.g. gpt-oss, Qwen3, Gemma 4, Llama 3.3 70B), billed per million input and output tokens and hosted in STACKIT's EU01 region; launched May 2025

Tencent HY (Hunyuan)Tencent

Tencent's in-house Hunyuan (Tencent HY) large language models, including Hy3 (256K context), Hy4 preview (1M context) and Hy-MT2 translation models, served through Tencent Cloud's LLM Service TokenHub API alongside third-party models

Vultr Serverless InferenceVultr

Serverless platform for deploying and scaling AI model inference without managing GPU infrastructure

Pricing

Pricing model:dbu-consumption