Serverless real-time endpoints for custom ML models, agents and hosted foundation models (pay-per-token or provisioned throughput), with autoscaling, gateway guardrails and Unity Catalog governance.
Jurisdictional exposure
Sub-services (4)
Foundation Model APIs
Pay-per-token and provisioned-throughput access to hosted LLMs
Custom Model Serving
Real-time endpoints for MLflow models and agents
External Models
Govern and route calls to third-party model providers
AI Gateway
Rate limits, guardrails, usage tracking and payload logging for endpoints
Compliance & Certifications
This service is attested for the following frameworks. Always verify with the provider before relying on a specific compliance posture.
Where this runs
Sovereign regions (1)
- AWS GovCloud (US-West) · San Francisco Bay AreaDatabricks on AWS GovCloud (FedRAMP High)
Commercial regions (56)
Europe (15)
- Europe West 1 (Belgium)
- EU (Paris)
- France Central (Paris)
- EU (Frankfurt)
- Europe West 3 (Frankfurt)
- Germany West Central (Frankfurt)
- EU (Ireland)
- North Europe (Ireland)
- West Europe (Netherlands)
- Sweden Central (Gävle)
- Switzerland North (Zurich)
- UK West (Cardiff)
- EU (London)
- UK South (London)
- Europe West 2 (London)
North America (18)
- Canada (Central)
- North America Northeast 1 (Montréal)
- Canada East (Quebec)
- Canada Central
- Mexico Central (Querétaro)
- US East (N. Virginia)
- US East 4 (Virginia)
- East US (Virginia)
- East US 2 (Virginia)
- US East (Ohio)
- US Central 1 (Iowa)
- Central US (Iowa)
- US West (Oregon)
- US West 4 (Nevada)
- US East 1 (South Carolina)
- West US 3 (Arizona)
- West US 2 (Washington)
- US West 1 (Oregon)
South America (3)
- South America (São Paulo)
- Brazil South (São Paulo)
- South America East 1 (São Paulo)
Asia (13)
- East Asia (Hong Kong)
- Asia Pacific (Mumbai)
- Asia South 1 (Mumbai)
- Central India (Pune)
- Asia Pacific (Jakarta)
- Asia Pacific (Tokyo)
- Japan East (Tokyo)
- Asia Northeast 1 (Tokyo)
- Asia Pacific (Singapore)
- Southeast Asia (Singapore)
- Asia Southeast 1 (Singapore)
- Asia Pacific (Seoul)
- Korea Central (Seoul)
Oceania (3)
- Asia Pacific (Sydney)
- Australia East (Sydney)
- Australia Southeast 1 (Sydney)
Middle East (3)
- Qatar Central (Doha)
- Middle East Central 2 (Dammam)
- UAE North (Dubai)
Africa (1)
- South Africa North (Johannesburg)
Tags
Equivalent services on other platforms
Enterprise ML and AI platform covering PAI-Studio visual workflow builder, PAI-DSW Jupyter notebooks, PAI-EAS elastic inference serving, PAI-Blade inference optimisation, and integration with Alibaba's Qwen foundation models
Alibaba's Qwen model family, from proprietary API models (Qwen-Max, Qwen-Plus, Qwen-Flash) to open-weight Qwen releases, served through Alibaba Cloud Model Studio's OpenAI-compatible API for chat, vision, audio, coding, embeddings and function calling
OpenAI-compatible API to open-weight models (e.g. gpt-oss-120b, Llama 3.1 8B, Mistral Small 3.2, Qwen3 Coder, bge-m3 embeddings, Qwen image models) hosted in Aruba's Italian data centres, billed per token or per image.
Fully managed ML platform (formerly Amazon SageMaker) for building, training and deploying models: Studio notebooks, managed training jobs, HyperPod clusters for foundation-model training, hosted inference endpoints, Canvas AutoML and Feature Store.
Build generative AI applications with foundation models from Anthropic (Claude Opus 4.7 from April 2026), Cohere, Meta, Mistral, Stability AI, TwelveLabs (video understanding), and Amazon's own Nova family — accessed via a single API with fine-tuning, knowledge bases, agents, and a model marketplace for discovery and easy onboarding
AWS-built foundation model family covering text (Micro, Lite, Pro, Premier), image generation (Canvas), and video generation (Reel) — accessed through the Bedrock runtime with tight pricing and low-latency streaming, launched at re:Invent 2024
Enterprise access to OpenAI models (GPT-5 family, reasoning, image, audio and embedding models) through Microsoft Foundry, with Entra ID auth, private networking, global, data-zone or regional deployments, and pay-as-you-go or provisioned throughput.
End-to-end platform for building and deploying ML models with automated ML, designer (drag-and-drop), managed compute clusters, MLflow tracking, and responsible AI dashboards
Platform for building, deploying and governing AI apps and agents (formerly Azure AI Studio and Azure AI Foundry): model catalogue spanning OpenAI and partner models, Foundry Agent Service with MCP support, Foundry IQ knowledge, evaluation, tracing and a control plane.
UK-hosted AI assistant and OpenAI-compatible API from Civo, with chat subscriptions per user and per-token API pricing; data processed in UK data centres
Serverless GPU-backed AI inference at the edge running a catalogue of open-source text, image, speech, and embedding models (Llama, Mistral, Stable Diffusion, Whisper, BGE) with pricing per Neuron (Workers AI's billing unit) and direct binding from Workers code
Hosted large-language-model inference endpoints on SecNumCloud-qualified GPUs. Positioned as the French sovereign alternative to hosted OpenAI / Anthropic APIs for regulated workloads — health data (HDS-qualified), public-sector, defence-adjacent
Managed model inference with a catalogue of DigitalOcean-hosted and third-party models, serverless and dedicated deployments, and request routing across providers
Concrete AI service that deploys public, gated or private Hugging Face models on dedicated NVIDIA GPUs in European data centres as OpenAI-compatible API endpoints, billed per second of GPU time plus Object Storage, with scale-to-zero
Serverless AI inference platform that deploys open-source or custom containerised models on NVIDIA GPUs in chosen regions, with smart routing across 210+ PoPs to the nearest endpoint and per-second GPU billing
AI platform for managing training and inference across on-premises, hybrid and cloud GPU environments, including air-gapped deployments, with JupyterLab, Slurm and MLflow tooling
Google Cloud's AI development platform (formerly Vertex AI): Model Garden access to Gemini and 200+ models, Agent Studio and ADK for building agents, Agent Runtime, managed training and tuning on TPUs/GPUs, pipelines, model registry and Vector Search.
Direct API access to Google's most capable multimodal AI models with text, image, audio, and video understanding, long context windows, and function calling support
Heroku add-on giving OpenAI-style API access to chat, embedding, rerank and image models hosted on Amazon Bedrock, with tool execution on dynos and MCP server support; US and EU model sets
End-to-end AI development platform with AutoML, data labelling, distributed training on Ascend and GPU clusters, and one-click deployment to cloud or edge
Huawei's Pangu family of large models for NLP, multimodal, prediction and scientific computing, with model development, fine-tuning and deployment on Ascend infrastructure
Enterprise AI studio for training, validating, tuning, and deploying foundation models and traditional ML models, with IBM's Granite model family, Hugging Face integration, prompt lab, synthetic data generation, and governance via watsonx.governance
OpenAI-compatible API to open-weight models hosted in Infomaniak's Swiss data centres: LLMs (e.g. Qwen 3.5, Mistral Small 4, Kimi K2.6, Apertus, Gemma 4), embeddings, rerankers, Whisper transcription and image generation; billed per token or per minute.
Serverless inference API for a curated catalogue of open-weight models (e.g. Llama, Mistral, Qwen, gpt-oss, FLUX image and BGE embedding models) hosted in Berlin, with an OpenAI-compatible API, built-in vector stores for RAG, and per-token or per-image billing.
Deploys built-in catalogue or custom AI models to dedicated GPU-backed inference endpoints called via API key; available to pre-approved customers
Naver's HyperCLOVA X foundation-model platform for Korean-language LLM workloads — chat completion, embeddings, function calling, RAG over Korean text with strong native-language performance
Self-serve, prepaid serverless inference API for open-weight chat, vision, embedding and image-generation models on Nscale GPU infrastructure, with OpenAI-compatible endpoints and token-based pay-as-you-go pricing.
Managed generative AI platform hosting Mistral AI models, operated end to end in France on NumSpot's sovereign cloud; access on request through sales rather than self-service
Self-managed AI/ML platform for OpenShift (formerly Red Hat OpenShift Data Science), built on the upstream Open Data Hub project, with workbenches, pipelines, model registry and KServe model serving; the managed Cloud Service edition ended in October 2025
OCI's managed generative AI platform: on-demand and dedicated-cluster access to Cohere, Meta Llama, Google Gemini, OpenAI gpt-oss and xAI Grok models, fine-tuning, OpenAI-compatible APIs, and Enterprise AI features for building and deploying agents.
Fully managed machine learning platform with JupyterLab notebooks, conda-environment library, job orchestration, model deployments as HTTPS endpoints, feature store, and model catalog — integrated with Autonomous Database and Object Storage for end-to-end ML workflows
AI development platform covering data preparation, Jupyter notebooks, CPU/GPU training (including automated ExeML) and deployment of models as online APIs, batch jobs or edge services
AI Studio (optionally with Le Chat and Vibe agent tooling) delivered on dedicated 8x H200 GPU capacity in the SecNumCloud cloudgouv-eu-west-1 region, giving access to a library of sovereign LLMs; sold on quotation
Dedicated Mistral AI model deployments (Ministral 8B, Mistral Small, Medium 3, Codestral, Voxtral, Embed) on reserved L40, H100 or H200 GPUs, sold as fixed monthly bundles in the SecNumCloud cloudgouv-eu-west-1 region
Serverless API access to 20+ open-weight models (LLMs, speech-to-text and text-to-speech, document and image analysis) through an OpenAI-compatible API. Billed per input and output token and hosted in the EU, with a free sandbox and a Batch mode in beta.
Managed GPU-backed training jobs for custom ML models, with H100 / H200 / L40s / L4 GPU options, distributed-training orchestration, and Jupyter integration
Managed serverless deployment of containerised AI/ML inference workloads with autoscaling and per-second billing, for hosting custom models built outside the LLM-focused AI Endpoints product
Managed Jupyter and VS Code notebooks with dedicated CPU or GPU resources, pre-installed frameworks (PyTorch, TensorFlow, Scikit-learn, Hugging Face) and per-minute billing.
OpenAI-compatible inference for open-weight models (e.g. gpt-oss, Mistral, Qwen) hosted in Paris: Serverless billed per million tokens with 1M free tokens, plus Dedicated Deployment (formerly Managed Inference) billed hourly
Fully managed AI and ML service offering hosted LLMs, vector search, and ML functions inside Snowflake SQL
Integrated machine-learning platform inside Snowflake — feature store, model registry, distributed training on warehouses or the container runtime, model serving and ML observability.
Managed inference API for shared open-weight chat and embedding models (e.g. gpt-oss, Qwen3, Gemma 4, Llama 3.3 70B), billed per million input and output tokens and hosted in STACKIT's EU01 region; launched May 2025
Tencent's in-house Hunyuan (Tencent HY) large language models, including Hy3 (256K context), Hy4 preview (1M context) and Hy-MT2 translation models, served through Tencent Cloud's LLM Service TokenHub API alongside third-party models
Serverless platform for deploying and scaling AI model inference without managing GPU infrastructure