II.
Layer overview
Reference · livelayer:2-provider
Provider overview
Inspect the raw attributes, linked wiki pages, and inbound or outbound graph edges for layer:2-provider.
Attributes
displayName
Provider
position
2
path
compute
scope
Hosted or self-hosted serving boundary.
summary
The hosted-inference vendor or self-hosted serving boundary that exposes a
`ModelVersion` over an endpoint. Provider posture covers auth scheme, rate
limits, regions, fine-tuning availability, and SLA — distinct from the wire
protocol (Layer 3) and the agent-side core that consumes it (Layer 4).
responsibilities
- Serve model versions through authenticated endpoints.
- Own availability, regions, quotas, rate limits, billing, and deployment posture.
- Publish provider-specific model and endpoint capabilities.
examples
- Anthropic, OpenAI, Google, Azure OpenAI, AWS Bedrock, OpenRouter.
- Self-hosted vLLM, Ollama, llama.cpp, or custom inference gateway.
- Auth scheme, region, quota, rate-limit, and SLA records.
fitNotes
LangChain/LangGraph apps usually choose providers through model adapters
rather than owning this layer. Gateways may specialize here while leaving
higher layers to another product.
Outgoing edges
None.
Incoming edges
documents11
- page:agent-generate-universal-agentic-stack-orientation·PageUniversal Agentic Stack Orientation
- page:agent-generate-universal-agentic-stack-landscape-diagram·PageUniversal Agentic Stack Landscape Diagram
- page:agent-generate-universal-agentic-stack-placement-checklist·PagePlacement Checklist
- page:agent-generate-universal-agentic-stack-worked-examples·PageWorked Examples
- page:agent-generate-universal-agentic-stack-comparison-matrix·PageComparison Matrix
- page:agent-generate-universal-agentic-stack-review-template·PageReview Template
- page:agent-generate-universal-agentic-stack-faq·PageFAQ
- page:agent-generate-universal-agentic-stack·PageUniversal Agentic Stack
- page:agent-generate-universal-agentic-stack-layers·PageUniversal Agentic Stack Layers
- page:agent-generate-universal-agentic-stack-source-map·PageUniversal Agentic Stack Source Map
- page:views-agent-stack-tower·PageAgent Stack Tower
realizes21
- provider:anthropic·ModelProviderProductAnthropic
- provider:azure-openai·ModelProviderProductAzure OpenAI
- provider:aws-bedrock·ProviderAWS Bedrock
- provider:cloudflare-ai·ModelProviderProductCloudflare Workers AI
- provider:cohere·ProviderCohere
- provider:deepseek·ProviderDeepSeek
- provider:fireworks-ai·ProviderFireworks AI
- provider:github·ModelProviderProductGitHub
- provider:azure-foundry·ProviderAzure AI Foundry
- provider:gcp-vertex·ProviderGoogle Cloud Vertex AI
- provider:google·ModelProviderProductGoogle
- provider:groq·ProviderGroq
- provider:hyperbolic·ProviderHyperbolic
- provider:jina-ai·ProviderJina AI
- provider:meta-direct·ProviderMeta (Llama API)
- provider:mistral·ProviderMistral AI
- provider:ollama·ProviderOllama
- provider:openai·ModelProviderProductOpenAI
- provider:replicate·ProviderReplicate
- provider:together-ai·ProviderTogether AI
- provider:voyageai·ProviderVoyage AI