[{"data":1,"prerenderedAt":36},["ShallowReactive",2],{"docs:providers/deepinfra":3},{"title":4,"navTitle":4,"description":5,"api":6,"html":7,"toc":8,"path":25,"tab":26,"group":27,"prev":28,"next":31,"markdownUrl":34,"sourceUrl":35,"lastModified":6},"@standardagents/deepinfra","Use DeepInfra chat models with live catalog metadata, streaming, tools, structured output, reasoning, and request-cost reporting.",null,"\u003Cp>The \u003Ccode>@standardagents/deepinfra\u003C/code> package is the first-party DeepInfra provider for Standard Agents. It targets DeepInfra's OpenAI-compatible Chat Completions API and reads model capabilities and per-million-token prices from the live public catalog.\u003C/p>\n\u003Ch2 id=\"install\">\u003Ca class=\"docs-anchor\" href=\"#install\" aria-label=\"Link to this section\">\u003C/a>Install\u003C/h2>\n\u003Cfigure class=\"docs-code\" data-docs=\"code\" data-lang=\"bash\">\u003Cpre class=\"shiki shiki-themes one-light github-dark\" style=\"--shiki-light:#383A42;--shiki-dark:#e1e4e8;--shiki-light-bg:#FAFAFA;--shiki-dark-bg:#24292e\" tabindex=\"0\">\u003Ccode>\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#4078F2;--shiki-dark:#B392F0\">pnpm\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> add\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> @standardagents/deepinfra\u003C/span>\u003C/span>\u003C/code>\u003C/pre>\u003C/figure>\n\u003Cp>Scaffolded projects already include the package. Set \u003Ccode>DEEPINFRA_API_KEY\u003C/code> to use your own DeepInfra account; when that key is absent and the project has \u003Ccode>STANDARD_AGENTS_API_KEY\u003C/code>, requests use hosted Standard Agents routing.\u003C/p>\n\u003Ch2 id=\"define-a-model\">\u003Ca class=\"docs-anchor\" href=\"#define-a-model\" aria-label=\"Link to this section\">\u003C/a>Define a model\u003C/h2>\n\u003Cfigure class=\"docs-code\" data-docs=\"code\" data-lang=\"typescript\">\u003Cfigcaption class=\"docs-code-title\">agents/models/deepinfra_chat.ts\u003C/figcaption>\u003Cpre class=\"shiki shiki-themes one-light github-dark\" style=\"--shiki-light:#383A42;--shiki-dark:#e1e4e8;--shiki-light-bg:#FAFAFA;--shiki-dark-bg:#24292e\" tabindex=\"0\">\u003Ccode>\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#A626A4;--shiki-dark:#F97583\">import\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\"> { \u003C/span>\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\">defineModel\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\"> } \u003C/span>\u003Cspan style=\"--shiki-light:#A626A4;--shiki-dark:#F97583\">from\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> '@standardagents/spec'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">;\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#A626A4;--shiki-dark:#F97583\">import\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\"> { \u003C/span>\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\">deepinfra\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\"> } \u003C/span>\u003Cspan style=\"--shiki-light:#A626A4;--shiki-dark:#F97583\">from\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> '@standardagents/deepinfra'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">;\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#A626A4;--shiki-dark:#F97583\">export\u003C/span>\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#F97583\"> default\u003C/span>\u003Cspan style=\"--shiki-light:#4078F2;--shiki-dark:#B392F0\"> defineModel\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">({\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\">  name\u003C/span>\u003Cspan style=\"--shiki-light:#0184BC;--shiki-dark:#E1E4E8\">:\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> 'deepinfra-chat'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\">  provider\u003C/span>\u003Cspan style=\"--shiki-light:#0184BC;--shiki-dark:#E1E4E8\">:\u003C/span>\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\"> deepinfra\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#E45649;--shiki-dark:#E1E4E8\">  model\u003C/span>\u003Cspan style=\"--shiki-light:#0184BC;--shiki-dark:#E1E4E8\">:\u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\"> 'deepseek-ai/DeepSeek-V3'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">});\u003C/span>\u003C/span>\u003C/code>\u003C/pre>\u003C/figure>\n\u003Cp>The Builder's model picker queries \u003Ccode>https://api.deepinfra.com/v1/models\u003C/code>, keeps models tagged \u003Ccode>chat\u003C/code>, and maps catalog context length, vision tags, and \u003Ccode>input_tokens\u003C/code>, \u003Ccode>output_tokens\u003C/code>, and \u003Ccode>cache_read_tokens\u003C/code> pricing. Each result uses bundled local artwork for the model ID's lab namespace, so model rows show DeepSeek, Meta, Qwen, and other creator marks rather than the DeepInfra provider mark.\u003C/p>\n\u003Ch2 id=\"provider-options\">\u003Ca class=\"docs-anchor\" href=\"#provider-options\" aria-label=\"Link to this section\">\u003C/a>Provider options\u003C/h2>\n\u003Cp>DeepInfra options belong in \u003Ccode>providerOptions\u003C/code>:\u003C/p>\n\u003Cfigure class=\"docs-code\" data-docs=\"code\" data-lang=\"typescript\">\u003Cpre class=\"shiki shiki-themes one-light github-dark\" style=\"--shiki-light:#383A42;--shiki-dark:#e1e4e8;--shiki-light-bg:#FAFAFA;--shiki-dark-bg:#24292e\" tabindex=\"0\">\u003Ccode>\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">providerOptions\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: {\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">  service_tier\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: \u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\">'priority'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">  reasoning_effort\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: \u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\">'high'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">  prompt_cache_key\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: \u003C/span>\u003Cspan style=\"--shiki-light:#50A14F;--shiki-dark:#9ECBFF\">'thread-stable-id'\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">  top_k\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: \u003C/span>\u003Cspan style=\"--shiki-light:#986801;--shiki-dark:#79B8FF\">40\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#B392F0\">  min_p\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">: \u003C/span>\u003Cspan style=\"--shiki-light:#986801;--shiki-dark:#79B8FF\">0.05\u003C/span>\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">,\u003C/span>\u003C/span>\n\u003Cspan class=\"line\">\u003Cspan style=\"--shiki-light:#383A42;--shiki-dark:#E1E4E8\">}\u003C/span>\u003C/span>\u003C/code>\u003C/pre>\u003C/figure>\n\u003Cp>Supported typed options include \u003Ccode>n\u003C/code>, \u003Ccode>seed\u003C/code>, frequency/presence/repetition penalties, \u003Ccode>top_k\u003C/code>, \u003Ccode>min_p\u003C/code>, \u003Ccode>logit_bias\u003C/code>, log probabilities, \u003Ccode>stop_token_ids\u003C/code>, \u003Ccode>reasoning_effort\u003C/code>, \u003Ccode>reasoning\u003C/code>, \u003Ccode>service_tier\u003C/code>, and \u003Ccode>prompt_cache_key\u003C/code>. The schema is passthrough so newly introduced DeepInfra request fields can be used without waiting for a package release.\u003C/p>\n\u003Cp>Standard Agents \u003Ccode>reasoning.level\u003C/code> maps to DeepInfra's \u003Ccode>none\u003C/code>, \u003Ccode>low\u003C/code>, \u003Ccode>medium\u003C/code>, or \u003Ccode>high\u003C/code> effort. A \u003Ccode>responseFormat\u003C/code> JSON schema is converted to strict \u003Ccode>json_schema\u003C/code> output, and Standard Agents tools are converted to strict OpenAI-compatible function definitions.\u003C/p>\n\u003Ch2 id=\"pricing-and-usage\">\u003Ca class=\"docs-anchor\" href=\"#pricing-and-usage\" aria-label=\"Link to this section\">\u003C/a>Pricing and usage\u003C/h2>\n\u003Cp>The package exposes live catalog prices on discovered models. DeepInfra returns request-level USD cost as \u003Ccode>usage.estimated_cost\u003C/code>; the provider preserves that value as Standard Agents \u003Ccode>usage.cost\u003C/code>. If an upstream response omits it, the provider falls back to the cached live catalog rates, including cache-read tokens when present.\u003C/p>\n\u003Cp>Hosted routing uses the same upstream-reported value for billing, then adds the plan's router fee. Request logs of hosted-routed requests show the router's charge, fee included. This avoids a stale platform pricing table as DeepInfra's catalog changes.\u003C/p>\n\u003Ch2 id=\"connection-configuration\">\u003Ca class=\"docs-anchor\" href=\"#connection-configuration\" aria-label=\"Link to this section\">\u003C/a>Connection configuration\u003C/h2>\n\u003Cdiv class=\"docs-table\">\u003Ctable>\n\u003Cthead>\n\u003Ctr>\n\u003Cth>Slot\u003C/th>\n\u003Cth>Default\u003C/th>\n\u003Cth>Purpose\u003C/th>\n\u003C/tr>\n\u003C/thead>\n\u003Ctbody>\n\u003Ctr>\n\u003Ctd>\u003Ccode>apiKey\u003C/code>\u003C/td>\n\u003Ctd>\u003Ccode>DEEPINFRA_API_KEY\u003C/code>\u003C/td>\n\u003Ctd>Bearer token for inference requests\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>baseUrl\u003C/code>\u003C/td>\n\u003Ctd>\u003Ccode>https://api.deepinfra.com/v1/openai\u003C/code>\u003C/td>\n\u003Ctd>OpenAI-compatible API base\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>modelsUrl\u003C/code>\u003C/td>\n\u003Ctd>\u003Ccode>https://api.deepinfra.com/v1/models\u003C/code>\u003C/td>\n\u003Ctd>Public model catalog\u003C/td>\n\u003C/tr>\n\u003Ctr>\n\u003Ctd>\u003Ccode>timeout\u003C/code>\u003C/td>\n\u003Ctd>\u003Ccode>30000\u003C/code>\u003C/td>\n\u003Ctd>Request timeout in milliseconds\u003C/td>\n\u003C/tr>\n\u003C/tbody>\n\u003C/table>\u003C/div>\n\u003Cp>The package honors provider \u003Ccode>fetch\u003C/code> and \u003Ccode>defaultHeaders\u003C/code> overrides, so test transports, instrumentation, and \u003Ccode>defineProvider\u003C/code> sub-providers work without patching the implementation.\u003C/p>",[9,13,16,19,22],{"id":10,"text":11,"depth":12},"install","Install",2,{"id":14,"text":15,"depth":12},"define-a-model","Define a model",{"id":17,"text":18,"depth":12},"provider-options","Provider options",{"id":20,"text":21,"depth":12},"pricing-and-usage","Pricing and usage",{"id":23,"text":24,"depth":12},"connection-configuration","Connection configuration","providers/deepinfra","docs","Providers",{"path":29,"title":30,"navTitle":30},"providers/cerebras","@standardagents/cerebras",{"path":32,"title":33,"navTitle":33},"providers/google","@standardagents/google","/docs/providers/deepinfra.md","https://github.com/standardagents/agentbuilder/blob/main/docs/providers/deepinfra.mdx",1794580509787]