Skip to main content

Crates

The workspace holds 16 packages at version 0.20.0. None is published to a registry: a project depends on them from Git at a release tag. A package name is its directory name; its library name uses underscores, so llm-core is use llm_core. This page is generated from cargo metadata by llm-docs; the overview says which crate to depend on for what.

PackageLibraryDirectoryWhat it is
llm-conformancebinary llm-conformancechecks/conformance—
llm-bedrockllm_bedrockcrates/llm-bedrockAmazon Bedrock Runtime behind the model port: Converse and Anthropic InvokeModel, event-stream decoding and hand-written SigV4.
llm-blockingllm_blockingcrates/llm-blockingA blocking turn adapter over any asynchronous model port, for a synchronous agent loop.
llm-chatllm_chatcrates/llm-chatChat Completions protocol projection and gateway ingress for the declared supported subset.
llm-clillm_clicrates/llm-cliThe llm command: lists the models an llm.routes/1 configuration file declares and runs one streamed turn on any of them.
llm-corellm_corecrates/llm-coreNeutral model requests, results, streaming, capabilities and typed failures; no I/O or execution authority.
llm-costllm_costcrates/llm-costUsage accounting, versioned price estimates and explicit admission limits.
llm-credentialsllm_credentialscrates/llm-credentialsInjected secret resolution and caller-managed credential refresh; optional backend adapters.
llm-docsbinary llm-docscrates/llm-docsGenerates and drift-checks the derived pages of the llm documentation site, and holds the programs its guides quote.
llm-httpllm_httpcrates/llm-httpShared bounded HTTP and SSE transport; no vendor fields or credential acquisition.
llm-messagesllm_messagescrates/llm-messagesMessages protocol projection and gateway ingress for the declared supported subset.
llm-modelsllm_modelscrates/llm-modelsBuilds the Chat Completions, Responses or Messages port a catalog serving model declares, with the caller's resolver for its account, and reads llm.routes/1 model routes into a catalog and resolvers.
llm-providersllm_providerscrates/llm-providersProvider/account and authentication bindings independent of protocol selection.
llm-responsesllm_responsescrates/llm-responsesResponses protocol projection, gateway ingress and a single-attempt client for the declared supported subset.
llm-routingllm_routingcrates/llm-routingTOML catalogs, capability-aware resolution and explicit ordered fallback.
llm-tool-callllm_tool_callcrates/llm-tool-callOne forced tool call on any model, returning the tool's JSON input, and a Responses model preset over the operator's Codex login.

Optional features​

Every feature is off by default unless the package lists it as a default. A feature adds the optional dependencies named beside it and nothing else.

PackageFeatureTurns onAdds dependencies
llm-bedrockprocesstokio/process—
llm-costsqlite—rusqlite
llm-credentialscodex-auth-file—base64, rustix, serde_json, sha2
llm-credentialscodex-renewalcodex-auth-filellm-http, tempfile
llm-credentialsenvironment—sha2
llm-credentialsfile—rustix, sha2
llm-credentialsjson-pointer—serde_json, sha2
llm-credentialskeychain—keyring-core, sha2
llm-credentialsnative-keychainkeychainzbus-secret-service-keyring-store, apple-native-keyring-store, windows-native-keyring-store
llm-credentialssecrets—secrets-core, secrets-keychain, keyring-core, sha2
llm-modelsenvironmentllm-credentials/environment—
llm-modelsfilellm-credentials/file—
llm-modelskeychainllm-credentials/keychainkeyring-core
llm-modelsprocessllm-bedrock/process—

No package turns on a feature by default.