AI Model Providers

NVIDIA

Connect Autohand to NVIDIA-hosted models through NVIDIA's OpenAI-compatible inference endpoint.

Overview

NVIDIA is available as the nvidia provider. Use it when your team wants NVIDIA-hosted model access, GPU-backed inference infrastructure, or a provider catalog that includes NVIDIA, Mistral, DeepSeek, and related model families.

Setup

export NVIDIA_API_KEY="your-nvidia-api-key"

autohand --provider nvidia --model deepseek-ai/deepseek-v4-pro

CLI configuration

{
  "provider": "nvidia",
  "nvidia": {
    "apiKey": "${NVIDIA_API_KEY}",
    "baseUrl": "https://integrate.api.nvidia.com/v1",
    "model": "deepseek-ai/deepseek-v4-pro"
  }
}
OptionDescriptionDefault
apiKeyYour NVIDIA API key-
baseUrlNVIDIA inference endpointhttps://integrate.api.nvidia.com/v1
modelNVIDIA-hosted model IDdeepseek-ai/deepseek-v4-pro

Models

Select NVIDIA-hosted models with /model or configure a custom model ID from your NVIDIA account.

Example modelBest for
deepseek-ai/deepseek-v4-proAdvanced coding and reasoning
mistralai/mixtral-8x7b-instruct-v0.1General-purpose instruction following
nvidia/usdcodeNVIDIA-specific coding and content workflows