Configure NVIDIA NIM as Your Hermes Provider
Configure Hermes Agent to use NVIDIA NIM for optimized inference on NVIDIA hardware.
NVIDIA NIM provides optimized inference for models running on NVIDIA hardware. Excellent performance for Nemotron and other NVIDIA-optimized models.
Deploy Hermes faster with FlyHermes
Managed cloud · API costs included · Skill library · Cancel anytime
Before you start:
- ☑Hermes Agent installed
- ☑NVIDIA developer account
- ☑NVIDIA API key from build.nvidia.com
Steps
- 1
Get your API key
Sign up at build.nvidia.com and get your NVIDIA API key
- 2
Add to .env
Add NVIDIA_API_KEY=nvapi-xxx to ~/.hermes/.env
- 3
Set the provider
In config.yaml, set model: provider: nvidia
- 4
Choose a model
Pick from NVIDIA-optimized models like Nemotron or Llama variants
Pro Tips
- 💡Nemotron models are specifically optimized for NVIDIA infrastructure
- 💡Good for enterprise deployments with NVIDIA hardware
- 💡Supports the latest NVIDIA-optimized model variants
Troubleshooting
❌ Authentication failed
✅ Ensure API key starts with nvapi-. Check key validity at build.nvidia.com.
❌ Model not found
✅ NVIDIA NIM has a specific model catalog. Check available models at build.nvidia.com.