Agent♥︎Age
Catalog

Onde Inference CLI: Fine-tune & Deploy Local LLMs

Official

by ondeinference · Rust

MCP server to fine-tune LoRA, export GGUF, and deploy local LLMs on Onde Inference.

Onde Inference CLI MCP Server

This MCP server exposes a command-line interface for Onde Inference, managing an Onde Inference account and models. It covers application management, access to a model catalog, and workflows for fine-tuned GGUF deploys.

🛠️ Key Features

  • Manage Onde Inference account
  • Apps management
  • Model catalog access
  • Fine-tuned GGUF deploys

🚀 Use Cases

  • Retrieve and browse available models in the Onde Inference catalog
  • Deploy fine-tuned GGUF models
  • Manage Onde Inference applications via CLI

⚡ Developer Benefits

  • Works as a CLI focused on Onde Inference account and model operations
  • Fits developer workflows using topics like cli and machine-learning

⚠️ Limitations

  • Server data provided does not specify supported MCP tools, authentication details, or integration surface beyond the CLI scope.

Topics

clicrates-iomachine-learningfine-tuningfine-tuning-llm