Model Catalog
Pick a model from our selection, or deploy a previously fine-tuned model.
Laya
New Laya is a multilingual, non-autoregressive System One decision model for calibrated routing, scoring, guardrails, moderation, and other low-latency decisions.
NVIDIA Nemotron 3 Diarization
100M-parameter speaker diarization model for identifying who spoke when in live and recorded audio, including overlapping speech from up to eight speakers.
Qwen3.8 27B
New Qwen3.8-27B is a compact 27B dense vision-language model with native image and video understanding, flexible thinking control, and stronger coding, research, and long-horizon agentic performance. Context length is 262K natively and extensible to 1M tokens.
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
New NVIDIA Nemotron 3.5 Lightning 30B A3B is a 30B-parameter sparse language model, provided in an NVIDIA-optimized NVFP4 format for efficient enterprise inference.
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16
New NVIDIA Nemotron 3.5 Lightning 30B A3B is a 30B-parameter sparse language model, provided in BF16 format for enterprise inference.
Muse Glimmer 30B GGUF
New GGUF-quantized Muse Glimmer 30B model for local llama.cpp deployments on GB10. It brings multimodal understanding, multi-step reasoning, reliable tool use, and failure recovery to consumer hardware.
Muse Glimmer 30B
New Muse Glimmer is a 30B-parameter causal language model, distilled from Muse Spark and built for autonomous local agents. It combines multimodal understanding, multi-step reasoning, reliable tool use, and failure recovery on consumer hardware.
North Mini Code 1.0 GGUF
Unsloth GGUF-quantized North Mini Code 1.0 release for llama.cpp deployments, optimized for code generation, agentic software engineering, and terminal tasks on GB10 systems.
Step 3.7 Flash GGUF
GGUF-quantized Step 3.7 Flash release for llama.cpp deployments, supporting reasoning, tool-calling, and multimodal agent workflows on GB10 systems.
Qwen3.6 27B MTP GGUF
Unsloth GGUF-quantized Qwen3.6-27B-MTP release for llama.cpp deployments, optimized for efficient local inference on GB10 systems.
Qwen3.6 35B A3B MTP GGUF
Unsloth GGUF-quantized Qwen3.6-35B-A3B-MTP release for llama.cpp deployments, using a sparse MoE architecture for efficient local inference on GB10 systems.
Gemma 4 26B A4B IT GGUF
Unsloth GGUF-quantized Gemma 4 26B A4B instruction-tuned release for llama.cpp deployments on GB10 systems.
Gemma 4 E4B IT GGUF
Unsloth GGUF-quantized Gemma 4 E4B instruction-tuned release for llama.cpp deployments on GB10 systems.
GPT OSS 20B GGUF
Unsloth GGUF-quantized GPT OSS 20B release for llama.cpp deployments, designed for efficient local reasoning and agentic workloads on GB10 systems.
Nemotron 3 Nano Omni 30B A3B Reasoning FP8
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8 is a multimodal large language model that unifies video, audio, image, and text understanding to support enterprise-grade Q&A, summarization, transcription, and document intelligence workflows.
Gemma 4 31B IT
Gemma 4 is Google's open multimodal family built on the same research stack as Gemini. This instruction-tuned 31B variant supports image-text input and conversational use.
Qwen3.5 27B
Qwen3.5-27B is a mid-sized version of Qwen3.5 that retains its advanced multimodal capabilities, efficient architecture, strong RL-driven generalization, and broad multilingual support while offering a more balanced performance-efficiency tradeoff.
NVIDIA Nemotron 3 Nano 30B A3B BF16
Nemotron-3-Nano-30B-A3B-BF16 is a large language model (LLM) trained from scratch by NVIDIA, and designed as a unified model for both reasoning and non-reasoning tasks.
GPT OSS 20B
GPT OSS is the latest OpenAI open-model designed for powerful reasoning, agentic tasks, and versatile developer use cases. GPT OSS 20B is intended for lower latency, and local or specialized use cases.