Osmantic / ODS
Osmantic / ODS
ODS Osmantic Deployment System: Turn your PC, Mac, or Linux box into a private AI server. ODS (Osmantic Deployment System) 部署系统:将您的 PC、Mac 或 Linux 电脑变成一台私有 AI 服务器。
AI server and homelab setup is rapidly becoming a solved problem. It should feel that way for everyone. ODS installs and wires together everything you need to run AI locally, so you do not have to assemble Ollama, Open WebUI, n8n, ComfyUI, and privacy tools by hand: AI 服务器和家庭实验室的搭建正迅速成为一个已解决的问题,每个人都应该能轻松享受到这一点。ODS 可以安装并连接您在本地运行 AI 所需的一切,因此您无需手动组装 Ollama、Open WebUI、n8n、ComfyUI 和各种隐私工具:
- Local model inference — run open models on your own hardware
- 本地模型推理 — 在您自己的硬件上运行开源模型
- ChatGPT-style web UI — talk to your models from any browser
- ChatGPT 风格的 Web UI — 通过任何浏览器与您的模型对话
- Control dashboard — manage models, services, setup, GPU status, and extensions from one place
- 控制面板 — 在一个地方管理模型、服务、设置、GPU 状态和扩展
- Voice, agents, and workflows — build automations that can listen, speak, call tools, and get work done
- 语音、智能体和工作流 — 构建能够听、说、调用工具并完成任务的自动化程序
- RAG and search — connect local documents, private search, and retrieval workflows
- RAG(检索增强生成)与搜索 — 连接本地文档、私有搜索和检索工作流
- Image generation — run local image tools without sending prompts to a hosted API
- 图像生成 — 运行本地图像工具,无需将提示词发送到托管的 API
- Privacy and ops — keep service auth, secrets, observability, and diagnostics in one local stack
- 隐私与运维 — 将服务认证、密钥、可观测性和诊断功能保留在一个本地堆栈中
No cloud required. No subscriptions required. Your prompts and data stay on your machine unless you choose otherwise. Cloud and hybrid API modes are optional when you want them. 无需云端,无需订阅。除非您另有选择,否则您的提示词和数据将始终保留在您的机器上。当您需要时,云端和混合 API 模式可作为可选方案。
Release validation
版本验证
Operational changes are checked with a release-grade fleet and distro lab: zero-prereq bootstrap, fresh installs, product flows, full-model capabilities, lifecycle recovery, and the final User Green gate. See Release Validation for what a green run proves. 运维变更会通过发布级集群和发行版实验室进行检查:包括零前提引导、全新安装、产品流程、全模型能力、生命周期恢复以及最终的“用户绿色通道”。请参阅“版本验证”以了解绿色运行所证明的内容。
Repo layout
仓库布局
The repository root holds the public README, installers, security policy, GitHub workflows, and project coordination docs. The ods/ directory is the product runtime: services, installer phases, compose overlays, dashboard, CLI, tests, and operator docs.
仓库根目录包含公开的 README、安装程序、安全策略、GitHub 工作流和项目协调文档。ods/ 目录是产品运行时:包含服务、安装阶段、Compose 覆盖配置、仪表板、CLI、测试和操作员文档。
Stable consumption
稳定使用
v2.6.0 is the current stable release. main moves quickly; use it for active development and validation candidates. For forks, appliances, labs, or production-like installs, pin a tagged release or audited commit and keep your own validation receipt. Stable patch fixes land on release/2.6.x before being merged forward. See Release Channels, Installer Trust, and Forkability.
v2.6.0 是当前的稳定版本。main 分支更新迅速;请将其用于活跃开发和验证候选版本。对于分支、设备、实验室或类生产环境安装,请锁定已标记的版本或经过审计的提交,并保留您自己的验证记录。稳定的补丁修复会先发布在 release/2.6.x,然后再合并到主分支。请参阅“发布渠道”、“安装程序信任”和“可分支性”。
Get Started
开始使用
Choose your system, copy the block, run it in a normal terminal. ODS installs the stack, picks a model for your hardware, starts the services, and gives you the local web UI. 选择您的系统,复制对应的代码块,并在普通终端中运行。ODS 将安装堆栈、为您的硬件选择模型、启动服务,并为您提供本地 Web UI。
Linux or macOS
curl -fsSL https://install.osmantic.com/ods.sh | bash
Windows PowerShell
$ProgressPreference = "SilentlyContinue"
$odsSrc = Join-Path $env:TEMP ("ods-install-" + [guid]::NewGuid().ToString("N"))
$odsZip = Join-Path $odsSrc "ods-main.zip"
New-Item -ItemType Directory -Path $odsSrc | Out-Null
Invoke-WebRequest "https://github.com/Osmantic/ODS/archive/refs/heads/main.zip" -OutFile $odsZip
Expand-Archive -LiteralPath $odsZip -DestinationPath $odsSrc -Force
cd (Get-ChildItem -LiteralPath $odsSrc -Directory | Select-Object -First 1).FullName
Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
.\install.ps1
Prerequisites: Docker must be installed and running. On Windows, use Docker Desktop with the WSL2 backend enabled and run the block in a normal, non-Administrator PowerShell window. 前提条件: 必须安装并运行 Docker。在 Windows 上,请使用启用了 WSL2 后端的 Docker Desktop,并在普通的非管理员 PowerShell 窗口中运行上述代码块。
At A Glance
概览
| Question | Answer |
|---|---|
| What is it? | A local AI server stack for your own hardware, with a one-command Linux/macOS installer and a PowerShell installer for Windows. |
| 它是什么? | 一个用于您个人硬件的本地 AI 服务器堆栈,提供 Linux/macOS 一键安装程序和 Windows PowerShell 安装程序。 |
| Who is it for? | People who want private AI at home, in a lab, or on a workstation without hand-wiring a dozen services. |
| 它适合谁? | 想要在家中、实验室或工作站使用私有 AI,且不想手动配置十几个服务的人。 |
| What do I get? | Local inference, Open WebUI chat, a control dashboard, voice, agents, workflows, RAG, search, image generation, privacy tools, observability, and developer tools. |
| 我能得到什么? | 本地推理、Open WebUI 聊天、控制面板、语音、智能体、工作流、RAG、搜索、图像生成、隐私工具、可观测性和开发工具。 |
| What does it run on? | Linux, Windows with WSL2/Docker Desktop, and macOS Apple Silicon. |
| 它运行在什么系统上? | Linux、带有 WSL2/Docker Desktop 的 Windows 以及 macOS Apple Silicon。 |
| Is cloud required? | No. Local mode is the default; cloud and hybrid API modes are optional. |
| 需要云端吗? | 不需要。默认使用本地模式;云端和混合 API 模式为可选。 |