Repository navigation
feat(macos): captions without Ollama and bundled local translation - #27
PCcoding666 wants to merge 1 commit into
Conversation
|
Benchmark + capture check for this PR (details in #28, Runtime is not the problem. Same Qwen3.5-4B weights on this M2 Pro / 16 GB: llama.cpp Metal (Q4_K_M) vs Ollama MLX (nvfp4) are within noise — p50 end-to-end 542 vs 534 ms, TTFT 146 vs 160 ms, chrF 55.8 vs 57.6, numbers/names kept 97% vs 92%. Embedding llama.cpp costs nothing in latency or quality. The bundled model is. The exact Capture on this branch works. Built 🤖 Posted by Claude Code |
Original captions previously refused to start when Ollama was missing. This change makes captions the default, independent path and ships a pinned llama.cpp runtime with an optional, app-managed Qwen model download.
Validation:
macos/Scripts/run_tests.shpassed Debug, Release, warnings-as-errors and 555 XCTest cases. A development-signed arm64 bundle passed strict verification and launched from Applications outside the build tree.Draft while real GUI/audio acceptance is completed. First-run captions-first UI is observed; privacy authorizations, actual app model download/inference, offline behavior and formal Developer ID/notarized distribution remain unverified. Intel hardware is untested. The official model host timed out in a CLI probe; that is not an app-download result. Local screenshots/logs are being collected for the GUI acceptance follow-up. See
docs/validation/2026-11-04-issue-25.md.Related to #25. This PR does not close the issue or publish a release.