Show HN:iOS 裝置端(離線)AI SDK(大型語言模型、視覺和 Stable Diffusion)

Hacker News·

開發者發布了一款支援大型語言模型、視覺和 Stable Diffusion 的 iOS 裝置端(離線)AI SDK,旨在讓 AI 推論在離線狀態下也能使用,並尋求開發者社群的意見回饋。

Image

Developer experience - create a session with a model - stream tokens as they generate - optionally get a full response (There’s a code snippet on the homepage showing the exact flow.)

Why I’m posting I’d love feedback from iOS devs (and anyone shipping on-device inference) on: - What would make this a “must use” SDK for you - What models you’d want supported first (small, fast, good-enough vs bigger, slower, better) - What your biggest pain is today: performance, model downloads, UX, memory, app size, safety, etc.

If you want updates / early access when it’s ready to share broadly, there’s a waitlist on the site (no credit card).

https://kuzco.co/

Image

Hacker News

相關文章

  1. Show HN:Kuzco – iOS 端側 AI SDK (支援 LLMs、視覺及 Stable Diffusion)

    3 個月前

  2. Show HN:Aotol AI – 可離線運作、支援語音與多語言的 iOS 大型語言模型應用程式

    7 個月前

  3. Show HN:Off Grid – 在您的手機上離線運行 AI 文字、圖像生成和視覺功能

    2 個月前

  4. Show HN:SwiftAI – 輕鬆在 iOS/macOS 上建置 LLM 功能的開源函式庫

    8 個月前

  5. Show HN:Waycore – 一款開源、離線優先的模組化野外電腦

    4 個月前