LLMobile.news

Cutting edge on edge devices.

iOS

16 updates on iOS.

  1. Hugging Face publishes swift-transformers for Core ML models in Swift apps

    A Swift package with tokenizers, Hub downloads and a Core ML generation loop, demonstrated with Llama 2, Falcon, StarCoder and GPT models.

  2. LLMFarm runs llama.cpp models offline on iOS and macOS

    The iOS and macOS app loads a quantised model file off the device and chats with it offline, with 3B the practical size on an iPhone.

  3. MLC LLM brings local language models to iPhone, browsers and consumer GPUs

    A compiler stack built on Apache TVM deploys chat models natively to iOS, browsers and consumer GPUs, with an iPhone build handed out through TestFlight.

  4. ONNX Runtime 1.5 adds a mobile build that ships only the operators a model uses

    The release introduced a reduced-size runtime for phones and the ORT model format, the base for the NNAPI, Core ML, QNN and XNNPACK mobile packages.