LLMobile.news

Cutting edge on edge devices.

Android

51 updates on Android.

  1. Sherpa runs LLaMA on an Android phone through a Flutter chat app

    The Flutter app loads a ggml model file off the phone and chats with it offline, and development stopped three weeks after it started.

  2. Qualcomm runs Stable Diffusion on an Android phone for the first time

    Qualcomm AI Research generated 512x512 images in under 15 seconds on a Snapdragon 8 Gen 2 phone after quantising the model from FP32 to INT8.

  3. ONNX Runtime 1.5 adds a mobile build that ships only the operators a model uses

    The release introduced a reduced-size runtime for phones and the ORT model format, the base for the NNAPI, Core ML, QNN and XNNPACK mobile packages.