Ai2

Ai2 releases OLMoE, 7B parameters with 1B active per token

Ai2's mixture-of-experts model holds 6.9B parameters but runs 1.3B per token, and its iOS app runs it offline on an iPhone 15 Pro or newer.