MLC Group Enables Web and Mobile LLM Usage

September 25, 2023

Provided by Utku Ege Tuluk (opens in a new tab)

AI
Hardware

The MLC group has launched a platform allowing users to run LLAMA models on the web and mobile devices. The web version offers a chat demo with model download, while the iOS and Android apps enable running 3B models on smartphones. The 3B model runs efficiently on iPhone 13, with a response speed of 5-15 tokens per second.

Never miss a RITS update

Subscribe to the RSS feed for AI, emerging technology, and digital scholarship news curated for the NYU Shanghai community, or get in touch to suggest a story.

Subscribe to RSS (opens in a new tab)Contact RITS

Connect with NYU Shanghai

Portal Campuses
NYU
Shanghai
Abu Dhabi

New York University — Equal Opportunity and Non-Discrimination at NYU. New York University is committed to maintaining an environment that encourages and fosters respect for individual values and appropriate conduct among all persons. In all University spaces—physical and digital—programming, activities, and events are carried out in accordance with applicable law as well as University policy, which includes but is not limited to its Non-Discrimination and Anti-Harassment Policy.