DeepSparse Enables LLM Inference on Commodity CPUs

October 19, 2023

Provided by Utku Ege Tuluk (opens in a new tab)

AI
Hardware

DeepSparse allows running LLM inference on commodity CPUs with usable speeds.

Never miss a RITS update

Subscribe to the RSS feed for AI, emerging technology, and digital scholarship news curated for the NYU Shanghai community, or get in touch to suggest a story.

Subscribe to RSS (opens in a new tab)Contact RITS

Connect with NYU Shanghai

Portal Campuses
NYU
Shanghai
Abu Dhabi

New York University — Equal Opportunity and Non-Discrimination at NYU. New York University is committed to maintaining an environment that encourages and fosters respect for individual values and appropriate conduct among all persons. In all University spaces—physical and digital—programming, activities, and events are carried out in accordance with applicable law as well as University policy, which includes but is not limited to its Non-Discrimination and Anti-Harassment Policy.