High end laptop runs 120B AI model locally

Hardware tests showed Microsoft's premium Surface Laptop Ultra processing a 120-billion parameter open weight model locally at speeds of 33 tokens per second. The test highlights expanding options for running large models on personal hardware without sending data to cloud servers.