Engineers Run Large Language Model Locally on Modded PlayStation 5

Software developers successfully ported local AI execution software to run a 27-billion-parameter language model directly on a modified PlayStation 5 console. The setup processes text generated on the system's graphics chip at speeds reaching approximately 20 tokens per second.