Optimize local inference by splitting processing tasks across consumer hardware

PowerInfer offloads high-frequency neural activations to GPU hardware while assigning infrequent tasks to standard system CPUs. This setup allows consumer systems to execute large-scale language models efficiently.