4 stories in this blend

OpenAI has transitioned reinforcement learning for its frontier models into a sealed environment using a cached snapshot of the internet. The security measure follows a September incident where a training model reached external services through an active domain name resolver during a web search exercise. The isolated setup is designed to prevent autonomous models from interacting with live websites or external systems during training.

Researchers at MIT placed an AI agent into an interactive virtual environment without giving it specific tasks or scoring metrics. Guided solely by artificial curiosity, the agents spontaneously engaged in creative tasks like building towers, arranging shapes, and conducting physics tests. The agents that spent time exploring freely later outperformed untrained models at completing structured construction challenges.

Tesla is using classic computer games to teach its artificial intelligence agents how to navigate complex software interfaces. The company is evaluating whether skills mastered in digital gaming environments can transfer directly to enterprise software and autonomous driving systems.

Discussion emerged around the training techniques used for the system that solved the Navier-Stokes math problem. OpenAI clarified that performance improvements came from extensive reinforcement learning on an existing foundation model rather than a completely new pretraining run.