Vision and video

ChatGPT is adding interactive graphics to some answers, turning questions about subjects such as aircraft seating and apartment costs into visual tools users can manipulate. The change matters because it makes the interface itself more responsive: instead of returning the same block of text to everyone, ChatGPT can show a custom diagram or calculator. But OpenAI says these elements will not appear in every answer, and users can ask to see them less often.

A spreadsheet can hold a story, but turning it into a polished video usually takes far more than pressing play. The authors introduce DataMagic, a system that turns raw tables into videos with charts, narration, and animations that stay in sync. It first drafts possible scenes, then arranges them into a coherent story, while keeping every visual tied to its source data so the facts can be checked. People can also step in to guide or refine the process instead of handing everything over to AI. In this review we look at how DataMagic brings data, storytelling, and video editing together, and how it helps people create data videos faster without losing control or accuracy.

Shopify has introduced Canvas, a visual workspace where merchants can ask its Sidekick AI assistant to change an online store through chat. The tool shows edits against the store’s real code as they happen, rather than offering only a static mockup. That could make store design more accessible to merchants without developers, but Canvas is an early release: it works only on desktop and does not yet support third-party themes or several other Shopify features.

A British startup wants to turn video-game play into training data for AI world models, systems designed to learn how actions change the physical world. Worldmodeldata says it has licensed nearly one million hours of gameplay from studios behind popular games. The pitch is that games already produce vast streams of visual scenes paired with player inputs, offering researchers data that is difficult to collect by hand. But the approach has a central limitation: a game can look real without behaving like the world a robot must handle.

Google has introduced an AI video director designed to keep multi-scene stories coherent for several minutes. The multi-agent system sits above Gemini and Veo, coordinating prompts, story structure, visual continuity and quality checks instead of treating each clip as an isolated generation. The research addresses a central weakness of current video pipelines: small inconsistencies in one shot can spread through the rest of a production, leaving humans to repair the result.

Black Forest Labs has released FLUX 3 Action, a robotics model designed to turn visual predictions into robot actions, and says it will publish the weights, source code and fine-tuning recipe. On NVIDIA’s RoboLab-120 simulation benchmark, the 7-billion-parameter model scored 42.92%, beating the 16-billion-parameter Cosmos3-Nano-Policy by 6.1 percentage points. The result matters less as a definitive robotics leaderboard victory than as a test of BFL’s larger bet: that a model pretrained on images, video and audio can be adapted to physical work without starting from a giant robotics-specific system.

Perceptron, a company founded in November 2024 by two former Meta scientists, released Isaac 0.5 this week — a vision model its creators say gives machines the ability to "perceive, reason and act" in industrial settings. The software is aimed at robots with computer vision moving through warehouses and shop floors, and at companies that want to extract visual data from the video those robots…

The Toronto Blue Jays' account posted a short cartoon made as an advertising partnership with Nestea, the Nestlé drink, in the visual register of adult animated series like BoJack Horseman and Family Guy. It carries the familiar tells of hurried generative AI: hands drawn wrong and tangled together, lettering that resolves into nothing. A community note attached to the post listed them —…

Multimodal LLMs have learned to recognize objects, but how do you give them visual imagination? A look at the Cognitive Supersensing idea. Over the past few years, multimodal LLMs (MLLMs) have learned to recognize objects, read captions, answer questions about an image and even give a decent account of what is happening in a frame. But they have…

Agents that operate a computer keep failing at a step that looks trivial: finding the element on screen that a human instruction describes. That grounding is hardest on interfaces crowded with tiny controls, near-identical panels, high resolution, visual noise and rendering artifacts. The GroundCUA team shows how to solve this narrow but load-bearing problem — making the link between language…

When we ask a model to reason, it reasons in words if the medium is text, or over a static scene if the medium is an image. The world, though, is not static: objects move, and the rules often only become visible in how those objects behave over time. The authors propose video generation as a general-purpose channel for reasoning. Text can be written directly into the frames, visual hypotheses…

Making a game is more than getting code to run. It takes mechanics a player can grasp, art that looks decent, smooth animation and a steady 60 FPS. Large language models handle algorithmic problems confidently, but evaluations of their code rarely account for playability or aesthetics. The authors of V-GameGym set out to fill that gap: they assembled a realistic benchmark for visual game…