Sony's New AI Patent Predicts Button Presses Using Finger-Camera Tech

Sony has recently filed a patent, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," which aims to significantly reduce latency in future gaming hardware. This move comes as a response to the challenges posed by newer graphics technologies like frame generation, which, while enhancing visual quality, can introduce additional latency, impacting game responsiveness.

The introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro has already shown Sony's commitment to improving visual fidelity. However, as gamers seek both high frame rates and low latency, especially in fast-paced genres like twitch shooters, Sony is exploring innovative solutions to maintain game responsiveness.

This new Sony patent could be a game-changer for PlayStation. Image credit: Sony Interactive Entertainment.

First spotted by Tech4gamers, this patent outlines a system that predicts user inputs using a machine-learning AI model, aided by external sensors. For instance, a camera could be used to monitor the player's controller, anticipating which button will be pressed next. The patent suggests that "the method may include providing camera input as an input to a machine learning (ML) model," which could indicate the next user command.

Additionally, Sony explores the potential of using the controller's buttons themselves as sensors. Given Sony's history with analog buttons, this could lead to advanced input prediction in next-generation controllers. The patent explains that the goal is to streamline the "timed release of user commands" to reduce the latency between a player's action and the game's response, thus preventing unintended consequences in gameplay.

While it's uncertain if this technology will appear in its current form in the PlayStation 6, Sony's patent filing clearly indicates a focus on reducing latency without sacrificing the benefits of modern rendering technologies like FSR 3 and DLSS 3. These technologies, while popular, add frame latency to systems, making Sony's pursuit of solutions particularly timely and relevant.

The potential impact of this technology on real-world gaming scenarios, especially in genres requiring quick reflexes and high responsiveness, could be transformative. However, whether this patent will translate into future hardware remains to be seen.