Currently, Gemini is focusing on desktop web use, especially for AI Ultra subscribers. There are hints that it may extend to Android soon, particularly with the latest Android 16 QPR3 Beta 2 introducing a “Screen automation” permission.
In this beta version, if you go to Settings > Apps > Special app access, you’ll find the new “Screen automation” feature. This permission allows apps to help you by interacting with content on other apps, even when those apps are running in the background. Right now, this feature is available only on Pixel 10 devices, and it’s unclear if it will roll out to other devices.
The Google app, which manages Gemini, is currently the only one supporting this feature. You get three choices: Always allow, Ask every time, and Don’t allow.
This feature will help apps see and interact with other apps’ screens to assist you with tasks.
There are several aspects to this new feature framed as “computer_control.” It’s designed so that apps can function similarly to humans—navigating the web, clicking, typing, and scrolling just like we do.
In May, Google demonstrated Project Astra, which showcased Gemini’s ability to scroll through Chrome and interact with YouTube. This suggests that more advanced capabilities are on the horizon.
Overall, as technology evolves, the integration of features like screen automation could change how we use our devices, making them more helpful and intuitive. As user preferences shift, this might become a standard expectation rather than a novelty.
This focus on automation reflects broader trends in tech aiming to simplify our online experiences. According to a recent survey from Pew Research Center, almost 70% of smartphone users wish for features that enhance productivity without demanding constant attention. Projects like Gemini aim to address that demand, although widespread availability may still be a bit far off.
While the future of Gemini looks promising, it’s exciting to think about how tools like these will shape our daily tech interactions. As we wait for these features to be fully implemented, keep an eye on updates from trusted sources like Google’s announcements or technology news platforms.
