This hidden Gemini feature uses AI to teach you to be a tech savant

A few weeks ago, Google Gemini taught me some new graphic design skills. I was editing a screenshot in Photopea, a free online Photoshop alternative, and wanted to place the image over a colorful border with a drop shadow behind it. Instead of digging through documentation or looking for You Tube tutorials, I just shared a live view of my web browser with Gemini and asked for guidance. Google’s AI assistant proceeded to walk me through Photopea’s complex menus step by step. This is the most underrated feature of Gemini’s Mac app, which launched in April. While other desktop AI apps have increasingly focused on taking direct control of your computer, Gemini’s app still sees the value of teaching you to do things on your own. Looking over your shoulder When you click the + button in Gemini’s Mac app, you’ll see a Share Window among Gemini’s list of tools. Dragging your cursor over this option brings up a list of open windows to share with Google’s AI assistant. (This feature does require some extra privacy permissions, enabled under Settings > Privacy & Security > Screen & System Audio Recording. From there you can turn on the Gemini toggle so that the app can automatically take screenshots.) Once you’ve shared a window with Gemini, it will take a screenshot of that window each time you post a question. That means you can use Gemini alongside your other apps and get help along the way. While creating my image border in Photopea, for instance, I ran into some trouble applying a gradient effect to my background. In response, Gemini looked at which menu was open in Photopea and told me exactly which buttons to click from there, citing Photopea’s online documentation. I’ve since used Gemini for guidance in couple of other software interactions. It helped me navigate the labyrinthine Fangraphs website while looking up some recent baseball statistics, and after I vibe coded a couple of Raycast scripts for wind