This hidden Gemini feature uses AI to teach you to be a tech savant

Google Gemini's Mac app, launched in April, offers a feature that teaches users how to perform tasks within other applications by sharing a live view of their screen. This "Share Window" functionality allows Gemini to analyze the user's current application interface and provide step-by-step guidance, a departure from AI tools that focus on direct control. For example, when a user was editing an image in Photopea, a free online Photoshop alternative, and needed assistance with creating a graphic border with a drop shadow, Gemini guided them through Photopea's menus. The AI assistant also provided specific instructions on which buttons to click, referencing Photopea's online documentation when the user encountered issues with applying a gradient effect. This feature requires specific privacy permissions, including enabling screen and system audio recording for the Gemini app. Beyond graphic design, the user also utilized Gemini for help navigating the Fangraphs website to find baseball statistics. This approach emphasizes empowering users with knowledge rather than simply automating tasks.