The mouse cursor has hardly changed for half a century. Google just tried to make that no longer the case

Google DeepMind has published the principles and demos of Magic Pointera mouse pointer powered by Gemini who understands what you are pointing out and why. Without writing anything. Just pointing.

Why is it important. The chatbot as the main interface has been the dominant model in AI for two years: you open a window, write and you get a response. Magic Pointer proposes the opposite: the AI ​​moves with you around the screen, reads what is in front of you and acts without you explaining the context. If it works as promised, the text box is no longer the gateway to AI.

The logic behind the project is that the problem with current AI is not its capacity, but the friction to use it. Every time you want to ask a model for something, you have to drag your world into it: open a window, paste text, explain the context from scratch, etc. Magic Pointer reverses that flow: the AI ​​goes where the cursor is.

In detail. The system captures visual and semantic context around the pointer. You indicate a date in an email and Gemini suggests creating an event. You select two images, a sofa and your living room, and the model composes them. You hover over a table and you can request a graph without opening any more apps.

The objective is to replace the prompts long by what DeepMind calls “natural shorthand”: point out something, say what you want, and have the system fill in the gaps.

  • There are live demos at Google AI Studio and the system now reaches Chrome.
  • In autumn it will land in Googlebookthe new Google laptop with Acer, Asus, Dell, HP and Lenovo as manufacturers.

Between the lines. We are looking at three ways to put AI in a computer:

  1. Apple integrates it within each application.
  2. Microsoft puts Copilot on a side panel.
  3. Google puts Gemini inside the pointing device itself: it is not in the background, it is the cursor, it is the widgetis the interface between the user and the machine.

That last one is a philosophical bet. And it has implications for the chatbot model: if the cursor acts as a contextual agent, the chat window loses its monopoly as an entry point.

Yes, but. Googlebook arrives in autumn as a premium product, with no announced price yet. The Android ecosystem on the desktop remains the weak flank: if developers do not build native apps for the big screen, the Magic Pointer points to a world that does not yet exist. And in any market where Gemini is restricted by regulations, the entire proposition becomes empty.

In Xataka | The AI ​​industry already knows how to make more money. Just use the fear strategy

Featured image | Google

Leave your vote

Leave a Comment

GIPHY App Key not set. Please check settings

Log In

Forgot password?

Forgot password?

Enter your account data and we will send you a link to reset your password.

Your password reset link appears to be invalid or expired.

Log in

Privacy Policy

Add to Collection

No Collections

Here you'll find all collections you've created before.