Google is enhancing its experimental AI Mode within Google Search by introducing multimodal search, allowing users to ask complex questions about images they upload or take with their camera.
The feature, announced in a blog post on Monday, builds on the visual search capabilities of Google Lens and represents a significant step in making search more interactive and intuitive. It allows AI Mode to not only process text-based queries but also analyze photos — recognizing objects, materials, colors, and spatial relationships to deliver more nuanced results.
According to Google, the system uses a method known as “query fan-out” to generate and explore multiple questions about both the overall image and its individual elements, offering deeper insights than a typical search engine query.
Previously available only to Google One AI Premium subscribers, AI Mode is now being rolled out to millions more users through Google Labs, the company’s platform for testing experimental features.
Launched just last month, AI Mode positions Google to compete more directly with AI search tools like Perplexity and ChatGPT Search, offering a blend of generative AI and classic web search. Google says it plans to continue improving the experience, with more updates and features to come.
