People are dunking on Google search AI's nonsensical answers

• Some users are struggling with Google's new AI-fueled search tool.
• Certain searches get responses that are nonsensical or downright wrong.

Google promised a sweeping overhaul to its ubiquitous search engine at I/O last week — but users are already pushing its limits.

In some cases, the new tool, powered by artificial intelligence, returns responses that aren't accurate. Some are slightly nonsensical. Others are downright wrong.

It's called AI Overview. Rather than giving you a list of third-party web pages, the new Google search function creates a new box with conversational answers culled from across the web and fueled by generative AI.

"Google will do the googling for you" was how the head of search, Liz Reid, put it onstage last week.

But in searches shared on X, users have gotten contradictory instructions on boiling taro and even been encouraged to run with scissors after the AI appeared to take a joke search seriously.

When we asked whether a dog had ever played in the NHL, Google answered that one had, apparently confused by a charity event for rescue pups.

Another time, Google's AI assistant said a series of presidents graduated from UW-Madison, citing a webpage referencing when students at the school had the same names as US presidents.

Jake Kleinman, the executive editor of Inverse, posted on X that a query for the biggest movie flops of 2024 returned a list from a website speculating on future box-office figures. AI Overview confidently said movies that hadn't come out yet were already failures, based on that article.

A Google spokesperson told Business Insider the examples being shared online were "extremely rare queries and aren't representative of most people's experiences." The spokesperson said the "vast majority of AI Overviews provide high-quality information."

The spokesperson said the examples started gaining search interest only because of the posts on social media. Google says it's seen more search usage and user satisfaction since AI Overview launched.

"We conducted extensive testing before launching this new experience and will use these isolated examples as we continue to refine our systems overall," the spokesperson said.

Google said at I/O that AI Overviews were available across the US and would roll out to 1 billion users by the end of the year — though some are already trying to figure out how to disable it.

The Google spokesperson said the company was going to introduce a "web" filter that would exclusively turn up links.

In addition to questions of reliability, there are concerns about AI from business owners who have long relied on SEO to drive hits and ad dollars.

They're worried that AI Overviews could decimate search traffic to their websites.

In a blog post, Reid said the "links included in AI Overviews get more clicks than if the page had appeared as a traditional web listing for that query," adding that Google would "continue to focus on sending valuable traffic to publishers and creators."