Monday 21 April 2025
Researchers have been studying how people search for information on the internet, and a recent paper sheds new light on this complex process. The study found that when users are given the option to use both traditional web search engines and conversational AI assistants like ChatGPT, they tend to adopt different strategies depending on their level of familiarity with the topic.
The researchers observed that participants who were more confident in their understanding of a subject tended to rely more heavily on the chat interface, asking follow-up questions and seeking clarification when needed. On the other hand, those who were less familiar with the topic often defaulted to traditional web search engines, using keywords and phrases to find relevant information.
This is not surprising, given that humans tend to default to what they know and are comfortable with. But what’s interesting is that even though participants were more likely to use traditional search methods when uncertain, they still reported feeling confident in their ability to find the answers they needed.
The study also found that users’ perceptions of credibility and trust played a significant role in their decision-making process. When using the chat interface, participants often took the AI’s responses at face value, without fact-checking or verifying the information provided. This highlights the importance of educating users about the limitations and potential biases of AI-generated content.
Another key takeaway is that users’ search behaviors are influenced by factors beyond just their level of knowledge or confidence. The study suggests that pre-task confidence and trust also play a significant role, with participants more likely to use the chat interface when they felt confident in their ability to find the answers they needed.
So what does this mean for the future of online information seeking? It’s clear that traditional web search engines will continue to have a place, particularly for users who are less familiar with a topic or prefer a more structured approach. However, conversational AI assistants like ChatGPT offer a new way for users to interact with information, and researchers will need to continue studying how these tools can be designed to effectively support users’ needs.
Ultimately, the study highlights the importance of understanding human behavior in online search environments, and how our perceptions and biases influence the way we seek out information. By better understanding these factors, developers can create more effective and user-friendly tools that help us find the answers we need – whether through traditional search methods or innovative AI-powered interfaces.
Cite this article: “ChatGPTs Search Conundrum: How Users Navigate the Intersection of AI and Web Search”, The Science Archive, 2025.
Information Seeking, Online Search, Conversational Ai, Chatgpt, Human Behavior, Web Search Engines, Familiarity, Confidence, Trust, Credibility
