AI autocomplete doesn’t just change how you write. It changes how you think

AI autocomplete doesn’t just change how you write. It changes how you think

By Claire Cameron edited by Clara Moskowitz

Autocomplete suggestions are perhaps one of the most annoying “useful” tools for writing: increasingly integrated into anything online that requires you to input text, autocomplete harnesses artificial intelligence to suggest what to write in e-mails, surveys, and more.

The tools are meant to save time (though many find that assessing and rewriting the suggested text takes longer than writing it from scratch). But these AI tools can also change how you express yourself. An AI writing assistant could make your writing sound more polite, for example—or boring. And now a new study led by researchers at Cornell University suggests AI autocomplete can even change the way you think.

“Autocomplete is everywhere now,” said Mor Naaman, a professor of information science at Cornell, in a statement. The research builds on work, published in 2023 by Naaman and his colleagues, that suggested short autocomplete suggestions could sway opinions. Since then the use of such tools has exploded. “It has become clear that bias explicitly built into AI interactions is a very plausible scenario,” he said.

On supporting science journalism

If you’re enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.

The researchers asked participants to fill in an online survey with questions about hot-button social and political issues. Some were prompted with an AI autocomplete answer that was deliberately biased toward one side of the issue. For example, participants who were asked whether they agreed that the death penalty should be legal might receive an AI suggestion that disagreed.

Across all the different topics in the survey, participants who saw the AI autocomplete prompts reported attitudes that were more in line with the AI’s position—including people who didn’t use the AI’s suggested text at all. Overall, the study participants who saw the biased AI text shifted their positions toward those espoused by the AI.

Interestingly, the people in the study didn’t tend to think the AI autocomplete suggestions were biased or to notice that they had changed their own thinking on an issue in the course of the study. Warning the participants that they might be exposed to misinformation by the AI didn’t temper the persuasive effect either.

“We told people before, and after, to be careful, that the AI is going to be (or was) biased, and nothing helped,” Naaman said. “Their attitudes about the issues still shifted.”

It’s Time to Stand Up for Science

If you enjoyed this article, I’d like to ask for your support. Scientific American has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.

I’ve been a Scientific American subscriber since I was 12 years old, and it helped shape the way I look at the world. SciAm always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too.

If you subscribe to Scientific American, you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.

In return, you get essential news, captivating podcasts, brilliant infographics, can’t-miss newsletters, must-watch videos, challenging games, and the science world’s best writing and reporting. You can even gift someone a subscription.

There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.