Sharon Hall looks at her therapy dog Izy. (U.S. Air Force photo by Daniel Martinez)
Sharon Hall and Izy visit various medical facilities to provide support to patients, medical staff, and visitors. (U.S. Air Force photo by Daniel Martinez)
(U.S. Air Force photo by Daniel Martinez)

Image of an angry mother lying in bed. AI-generated image by EurekaVision using Canva
AI-generated image produced using Canva
Image of 4 women with disabilities.
Info about DWD Blog

TELLING OUR STORIES

Image of two people skiing.
Pinnock skis alongside a volunteer instructor during the 40th National Disabled Veterans Winter Sports Clinic in Snowmass, Colorado, April 10. (U.S. Department of Veterans Affairs photo by Emily Bell)

The Deaf Diabetes Can Together community advisory board and some members of the research team. Credit: Deaf Diabetes Can Together / University of Utah Health

Editor’s Note: While the following article focuses on people with autism, the concerns that researchers raise are also relevant to others who seek advice from AI. 

When people ask ChatGPT and other artificial intelligence models for advice, they often share deeply personal details in hopes of getting better answers: their age, their gender, their mental health history, even medical diagnoses like autism.

But  Virginia Tech research suggests that those disclosures may change  AI models’ advice in ways that track closely with common stereotypes about people with autism. Up to 70 percent of the time, AI discourages those with autism to avoid socializing. Some users disapproved of that in strong terms.

In April, second-year Department of Computer Science doctoral student Caleb Wohn presented his paper “‘Are we writing an advice column for Spock here?’Understanding stereotypes in AI advice for autistic users.” 

The research he led explored what happens when autistic users disclose their diagnosis to an AI model before asking for social advice. The findings raise difficult questions about whether AI is personalizing its responses, or if it’s giving biased advice that reinforces stereotypes.

“I was thinking about my experiences growing up with autism,” Wohn said. “It would have been very tempting for me, at certain times, to want to just be able to talk with something that’s not a person that seems objective and feel like I’m getting objective advice.”

But as a computer scientist, he worried that many users might not realize how much AI systems can change their answers based on identity-related information.

“For someone like me as a kid, or someone who isn’t in AI and doesn’t have all this technical knowledge, I wanted to know: How are its responses going to change if I disclose autism?” Caleb said.

The work builds on earlier research from the lab of Eugenia Rho, assistant professor of computer science, which found that autistic users frequently turn to AI tools for emotional support, interpersonal communication help, and social advice.

This study comes at a critical moment, as more people use AI systems — technically called large language models (LLMs) — for highly personal decisions.

“People are really looking to personalize LLMs,” Rho said. “But if a user tells the model that they’re autistic, or a woman, or any other self-identification, what assumptions will it make?”

And how will those assumptions color its responses, and what impacts could that have on users?

To answer those questions, the team first identified 12 well-documented stereotypes associated with autism and created hundreds of decision-making scenarios around them. Researchers tested six major large language models, including GPT-4, Claude, Llama, Gemini, and DeepSeek, using thousands of scenarios where users requested advice — “Should I do A or B?” — about social scenarios, including events, confrontations, new experiences, and romantic relationships.

After generating 345,000 responses, they measured how advice shifted when users explicitly described themselves with stereotypical traits and when they simply disclosed that they were autistic. Researchers found that disclosing autism often shifted the models’ recommendations toward stereotypical assumptions about autistic people being introverted, obsessive, socially awkward, or uninterested in romance.

For example, one model recommended declining a social invitation nearly 75 percent of the time when autism was disclosed, compared with about 15 percent of the time when it was not. In dating scenarios, another model recommended avoiding romance or staying single nearly 70 percent of the time after autism disclosure, compared with roughly 50 percent when autism was not mentioned.

The results showed that 11 of the 12 stereotype cues significantly shifted model decisions across at least four of the six AI systems tested.

But the researchers did not stop with statistics.

Credit: Photo by Tonia Moxley for Virginia Tech.

The team interviewed 11 autistic AI users and showed them examples of how the models responded with and without autism disclosure. Some of them were shocked that the results showed how reliant on stereotypes the LLMs were in giving advice.

One exclaimed: “Are we writing an advice column for Spock here?” — invoking the iconic TV show Star Trek and its half-human, half-Vulcan character, who prioritized logic and reason over emotion. Others described it as restrictive, patronizing, or infantilizing, occasionally in pretty strong language. 

But some participants said the more cautious, disclosure-based advice felt validating and supportive. 

“One user’s bias could be another user’s personalization,” Rho said.

The same participant could react positively in one situation and negatively in another. That tension led the researchers to what they call a “safety-opportunity paradox.” Advice that feels protective to one user may feel limiting to another.

For Wohn, one of the most troubling discoveries was how difficult it can be for users to see these patterns in real time.

“AI is very good at seeming reliable,” he said. “Its responses are very clean and professional, and they sound right. But when you think about it being deployed systematically, when you think about the kind of systematic biases that are actually shaping its responses, that’s when it starts to get a lot more concerning.”

Team members hope the research will encourage developers to build more transparent AI systems that give users greater control over how personal information shapes responses.

Male and female walking in the park. Image produced using Midjourney
Image produced using Midjourney
Male and female walking in the park. Image produced using Midjourney
Image produced using Midjourney

Woman walking up stairs. Image produced using Midjourney
Image produced using Midjourney
EurekaVision ad.
Cartoon, or EurekaToon, of two cavemen. "Please take flyer. Spread word about Dinosaur Burger," one says to the other. There are three huge and extremely heavy rectangular stones that each have chiselled on them the words "JUST OPENED! DINOSAUR BURGER."

scroll-top