Tech
1970s Boy Making A Face
(Photo: D Logan / Getty Images)

The online “funhouse mirror” distorting everyone’s reality

Tiny numbers of “toxic” accounts can have massive, outsize negative effects for all.

10/10/24 10:59AM

A small, vocal minority is distorting our view of what’s normal online. That’s the conclusion of a new paper from researchers at New York University, “Inside the funhouse mirror factory: How social media distorts perceptions of norms.” 

Online discourse is… not doing well. Platforms are fighting claims of censorship in the courts, misinformation on social media is raging, and AI slop is filling up users’ feeds. 

All of this is enough to make people question just what reality looks like. It turns out that’s kind of what is happening, according to the paper, which points to several things contributing to this reality-distortion effect. 

Just 0.1% of users were responsible for 80% of fake news. 

Research cited in the paper notes that tiny numbers of “toxic” accounts can have massive, outsize negative effects for all users. “While only 3% of active accounts are toxic, they produce 33% of all content,” the authors said. Much of the false information online can be attributed to this minority group, too, noting that just 0.1% of users were responsible for 80% of fake news

This content sparks outrage among a large number of users, and can create “false polarization” among moderate users who are less likely to wade into the viper’s nest of online discussions and share their more typical viewpoints. 

Adding to the problem, online platforms are built to amplify the most extreme voices and reactions (both positive and negative) to capture our attention and distill it into engagement. 

This doesn’t just apply to social media, but also to content like online product reviews. You usually only see the worst reviews and the best reviews, and rarely anything in the middle. 

And on platforms like Meta’s Instagram, this manifests itself in a different way: you only see the perfect moments and most flattering moments from influencers (who are probably staging them). 

Even Microsoft’s LinkedIn isn't immune to this, note the authors of the paper. You’ll likely only see the most positive professional achievements in your feed, which might give you the false impression that everyone is absolutely crushing it at work except yourself. You’re less likely to see posts about more quotidian failures and setbacks. 

The paper notes that this fun house mirror doesn’t just give people a distorted view of what’s really happening, but can cause real-world harm. Citing prior research, the authors explain that these distortions can lead to teen drug and alcohol abuse, and support for authoritarian regimes

“The internet is an attention economy, but what we pay attention to is biased based towards threatening content.”

Claire E. Robertson is a research associate at NYU and the lead author of the paper. Robertson said there are two important things that platforms can do to help correct some of these distortions: be more transparent about how their algorithms work and give users more control over the content we do see.

“The internet is an attention economy, but what we pay attention to is biased based towards threatening content — things that threaten us and our social groups,” Robertson wrote in an email to Sherwood News.

This results in an amplification of negative and threatening content, Robertson said. Robertson also explained that the kind of content people actually prefer isn’t exactly a mystery. “Allowing people to make more concrete choices about the types of content they want to see might mitigate some of these negative outcomes.”

But what can people do to correct their perceptions of what’s actually happening offline in the real world? Robertson suggests a few ways that you can correct some of the biases.

“One thing you can do is compare the types of content you see online to your offline environment. Go through the last 20 people you called or texted — these are probably people you trust. How many of them have posted their opinions online? Do you think their opinions are well represented by your Twitter feed?” Robertson said.

Another exercise that Robertson suggests is to take a look at high-quality public polling on big issues from Gallup Polling or Pew Research. Robertson said there is a real disconnect between what people actually say their values are and what is portrayed online. “Most people hold nuanced views, and a notable portion hold opposite views than we would expect.”

More Tech

See all Tech
“Daddy is very much home”

Tesla is up 2% today after CEO Elon Musk posted in a response to someone on X, “Daddy is very much home,” before detailing his packed Tesla schedule and involvement with various aspects of the company, including Optimus, where he’s said 80% of Tesla’s value will lie.

Tesla investors generally consider Musk’s involvement with the company to be a good thing, believing as Wedbush analyst Dan Ives has said, “Musk is Tesla and Tesla is Musk.”

Additionally, new data from Cox Automotive showed Tesla had more US sales than the next four top brands combined in August.

The stock soared yesterday after Musk purchased $1 billion in stock — a move that sent his personal wealth up $17 billion. The stock also jumped earlier this month after Tesla proposed a mammoth $1 trillion pay package for Musk intended to keep Musk at the company.

The phrase “Daddy’s home” is most commonly associated with the 2010 Usher track “Hey Daddy (Daddy’s Home).”

tech

OpenAI building a teen mode that will guess a user’s age and restrict flirtatious and self-harm-related chats

After a series of alarming safety failures in which ChatGPT encouraged self-harm, OpenAI has announced a 120-day plan to roll out new protections for young users and those that may be experiencing a mental health crisis.

In a blog post today, OpenAI CEO Sam Altman gave an update on the plan, saying that the company was building an “under-18 experience” for teens that won’t engage in “flirtatious talk” or engage in any discussions of self-harm.

The teen mode will also try to contact underage users’ parents if self-harm ideation is detected, and could reach out to law enforcement if the parents can’t be reached, according to Altman.

The plan calls for a new “age-prediction” system that will default to the under-18 safety mode. In a move that could frustrate many ChatGPT users, adults can exit only upon verifying their age by sharing their ID.

Altman acknowledged the trade-off in a post on X, but said the priority is protecting young users:

“I don’t expect that everyone will agree with these tradeoffs, but given the conflict it is important to explain our decisionmaking.”

Young adults make up a substantial portion of OpenAI’s end users. According to a large study of real-world ChatGPT users released yesterday, half of all adult users included in the study were under 26.

The teen mode will also try to contact underage users’ parents if self-harm ideation is detected, and could reach out to law enforcement if the parents can’t be reached, according to Altman.

The plan calls for a new “age-prediction” system that will default to the under-18 safety mode. In a move that could frustrate many ChatGPT users, adults can exit only upon verifying their age by sharing their ID.

Altman acknowledged the trade-off in a post on X, but said the priority is protecting young users:

“I don’t expect that everyone will agree with these tradeoffs, but given the conflict it is important to explain our decisionmaking.”

Young adults make up a substantial portion of OpenAI’s end users. According to a large study of real-world ChatGPT users released yesterday, half of all adult users included in the study were under 26.

tech

Anthropic data: Businesses are using Claude to automate rather than collaborate

Fresh on the heels of a revealing ChatGPT usage research paper from OpenAI, rival AI startup Anthropic released its own detailed look at how consumers and businesses are using its Claude AI chatbot.

While OpenAI’s study analyzed only end users of its ChatGPT chatbot, the Anthropic Economic Index report includes how businesses are using Claude via its API (application programming interface).

In a worrying sign of how AI might replace whole categories of human labor, Anthropic found that 77% of businesses using Claude were automating whole jobs away rather than collaborating with humans while they do their jobs.

The number of Claude users overall is tiny compared to ChatGPT, but its users do way more coding with the tool than with OpenAI’s chatbot.

The report also breaks down Claude usage by geography, showing that in the US, Washington, DC, has the highest Claude usage per capita, where the top tasks were document editing, gathering information, and job applications.

In a worrying sign of how AI might replace whole categories of human labor, Anthropic found that 77% of businesses using Claude were automating whole jobs away rather than collaborating with humans while they do their jobs.

The number of Claude users overall is tiny compared to ChatGPT, but its users do way more coding with the tool than with OpenAI’s chatbot.

The report also breaks down Claude usage by geography, showing that in the US, Washington, DC, has the highest Claude usage per capita, where the top tasks were document editing, gathering information, and job applications.

tech

Tesla faces door handle probe after Bloomberg report

A week after Bloomberg published a report called “Tesla’s Dangerous Doors” that detailed instances where people were hurt or injured after accidents reportedly left the flush electronic door handles inoperable, the National Highway Traffic Safety Administration has launched a probe into the matter.

“NHTSA’s investigation is focused on the operability of the electronic door locks from outside of the vehicle as that circumstance is the only one in which there is no manual way to open the door,” the NHTSA wrote. It cited reports of parents being forced to break the windows of their Teslas to extract their children locked inside.

The probe adds to a list of headwinds Tesla is facing, including declining sales, the end of the federal EV tax credit, and increased competition. However, Tesla, riding high on news yesterday that CEO Elon Musk purchased $1 billion in shares, doesn’t seem to be dampened by the news. It’s up 1.5% premarket.

“NHTSA’s investigation is focused on the operability of the electronic door locks from outside of the vehicle as that circumstance is the only one in which there is no manual way to open the door,” the NHTSA wrote. It cited reports of parents being forced to break the windows of their Teslas to extract their children locked inside.

The probe adds to a list of headwinds Tesla is facing, including declining sales, the end of the federal EV tax credit, and increased competition. However, Tesla, riding high on news yesterday that CEO Elon Musk purchased $1 billion in shares, doesn’t seem to be dampened by the news. It’s up 1.5% premarket.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.