Facebook and Instagram's algorithms facilitated child sexual harassment, state lawsuit claims

Last December the state of New Mexico sued Meta for failing to protect children, claiming that Facebook and Instagram algorithms recommended sexual content to minors. Now, an unredacted internal Meta presentation has been revealed, with the company's own employees estimating that 100,000 child users were harassed daily, The Wall Street Journal reported.

According to a 2021 internal document, Facebook's "People You May Know" (PMYK) algorithm was singled out as a primary connector of children to predators. When employees reported those findings to Meta executives, they reportedly rejected recommendations that the algorithm be redesigned to stop recommending adults to minors. 

The feature was responsible for 75 percent of all inappropriate adult-minor contact, according to one employee. "How on earth have we not just turned off PYMK between adults and children?" another employee said. "It's really, really upsetting," added another. 

The issues were particularly insidious on Instagram, according to an internal 2020 memo, with "sex talk" 38 times more prevalent on that platform than Facebook Messenger in the US. In one case an Apple executive reported that his 12-year-old child was solicited on Instagram. "This is the kind of thing that pisses Apple off to the extend of threat[en]ing to remove us from the App Store," said an employee charged with addressing the issue. 

New Mexico claims that Meta has failed to address large-scale predation on its platform, particularly around recommendation algorithms. State investigators originally set up phony accounts for children, providing adult dates of birth, as kids often misstate their ages to access online services that they're not supposed to. Then, they implied that the accounts were being used by children, with one posting about a lost baby tooth and starting seventh grade. The suit alleged that, among other things, the accounts were sent child sex images and offers to pay for sex.

The state further alleges that Meta leaders didn't take action to limit adult predation on minors until late 2022, and still stopped short of strict measure recommended by safety staff. Instead it, only attempted to block suggestions to adults who previously demonstrated suspicious behavior toward children. However, according to a Meta study, 99 percent of accounts disabled for grooming children failed to state their age.

Meta recently introduced measures for teen users on Instagram and Facebook, including stopping non-followers from messaging them and blocking offensive comments. On top of the New Mexico complaint, Meta is facing lawsuits from 41 states complaining it harms the mental health of its youngest users. Another recently unsealed complaint filed by 33 states alleges that Meta "coveted and pursued" users under the age of 13 and has been dishonest about how it handles underage users' accounts when they're discovered.

This article originally appeared on Engadget at https://www.engadget.com/facebook-and-instagrams-algorithms-facilitated-child-sexual-harassment-state-lawsuit-claims-095314139.html?src=rss https://www.engadget.com/facebook-and-instagrams-algorithms-facilitated-child-sexual-harassment-state-lawsuit-claims-095314139.html?src=rss
Created 1y | Jan 21, 2024, 2:41:04 AM


Login to add comment

Other posts in this group

Tesla's inaugural Robotaxi rides will have a human 'safety monitor' on board

A select few will soon get to experience Tesla's robotaxi service for the first time, but they won't be alone in the car. The company plans to launch its fully autonomous ride-hailing service in Au

Jun 21, 2025, 6:10:16 PM | Engadget
Chinese company Netease is making an AAA action-adventure game called 'Blood Message'

NetEase, the Chinese video game company that published

Jun 21, 2025, 6:10:14 PM | Engadget
Xbox's VR headset with Meta could release sooner than we thought

Xbox has come a long way since its humble beginnings as a chunky console. It's recently taken on the form of an Asus

Jun 21, 2025, 6:10:13 PM | Engadget
Playdate Season 2 review: Shadowgate PD and CatchaDiablos

Earlier in this Playdate season, I

Jun 21, 2025, 3:40:17 PM | Engadget
Apple is reportedly considering the acquisition of Perplexity AI

Apple's executives are thinking of acquiring Perplexity AI both to get more talent and to be able to offer an AI-based search engine in the future, according to

Jun 21, 2025, 3:40:16 PM | Engadget
Amazon Prime Day 2025: The best early deals you can shop now, dates and everything else you need to know

Amazon Prime Day 2025 will be here soon on July 8-11, but as to be expected, you can already find some decent sales

Jun 21, 2025, 3:40:15 PM | Engadget
Engadget review recap: Switch 2, Playdate games and a Framework laptop

The Nintendo Switch 2 has been all the rage around the Engadget HQ for the last few weeks. Even the editors who didn't write the official review have had their hands glued to their new toys. Of cou

Jun 21, 2025, 1:30:09 PM | Engadget