Google AI mistakenly reported a parent for possible child abuse

The company has explained that they make use of specialists and “state-of-the-art technology” to generate matches between the new images and a repository of information that they have in their system so that when they find any MASI, they inform the NCMEC and take action together with agencies. police around the world.

A Google spokesperson told the Times that the company only scans users’ images when they take “affirmative action” to do so, which apparently can include backing up their photos to Google Photos.

During 2021, Google sent 287,368 reports of possible child sexual abuse to NCMEC, according to its transparency report, while this organization alerted the authorities to about 4,260 possible victims, including Mark’s son.

Although the father tried to appeal Google’s decision, Google denied his request and instead ended up losing access to his emails, contact, photos and even his phone number, as he used Google Fi mobile service.