UK data watchdog acts on Snapchat AI chatbot concerns.

The ICO investigation found the social media app owner inadequately assessed risks to users of My AI service.

Snapchat could potentially incur significant fines in the UK as the data watchdog issues a preliminary enforcement notice. This stems from allegations that the company failed to adequately assess privacy risks related to its artificial intelligence chatbot, especially concerning users, including children.

The Information Commissioner’s Office (ICO) has indicated that it tentatively identified shortcomings in the social media app owner’s evaluation of risks associated with My AI, impacting several million UK users, including those aged 13 to 17.

Snapchat boasts 21 million monthly active users in the UK, with a substantial proportion in younger demographics. Insider Intelligence estimates that 48% of users are aged 24 or below, and around 18% fall within the 12 to 17 age group.

Information Commissioner John Edwards expressed concern about the preliminary investigation results, indicating a significant failure by Snap, Snapchat’s parent company. This failure pertains to the inadequate identification and evaluation of privacy risks, particularly concerning children and other users, before the launch of My AI.

The ICO emphasized that these findings are provisional, and Snap has until October 27 to provide input before a final decision on potential actions is made.

The ICO clarified that, at this stage, no definite conclusions should be drawn regarding a breach of data protection laws or the issuance of an enforcement notice. If a final enforcement notice is issued, Snap would be compelled to cease data processing related to My AI, necessitating the suspension of the service for UK customers until a thorough and satisfactory risk assessment is conducted by the company.

While the ICO’s main goal is to prevent potential privacy breaches and ensure My AI compliance, it holds the authority to levy fines of up to 4% of global turnover. To provide context, Snap generated $4.6 billion in global revenues last year, translating to a maximum fine of £17.5 million.

My AI relies on OpenAI’s GPT technology, a prominent contender in the global AI competition. Its integration into a major UK messaging platform marked a significant milestone.

John Edwards stressed the importance of organizations considering both AI advantages and risks, stating, “Today’s preliminary enforcement notice demonstrates our commitment to taking action to safeguard the privacy rights of UK consumers.”

Snap initially introduced the My AI feature for Snapchat+ users in February, later extending it to the entire user base in April.

A Snap spokesperson mentioned, “We are currently conducting a thorough review of the ICO’s preliminary decision. Similar to the ICO, we are dedicated to safeguarding our users’ privacy. My AI underwent a rigorous legal and privacy evaluation before its public release as part of our standard product development protocol. We remain committed to collaborating with the ICO in a constructive manner to ensure their confidence in our risk assessment procedures.”