Home > AI

Is Snapchat’s AI Chatbot Safe? Addressing concerns

Addressing some concerns over the social media chatbot

Reviewed By: Kevin Pocock

Last Updated on December 5, 2023
is-snapchat-ai-chatbot-safe-snapchat-logo-safety-icon
You can trust PC Guide: Our team of experts use a combination of independent consumer research, in-depth testing where appropriate - which will be flagged as such, and market analysis when recommending products, software and services. Find out how we test here.

Wondering whether Snapchat’s AI chatbot is safe? Snapchat recently introduced its own AI chatbot, My AI. This chatbot avatar, powered by OpenAI’s ChatGPT, aims to offer users advice, answer questions, and engage in conversations. However, many people have raised concerns regarding the safety and appropriateness of My AI, especially for its young user base. 

In this article, we will look at the safety concerns associated with the AI chatbot’s usage and safety measures that should be put in place before and after the deployment of AI chatbots.

Essential AI Tools

Editor’s pick
Only $0.00019 per word!

Content Guardian – AI Content Checker – One-click, Eight Checks

8 Market leading AI Content Checkers in ONE click. The only 8-in-1 AI content detector platform in the world. We integrate with leading AI content detectors to give unparalleled confidence that your content appear to be written by a human.
EXCLUSIVE DEAL 10,000 free bonus credits

Jasper AI

On-brand AI content wherever you create. 100,000+ customers creating real content with Jasper. One AI tool, all the best models.
TRY FOR FREE

WordAI

10x Your Content Output With AI. Key features – No duplicate content, full control, in built AI content checker. Free trial available.
TRY FOR FREE

Copy.ai

Experience the full power of an AI content generator that delivers premium results in seconds. 8 million users enjoy writing blogs 10x faster, effortlessly creating higher converting social media posts or writing more engaging emails. Sign up for a free trial.
TRY FOR FREE

Writesonic

Create SEO-optimized and plagiarism-free content for your blogs, ads, emails, and website 10X faster. Start for free. No credit card required.

Is Snapchat’s AI Chatbot Safe? Unpredictable Responses

The chatbot has some notable deficiencies. Some experiments carried out showed that My AI can sometimes generate unpredictable responses, some of which may be inappropriate for certain Snapchat users. This highlights the potential dangers of the chatbot’s responses, which could impact the mental health and mood of especially younger users. In an experiment where researcher Aza Raskin posed as a 13-year-old girl, the AI’s responses were inappropriate and sometimes dangerous

Privacy Concerns and Retention of User Data

Apart from the potential risks associated with My AI’s responses, there are also privacy concerns surrounding the messaging service provided by the chatbot. This is similar to ChatGPT.

Snapchat acknowledges that unless manually deleted, a user’s message history with My AI will be retained and used for improving the chatbot’s functionality and personalizing advertisements. As a result, Snapchat, as a disclaimer, advises users not to share any confidential or sensitive information with My AI. This raises concerns about the security and privacy of users’ conversations and the potential misuse of their data.

Ensuring Safety Measures for AI Chatbots

The issues surrounding My AI on Snapchat highlight the need for stricter safety measures when implementing AI chatbots, particularly on platforms with a significant underage user base. To ensure the safety of users, AI chatbots should undergo thorough testing and continuous monitoring to prevent inappropriate responses. 

Additionally, platforms like Snapchat should provide clear guidelines to users, emphasizing the importance of not oversharing personal information or engaging in potentially harmful conversations.

Regulatory bodies and industry-wide standards should also play a crucial role in overseeing the development and deployment of AI chatbots. Implementing strict guidelines and regular audits can help prevent the dissemination of harmful content and protect vulnerable users from potential risks.

Is Snapchat’s AI Chatbot Safe? Conclusion

While Snapchat’s My AI chatbot offers an innovative and interactive experience within the app, concerns regarding its safety and appropriateness persist. The unpredictable responses and retention of user data by the chatbot pose significant risks to users.

Gloria is a tech and AI writer for PC Guide. She is interested in what new technology means for the future of digital and broadcast journalism.