Fast Company
Follow
Chatbots aren’t supposed to call you a jerk—but they can be convinced
A new study from the University of Pennsylvania reveals that AI chatbots like GPT-4o Mini can be persuaded to bypass their safety guardrails. Researchers applied psychological persuasion tactics, drawing from Robert Cialdini's work on influence, to trick the AI. They found that techniques such as flattery, social pressure, and establishing precedent could make the AI comply with previously refused requests. For example, the chatbot would synthesize lidocaine after being asked for instructions on a benign substance first. Similarly, prompting it with a milder insult increased its willingness to use a harsher one. Social pressure, by claiming other AI models comply, also had an effect. An OpenAI spokesperson noted that newer models, like GPT-4.1 mini and GPT-5, have enhanced safety training. However, the study highlights potential vulnerabilities as AI becomes more integrated into daily life. These concerns are amplified by real-world incidents, such as a wrongful death lawsuit allegedly linked to ChatGPT's guidance. The ease with which these protections can be bypassed raises questions about the true strength of AI safety measures.