OpenAI has permanently banned several ChatGPT accounts allegedly connected to China-backed surveillance attempts. This move reflects the company’s strict policy against misuse of AI technology. According to OpenAI’s “Disrupting Malicious Uses of AI: October 2025” report, these accounts were attempting to use ChatGPT to develop mass surveillance tools, profiling systems, and social media monitoring platforms targeting specific groups.
China-Linked Users and Surveillance Attempts
The report noted that some accounts were potentially linked to the Chinese government and used ChatGPT to create authoritarian monitoring tools. OpenAI described this as “a rare glimpse into authoritarian abuses of AI.” These attempts occurred multiple times throughout 2025. One user reportedly asked ChatGPT to draft project plans and promotional material for a “social media listening tool.” This tool was designed to monitor political and extremist content on platforms such as X (formerly Twitter), Facebook, Instagram, Reddit, TikTok, and YouTube. OpenAI confirmed that this tool was never developed or deployed.
Another account sought assistance in creating a High-Risk Uyghur-Related Inflow Warning Model, which would have tracked “high-risk” individuals by analyzing transport bookings against police records. OpenAI clarified that this model was never built or operational.
Profiling and Research Activities
Several other accounts were using ChatGPT for profiling and online research. Some asked the AI to gather funding sources for X accounts critical of the Chinese government or collect details about petition organizers in Mongolia. In all cases, ChatGPT only provided publicly available information. Some accounts also used ChatGPT to summarize breaking news relevant to China or gather information on sensitive topics, such as the 1989 Tiananmen Square massacre and the Dalai Lama’s birthday.
Also Read This- S26 Ultra Leaks Hint at 2026 Flagship Upgrades
Also Read This- Your Phone Just Became a Computer — Thanks to Chrome!
Russian Accounts Also Involved
The report also mentioned a few Russia-based accounts attempting to misuse AI for phishing and other malicious activities. OpenAI reaffirmed its commitment to preventing the platform’s abuse.
OpenAI’s actions underline the importance of ethical AI use and demonstrate the company’s proactive approach to stopping authoritarian or malicious exploitation, ensuring user safety and privacy worldwide.