Deepseek's latest reasoning-focused artificial intelligence (AI) Model, Deepseek-R1, is said to be censoring a large number of queries. An AI Firm Ran Tests on the Large Language Model (LLM) and Found that it does not answer china-specific queries that go against the political's ruling party. By running a code to generate a synthetic prompt dataset, the ai firm found more than 1,000 prompts where the ai model either is completely refused to answer, Or Gave a General REPONSE.
Deepsek-R1 is Censoring Queries
In a blog postAI Model Testing Firm Promptfoo Said, “Today We're Publishing a Dataset of Prompts Covening Sensitive Topics that are likely to be censored by the ccp. These topics include perennial issues like Taiwanese Independence, Historical narratives Around the Cultural Revolution, and Questions About XI Jinping. “
The firm created the dataset of prompts by seeding questions into a program and by extending it via synthetic data generation. The dataset was published in a hugging face Listing As well on google sheets. Promptfoo stated that it was able to find 1,360 prompts, where most of them contain sensitive topics Around China.
As per the post, 85 percent of these prompts resulted in refusals. However, these not the kind of refusals expected from a reasoning-focused ai model. Typically, when a large language model (lLM) is trained to not answer queries, it will typically reply that it is incapable of fullfilling the request.
Deepsek-R1's Prompt refusal
However, as highlighted by promptfoo, the Deepseek-R1 AI model generated a long response in adherence with the chinese communist party's (CCP) Policies. The post noted that there was no chain-of-thought (cot) mechanisms activated when answering these queries. The full evaluation by the firm can be found hereGadgets 360 Staff Members Tested These Prompts on Deepsek and Faced Similar refusals.
Such censorship is not surprising, giving that China-spoiled ai models are required to adhere to strict state-based regulations. However, with such a large number of queries censored by the developers, the reliability of the ai model come under scrutiny. Since the ai model has not been extended tested, there could be other responsives which are influenced by ccp policies.