Rendered at 06:08:23 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
evan-dong 32 minutes ago [-]
You really can’t trust what an LLM says about its own identity. If it has seen tons of chats saying “I’m Claude / GPT‑4 / DeepSeek”, it will just echo that pattern in similar contexts. That’s more about dataset contamination and pattern matching than any real evidence it is that model.
muzani 4 hours ago [-]
They all are trained by each other. Claude says it's DeepSeek if you ask it in Mandarin.
SilverElfin 3 hours ago [-]
Most people seem to think that phenomenon is not the same thing. People have shown by experimenting with different prompts that even in Mandarin, Claude correctly says it’s Claude when it is doing something for you. But if you ask it about its identity, it sometimes says DeepSeek. The current theory is it just has run into Chinese content that has chat logs that often have a DeepSeek model answering that it is DeepSeek. But the inconsistency in different prompts suggests this is something different from distillation.
pogue 49 minutes ago [-]
Is theft of theft theft?
orbital-decay 1 hours ago [-]
If it was, that line is not an indicator. Distillation is done on useful prompts, not on "Who are you?" - "I'm this model of that company".
Name training is always shallow, Claude itself would claim it's GPT-3, GPT-4, or Reddit (heh) when confused. It's just dataset contamination, because the web is full of slop. Never trust self-reported names.
SilverElfin 3 hours ago [-]
This has been a common issue with the Chinese open weight models. It appears most or all have been trained via distillation on OpenAI and Anthropic models.
orbital-decay 44 minutes ago [-]
They most likely weren't, despite very dubious claims of Amodei and Altman and a certain twitter influencer running a pretty naive writing benchmark ("slop test") that is wrong in a very obvious manner. The only unambiguous cases of distillation were Gemini 2.0 experimentals being trained on Claude outputs, and GLM-4.7 being trained on Gemini 3.0 Pro. The rest are pretty different from each other.
Name training is always shallow, Claude itself would claim it's GPT-3, GPT-4, or Reddit (heh) when confused. It's just dataset contamination, because the web is full of slop. Never trust self-reported names.