23 points rzk 2 hours ago 5 comments

cyanydeez 16 minutes ago | parent

These people know they're doing anthropology right, sociology. LLMs are a raw dump of western civilization.

jrrc_dev 12 minutes ago | parent

Seems LLMs copy human behaviour pretty well

notenchange 8 minutes ago | parent

Sincerely, did anyone that knows how LLMs are trained expected otherwise?

LLMs are reflexion of their training data, and their training data reflects mostly the current societal norms, with a bias (not sure how heavy) to the societal norms supported by the ones involved in training the LLMs.

What's interesting for me to see, is that Chinese models are as biased - if not more - than ChatGPT. This is probably because a big part of their training comes from distilation of US models.

It would be interesting to see Anthropic, Mistral and Grok in the comparison as well.

riedel 1 minute ago | parent

What one can theoretically do is to carefully remove gender signals from training data in a processing run. My guess is that you would not lose all to much knowledge, however you might lose the ability to recall facts about fictional and non-fictional persons. Wonder if anyone would go through that hassle though.

goodcake3963 1 minute ago | parent

One of the worst societal bias ever