23 points rzk 2 hours ago 5 comments
cyanydeez 16 minutes ago | parent
These people know they're doing anthropology right, sociology. LLMs are a raw dump of western civilization.
jrrc_dev 12 minutes ago | parent
Seems LLMs copy human behaviour pretty well
notenchange 8 minutes ago | parent
Sincerely, did anyone that knows how LLMs are trained expected otherwise?
LLMs are reflexion of their training data, and their training data reflects mostly the current societal norms, with a bias (not sure how heavy) to the societal norms supported by the ones involved in training the LLMs.
What's interesting for me to see, is that Chinese models are as biased - if not more - than ChatGPT. This is probably because a big part of their training comes from distilation of US models.
It would be interesting to see Anthropic, Mistral and Grok in the comparison as well.
riedel 1 minute ago | parent
What one can theoretically do is to carefully remove gender signals from training data in a processing run. My guess is that you would not lose all to much knowledge, however you might lose the ability to recall facts about fictional and non-fictional persons. Wonder if anyone would go through that hassle though.
goodcake3963 1 minute ago | parent
One of the worst societal bias ever