Human discovery ability as a benchmark for judging language models
Scott Alexander and Dwarkesh Patel disagree over whether human ability provides grounds for judging language models negatively when they fail to make the kind of discovery under discussion. Alexander says humans also cannot do it; Patel argues that humans have demonstrated the ability, so language models deserve greater criticism for failing to do so.
2speakers
1show
1–1claims for and against
90%confidence, no higher than its weakest claim
The split
One segment per claim
1 for · Scott AlexanderDwarkesh Patel · against 1
When each side was argued
MarAprMay
For · 1 claim
The speaker's example was that humans also cannot make the kind of discovery under discussion.
The speaker argues that language models should be judged more negatively for failing to make discoveries of this kind, since humans have demonstrated the ability to do so.