Do Large Language Models Know What Humans Know?

Published on July 4, 2023

Imagine you have two detectives investigating a crime. One is a human detective who has years of experience and the other is a rookie detective who has only read crime novels. They are both given a passage to read and are asked to determine what one of the characters knows. Surprisingly, the rookie detective does a decent job, even though they have only learned about crime through books. This scenario mirrors a study where researchers tested whether large language models, like GPT-3, can understand human knowledge by examining their ability to infer characters’ beliefs in written passages. The results showed that while language models perform better than chance, they still fall short compared to humans. This suggests that exposure to language alone does not fully explain how humans develop the ability to understand others’ mental states. There must be other mechanisms at play. To dig deeper into this fascinating research, check out the full article!

Abstract
Humans can attribute beliefs to others. However, it is unknown to what extent this ability results from an innate biological endowment or from experience accrued through child development, particularly exposure to language describing others’ mental states. We test the viability of the language exposure hypothesis by assessing whether models exposed to large quantities of human language display sensitivity to the implied knowledge states of characters in written passages. In pre-registered analyses, we present a linguistic version of the False Belief Task to both human participants and a large language model, GPT-3. Both are sensitive to others’ beliefs, but while the language model significantly exceeds chance behavior, it does not perform as well as the humans nor does it explain the full extent of their behavior—despite being exposed to more language than a human would in a lifetime. This suggests that while statistical learning from language exposure may in part explain how humans develop the ability to reason about the mental states of others, other mechanisms are also responsible.

Read Full Article (External Site)

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes:

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>