In episode 112 of The Gradient Podcast, Daniel Bashir speaks to Cameron Jones and Sean Trott.
Cameron is a PhD candidate in the Cognitive Science Department at the University of California, San Diego. His research compares how humans and large language models process language about world knowledge, situation models, and theory of mind.
Sean is an Assistant Teaching Professor in the Cognitive Science Department at the University of California, San Diego. His research interests include probing large language models, ambiguity in languages, how ambiguous words are represented, and pragmatic inference. He previously completed his PhD at UCSD.
Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at editor@thegradient.pub
Subscribe to The Gradient Podcast: Apple Podcasts | Spotify | Pocket Casts | RSS
Follow The Gradient on Twitter
Outline:
(00:00) Intro
(02:55) Cameron’s background
(06:00) Sean’s background
(08:15) Unexpected capabilities of language models and the need for embodiment to understand meaning
(11:05) Interpreting results of Turing tests, separating what humans and LLMs do when behaving as though they “understand”
(14:27) Internal mechanisms, interpretability, how we test theories
(16:40) Languages are efficient, but for whom?
(17:30) Initial motivations: lexical ambiguity
(19:20) The balance of meanings across wordforms
(22:35) Tension between speaker- and comprehender-oriented pressures in lexical ambiguity
(25:05) Context and potential vs. realized ambiguity
(27:15) LLM-ology
(28:30) Studying LLMs as models of human cognition and as interesting objects of study in their own right
(30:03) Example of explaining away effects
(33:54) The internalist account of belief sensitivity—behavior and internal representations
(37:43) LLMs and the False Belief Task
(42:05) Hypothetical on observed behavior and inferences about internal representations
(48:05) Distributional Semantics Still Can’t Account for Affordances
(50:25) Tests of embodied theories and limitations of distributional cues
(53:54) Multimodal models and object affordances
(58:30) Language and grounding, other buzzwords
(1:04:50) Reference: as a thing words do vs. ontological notion
(1:11:38) The Role of Physical Inference in Pronoun Resolution
(1:16:40) World models and world knowledge
(1:19:45) EPITOME
(1:20:20) The different tasks
(1:26:43) Confounders / “attending” in LM performance on tasks
(1:30:30) Another hypothetical, on theory of mind
(1:32:26) How much information can language provide in service of mentalizing?
(1:35:14) Convergent validity and coherence/validity of theory of mind
(1:39:30) Interpretive questions about behavior w/r/t/ theory of mind
(1:43:35) Does GPT-4 Pass the Turing Test?
(1:44:00) History of the Turing Test
(1:47:05) Interrogator strategies and the strength of the Turing Test
(1:52:15) “Internal life” and personality
(1:53:30) How should this research impact how we assess / think about LLM abilities?
(1:58:56) Outro
Links:
Research — Language and NLP
Research — LLM-ology
Research — language and grounding, theory of mind, reference [insert other buzzwords here]
Cameron Jones & Sean Trott: Understanding, Grounding, and Reference in LLMs