[LR] Unveiling Theory of Mind in LLMs
[This review is intended solely for my personal learning] Paper Info arXiv:2309.01660 Title: Unveiling Theory of Mind in Large Language Models: A Parallel to Single Neurons in the Human Brain Author: Mohsen Jamali and Ziv M. Williams and Jing Cai Prior Knowledge Theory of Mind (ToM): A complex cognitive capacity related to our conscious mind and mental state that allows us to infer another’s beliefs and perspective. Through ToM, human can create intricate mental representations of other agents and realize that others may have beliefs that’s different from our own or the objective reality. True- and False-belief Task True-belief task: assesses whether someone understands that some other people’s believes is correctly aligned with reality. False-belief task: assesses whether someone understands that some other people’s believes is not correctly aligned with reality. (ex: belief diverges from reality after a change to the environment that one did not witness.) A critical test for ToM is the false belief task. Both tasks are evaluated by providing the participant a scenario and asking the participant “fact questions” and “belief questions”, which are about the reality and the belief of some character in the scenario respectively. These tasks are designed to test if the individual can attribute mental states (including potentially false beliefs) to others in general. ToM in the human brain Human brain imaging studies have provided substantial evidence for the brain network that supports our ToM ability, including the temporalparietal junction, superior temporal sulcus and the dorsal medial prefrontal cortex (dmPFC) ...