NSP as a computational account of discourse comprehension. (IMAGE)
Caption
(A) Humans integrate words and sentences to achieve a full understanding of discourse. In LLMs, the NSP task proposed by BERT (19) can serve as a computational account of human discourse comprehension. (B) Illustration of the MLM task. (C) Illustration of the NSP task and its relevance to the Mason and Just model (23). (D) Illustration of Mason and Just’s neurocognitive model of discourse processing. Yang et al. (22) explicitly labeled two key aspects in this model as “coherent text integration” and “incoherent text integration” (originally “text integration” and “coherence monitoring”). The human head illustration in (A) was created with BioRender.com.
Credit
© 2024 Research and Innovation Office, The Hong Kong Polytechnic University. All Rights Reserved.
Usage Restrictions
Nil
License
Original content