Can Computers Understand Words Like Humans Do? Comparable Semantic Representation in Neural and Computer Systems

다국어 초록 (Multilingual Abstract)

Semantic representation has been studied independently in neuroscience and computer science. A deep understanding of human neural computations and the revolution to strong artificial intelligence appeal for a joint force in the language domain. To investigate comparable representational formats of lexical semantics between these two complex systems, we used fine temporal resolution neural recordings to create a novel open dataset and innovated analysis methods. Specifically, we evaluated three natural language processing (NLP) models with electroencephalography (EEG) recordings under a semantic priming paradigm. With our novel single-trial analysis method, we found semantic representations generated from computational models significantly correlated with EEG responses at an early stage of a typical semantic processing time window in a two-word semantic priming paradigm. Moreover, three representative computational models differentially predicted EEG responses along the dynamics of word processing. Our study thus developed an objective biomarker for assessing human-like computation in computational models. Our novel framework trailblazed a promising way to bridge across disciplines in the investigation of higher-order cognitive functions in human and artificial intelligence.

참고문헌 (Reference)

1 Resnik, P., "Using information content to evaluate semantic similarity in a taxonomy" 1995

2 Kutas, M., "Thirty years and counting : finding meaning in the N400 component of the event-related brain potential(ERP)" 62 : 621-647, 2011

3 Brown, C., "The processing nature of the N400 : Evidence from masked priming" 5 (5): 34-44, 1993

4 Pylkkänen, L., "The neural basis of combinatory syntax and semantics" 366 (366): 62-66, 2019

5 Kiefer, M., "The n400 is modulated by unconsciously perceived masked words : Further evidence for an automatic spreading activation account of n400 priming effects" 13 (13): 27-39, 2002

6 Poeppel, D., "The maps problem and the mapping problem: two challenges for a cognitive neuroscience of speech and language" 29 (29): 34-55, 2012

7 Zhang, L., "The interplay of composition and concept specificity in the left anterior temporal lobe : An meg study" 111 : 228-240, 2015

8 Bemis, D. K., "Simple composition : A magnetoence phalography investigation into the comprehension of minimal linguistic phrases" 31 (31): 2801-2814, 2011

9 Resnik, P., "Semantic similarity in a taxonomy : An information-based measure and its application to problems of ambiguity in natural language" 11 : 95-130, 1999

10 Holcomb, P. J., "Semantic priming and stimulus degradation : Implications for the role of the n400 in language processing" 30 (30): 47-61, 1993

11 Neely, J. H., "Semantic priming and retrieval from lexical memory : Roles of inhibitionless spreading activation and limited-capacity attention" 106 (106): 226-, 1977

12 Neely, J. H., "Semantic priming and retrieval from lexical memory : Evidence for facilitatory and inhibitory processes" 4 (4): 648-654, 1976

13 Wang, X., "Revealing the temporal dynamics in non-invasive electrophysiological recordings with topography-based analyses" 2019

14 Kriegeskorte, N., "Representational geometry : Integrating cognition, computation, and the brain" 17 (17): 401-412, 2013

15 Lehmann, D., "Reference-free identification of components of checkerboard-evoked multichannel potential fields" 48 (48): 609-621, 1980

16 Lorch Jr, R. F., "Priming and search processes in semantic memory : A test of three models of spreading activation" 21 (21): 468-492, 1982

17 Yamins, D., "Performance-optimized hierarchical models predict neural responses in higher visual cortex" 111 (111): 8619-8624, 2014

18 Brennan, J., "Naturalistic sentence comprehension in the brain" 10 (10): 299-313, 2016

19 Huth, A. G., "Natural speech reveals the semantic maps that tile human cerebral cortex" 532 (532): 453-458, 2016

20 Ettinger, A., "Modeling n400 amplitude using vector space models of word representation" 2016

21 Chen, X., "Joint learning of character and word embeddings" 2015

22 Hagoort, P., "Integration of word meaning and world knowledge in language comprehension" 304 (304): 438-441, 2004

23 Yang, J., "Group-level multivariate analysis in EasyEEG toolbox : Examining the temporal dynamics using topographic responses" 12 : 468-, 2018

24 Pennington, J., "GloVe: Global vectors for word representation" 1532-1543, 2014

25 Turney, P. D., "From frequency to meaning : Vector space models of semantics" 37 : 141-188, 2010

26 Bentin, S., "Event-related potentials, lexical decision and semantic priming" 60 (60): 343-355, 1985

27 Deacon, D., "Event-related potential indices of semantic priming using masked and unmasked words : evidence that the n400 does not reflect a post-lexical process" 9 (9): 137-146, 2000

28 Broderick, M. P., "Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech" 28 (28): 803-809, 2018

29 Mikolov, T., "Efficient estimation of word representations in vector space" 2013

30 Harris, Z. S., "Distributional structure" 10 (10): 146-162, 1954

31 Miller, G. A., "Dictionaries in the mind" 1 (1): 171-185, 1986

32 Khaligh-Razavi, S. -M., "Deep supervised, but not unsupervised, models may explain IT cortical representation" 10 (10): e1003915-, 2014

33 Balota, D. A., "Automatic semantic activation and episodic memory encoding" 22 (22): 88-104, 1983

34 Lin, D., "An information-theoretic definition of similarity" 98 (98): 296-304, 1998

35 Kutas, M., "An electrophysiological probe of incidental semantic association" 1 (1): 38-49, 1989

36 Firth, J. R., "A synopsis of linguistic theory, 1930-1955" 10-32, 1957

37 Collins, A. M., "A spreading-activation theory of semantic processing" 82 (82): 407-, 1975

38 Roelofs, A., "A spreading-activation theory of lemma retrieval in speaking" 42 (42): 107-142, 1992

39 Anderson, J. R., "A spreading activation theory of memory" 22 (22): 261-295, 1983

40 Federmeier, K. D., "A rose by any other name : Long-term memory structure and sentence processing" 41 (41): 469-495, 1999