Multiplicative processing in the modeling of cognitive activities in large neural networks
Explaining the foundation of cognitive abilities in the processing of information by neural systems has been in the beginnings of biophysics since McCulloch and Pitts pioneered work within the biophysics school of Chicago in the 1940s and the interdisciplinary cybernetists meetings in the 1950s, ins...
Αποθηκεύτηκε σε:
| Κύριος συγγραφέας: | |
|---|---|
| Άλλοι συγγραφείς: | , |
| Μορφή: | article |
| Γλώσσα: | Αγγλικά |
| Έκδοση: |
2023
|
| Θέματα: | |
| Διαθέσιμο Online: | https://hdl.handle.net/20.500.12008/43175 |
| Ετικέτες: |
Δεν υπάρχουν, Καταχωρήστε ετικέτα πρώτοι!
|
| _version_ | 1868890095344418816 |
|---|---|
| author | Valle Lisboa, Juan C. |
| author2 | Pomi, Andrés Mizraji Nathan, Eduardo Jacobo |
| author2_role | author author |
| author_browse | Mizraji Nathan, Eduardo Jacobo Pomi, Andrés Valle Lisboa, Juan C. |
| author_facet | Valle Lisboa, Juan C. Pomi, Andrés Mizraji Nathan, Eduardo Jacobo |
| author_role | author |
| collection | COLIBRI |
| dc.contributor.none.fl_str_mv | Valle Lisboa Juan C., Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología. Pomi Andrés, Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología. Mizraji Nathan Eduardo Jacobo, Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología. |
| dc.creator.none.fl_str_mv | Valle Lisboa, Juan C. Pomi, Andrés Mizraji Nathan, Eduardo Jacobo |
| dc.date.none.fl_str_mv | 2023 2024-03-19T12:16:12Z 2024-03-19T12:16:12Z |
| dc.format.none.fl_str_mv | 19 h. application/pdf |
| dc.identifier.none.fl_str_mv | Valle Lisboa, J, Pomi, A y Mizraji Nathan, E. "Multiplicative processing in the modeling of cognitive activities in large neural networks". Biophysical Reviews. [en línea] 2023, 15(4): 767–785. 19 h. DOI: 10.1007/s12551-023-01074-5. 1867-2469 https://hdl.handle.net/20.500.12008/43175 10.1007/s12551-023-01074-5 |
| dc.language.none.fl_str_mv | en eng |
| dc.publisher.none.fl_str_mv | Springer |
| dc.relation.none.fl_str_mv | Biophysical Reviews, 2023, 15(4): 767–785. |
| dc.rights.none.fl_str_mv | info:eu-repo/semantics/openAccess Licencia Creative Commons Atribución (CC - By 4.0) |
| dc.source.none.fl_str_mv | reponame:COLIBRI instname:Universidad de la República instacron:Universidad de la República |
| dc.subject.none.fl_str_mv | Multiplication Tensor product Context-dependent memory Associative memories Neural networks |
| dc.title.none.fl_str_mv | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| dc.type.none.fl_str_mv | Artículo info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion |
| description | Explaining the foundation of cognitive abilities in the processing of information by neural systems has been in the beginnings of biophysics since McCulloch and Pitts pioneered work within the biophysics school of Chicago in the 1940s and the interdisciplinary cybernetists meetings in the 1950s, inseparable from the birth of computing and artifcial intelligence. Since then, neural network models have traveled a long path, both in the biophysical and the computational disciplines. The biological, neurocomputational aspect reached its representational maturity with the Distributed Associative Memory models developed in the early 70 s. In this framework, the inclusion of signal-signal multiplication within neural network models was presented as a necessity to provide matrix associative memories with adaptive, context-sensitive associations, while greatly enhancing their computational capabilities. In this review, we show that several of the most successful neural network models use a form of multiplication of signals. We present several classical models that included such kind of multiplication and the computational reasons for the inclusion. We then turn to the diferent proposals about the possible biophysical implementation that underlies these computational capacities. We pinpoint the important ideas put forth by diferent theoretical models using a tensor product representation and show that these models endow memories with the context-dependent adaptive capabilities necessary to allow for evolutionary adaptation to changing and unpredictable environments. Finally, we show how the powerful abilities of contemporary computationally deep-learning models, inspired in neural networks, also depend on multiplications, and discuss some perspectives in view of the wide panorama unfolded. The computational relevance of multiplications calls for the development of new avenues of research that uncover the mechanisms our nervous system uses to achieve multiplication. |
| eu_rights_str_mv | openAccess |
| format | article |
| id | anni_7298e2247bcd042f0e9af19ef5b8739b |
| identifier_str_mv | Valle Lisboa, J, Pomi, A y Mizraji Nathan, E. "Multiplicative processing in the modeling of cognitive activities in large neural networks". Biophysical Reviews. [en línea] 2023, 15(4): 767–785. 19 h. DOI: 10.1007/s12551-023-01074-5. 1867-2469 10.1007/s12551-023-01074-5 |
| instacron_str | Universidad de la República |
| institution | Universidad de la República |
| instname_str | Universidad de la República |
| language | eng |
| language_invalid_str_mv | en |
| network_acronym_str | anni |
| network_name_str | oai-lr-anni |
| oai_identifier_str | oai:colibri.udelar.edu.uy:20.500.12008/43175 |
| publishDate | 2023 |
| publishDateSort | 2023 |
| publisher.none.fl_str_mv | Springer |
| reponame_str | COLIBRI |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | Licencia Creative Commons Atribución (CC - By 4.0) |
| spelling | Multiplicative processing in the modeling of cognitive activities in large neural networksValle Lisboa, Juan C.Pomi, AndrésMizraji Nathan, Eduardo JacoboMultiplicationTensor productContext-dependent memoryAssociative memoriesNeural networksExplaining the foundation of cognitive abilities in the processing of information by neural systems has been in the beginnings of biophysics since McCulloch and Pitts pioneered work within the biophysics school of Chicago in the 1940s and the interdisciplinary cybernetists meetings in the 1950s, inseparable from the birth of computing and artifcial intelligence. Since then, neural network models have traveled a long path, both in the biophysical and the computational disciplines. The biological, neurocomputational aspect reached its representational maturity with the Distributed Associative Memory models developed in the early 70 s. In this framework, the inclusion of signal-signal multiplication within neural network models was presented as a necessity to provide matrix associative memories with adaptive, context-sensitive associations, while greatly enhancing their computational capabilities. In this review, we show that several of the most successful neural network models use a form of multiplication of signals. We present several classical models that included such kind of multiplication and the computational reasons for the inclusion. We then turn to the diferent proposals about the possible biophysical implementation that underlies these computational capacities. We pinpoint the important ideas put forth by diferent theoretical models using a tensor product representation and show that these models endow memories with the context-dependent adaptive capabilities necessary to allow for evolutionary adaptation to changing and unpredictable environments. Finally, we show how the powerful abilities of contemporary computationally deep-learning models, inspired in neural networks, also depend on multiplications, and discuss some perspectives in view of the wide panorama unfolded. The computational relevance of multiplications calls for the development of new avenues of research that uncover the mechanisms our nervous system uses to achieve multiplication.SpringerValle Lisboa Juan C., Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología.Pomi Andrés, Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología.Mizraji Nathan Eduardo Jacobo, Universidad de la República (Uruguay). Facultad de Ciencias. Instituto de Biología.2024-03-19T12:16:12Z2024-03-19T12:16:12Z2023Artículoinfo:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersion19 h.application/pdfValle Lisboa, J, Pomi, A y Mizraji Nathan, E. "Multiplicative processing in the modeling of cognitive activities in large neural networks". Biophysical Reviews. [en línea] 2023, 15(4): 767–785. 19 h. DOI: 10.1007/s12551-023-01074-5.1867-2469https://hdl.handle.net/20.500.12008/4317510.1007/s12551-023-01074-5reponame:COLIBRIinstname:Universidad de la Repúblicainstacron:Universidad de la RepúblicaenengBiophysical Reviews, 2023, 15(4): 767–785.Las obras depositadas en el Repositorio se rigen por la Ordenanza de los Derechos de la Propiedad Intelectual de la Universidad de la República.(Res. Nº 91 de C.D.C. de 8/III/1994 – D.O. 7/IV/1994) y por la Ordenanza del Repositorio Abierto de la Universidad de la República (Res. Nº 16 de C.D.C. de 07/10/2014)info:eu-repo/semantics/openAccessLicencia Creative Commons Atribución (CC - By 4.0)oai:colibri.udelar.edu.uy:20.500.12008/431752026-04-14T10:10:34Z |
| spellingShingle | Multiplicative processing in the modeling of cognitive activities in large neural networks Valle Lisboa, Juan C. Multiplication Tensor product Context-dependent memory Associative memories Neural networks |
| status_str | publishedVersion |
| title | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| title_full | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| title_fullStr | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| title_full_unstemmed | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| title_short | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| title_sort | Multiplicative processing in the modeling of cognitive activities in large neural networks |
| topic | Multiplication Tensor product Context-dependent memory Associative memories Neural networks |
| url | https://hdl.handle.net/20.500.12008/43175 |