Leaky-Integrate-and-Fire Neuron-Like Long-Short-Term-Memory Units as Model System in Computational Biology
Gerum R, Erpenbeck A, Krauß P, Schilling A (2023)
Publication Language: English
Publication Type: Conference contribution
Publication year: 2023
Publisher: Institute of Electrical and Electronics Engineers Inc.
Conference Proceedings Title: 2023 International Joint Conference on Neural Networks (IJCNN)
Event location: Gold Coast, QLD
ISBN: 978-1-6654-8868-6
DOI: 10.1109/IJCNN54540.2023.10191268
Abstract
Biological neural networks encode information very efficiently, and dynamically react to sensory input on very small time scales. In contrast to most contemporary machine learning approaches which rely on rate neurons with continuous output, biological neural networks are based on spiking neurons with quasi-binary discrete output. In Artificial Intelligence (AI) Research, time series data are efficiently encoded in Long-Short- Term-Memory (LSTM) networks. Despite their strength in encoding time series data and making predictions, LSTM units are assumed to be biologically implausible. Nevertheless, recent studies show that LSTM unit networks indeed behave similar to biological neural networks. In this study, we show that a particular choice of parameters for the weights and gates in peephole LSTM units causes these units to show similar dynamic behaviour as biologically plausible leaky integrate-and-fire (LIF) neurons, which represent a simple biologically inspired spiking neuron model. We analyzed the spiking characteristics of the restricted peephole LSTM units and characterize the parameter space, in which these units show certain spiking characteristics. We conclude that tackling complex cognitive tasks with biologically plausible and explainable artificial neural networks is an important step to make progress in both fields, neuroscience and artificial intelligence.
Authors with CRIS profile
Richard Gerum
Patrick Krauß Department of Otorhinolaryngology – Head and Neck Surgery (HNO-Klinik) Achim Schilling Department of Otorhinolaryngology – Head and Neck Surgery (HNO-Klinik)
Patrick Krauß Department of Otorhinolaryngology – Head and Neck Surgery (HNO-Klinik) Achim Schilling Department of Otorhinolaryngology – Head and Neck Surgery (HNO-Klinik)
Involved external institutions
Canada (CA)
United States (USA) (US)How to cite
APA:
Gerum, R., Erpenbeck, A., Krauß, P., & Schilling, A. (2023). Leaky-Integrate-and-Fire Neuron-Like Long-Short-Term-Memory Units as Model System in Computational Biology. In 2023 International Joint Conference on Neural Networks (IJCNN). Gold Coast, QLD, AU: Institute of Electrical and Electronics Engineers Inc..
MLA:
Gerum, Richard, et al. "Leaky-Integrate-and-Fire Neuron-Like Long-Short-Term-Memory Units as Model System in Computational Biology." Proceedings of the 2023 International Joint Conference on Neural Networks, IJCNN 2023, Gold Coast, QLD Institute of Electrical and Electronics Engineers Inc., 2023.
BibTeX: Download