Among the recent disruptive technologies, volatile/nonvolatile memory-resistor (memristor) has attracted the researchers' attention as a fundamental computation element. It has been experimentally shown that memristive elements can emulate synaptic dynamics and are even capable of supporting spike timing dependent plasticity (STDP), an important adaptation rule for competitive Hebbian learning. The overall goal of this work is to provide a novel analogue computing platform based on memristor devices and recurrent neural networks that exploit the memristor device physics to implement the backpropagation algorithm. Back propagation for recurrent neural networks requires a side network for the propagation of error derivatives. The use of memristor-based synaptic weights permit to propagate the error signals in the network via the nonlinear dynamics without the need of a digital side network. Experimental results show that the approach significantly outperforms conventional architectures used for pattern reconstruction. Further results will be reported in an extended work.
A continuous-time learning rule for memristor-based recurrent neural networks / Zoppo, G.; Marrone, F.; Corinto, F.. - (2019), pp. 494-497. (Intervento presentato al convegno 26th IEEE International Conference on Electronics, Circuits and Systems, ICECS 2019 tenutosi a Genova nel 2019) [10.1109/ICECS46596.2019.8964918].
A continuous-time learning rule for memristor-based recurrent neural networks
Zoppo G.;Marrone F.;Corinto F.
2019
Abstract
Among the recent disruptive technologies, volatile/nonvolatile memory-resistor (memristor) has attracted the researchers' attention as a fundamental computation element. It has been experimentally shown that memristive elements can emulate synaptic dynamics and are even capable of supporting spike timing dependent plasticity (STDP), an important adaptation rule for competitive Hebbian learning. The overall goal of this work is to provide a novel analogue computing platform based on memristor devices and recurrent neural networks that exploit the memristor device physics to implement the backpropagation algorithm. Back propagation for recurrent neural networks requires a side network for the propagation of error derivatives. The use of memristor-based synaptic weights permit to propagate the error signals in the network via the nonlinear dynamics without the need of a digital side network. Experimental results show that the approach significantly outperforms conventional architectures used for pattern reconstruction. Further results will be reported in an extended work.File | Dimensione | Formato | |
---|---|---|---|
Zoppo-Continuous-time.pdf.pdf
non disponibili
Tipologia:
2a Post-print versione editoriale / Version of Record
Licenza:
Non Pubblico - Accesso privato/ristretto
Dimensione
407.53 kB
Formato
Adobe PDF
|
407.53 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
Zoppo-Continuous-time1.pdf
accesso aperto
Tipologia:
2. Post-print / Author's Accepted Manuscript
Licenza:
PUBBLICO - Tutti i diritti riservati
Dimensione
385.36 kB
Formato
Adobe PDF
|
385.36 kB | Adobe PDF | Visualizza/Apri |
Pubblicazioni consigliate
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/11583/2794032