Three-dimensional memristive deep neural network with programmable attention mechanism
Document Type
Conference Proceeding
Publication Date
5-10-2021
Department
Department of Electrical and Computer Engineering
Abstract
Attention Mechanism is a critical function of a neural network-based visual system that enables the human brain can devote computing effort to process desired information, concurrently ignoring undesired background noise intentionally. Through this signal processing methodology, the brain system achieves a remarkable energy efficiency. The significance of investigating the attention mechanism is to not only potentially reveal how the human brain comprehends visual signals but also to construct an attention-oriented power-efficient neuromorphic system. This paper proposes a hypothesis for the visual attention mechanism, derives a neural network model with mathematical equations, and realizes the circuit implementation with memristor and three-dimensional (3D) monolithic integration technology.
Publication Title
Proceedings - International Symposium on Quality Electronic Design, ISQED
ISBN
9781728176413
Recommended Citation
An, H.,
Bai, K.,
&
Yi, Y.
(2021).
Three-dimensional memristive deep neural network with programmable attention mechanism.
Proceedings - International Symposium on Quality Electronic Design, ISQED,
2021-April, 210-215.
http://doi.org/10.1109/ISQED51717.2021.9424331
Retrieved from: https://digitalcommons.mtu.edu/michigantech-p/14885