Method for Low Resource and Low Power Consuming Implementation of Nonlinear Activation Functions of Artificial Neural Networks

摘要

A method does not use high resource and high power consuming memory elements (LUT, Block RAM, etc.) or a distributed RAM in an implementation of nonlinear activation functions of artificial neural networks (ANN), eliminating a need for multiplication elements completely by using shift operations. Since each neuron includes an activation function, eliminating a multiplication element saves significant amount of resource and power in an implementation of the ANN.