Activation functions are important for a neural network to learn and understand the complex patterns. The main function of it is to introduce non-linear properties into the network. I'll be explaining about several kinds of non-linear activation functions, like Sigmoid, Tanh, ReLU activation and leaky ReLU.