Activation Function

An activation function is a small math function applied to a neuron's output in a neural network. It introduces non-linearity, allowing the network to learn…