Activation Function

A mathematical function applied to the output of a neural network node that introduces non-linearity, enabling the network to learn complex patterns. Common activation functions include ReLU, sigmoid, and softmax. The choice of activation function significantly impacts model training speed and performance.