Exponential Linear Unit1

• 

  ELU (Exponential Linear Unit) Information The ELU (Exponential Linear Unit) is a type of activation function commonly used in artificial neural networks. It is similar to the ReLU activation function, but with some modifications to handle negative inputs better. The ELU function is defined as f(x) = x for x ≥ 0 and f(x) = α(e^x - 1) for x < 0, where α is a hyperparameter that controls the output value for negative inputs. Th.. Zettelkasten/Terminology Information 2023. 2. 27.