Attribute activation_function::relu

← Back to Class activation_function



Module neural → Class activation_function → relu

Description

ReLU (Rectified Linear Unit) activation function. It is defined as: \[f(x) = \text{max}(0, x)\] 

field relu


Usage Example

import neural
 
model = neural_network([784, 20, 10, 10], 0.01)
model.set_activation_function(1, activation.relu)