Swish: Booting ReLU from the Activation Function Throne | by Andre Ye | Towards Data Science
Gaussian Error Linear Unit Activates Neural Networks Beyond ReLU | Synced
tensorflow - Can relu be used at the last layer of a neural network? - Stack Overflow
SELU vs RELU activation in simple NLP models | Hardik Patel
Flatten-T Swish: A Thresholded ReLU-Swish-like Activation Function for Deep Learning | by Joshua Chieng | Medium
Activation Functions Explained - GELU, SELU, ELU, ReLU and more
Why is relu better than tanh and sigmoid function in artificial neural network? - 文章整合
deep learning - Why Relu shows better convergence than Sigmoid Activation Function? - Data Science Stack Exchange
Swish Vs Mish: Latest Activation Functions – Krutika Bapat – Engineering at IIIT-Naya Raipur | 2016-2020
Empirical Evaluation of Rectified Activations in Convolution Network
Different Activation Functions. a ReLU and Leaky ReLU [37], b Sigmoid... | Download Scientific Diagram
Swish Vs Mish: Latest Activation Functions – Krutika Bapat – Engineering at IIIT-Naya Raipur | 2016-2020
Different Activation Functions for Deep Neural Networks You Should Know | by Renu Khandelwal | Geek Culture | Medium
What makes ReLU so much better than Linear Activation? As half of them are exactly the same. - Quora
Activation Functions : Sigmoid, tanh, ReLU, Leaky ReLU, PReLU, ELU, Threshold ReLU and Softmax basics for Neural Networks and Deep Learning | by Himanshu S | Medium
Meet Mish: New Activation function, possible successor to ReLU? - fastai users - Deep Learning Course Forums
What makes ReLU so much better than Linear Activation? As half of them are exactly the same. - Quora
A Comprehensive Survey and Performance Analysis of Activation Functions in Deep Learning
What are some good Activation Functions other than ReLu or Leaky ReLu? - Quora
Advantages of ReLU vs Tanh vs Sigmoid activation function in deep neural networks. - Knowledge Transfer
FReLU: Flexible Rectified Linear Units for Improving Convolutional Neural Networks
Why Relu? Tips for using Relu. Comparison between Relu, Leaky Relu, and Relu-6. | by Chinesh Doshi | Medium