Randomized ReLU in Keras

Asked Apr 13 '19 at 14:51

Active Apr 15 '19 at 05:41

Viewed 1,055 times

It is proved that Randomized ReLU, as well as Parametric ReLU, perform better compared to ReLU in CIFAR-10, CIFAR-100 and NDSB datasets. While Keras has provided documentation on how to use PReLU, I was not able to find one for RReLU. Can someone brief about the usage of Randomized ReLU activation in Keras?

Below is the description of RReLU from the paper arXiv:1505.00853v2.

edited Apr 15 '19 at 05:41

dahiya_boy

9,298
1
30
51

asked Apr 13 '19 at 14:51

Anirudh M

Could you please include the formula for RReLU? – rvinas Apr 14 '19 at 12:11
I have added it! @rvinas – Anirudh M Apr 14 '19 at 16:20
TAke a look at this repo https://github.com/JGuillaumin/one_week_one_paper/tree/master/week_46_drop_activation – Sreeram TP Apr 15 '19 at 06:30
Have already tried the syntax given in that notebook which is activation='randomized-relu'. But it throws an error saying Unknown activation function. – Anirudh M Apr 15 '19 at 14:02

Randomized ReLU in Keras

0 Answers0