Is Leaky Relu with alpha = 1 a linear activation function?

Question

if I set alpha = 1, then I simply extend the normal Relu function down. Should this function then be viewed as a linear activation function?

score 1 · Answer 1 · answered Jul 13 '20 at 07:21

1

Yes, Leaky ReLU with alpha equals to 1 is in fact the linear activation function.

answered Jul 13 '20 at 07:21

Ignacio Peletier

You are welcome! If the post answered your question. Please mark it as answered. – Ignacio Peletier Jul 13 '20 at 10:23

1 Answers1