fastreid.layers.activation.SwishImplementation Class Reference

Inheritance diagram for fastreid.layers.activation.SwishImplementation:

Static Public Member Functions
	forward (ctx, i)
	backward (ctx, grad_output)

Detailed Description

Definition at line 34 of file activation.py.

Member Function Documentation

backward()

fastreid.layers.activation.SwishImplementation.backward ( ctx, grad_output )

static

Definition at line 42 of file activation.py.

    def backward(ctx, grad_output):
        i = ctx.saved_variables[0]
        sigmoid_i = torch.sigmoid(i)
        return grad_output * (sigmoid_i * (1 + i * (1 - sigmoid_i)))
 
 

forward()

fastreid.layers.activation.SwishImplementation.forward ( ctx, i )

static

Definition at line 36 of file activation.py.

    def forward(ctx, i):
        result = i * torch.sigmoid(i)
        ctx.save_for_backward(i)
        return result
 

---

The documentation for this class was generated from the following file:

• smreid/fastreid/layers/activation.py