Tips and pitfalls of deep learning practice

less than 1 minute read


  1. Don’t add activation function of the output layer. For classification, the softmax activation is incorporated with the loss function in pytorch and keras API. So we only need to feed the raw logits (rather than the sigmoid or softmax score) to the loss function.

Leave a Comment