GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks

Adjusts the weights of the losses in a way that balances the gradient magnitudes.

[Paper] [Code]