GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks
Adjusts the weights of the losses in a way that balances the gradient magnitudes.
[Paper] [Code]
Adjusts the weights of the losses in a way that balances the gradient magnitudes.
[Paper] [Code]
0) Motivation, Object and Related works:
Motivation:
Objectives:
References: