Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
p.add_(torch.sign(update), alpha=-group['lr']) has been made more eff…
…icient by using the torch.sign function's inplace mode. This will prevent the need to create a new tensor for the updated parameter, which can save a significant amount of time for large models. (#1193)
- Loading branch information