bound_lower_multiplicative

bound_lower_multiplicative(param: Tensor, update: Tensor, limit: float, **kwargs) → Tensor

Computes the scaled update of lower-bound multiplicative parameter dependence.

This is sometimes also referred to as “soft parameter dependence” and is equivalent to power dependence with an exponent of 1.

\[U_- = (P - P_\text{min}) U_-\]

Parameters:

• param (torch.Tensor) – parameter with update bounding, \(P\).

• update (torch.Tensor) – depressive update being applied, \(U_-\).

• limit (float) – value of the upper bound, \(P_\text{min}\).

Returns:

bounded update.

Return type:

torch.Tensor