Currently, our custom ops are not autocast eligible. This can lead to problems where higher precision is used than necessary if the very first layer in a network is a TH custom op. We need to mark all custom ops as autograd eligible to circumvent this. This is a bigger effort, tracking it here.
Currently, our custom ops are not autocast eligible. This can lead to problems where higher precision is used than necessary if the very first layer in a network is a TH custom op. We need to mark all custom ops as autograd eligible to circumvent this. This is a bigger effort, tracking it here.