CUDA runtime error: an illegal memory access

[merlinarer]

Not always but sometimes, I got this error:
CUDA runtime error: an illegal memory access was encountered /codegeex-fastertransformer/src/fastertransformer/utils/memory_utils.cu:94
It is so weird :)

[Lzhang-hub]

+1

[lorashen]

try the updated batch_inf branch