cuda运行错误，call to cuMemcpy failed, 返回错误代码700

Question

我在运行mpi+cuda程序的时候，显示
call to cuMemcpy failed
cuMemcpy return value: 700
在cuda.h中查了一下错误代码700的解释如下：
While executing a kernel, the device encountered a load or store instruction on an invalid memory address.This leaves the process in an inconsistent state and any further CUDA work will return the same error. To continue using CUDA, the process must be terminated and relaunched.
求问该如何解决。

Answer 1

https://blog.csdn.net/u012348774/article/details/49663299