Lai, Weijian 4e4b2d5f6d ModelArts UMN 23.3.0 Version.

Reviewed-by: Hasko, Vladimir <vladimir.hasko@t-systems.com>
Co-authored-by: Lai, Weijian <laiweijian4@huawei.com>
Co-committed-by: Lai, Weijian <laiweijian4@huawei.com>

2024-06-26 07:03:02 +00:00

2.5 KiB

Raw Permalink Blame History

Error Message "max_pool2d_with_indices_out_cuda_frame failed with error code 0" Displayed in Logs

Symptom

After PyTorch 1.3 is upgraded to 1.4, the following error message is displayed:

"RuntimeError:max_pool2d_with_indices_out_cuda_frame failed with error code 0"

Possible Causes

The PyTorch 1.4 engine is incompatible with that of PyTorch 1.3.

Solution

Run the following commands to add contiguous data:

images = images.cuda()  
pred = model(images.permute(0, 3, 1, 2).contigous())

Roll back to PyTorch 1.3.
Use the local PyCharm to remotely access notebook for debugging.

Summary and Suggestions

Before creating a training job, use the ModelArts development environment to debug the training code to maximally eliminate errors in code migration.

Parent topic: Service Code Issues

2.5 KiB Raw Permalink Blame History