It seems like you use PaddleOCR, and I want to suggest you post an issue below the repo PaddleOCR, but I found you have already submitted an issue below it with a link( PaddlePaddle/PaddleOCR#12027 ).

First of all, the reply suggests you update the version of Paddle to 2.5.2, is the problem fixed? if not, please try Paddle 2.6 and the Paddle develop branch. The latest updates may have an effect on your bugs.

Secondly, your question is more similar to Paddle framework bugs. Maybe the version updates import bugs to the kernel. As for more detailed exploration, please supply more details about which part or algorithm you used in PaddleOCR, what data type format you used, and so on. If you have any minimal reproducible environment(such as data and script), it is better.

Hello, Vvsmile,
Thank you for addressing my issue and helping me.

Unfortunately, updating the Paddle version to 2.5.2 doesn't fix my problem. I still get different results on CPU and GPU. I have tried to update my Paddle version to 2.6, but it was not compatible with the version of PaddleOCR that I'm supposed to use.

I also believe that the bug is connected with the Paddle framework, not PaddleOCR, because I don't face any challenges with version 2.4 of Paddle. From PaddleOCR, I use text detection, text recognition, and the LayoutXML model. All of them produce the wrong result when I run my script on a machine with the following configuration:

• Nvidia driver version: 550.54.15
• CUDA version: 12.4
• GPU: Tesla P40

I have to mention that I checked a lot of other versions of CUDA and Nvidia driver (CUDA: 10.2, 11.6, 11.7, 11.8 / Nvidia: 510, 535, 545, 550), but none of them changed this behavior. The only thing that was constant was the Tesla P40 GPU, and I'm wondering if that's the reason. I checked the change logs of version 2.5 of Paddle and found out that you're not supporting GPUs with Kepler architectures anymore after 2.5 (and supporting CUDA 12), but Pascal series was still on the list. Is it possible that maybe Paddle should have discarded Pascal GPUs too?

I mentioned in my previous message that the Docker image works perfectly on both GPU and CPU on another machine. Here are the configs of this one:

• Nvidia driver version: 545.23.08
• CUDA version: 12.3
• GPU: NVIDIA GeForce RTX 3090 Ti

I provide a Docker image, and I hope it helps you to reproduce the issue. You can find it in this link . By following these steps, you can see the English text detection model result on CPU and GPU.

docker build -t repr-gpu-bug .
mkdir result
docker run --runtime nvidia -v ./result:/home/result repr-gpu-bug python test.py

After that, you will find two images in the result directory. When I run this docker on my 3090 Ti machine, the two images are similar. However, on the P40 GPU, they are different. I have uploaded the result for you on Google Drive too.