BSE on gpu possible without cusolvermp? possible on GH200?

questions related to VASP with GPU support (vasp.5.4.1, version released in Feb 2016)

Moderators: Moderator, Global Moderator

Post Reply
Message
Author
jonathan_schmidt
Newbie
Newbie
Posts: 5
Joined: Sat Jun 10, 2023 1:44 pm

BSE on gpu possible without cusolvermp? possible on GH200?

#1 Post by jonathan_schmidt » Fri Jul 05, 2024 8:23 am

Dear Vasp team,
We are trying to get the BSE to run on gpu on the new swiss supercomuting system using gh200s https://github.com/eth-cscs/alps-uenv/pull/122 .
Is cusolvermp required for the gpu acceleration?
Do you know if it's possible to use vasp with cusolvermp on ARM chips right now? The information out there is a little bit confusing e.g. https://docs.nvidia.com/hpc-sdk/hpc-sdk ... index.html say it should be available on Linux_aarch64 but https://docs.nvidia.com/cuda/cusolvermp ... quirements claims it only runs on x86_64.
thank you so much,
Jonathan

alexey.tal
Global Moderator
Global Moderator
Posts: 288
Joined: Mon Sep 13, 2021 12:45 pm

Re: BSE on gpu possible without cusolvermp? possible on GH200?

#2 Post by alexey.tal » Fri Jul 05, 2024 2:07 pm

Dear Johnathan,
Is cusolvermp required for the gpu acceleration?
The cusolvermp library is required for performing BSE calculations on GPU.
Do you know if it's possible to use vasp with cusolvermp on ARM chips right now?
I contacted people from Nvidia and they confirmed that cusolvermp does support ARM.

Note that although the BSE driver in VASP6.4.3 does support acceleration on GPUs, there is a caveat. For an efficient data distribution the BSE driver requires the cuBLASMp v0.2.0 library. However, it was released after VASP6.4.3 and cublasmp is not supported in VASP6.4.3. Without cublasmp the distribution of the data is performed on CPU, which dramatically affects the performance. Thus, I would recommend waiting for the VASP6.5 release where this issue has been resolved.

If you would like to run BSE calculations on GPU with VASP6.4.3:
- make sure to compile it with CUSOLVERMP support
- select the new BSE driver, i.e., IBSE=2
- use Nvidia HPC-X
- use nvhpc-24.5

jonathan_schmidt
Newbie
Newbie
Posts: 5
Joined: Sat Jun 10, 2023 1:44 pm

Re: BSE on gpu possible without cusolvermp? possible on GH200?

#3 Post by jonathan_schmidt » Fri Jul 12, 2024 2:07 pm

Thank you so much for the detailed reply. Do you know when we 6.4.5 will be available for testing?
best,
Jonathan

alexey.tal
Global Moderator
Global Moderator
Posts: 288
Joined: Mon Sep 13, 2021 12:45 pm

Re: BSE on gpu possible without cusolvermp? possible on GH200?

#4 Post by alexey.tal » Fri Jul 12, 2024 3:08 pm

We are planning the next release for the beginning of fall or the end of summer.

Post Reply