MD on gpu SCF fast update slow: solution?

questions related to VASP with GPU support (vasp.5.4.1, version released in Feb 2016)

Moderators: Global Moderator, Moderator

Post Reply
Message
Author
User avatar
paulfons
Jr. Member
Jr. Member
Posts: 55
Joined: Sun Nov 04, 2012 2:40 am
License Nr.: 5-1405
Location: Yokohama, Japan
Contact:

MD on gpu SCF fast update slow: solution?

#1 Post by paulfons » Fri Apr 22, 2022 8:16 am

I have system of 428 atoms consisting of graphene and 100 water molecules. The system is quite large so I am running with vasp_gam. When I run the system on 32 cores, the SCF steps are quite slow with several minutes between steps. When I run the same input file on the ACC gpu vasp_gam version the SCF looks are very quick -- perhaps a few seconds per iteration, but the updates after the completion of a SCF loop are very slow and take more than ten minutes. I note that it is required to run the gpu using "mpirun -n 1 vasp_gam", e.g. with a single core. Is this the cause of the slow update (presumably updating the forces and calculating the new positions?). More importantly, is there something that can be done to speed up the calculation in terms of INCAR (or other) settings? It seems strange that the gpu SCF steps are so fast, but the updates to the next ion movement are a couple of orders of magnitude slower.
You do not have the required permissions to view the files attached to this post.

ferenc_karsai
Global Moderator
Global Moderator
Posts: 228
Joined: Mon Nov 04, 2019 12:44 pm

Re: MD on gpu SCF fast update slow: solution?

#2 Post by ferenc_karsai » Mon Apr 25, 2022 9:17 am

Please send us the following files:

INCAR, KPOINTS, POSCAR, POTCAR,
OUTCAR for GPU calculation
OUTCAR for the pure CPU calculations

Is it a calculation using ML_LMLFF=.TRUE.?

User avatar
paulfons
Jr. Member
Jr. Member
Posts: 55
Joined: Sun Nov 04, 2012 2:40 am
License Nr.: 5-1405
Location: Yokohama, Japan
Contact:

Re: MD on gpu SCF fast update slow: solution?

#3 Post by paulfons » Thu Apr 28, 2022 7:02 am

I am sorry for the delay in replying. This calculation was purely ab-initio. The job was run with a single core on the gpu with "mpirun -n 1 vasp_gam". The terminal output is in the file nohup.log in the attached tar file along with all of the input files. I was truly impressed with the the speed of the SCF look, but don't understand why ionic steps were so slow. I would be glad to try out any suggestions.
You do not have the required permissions to view the files attached to this post.

davidnormal
Newbie
Newbie
Posts: 3
Joined: Thu Nov 04, 2021 7:56 am

Re: MD on gpu SCF fast update slow: solution?

#4 Post by davidnormal » Tue May 17, 2022 4:53 am

maybe try the openMP parallelization?

`export OMP_NUM_THREADS=4`

see if there is any improvement

Post Reply