Optimizing plotting on an AMD Ryzen 5950x (or any other 16c/32t CPU)

When I was doing “only” 9 parallel plots on my 5950x here’s what I got:

I do 9 staggered 4c/6gb plots on my 5950x system with 64gb RAM. I should up the memory a little more, I didn’t post times for it so here goes:

Ryzen 5950X / X570 16c/32t, 9 parallel plots, 4c/6gb

plot 1/9

  • Total time = 26235.440 seconds. CPU (133.800%) Mon Apr 19 00:15:55 2021
  • Total time = 25311.904 seconds. CPU (134.070%) Mon Apr 19 07:29:56 2021
  • Total time = 27298.254 seconds. CPU (133.380%) Mon Apr 19 15:18:03 2021
  • Total time = 26961.730 seconds. CPU (133.060%) Sun Apr 18 16:47:25 2021

plot 2/9

  • Total time = 27156.522 seconds. CPU (132.680%) Sun Apr 18 17:17:28 2021
  • Total time = 25777.321 seconds. CPU (134.060%) Mon Apr 19 00:38:44 2021
  • Total time = 25110.607 seconds. CPU (134.370%) Mon Apr 19 07:45:11 2021
  • Total time = 27209.414 seconds. CPU (133.240%) Mon Apr 19 15:26:49 2021

plot 3/9

  • Total time = 27316.069 seconds. CPU (132.560%) Sun Apr 18 17:44:33 2021
  • Total time = 25832.624 seconds. CPU (134.910%) Mon Apr 19 01:06:47 2021
  • Total time = 25309.082 seconds. CPU (134.570%) Mon Apr 19 08:21:00 2021
  • Total time = 27020.246 seconds. CPU (133.240%) Mon Apr 19 16:04:43 2021

plot 4/9

  • Total time = 28002.689 seconds. CPU (129.530%) Sun Apr 18 17:53:54 2021
  • Total time = 25737.511 seconds. CPU (134.330%) Mon Apr 19 01:15:50 2021
  • Total time = 25580.768 seconds. CPU (134.050%) Mon Apr 19 -08:30:40 2021
  • Total time = 27368.038 seconds. CPU (132.010%) Mon Apr 19 16:15:45 2021

plot 5/9

  • Total time = 27147.972 seconds. CPU (129.890%) Sun Apr 18 14:11:40 2021
  • Total time = 26867.865 seconds. CPU (131.800%) Sun Apr 18 21:50:01 2021
  • Total time = 25822.351 seconds. CPU (131.280%) Mon Apr 19 05:12:20 2021
  • Total time = 27687.093 seconds. CPU (128.110%) Mon Apr 19 13:06:38 2021

plot 6/9

  • Total time = 25964.157 seconds. CPU (128.560%) Sun Apr 18 21:23:45 2021
  • Total time = 25622.896 seconds. CPU (131.940%) Mon Apr 19 04:38:35 2021
  • Total time = 27269.767 seconds. CPU (127.520%) Mon Apr 19 12:21:09 2021

plot 7/9

  • Total time = 27729.357 seconds. CPU (130.480%) Sun Apr 18 18:27:53 2021
  • Total time = 25364.418 seconds. CPU (133.250%) Mon Apr 19 01:42:34 2021
  • Total time = 25869.598 seconds. CPU (133.490%) Mon Apr 19 09:06:23 2021
  • Total time = 27604.056 seconds. CPU (132.370%) Mon Apr 19 17:00:17 2021

plot 8/9

  • Total time = 27787.066 seconds. CPU (130.760%) Sun Apr 18 18:20:39 2021
  • Total time = 25767.090 seconds. CPU (133.790%) Mon Apr 19 01:42:41 2021
  • Total time = 25605.343 seconds. CPU (133.970%) Mon Apr 19 08:59:51 2021
  • Total time = 27546.598 seconds. CPU (132.560%) Mon Apr 19 16:47:40 2021

plot 9/9

  • Total time = 26269.964 seconds. CPU (132.280%) Sun Apr 18 22:05:44 2021
  • Total time = 23608.046 seconds. CPU (130.870%) Mon Apr 19 04:47:04 2021
  • Total time = 25770.912 seconds. CPU (126.490%) Mon Apr 19 12:04:49 2021

Note that I have six (6) full bandwidth M.2 NVMe 980 Pro 2tb drives as targets (the ASUS Hyper card with bifurcation set) so I never exceed 3 plots per disk. I believe very strongly that disk I/O is not the bottleneck here.

So pretty much 7.5 hours per plot or 27k seconds. That maths out to 28.8 plots per day I guess?

Increasing to 12 parallel plots increased my overall plot time to closer to 30k seconds, but overall it was a gain. Looking at write times in the dump folder (two dump drives), I was seeing 18 per drive or 36 plots per day?

7 Likes