@dan90266 I think the general idea is to avoid simultaneous copying to the -d
destination disk.
I have a decent number of plots on older hardware. These should all be on 1.0.4. They’re somewhat interesting because I’m plotting to matching (old) HDDs in 3 different systems.
Intel(R) Xeon(R) CPU E5-2620 v2 @ 2.10GHz (x2), 128GB RAM
- 12 cores / 24 threads total
- HDDs
- 4x 2TB Hitach HUA723020ALA640
- matching -t and -d args
- 4 parallel plots (looped)
One interesting thing to note here is the plots shouldn’t be restricted by CPU / RAM and the times end up being worse than the i7 running 6 parallel plots on 4 cores. I’m guessing I’m losing time from anything compute related due to the low clock speed of the CPUs in this system.
chia plots create -k 32 -n 1 -b 6750 -r 4 -u 128 \
-f "${fpk}" -p "${ppk}" -t "${tmp}" -d "${dst}" \
1> "${flog}" 2> "${elog}" &
Total time = 52997.309 seconds. CPU (96.950%) Fri Apr 16 09:04:49 2021
Total time = 56877.742 seconds. CPU (96.380%) Sat Apr 17 00:52:55 2021
Total time = 56320.806 seconds. CPU (95.900%) Sat Apr 17 16:31:44 2021
Total time = 55545.991 seconds. CPU (94.650%) Sun Apr 18 07:57:39 2021
Total time = 52670.217 seconds. CPU (95.940%) Thu Apr 15 17:05:43 2021
Total time = 52020.539 seconds. CPU (94.900%) Fri Apr 16 08:48:40 2021
Total time = 52893.222 seconds. CPU (96.440%) Fri Apr 16 23:30:17 2021
Total time = 52698.017 seconds. CPU (95.860%) Sat Apr 17 14:08:44 2021
Total time = 53597.958 seconds. CPU (93.830%) Sun Apr 18 05:02:05 2021
Total time = 49713.422 seconds. CPU (100.440%) Thu Apr 15 16:16:31 2021
Total time = 50808.946 seconds. CPU (101.280%) Fri Apr 16 08:28:33 2021
Total time = 49460.708 seconds. CPU (100.880%) Fri Apr 16 22:13:23 2021
Total time = 49813.684 seconds. CPU (100.090%) Sat Apr 17 12:04:32 2021
Total time = 50352.219 seconds. CPU (98.620%) Sun Apr 18 02:04:11 2021
Total time = 51927.866 seconds. CPU (96.670%) Sun Apr 18 16:30:38 2021
Total time = 50610.372 seconds. CPU (101.600%) Thu Apr 15 16:31:33 2021
Total time = 51741.478 seconds. CPU (100.030%) Fri Apr 16 08:44:09 2021
Total time = 50767.802 seconds. CPU (101.170%) Fri Apr 16 22:50:49 2021
Total time = 49919.185 seconds. CPU (102.220%) Sat Apr 17 12:42:57 2021
Total time = 52194.367 seconds. CPU (101.070%) Sun Apr 18 03:13:24 2021
- SSDs
- 2x Samsung SSD 850 PRO 256GB (6.0 Gb/s SATA)
- RAID0
- external HDD for -d
- 2 parallel plots contiuously looped after phase 1 is done
chia plots create -k 32 -n 1 -b 6750 -r 4 -u 128 \
-f "${fpk}" -p "${ppk}" -t "${tmp}" -d "${dst}" \
1> "${flog}" 2> "${elog}" &
Total time = 35647.899 seconds. CPU (133.050%) Thu Apr 15 12:21:35 2021
Total time = 37323.691 seconds. CPU (132.430%) Fri Apr 16 04:41:22 2021
Total time = 37814.833 seconds. CPU (128.800%) Fri Apr 16 15:25:13 2021
Total time = 37314.965 seconds. CPU (128.680%) Sat Apr 17 02:00:54 2021
Total time = 37424.037 seconds. CPU (130.650%) Sat Apr 17 12:39:28 2021
Total time = 37657.850 seconds. CPU (131.010%) Sat Apr 17 23:22:40 2021
Total time = 36579.381 seconds. CPU (130.450%) Sun Apr 18 09:48:27 2021
Total time = 38395.255 seconds. CPU (130.700%) Fri Apr 16 09:09:06 2021
Total time = 38520.077 seconds. CPU (131.280%) Fri Apr 16 20:05:22 2021
Total time = 38652.444 seconds. CPU (129.230%) Sat Apr 17 07:04:09 2021
Total time = 37746.034 seconds. CPU (128.400%) Sat Apr 17 17:47:24 2021
Total time = 37777.937 seconds. CPU (129.670%) Sun Apr 18 04:32:51 2021
Total time = 38249.343 seconds. CPU (130.510%) Sun Apr 18 15:26:53 2021
Intel(R) Core™ i7-4790 CPU @ 3.60GHz, 32GB RAM
- 4 cores / 8 threads total
This one has 2 different types of disks, so I broke it down by disk type. The machine runs 6 parallel plots (looped) using all 6 disks.
- HDDs
- 3x 2TB Hitach HUA723020ALA640
- matching -t and -d args
I had some scripting issues on this machine, so the numbers aren’t super reliable because I didn’t have 6 parallel plots all the time. I find it really interesting to see the fastest plot with some of the lowest CPU usage. I wonder if it’s counting D state as CPU time or something.
It’s also interesting to see the CPU usage calculated to be lower than the last machine which has slower plot times. I think that means I’m leaving CPU performance on the table, but I’m not sure. Anyone know?
Since I didn’t have 6 parallel plots going at first the lower times are a reasonable estimate of the fastest plots I can do to the Hitachi HDDs on this system.
chia plots create -k 32 -n 1 -b 4096 -r 2 -u 128 \
-f "${fpk}" -p "${ppk}" -t "${tmp}" -d "${dst}" \
1> "${flog}" 2> "${elog}" &
Total time = 39300.386 seconds. CPU (69.620%) Fri Apr 16 11:49:05 2021
Total time = 42273.174 seconds. CPU (70.800%) Sat Apr 17 03:31:29 2021
Total time = 40857.753 seconds. CPU (75.040%) Sat Apr 17 15:29:19 2021
Total time = 42719.311 seconds. CPU (74.630%) Sun Apr 18 06:30:42 2021
Total time = 44129.339 seconds. CPU (63.370%) Fri Apr 16 13:09:43 2021
Total time = 45614.537 seconds. CPU (68.250%) Sat Apr 17 04:27:20 2021
Total time = 47091.374 seconds. CPU (71.630%) Sat Apr 17 17:37:17 2021
Total time = 46774.869 seconds. CPU (68.890%) Sun Apr 18 07:38:26 2021
Total time = 43925.360 seconds. CPU (64.770%) Fri Apr 16 13:06:26 2021
Total time = 44995.274 seconds. CPU (65.480%) Sat Apr 17 04:17:07 2021
Total time = 46374.006 seconds. CPU (68.380%) Sat Apr 17 17:22:41 2021
Total time = 48164.761 seconds. CPU (70.010%) Sun Apr 18 08:01:41 2021
- HDDs
- 3x 320GB Seagate Barracuda 7200.10 (ST3320620AS)
- large internal HDD for -d
I had scripting issues for the first couple rounds and the plots to these disks were failing, so I only have the first successful round. I can watch iostat
and see these disks are slower than the others.
chia plots create -k 32 -n 1 -b 4096 -r 2 -u 128 \
-f "${fpk}" -p "${ppk}" -t "${tmp}" -d "${dst}" \
1> "${flog}" 2> "${elog}" &
Total time = 64126.384 seconds. CPU (50.990%) Sat Apr 17 14:33:28 2021
Total time = 65534.108 seconds. CPU (50.930%) Sat Apr 17 15:11:29 2021
Total time = 65253.436 seconds. CPU (52.260%) Sat Apr 17 15:08:37 2021
Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz, 64GB RAM
- 4 cores / 8 threads total
- HDDs
- 2TB Hitach HUA723020ALA640
- matching -t and -d args
- 4 disks running in parallel with 4 more started after phase 1
- 8 parallel plots at after the first stagger
chia plots create -k 32 -n 1 -b 6750 -r 2 -u 128 \
-f "${fpk}" -p "${ppk}" -t "${tmp}" -d "${dst}" \
1> "${flog}" 2> "${elog}" &
Total time = 61173.757 seconds. CPU (78.220%) Thu Apr 15 22:14:12 2021
Total time = 60109.205 seconds. CPU (81.210%) Fri Apr 16 22:30:13 2021
Total time = 60177.397 seconds. CPU (81.070%) Sun Apr 18 00:52:46 2021
Total time = 61352.661 seconds. CPU (78.860%) Fri Apr 16 05:21:37 2021
Total time = 60260.062 seconds. CPU (80.560%) Sat Apr 17 08:05:10 2021
Total time = 60243.810 seconds. CPU (80.370%) Sun Apr 18 08:30:42 2021
Total time = 61178.092 seconds. CPU (77.610%) Thu Apr 15 22:14:45 2021
Total time = 62880.919 seconds. CPU (77.940%) Fri Apr 16 23:18:18 2021
Total time = 63454.978 seconds. CPU (77.550%) Sun Apr 18 02:00:22 2021
Total time = 59981.112 seconds. CPU (80.950%) Fri Apr 16 04:46:54 2021
Total time = 60137.530 seconds. CPU (80.250%) Sat Apr 17 08:14:34 2021
Total time = 60761.847 seconds. CPU (79.760%) Sun Apr 18 09:25:05 2021
Total time = 61226.161 seconds. CPU (78.130%) Thu Apr 15 22:16:14 2021
Total time = 62288.823 seconds. CPU (77.950%) Fri Apr 16 23:09:33 2021
Total time = 62666.744 seconds. CPU (77.790%) Sun Apr 18 01:58:53 2021
Total time = 60868.249 seconds. CPU (80.390%) Fri Apr 16 05:09:01 2021
Total time = 60620.490 seconds. CPU (79.800%) Sat Apr 17 08:20:21 2021
Total time = 61447.937 seconds. CPU (79.240%) Sun Apr 18 09:57:00 2021
Total time = 60719.927 seconds. CPU (78.970%) Thu Apr 15 22:08:09 2021
Total time = 61064.468 seconds. CPU (79.440%) Fri Apr 16 22:31:53 2021
Total time = 61730.494 seconds. CPU (78.930%) Sun Apr 18 01:17:45 2021
Total time = 60115.464 seconds. CPU (80.800%) Fri Apr 16 04:52:27 2021
Total time = 60441.838 seconds. CPU (80.820%) Sat Apr 17 08:03:57 2021
Total time = 60271.737 seconds. CPU (80.080%) Sun Apr 18 08:22:56 2021
Total time = 60653.026 seconds. CPU (80.010%) Fri Apr 16 15:18:05 2021
Total time = 61004.122 seconds. CPU (79.320%) Sat Apr 17 15:34:53 2021
Total time = 60979.367 seconds. CPU (80.390%) Fri Apr 16 15:19:44 2021
Total time = 60986.338 seconds. CPU (79.320%) Sat Apr 17 16:18:56 2021
Total time = 61135.941 seconds. CPU (79.130%) Fri Apr 16 15:24:16 2021
Total time = 62452.243 seconds. CPU (77.950%) Sat Apr 17 16:45:00 2021
Total time = 60635.489 seconds. CPU (80.180%) Fri Apr 16 15:03:46 2021
Total time = 60817.650 seconds. CPU (79.130%) Sat Apr 17 15:32:05 2021
I started 10 days ago and I’m going to get my 200th plot today. I’ve won 4 XCH so far which is pretty decent statistically considering I had 0 plots 10 days ago and it’s only been 3-4 days since I got everything scripted to my liking.