Hi guys, I’ve been lurking around these posts for some time now and have tried to narrow the problem down on my own but I don’t have the money to shell out for new hardware to test it out so maybe someone can tell me where I’m bottlenecking…?.?
Here are my specs:
HP x600:
CPU - DUAL x5675 @ 3.07 6 core 12 threads but running dual so double (12 cores 24 threads).
RAM - 32gb ddr3
D drive - NVME - inland 2tb NVMe SSD pcie 3.0 x4
E drive - Samsung evo SSD 850 250GB
Win 10 pro x64
Any help would be appreciated as I’m just somewhat blindly throwing money at this with trying to use my best guesstimates.
Final Directory: E:
Number of Plots: 1
Crafting plot 1 out of 1
Process ID: 3668
Number of Threads: 16
Number of Buckets P1: 2^8 (256)
Number of Buckets P3+P4: 2^8 (256)
Pool Puzzle Hash:
Farmer Public Key:1
Working Directory: E:
Working Directory 2: D:
Plot Name: plot-k32-2021-08-02-23-12-08b5be28fa72a251276f0d55931f4eb8a93d37a3d5666234550b97517d3e5014
[P1] Table 1 took 102.27 sec
[P1] Table 2 took 536.265 sec, found 4294920962 matches
[P1] Table 3 took 784.875 sec, found 4294800618 matches
[P1] Table 4 took 958.963 sec, found 4294682414 matches
[P1] Table 5 took 939.179 sec, found 4294485066 matches
[P1] Table 6 took 917.191 sec, found 4293945267 matches
[P1] Table 7 took 597.197 sec, found 4292832404 matches
Phase 1 took 4836.45 sec
[P2] max_table_size = 4294967296
[P2] Table 7 scan took 44.4504 sec
[P2] Table 7 rewrite took 103.229 sec, dropped 0 entries (0 %)
[P2] Table 6 scan took 145.84 sec
[P2] Table 6 rewrite took 283.002 sec, dropped 581380977 entries (13.5396 %)
[P2] Table 5 scan took 142.261 sec
[P2] Table 5 rewrite took 268.193 sec, dropped 762120801 entries (17.7465 %)
[P2] Table 4 scan took 141.574 sec
[P2] Table 4 rewrite took 263.941 sec, dropped 828931189 entries (19.3013 %)
[P2] Table 3 scan took 135.594 sec
[P2] Table 3 rewrite took 261.707 sec, dropped 855070486 entries (19.9094 %)
[P2] Table 2 scan took 139.857 sec
[P2] Table 2 rewrite took 239.113 sec, dropped 865609276 entries (20.1543 %)
Phase 2 took 2190.92 sec
Wrote plot header with 252 bytes
[P3-1] Table 2 took 174.45 sec, wrote 3429311686 right entries
[P3-2] Table 2 took 130.983 sec, wrote 3429311686 left entries, 3429311686 final
[P3-1] Table 3 took 180.457 sec, wrote 3439730132 right entries
[P3-2] Table 3 took 147.319 sec, wrote 3439730132 left entries, 3439730132 final
[P3-1] Table 4 took 185.704 sec, wrote 3465751225 right entries
[P3-2] Table 4 took 145.203 sec, wrote 3465751225 left entries, 3465751225 final
[P3-1] Table 5 took 189.104 sec, wrote 3532364265 right entries
[P3-2] Table 5 took 147.966 sec, wrote 3532364265 left entries, 3532364265 final
[P3-1] Table 6 took 196.999 sec, wrote 3712564290 right entries
[P3-2] Table 6 took 159.947 sec, wrote 3712564290 left entries, 3712564290 final
[P3-1] Table 7 took 202.022 sec, wrote 4292832404 right entries
[P3-2] Table 7 took 187.103 sec, wrote 4292832404 left entries, 4292832404 final
Phase 3 took 2051.03 sec, wrote 21872554002 entries to final plot
[P4] Starting to write C1 and C3 tables
[P4] Finished writing C1 and C3 tables
[P4] Writing C2 table
[P4] Finished writing C2 table
Phase 4 took 486.055 sec, final plot size is 108807372026 bytes
Total plot creation time was 9564.61 sec (159.41 min)
try linux ,it is free… you may find improvement.
Take one of my server for example,it has Dual E5 2670V2 cpu with 256G Full ramdisk as temp&2,
same setup but get a lot of improvement from 45-50 minutes in windows to 27-29 minutes in Ubuntu Linux.
I think it may also be helpful for using NVME as temp drive condition. You can have a try without any cost. But I do suggest you update your memory to 128G and setup as temp 2,
and use current NVME as temp, it should make the time under 45 minutes at least…
im pretty familiar with linux so that shouldn’t be a problem im just surprised why im getting 150 min plot times. I feel like im missin something obvious.
If i could get under 45 min that would be amazing. and WOW 27-29 min is lighting fast.
Do you think my nvme is junk since it has a small chache
I have used it as temp storege #1 and #2. I have also took it completely out of the equation and just used my nvme for temp and final then moved it myself afterwards.
I’m no expert but if I’m getting 3.24 hours plot times with my old 3rd gen i5 laptop with 8GB RAM and a single SSD for temp I would have thought floods7 should be getting better results than they are. Mine’s on Ubuntu server though so that may be helping. Could it be the old SSD not getting trim command problem?
Single SSD as temp maybe a bottleneck since it may only around 300-400M/s
please try using ramdisk as temp 2 in Linux by 128G DDR3 (which should not be too much cost) with 6000M-8000M/S and use your NVME as temp for 25% of TBW,
as it could help greatly improve time to maybe under 1 hour even with your 8 core CPU.
Personally I don’t think CPU is the bottleneck under MadMAX …
Yes try Linux first. If still that slow you can think about hardware upgrades.
But honestly x5675 is pretty old, not sure how fast it can be if all the other components are optimal.
I mean I run a plot with 3900x on two 1 TB nvme’s (SN750) in 30 minutes. The Inland nvme might be a bit slower, but not to the point of 2.5 hour plots I think.
You should have a google around and see if you can find people with similar CPU’s and what their plot times are. That should give you a better idea of how much you can do with it.
ddr registered memory is pretty cheap, so you could try that. But If I were you I’d like to know if those CPU’s can make use of it. I think they can, but the question is how much?
Last night, I reinstalled Ubuntu on my 2012 Mac Pro 12c/24t (2x X5650 Xeon) 32GB RAM and a Adata SATA 500GB SSD (temp). I ran Madmax with -r23. I ran the test before, but I thought it would be different this time. This time, after about 30 minutes of it just sitting there and showing the final directory, number of plots, process ID etc, I just gave up and turned it off. My AMD R5 2600 system blows it out of the water and takes no more than 30 seconds to pass P1 table 1 and no more than 300 seconds for P1 table 2. I can plot less than 1 hour 30 minutes on my AMD system.
What am I saying here? 2.5 hours is OK and might even be the best you can get for plotting because without Madmax, I am 100% confident you wouldn’t even be able to plot with that system.
edit: I did not use PCIe 2.0 or a USB 3.0 card/dock on the Mac Pro for the SSD. I just used the SATA 2 interface for the test.
If I was willing to spend money on my Mac pro for stuff I can repurpose, I’d get a PCIe x16 to dual NVMe and at least 1x 1TB Inland (or similar) NVMe (just 1 NVME to start). I will try tonight after work, if I have time, using a USB 3 dock and the Adata 500GB SSD.
I am aware that the Mac Pro maxes out at SATA 2 (early spec) and PCIe 2 (early spec).
Is it even worth it to use the Mac Pro for plotting?
I have a plotter with the same CPUs same amount of ram and same inland 2t. in a hp z800
Windows times are 53 min ~
ubuntu times are 47 min per plot stable for weeks
I wouldn’t used that SSD as second… That inland 2tb is awesome. I have it in 3 plotters that use those and they don’t give up. One has generated 208TB worth of plots single handedly.
Are you saying use the inland for Temp and Temp 2? Final location is a HDD. how many threads do you use? Id love to get 53 minutes.
I ran another setup with the nvme as temp and temp 2. Final directory was the nvme as well, just so i didnt have to wait for transfer time. 174 MIN? wft? im not sure where im going wrong? I tried 36 threads for some reason but i usually run it at 16 with about the same results.
Any help would be great, im banging my head against the wall here.
jjs, Are you doing anything differently than i am? besides having a third of my plot time lol
Here is my log…
Keep in mind the D drive is the nvme
Final Directory: D:
Number of Plots: 4
Crafting plot 1 out of 4
Process ID: 5784
Number of Threads: 36
Number of Buckets P1: 2^8 (256)
Number of Buckets P3+P4: 2^8 (256)
Pool Puzzle Hash:
Farmer Public Key:
Working Directory: D:
Working Directory 2: D:
Plot Name: plot-k32-2021-08-03-02-01-de70b68626042f4cbc0964a9856f1464d9ca29840dd6b6f214b9ad19f497b4f4
[P1] Table 1 took 130.068 sec
[P1] Table 2 took 639.168 sec, found 4294919836 matches
[P1] Table 3 took 911.92 sec, found 4294888406 matches
[P1] Table 4 took 1110.46 sec, found 4294641980 matches
[P1] Table 5 took 1083.81 sec, found 4294223625 matches
[P1] Table 6 took 1019.63 sec, found 4293498300 matches
[P1] Table 7 took 702.218 sec, found 4291996410 matches
Phase 1 took 5597.58 sec
[P2] max_table_size = 4294967296
[P2] Table 7 scan took 58.3338 sec
[P2] Table 7 rewrite took 153.702 sec, dropped 0 entries (0 %)
[P2] Table 6 scan took 164.372 sec
[P2] Table 6 rewrite took 304.606 sec, dropped 581448514 entries (13.5425 %)
[P2] Table 5 scan took 163.286 sec
[P2] Table 5 rewrite took 288.129 sec, dropped 762163890 entries (17.7486 %)
[P2] Table 4 scan took 148.496 sec
[P2] Table 4 rewrite took 254.921 sec, dropped 829046012 entries (19.3042 %)
[P2] Table 3 scan took 149.46 sec
[P2] Table 3 rewrite took 255.946 sec, dropped 855207151 entries (19.9122 %)
[P2] Table 2 scan took 146.663 sec
[P2] Table 2 rewrite took 252.052 sec, dropped 865593266 entries (20.1539 %)
Phase 2 took 2353.14 sec
Wrote plot header with 252 bytes
[P3-1] Table 2 took 221.267 sec, wrote 3429326570 right entries
[P3-2] Table 2 took 140.835 sec, wrote 3429326570 left entries, 3429326570 final
[P3-1] Table 3 took 220.009 sec, wrote 3439681255 right entries
[P3-2] Table 3 took 152.795 sec, wrote 3439681255 left entries, 3439681255 final
[P3-1] Table 4 took 214.662 sec, wrote 3465595968 right entries
[P3-2] Table 4 took 149.66 sec, wrote 3465595968 left entries, 3465595968 final
[P3-1] Table 5 took 221.73 sec, wrote 3532059735 right entries
[P3-2] Table 5 took 154.361 sec, wrote 3532059735 left entries, 3532059735 final
[P3-1] Table 6 took 229.818 sec, wrote 3712049786 right entries
[P3-2] Table 6 took 163.099 sec, wrote 3712049786 left entries, 3712049786 final
[P3-1] Table 7 took 245.635 sec, wrote 4291996410 right entries
[P3-2] Table 7 took 197.282 sec, wrote 4291996410 left entries, 4291996410 final
Phase 3 took 2314.92 sec, wrote 21870709724 entries to final plot
[P4] Starting to write C1 and C3 tables
[P4] Finished writing C1 and C3 tables
[P4] Writing C2 table
[P4] Finished writing C2 table
Phase 4 took 187.009 sec, final plot size is 108796175840 bytes
Total plot creation time was 10452.8 sec (174.214 min)