@maran as specified earlier in the topic, it is the Terramaster F5-422. I will be selling a bunch of these soon, so if anyone is interested let me know! Otherwise they are going on eBay. Individually they actually work fine, my problem is I had too many of them going at once across the network…
Just to clarify, this isn’t how most manufacturers define JBOD, they define it as “present one large storage volume encompassing all drives”. So if you set up a JBOD of three 5tb drives, you see a magical single 15tb storage folder, with no redundancy or performance improvements, literally all you get out of it is one giant storage area instead of {x} individual storage areas.
I switched my setup today over from machines running the remote harvester to sharing disks over the network (posted about it in more detail here) and noticed in my logs I have some isolated cases of checks exceeding the 30 second limit:
Another bottleneck to consider may be not to harvest from disks that are currently being written to after plotting? I think that’s the most likely reason in my case, though I’m going to keep an eye on the timing of this. I’m not transferring any plots over the network in my case also so there shouldn’t be any issues in terms of it being saturated
Yeah it would be a zillion times easier if the harvester told you which specific plots were eligible, then you could isolate which devices might be problematic based on that data.
Right now it’s a complete guessing game, and zero feedback in the GUI when this is happening… hell… even in the logs by default you’d have no way of knowing… the over 30 second isn’t even logged as anything greater than INFO, and the default log level only shows WARN and ERROR!
not just a ‘consumer nas’ issue. I had 1700 plots for 6 days with no blocks found for this exact reason. And mine are all supermicro servers with 10gb SFP+ uplinks to brocade switches.
These are all supermicro rackmount servers with dual E5-2690 v4 (28 cores) and 128GB mem, SSDs for the main os and loads of 10TB enterprise drives connected via AOC-S3008L-L8E SAS3 12Gbps controllers for storing the plots. Each drive formatted as XFS or EXT4 (wasn’t sure which was better so I split them). No raid.
I was running remote harvesters on these superservers that had all the plots connected to a separate full node (also a supermicro server similar specs) that was running the node + farmer + wallet.
This was super frustrating to figure out as everything looked ok in the logs (no warnings or errors indicating any issues). I turned all my remote harvesters into full nodes yesterday and I’ve already found 5 blocks. I am super pissed about all the coins I missed out on, and I guess this just shows as to the immaturity of the coin (not really production ready yet…too many issues). IMO remote harvesters are totally broken for this reason.
I feel you; I went at least 5 days with a 8/9 hour estimated win rate and got nothing for the same reason. So that’s … like … 13-ish coins, let’s call it 8 conservatively for unluckiness?
Well, one charitable way to look at it: this favored smaller famers with less complex configurations and less plots. So I’m OK with that. Smaller farmers got more wins as a result.
But they need to fix this going forward:
make it log ERROR
surface it in the GUI
tell us which specific plots the harvester is picking so we can isolate problem devices
I also fundamentally object to this hard-coded 30 second harvester limit… but it sounds like that 30 second harvester plot test limit is truly written in stone. That’s one thing to ask about @dchuk … is that 30 second limit gonna be that way forever?
There’s probably a loooot of people running into this timeout right now with absolutely no idea that it is happening.
well i’m not going to say I understand all the exact fundamentals of chia and how the blocks are created/found/published/etc yet, but wouldn’t anything longer than 30 seconds not really mean anything if the avg block times are 18 seconds each? anything longer than that and i’d think the challenge has expired. but again I admit I need to study chia a bit more to know exactly the process here…
I feel this. I’ve been farming since the 12th and up to 345 plots with 0 rewards but switched to just a single full node today. Not a good feeling to drop $15k on new hardware and be staring at the 0 XCH block rewards this entire time haha. My expected time to win has been under a week for 10+ days so I guess it’s not too much of a stretch to think I’ve just been unlucky but with other people having similar experiences it seems something might be broken with remote harvesting.
heh well yea so +1 to the little guys at least that don’t run more of a complicated network. but mining is also a game of who does their homework to understand everything under the hood and how to optmize everything. I guarantee you that probably less than 5% read these forums or even run any statistics to that would trigger an alarm that something is amiss. It was pretty obvious for me after 2-3 days. Been mining eth (have solo’d it for a while too) for many years and I understand the ‘luck’ factor, but after the 4th day I was like WTF and started really going through everything here and reddit and their bug tracker and on keybase before I suspected that it was due to something network related and switched all the harvesters to be full nodes instead.
Yeah exactly! I’ve been keeping an eye on my logs and the timeline of 2 plots being in phase 4 and writing to disk matches up with the checks taking > 30 seconds (notice the total plot count increases also):
Also note for the previous 30-40 minutes all checks were either 1 or <1 second. I’m currently doing 2-3 plots per hour so it seems for checks to take longer, finding an eligible plot for farming on a specific disk that is also getting written to during phase 4 would need to occur. In your case if you are doing network transfers maybe that would explain why it’s more consistently going above 30 seconds?
Edit: maybe if there is some way to prioritize disk reads over writes it would solve this also? Looking into whether that is possible now
Edit2: wonder if there is a way to use ionice automatically on the chia plotting processes (or my sshd processes to prioritize farming checks)
Let’s play a game, can you guess when I was copying plots over the network to my NAS?
2021-04-26T00:13:10.174 - 1 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.26406 s. 22 plots
2021-04-26T00:13:19.345 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.03101 s. 22 plots
2021-04-26T00:13:29.594 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.11153 s. 22 plots
2021-04-26T00:13:38.445 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.10153 s. 22 plots
2021-04-26T00:13:55.631 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 2.43613 s. 22 plots
2021-04-26T00:14:01.344 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.12153 s. 22 plots
2021-04-26T00:14:08.984 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.10302 s. 22 plots
2021-04-26T00:14:18.974 - 2 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.36425 s. 22 plots
2021-04-26T00:14:25.783 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.09453 s. 22 plots
2021-04-26T00:14:35.204 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.10453 s. 22 plots
2021-04-26T00:14:44.122 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.09902 s. 22 plots
2021-04-26T00:14:52.861 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.09453 s. 22 plots
2021-04-26T00:15:03.090 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.11303 s. 22 plots
2021-04-26T00:15:13.041 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.15303 s. 22 plots
2021-04-26T00:15:20.041 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.03101 s. 22 plots
2021-04-26T00:15:27.880 - 0 plots were eligible for farming 3c3b364783... Found 0 proofs. Time: 0.11102 s. 22 plots
2021-04-26T00:15:37.445 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10453 s. 22 plots
2021-04-26T00:15:47.933 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.12903 s. 22 plots
2021-04-26T00:15:54.888 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10502 s. 22 plots
2021-04-26T00:16:03.442 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.09902 s. 22 plots
2021-04-26T00:16:12.872 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10302 s. 22 plots
2021-04-26T00:16:22.115 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.09965 s. 22 plots
2021-04-26T00:16:31.823 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10802 s. 22 plots
2021-04-26T00:16:40.880 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11003 s. 22 plots
2021-04-26T00:16:49.777 - 2 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.49411 s. 22 plots
2021-04-26T00:17:01.542 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.15418 s. 22 plots
2021-04-26T00:17:09.602 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.09790 s. 22 plots
2021-04-26T00:17:18.529 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.29034 s. 22 plots
2021-04-26T00:17:25.907 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.03101 s. 22 plots
2021-04-26T00:17:35.318 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11603 s. 22 plots
2021-04-26T00:17:42.913 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10002 s. 22 plots
2021-04-26T00:17:52.169 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.13603 s. 22 plots
2021-04-26T00:18:03.200 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11603 s. 22 plots
2021-04-26T00:18:10.274 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11453 s. 22 plots
2021-04-26T00:18:18.614 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11703 s. 22 plots
2021-04-26T00:18:29.383 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.18404 s. 22 plots
2021-04-26T00:18:43.215 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 1.69423 s. 22 plots
2021-04-26T00:18:48.561 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.42509 s. 22 plots
2021-04-26T00:18:59.795 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 2.86821 s. 22 plots
2021-04-26T00:19:05.245 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.10302 s. 22 plots
2021-04-26T00:19:16.070 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 2.80780 s. 22 plots
2021-04-26T00:19:23.909 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.58564 s. 22 plots
2021-04-26T00:19:33.749 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.14603 s. 22 plots
2021-04-26T00:19:44.140 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.11803 s. 22 plots
2021-04-26T00:19:54.665 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.80382 s. 22 plots
2021-04-26T00:20:05.473 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 4.02026 s. 22 plots
2021-04-26T00:20:10.667 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.18015 s. 22 plots
2021-04-26T00:20:22.078 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 3.02070 s. 22 plots
2021-04-26T00:21:05.307 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 33.72944 s. 22 plots
2021-04-26T00:21:38.026 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 32.71605 s. 22 plots
2021-04-26T00:21:39.941 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 1.91365 s. 22 plots
2021-04-26T00:21:39.985 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.04301 s. 22 plots
2021-04-26T00:21:59.115 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 18.11337 s. 22 plots
2021-04-26T00:22:28.519 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 29.40264 s. 22 plots
2021-04-26T00:23:49.431 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 24.93007 s. 22 plots
2021-04-26T00:24:06.990 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 17.55818 s. 22 plots
2021-04-26T00:24:30.084 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 23.09298 s. 22 plots
2021-04-26T00:24:53.082 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 22.99738 s. 22 plots
2021-04-26T00:25:19.646 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 26.56428 s. 22 plots
2021-04-26T00:26:09.073 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 20.89115 s. 22 plots
2021-04-26T00:26:09.423 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.35008 s. 22 plots
2021-04-26T00:26:09.458 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.03401 s. 22 plots
2021-04-26T00:26:09.495 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.03601 s. 22 plots
2021-04-26T00:26:10.457 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.96131 s. 22 plots
2021-04-26T00:26:15.495 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 198.97043 s. 22 plots
2021-04-26T00:26:15.496 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 226.97653 s. 22 plots
2021-04-26T00:26:41.556 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 25.03939 s. 22 plots
2021-04-26T00:28:29.143 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.02064 s. 22 plots
2021-04-26T00:28:29.184 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.04101 s. 22 plots
2021-04-26T00:28:29.209 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.02566 s. 22 plots
2021-04-26T00:28:29.245 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.03536 s. 22 plots
2021-04-26T00:28:29.276 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 0.03025 s. 22 plots
2021-04-26T00:28:41.003 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 11.72717 s. 22 plots
2021-04-26T00:29:10.672 - 0 plots were eligible for farming 294794196b... Found 0 proofs. Time: 29.66776 s. 22 plots
2021-04-26T00:30:39.360 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 30.08901 s. 22 plots
2021-04-26T00:30:58.516 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 19.15568 s. 22 plots
2021-04-26T00:31:10.032 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.51406 s. 22 plots
2021-04-26T00:31:15.078 - 2 plots were eligible for farming 294794196b... Found 0 proofs. Time: 355.43136 s. 22 plots
2021-04-26T00:31:27.102 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 12.02371 s. 22 plots
2021-04-26T00:31:37.559 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 10.44690 s. 22 plots
2021-04-26T00:31:49.806 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 12.24711 s. 22 plots
2021-04-26T00:31:57.744 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 6.91736 s. 22 plots
2021-04-26T00:32:05.384 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 7.63934 s. 22 plots
2021-04-26T00:32:13.264 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 7.87821 s. 22 plots
2021-04-26T00:32:18.121 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 4.85740 s. 22 plots
2021-04-26T00:32:18.233 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.11180 s. 22 plots
2021-04-26T00:32:18.332 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09772 s. 22 plots
2021-04-26T00:32:18.646 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10261 s. 22 plots
2021-04-26T00:32:19.040 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10938 s. 22 plots
2021-04-26T00:32:19.243 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:19.353 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10938 s. 22 plots
2021-04-26T00:32:19.447 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:19.556 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:19.764 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09799 s. 22 plots
2021-04-26T00:32:19.857 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:19.951 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:20.061 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:20.154 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:20.248 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09375 s. 22 plots
2021-04-26T00:32:20.436 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09376 s. 22 plots
2021-04-26T00:32:20.546 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.11047 s. 22 plots
2021-04-26T00:32:20.652 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10585 s. 22 plots
2021-04-26T00:32:29.397 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 198.72497 s. 22 plots
2021-04-26T00:32:29.398 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 347.84193 s. 22 plots
2021-04-26T00:32:29.398 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 169.63869 s. 22 plots
2021-04-26T00:32:29.399 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 300.93731 s. 22 plots
2021-04-26T00:32:29.399 - 2 plots were eligible for farming 294794196b... Found 0 proofs. Time: 241.51505 s. 22 plots
2021-04-26T00:32:29.400 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 328.21167 s. 22 plots
2021-04-26T00:32:29.400 - 1 plots were eligible for farming 294794196b... Found 0 proofs. Time: 270.82610 s. 22 plots
2021-04-26T00:32:29.546 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.13648 s. 22 plots
2021-04-26T00:32:29.740 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09727 s. 22 plots
2021-04-26T00:32:29.837 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09602 s. 22 plots
2021-04-26T00:32:29.933 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09502 s. 22 plots
2021-04-26T00:32:30.031 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09702 s. 22 plots
2021-04-26T00:32:30.128 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09702 s. 22 plots
2021-04-26T00:32:30.232 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10319 s. 22 plots
2021-04-26T00:32:30.233 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.39614 s. 22 plots
2021-04-26T00:32:30.233 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.19308 s. 22 plots
2021-04-26T00:32:30.234 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.48843 s. 22 plots
2021-04-26T00:32:30.234 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 10.67842 s. 22 plots
2021-04-26T00:32:30.235 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 9.98731 s. 22 plots
2021-04-26T00:32:30.236 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.58945 s. 22 plots
2021-04-26T00:32:30.236 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.81072 s. 22 plots
2021-04-26T00:32:30.237 - 2 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 11.90580 s. 22 plots
2021-04-26T00:32:30.246 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 2.53322 s. 22 plots
2021-04-26T00:32:30.276 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.72974 s. 22 plots
2021-04-26T00:32:35.073 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09763 s. 22 plots
2021-04-26T00:32:46.797 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.21905 s. 24 plots
2021-04-26T00:32:55.130 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.12603 s. 24 plots
2021-04-26T00:33:03.399 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.11253 s. 24 plots
2021-04-26T00:33:13.458 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.24005 s. 24 plots
2021-04-26T00:33:22.057 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10302 s. 24 plots
2021-04-26T00:33:30.466 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10153 s. 24 plots
2021-04-26T00:33:40.607 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.12103 s. 24 plots
2021-04-26T00:33:52.144 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.47398 s. 24 plots
2021-04-26T00:33:58.975 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10153 s. 24 plots
2021-04-26T00:34:06.337 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10102 s. 24 plots
2021-04-26T00:34:17.390 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.13510 s. 24 plots
2021-04-26T00:34:27.410 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09965 s. 24 plots
2021-04-26T00:34:37.175 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.10102 s. 24 plots
2021-04-26T00:34:46.214 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.09004 s. 24 plots
2021-04-26T00:34:55.570 - 1 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.17755 s. 24 plots
2021-04-26T00:35:02.399 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.03401 s. 24 plots
2021-04-26T00:35:12.355 - 0 plots were eligible for farming 3404067bef... Found 0 proofs. Time: 0.11503 s. 24 plots
2021-04-26T00:35:37.548 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 2.68874 s. 24 plots
2021-04-26T00:35:42.574 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.10764 s. 24 plots
2021-04-26T00:35:50.960 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.10769 s. 24 plots
2021-04-26T00:36:00.564 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.31466 s. 24 plots
2021-04-26T00:36:08.957 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.31836 s. 24 plots
2021-04-26T00:36:19.921 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.11903 s. 24 plots
2021-04-26T00:36:35.322 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 2.44832 s. 24 plots
2021-04-26T00:36:41.841 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.12303 s. 24 plots
2021-04-26T00:36:52.299 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.20945 s. 24 plots
2021-04-26T00:36:59.525 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.28439 s. 24 plots
2021-04-26T00:37:07.578 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.04175 s. 24 plots
2021-04-26T00:37:15.419 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.12523 s. 24 plots
2021-04-26T00:37:25.228 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.24605 s. 24 plots
2021-04-26T00:37:32.422 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.09502 s. 24 plots
2021-04-26T00:37:41.390 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.27772 s. 24 plots
2021-04-26T00:37:50.348 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.14903 s. 24 plots
2021-04-26T00:37:59.946 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.11352 s. 24 plots
2021-04-26T00:38:08.713 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.10502 s. 24 plots
2021-04-26T00:38:17.792 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.13503 s. 24 plots
2021-04-26T00:38:29.621 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.10354 s. 24 plots
2021-04-26T00:38:37.131 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.09829 s. 24 plots
2021-04-26T00:38:49.307 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.11903 s. 24 plots
2021-04-26T00:39:05.010 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 2.48289 s. 24 plots
2021-04-26T00:39:20.670 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 4.45086 s. 24 plots
2021-04-26T00:39:35.696 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 11.12075 s. 24 plots
2021-04-26T00:39:49.094 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 13.39567 s. 24 plots
2021-04-26T00:40:00.811 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 10.70149 s. 24 plots
2021-04-26T00:40:12.669 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 10.84244 s. 24 plots
2021-04-26T00:40:12.826 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.15304 s. 24 plots
2021-04-26T00:40:13.767 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.94121 s. 24 plots
2021-04-26T00:40:25.549 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 6.13759 s. 24 plots
2021-04-26T00:40:35.044 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 6.94259 s. 24 plots
2021-04-26T00:40:42.367 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 6.63185 s. 24 plots
2021-04-26T00:41:03.269 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 7.62677 s. 24 plots
2021-04-26T00:41:03.271 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 18.52764 s. 24 plots
2021-04-26T00:41:05.595 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.30357 s. 24 plots
2021-04-26T00:41:21.330 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 9.68639 s. 24 plots
2021-04-26T00:41:33.682 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 10.34139 s. 24 plots
2021-04-26T00:41:45.941 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 11.24087 s. 24 plots
2021-04-26T00:42:06.661 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 11.07166 s. 24 plots
2021-04-26T00:42:06.662 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 19.70617 s. 24 plots
2021-04-26T00:42:13.086 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 6.42099 s. 24 plots
2021-04-26T00:42:27.492 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 14.40315 s. 24 plots
2021-04-26T00:42:37.878 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 9.37790 s. 24 plots
2021-04-26T00:42:43.874 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 5.99615 s. 24 plots
2021-04-26T00:43:08.800 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 13.35911 s. 24 plots
2021-04-26T00:43:23.405 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 8.07813 s. 24 plots
2021-04-26T00:43:23.413 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 37.52732 s. 24 plots
2021-04-26T00:43:35.484 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 12.06850 s. 24 plots
2021-04-26T00:43:45.744 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 10.25884 s. 24 plots
2021-04-26T00:43:46.755 - 2 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 37.95093 s. 24 plots
2021-04-26T00:44:04.920 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 8.53386 s. 24 plots
2021-04-26T00:44:15.434 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 10.51356 s. 24 plots
2021-04-26T00:44:25.878 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 39.12007 s. 24 plots
2021-04-26T00:44:53.560 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 38.12616 s. 24 plots
2021-04-26T00:45:14.387 - 2 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 48.50676 s. 24 plots
2021-04-26T00:45:14.387 - 2 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 42.30431 s. 24 plots
2021-04-26T00:45:14.387 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 32.90537 s. 24 plots
2021-04-26T00:45:14.544 - 0 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.14172 s. 24 plots
2021-04-26T00:45:14.684 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 20.11833 s. 24 plots
2021-04-26T00:45:14.801 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 13.07294 s. 24 plots
2021-04-26T00:45:15.141 - 2 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 0.59749 s. 24 plots
2021-04-26T00:45:15.224 - 1 plots were eligible for farming 4f2b16c867... Found 0 proofs. Time: 1.29859 s. 24 plots
2021-04-26T00:45:32.804 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 11.45688 s. 24 plots
2021-04-26T00:45:42.831 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 9.01052 s. 24 plots
2021-04-26T00:45:49.788 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 5.95301 s. 24 plots
2021-04-26T00:45:50.922 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10938 s. 24 plots
2021-04-26T00:45:59.123 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09753 s. 24 plots
2021-04-26T00:46:08.905 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10302 s. 24 plots
2021-04-26T00:46:17.023 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09966 s. 24 plots
2021-04-26T00:46:26.121 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09553 s. 24 plots
2021-04-26T00:46:35.344 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09824 s. 24 plots
2021-04-26T00:46:41.963 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09718 s. 24 plots
2021-04-26T00:46:50.265 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11478 s. 24 plots
2021-04-26T00:46:59.317 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11154 s. 24 plots
2021-04-26T00:47:10.790 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11403 s. 24 plots
2021-04-26T00:47:23.483 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.18669 s. 25 plots
2021-04-26T00:48:05.756 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11103 s. 25 plots
2021-04-26T00:48:14.542 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09803 s. 25 plots
2021-04-26T00:48:22.767 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.08444 s. 25 plots
2021-04-26T00:48:31.092 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09829 s. 25 plots
2021-04-26T00:48:41.893 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11903 s. 25 plots
2021-04-26T00:48:52.453 - 2 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.57964 s. 25 plots
2021-04-26T00:48:59.853 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.24053 s. 25 plots
2021-04-26T00:49:11.363 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10340 s. 25 plots
2021-04-26T00:49:18.007 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.08956 s. 25 plots
2021-04-26T00:49:28.334 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.15626 s. 25 plots
2021-04-26T00:49:38.789 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11874 s. 25 plots
2021-04-26T00:49:48.728 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09893 s. 25 plots
2021-04-26T00:49:57.764 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.18734 s. 25 plots
2021-04-26T00:50:06.848 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10240 s. 25 plots
2021-04-26T00:50:16.082 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10005 s. 25 plots
2021-04-26T00:50:26.468 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11795 s. 25 plots
2021-04-26T00:50:37.264 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11493 s. 25 plots
2021-04-26T00:50:44.876 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10301 s. 25 plots
2021-04-26T00:50:52.971 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10938 s. 25 plots
2021-04-26T00:51:02.687 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09796 s. 25 plots
2021-04-26T00:51:11.088 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10895 s. 25 plots
2021-04-26T00:51:21.692 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10486 s. 25 plots
2021-04-26T00:51:31.857 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.15007 s. 25 plots
2021-04-26T00:51:44.102 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.31414 s. 25 plots
2021-04-26T00:51:52.865 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10753 s. 25 plots
2021-04-26T00:52:01.077 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.27576 s. 25 plots
2021-04-26T00:52:10.995 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11044 s. 25 plots
2021-04-26T00:52:19.420 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.08338 s. 25 plots
2021-04-26T00:52:28.154 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.15592 s. 25 plots
2021-04-26T00:52:38.925 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.12805 s. 25 plots
2021-04-26T00:52:47.303 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10336 s. 25 plots
2021-04-26T00:52:55.516 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10246 s. 25 plots
2021-04-26T00:53:05.282 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.11438 s. 25 plots
2021-04-26T00:53:13.275 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10621 s. 25 plots
2021-04-26T00:53:25.942 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.16104 s. 25 plots
2021-04-26T00:53:34.079 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.14143 s. 25 plots
2021-04-26T00:53:42.684 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.03271 s. 25 plots
2021-04-26T00:53:52.135 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.12750 s. 25 plots
2021-04-26T00:54:06.614 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 2.42474 s. 25 plots
2021-04-26T00:54:12.675 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10353 s. 25 plots
2021-04-26T00:54:26.408 - 1 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.14197 s. 25 plots
2021-04-26T00:54:35.404 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10442 s. 25 plots
2021-04-26T00:54:44.334 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.12705 s. 25 plots
2021-04-26T00:54:52.350 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.10838 s. 25 plots
2021-04-26T00:55:00.585 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.08492 s. 25 plots
2021-04-26T00:55:11.216 - 2 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.41879 s. 25 plots
2021-04-26T00:55:19.842 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.09857 s. 25 plots
2021-04-26T00:55:28.789 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.08817 s. 25 plots
2021-04-26T00:55:37.808 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.14977 s. 25 plots
2021-04-26T00:55:46.460 - 0 plots were eligible for farming 8d6fd7b446... Found 0 proofs. Time: 0.02805 s. 25 plots
2021-04-26T00:55:56.035 - 0 plots were eligible for farming b21aafc132... Found 0 proofs. Time: 0.11453 s. 25 plots
2021-04-26T00:56:04.210 - 0 plots were eligible for farming b21aafc132... Found 0 proofs. Time: 0.11470 s. 25 plots
2021-04-26T00:56:12.151 - 0 plots were eligible for farming b21aafc132... Found 0 proofs. Time: 0.10702 s. 25 plots
2021-04-26T00:56:21.629 - 0 plots were eligible for farming b21aafc132... Found 0 proofs. Time: 0.09804 s. 25 plots
Not sure yet if those timings are due to writing to the disk or transferring over the network
Next time I’m in phase 4 of a plot and see higher farming times I’m going to try something like this on the plotting machine currently in phase 4:
# Give any chia plotting process a lower priority
sudo ionice -c2 -n1 -p `pidof chia`
# Give any sshd processes the highest priority
sudo ionice -c2 -n0 -p `pidof sshd`
Will report back if it fixes it. First time using ionice but I guess this would only work for the current plotting jobs and open ssh connections from the main node, so apart from just running this on a schedule not sure about the best practices here.
I was able to skim the thread. What NAS, what drives, what data protection. Was there an initialization event or background scrub happening? I’ve also seen many timeout issues over NFS. Harvester protocol is much preferred to network storage.
Obviously if your NAS doesn’t support that (it’d have to support ssh access to the linux OS to install and configure chia directly on the device) it’s a no-go!
right now it sounds like you have a main farmer that is also acting as your harvester for all plots across a series of NAS. The harvester protocol is actually very clever, the farmer sends the challenge to the remote harvesters (lightweight code that can be ran in docker image on NAS), the harvester only responds when it has a proof and the farmer then signs it to get the block reward. This eliminates almost all intra network traffic which doesn’t scale well with hundreds of TB to PB.
