In search of: Extremely Technical details of Quality and Proof checking

When using wasabi you should have an eye on your data usage. Outgoing traffic must be under your active storage. So for each TB stored you have one TB outgoing traffic. If you go above that limit your account will be suspended.

Does anyone know how much traffic is caused by farming a plot for one month? If it is above 100GB you have a problem. You have to take into account that s3fs and goofys transfer data in blocks, so even if you just request a single byte, much more data gets transferred.

Plotting is about $8 per TB, and cheapest S3 storage class is around $11.3 per TB per month(minimum 30 days) . The data retrieval and api requests don’t appear to be much(cost should be considerably less than storage cost) based on my observation of farming for the past a couple of hours.

However there are too many variables here, and I strongly recommend against using AWS for plotting and farming because there are many things that can go wrong and you may end up with a huge AWS bill. All things considered, I wish I hadn’t set it up on AWS and will be pleased even if it breaks even in the end…

I reckon that it might be profitable at beginning because public cloud offers you an opportunity to build something up at a larger scale than individuals. However given current network space and chia coin price, I don’t think it’s valid option anymore.

Good call out on the data usage. I’ve talked directly with Wasabi on this. Bandwidth used by goofys was acceptable, (~1Mbps per 50TB stored) - s3fs (at least in my configuration) was not (over 1Gbps per 50TB stored).

I ran another quality check on a set of plots on a SSD I’m shuttling around…

Proofs 95 / 100, 0.95
Proofs 86 / 100, 0.86
Proofs 106 / 100, 1.06
Proofs 94 / 100, 0.94
Proofs 122 / 100, 1.22
Proofs 98 / 100, 0.98
Proofs 98 / 100, 0.98
Proofs 71 / 100, 0.71
Proofs 96 / 100, 0.96
Proofs 118 / 100, 1.18
Proofs 105 / 100, 1.05
Proofs 102 / 100, 1.02
Proofs 100 / 100, 1.0
Proofs 97 / 100, 0.97
Proofs 100 / 100, 1.0
Proofs 119 / 100, 1.19
Proofs 104 / 100, 1.04
Proofs 89 / 100, 0.89
Proofs 109 / 100, 1.09
Proofs 86 / 100, 0.86
Proofs 102 / 100, 1.02
Proofs 95 / 100, 0.95
Proofs 104 / 100, 1.04
Proofs 89 / 100, 0.89
Proofs 88 / 100, 0.88
Proofs 86 / 100, 0.86
Proofs 108 / 100, 1.08
Proofs 79 / 100, 0.79
Proofs 89 / 100, 0.89
Proofs 91 / 100, 0.91
Proofs 91 / 100, 0.91
Proofs 104 / 100, 1.04
Proofs 102 / 100, 1.02
Proofs 98 / 100, 0.98
Proofs 105 / 100, 1.05
Proofs 80 / 100, 0.8

Nothing too stinky in there? I guess the 71/100 one? Let me run 200 checks on that one…

Proofs 168 / 200, 0.84

Or 400 checks?

Proofs 356 / 400, 0.89

:thinking:

Thanks for sharing. I have a question, how do you move your plots to wasabi? The bandwidth fee is expensive, right?

Got my cloud plots from http://chiaappliance.com/ they deliver to wasabi. Wasabi doesn’t charge bandwidth, only storage.

1 Like

Will wasabi really work for POS? Chia support said it will never work and don’t waste time/money testing it.

Have you successfully mined any XCH, chia support kept saying that it will not work.

I have problem doing direct plotting into wasabi, transfering of plots via goofys also failed at ~30%.

1 Like

Won’t mind providing the goofys binaries with a correctly optimized read ahead size for farming, im also currently trying to figure out the exact same issue.

Goofys usually reads up to 20mb for a random access, from debugging the fuse layer they actually been all lower than 192k bytes reads, but it’s still to slow
Even with a max of 250k chunk size

I’m using backblaze right now and havent been charged for more than 20mb bandwirh (which is nothing) in 24h
At 20 plots, so it may not be as bad as we I been thinking.

I’ve won 3 times in the cloud already. I didn’t upload my plots (@chiaappliance did :slight_smile: ), but I’ve moved large files to s3 before. I’d expect the s3-cli with multipart support to work just fine, and be able to resume if there’s network interruption.

how u do this? i even get failure on awscli :frowning:

so s3 object storage is definitely doable? chia support said NO NO NO…

is it under 28 secs? Amazon S3 or Wasabi?

99th percentile on the Raspberry Pi harvesting wassabi from my home internet is under 25 seconds. From Digital Ocean the 99th percentile is under 20 seconds. My last win was turned in in 26 seconds (And this was prior to my change to chiapos 1.0.3 which is even faster on proofs). It’s a real thing that’s really making XCH :slight_smile:

2 Likes

are you using DO?

what is this and how do i change?

chiapos was improved to read from the plot files concurrently, which can make a big difference in a networked setting where requests can be randomly delayed and/or potentially serviced by multiple backend hosts & disks.

1 Like

@luckidog Hi! I have my plots hosted on google drive, chia does recognize my plots, but the response times are very slow, could you please help me to fix it?

Our farmer will greatly decrease your lookup times if your interested. But you need NFT pool plots which probably means its not worth it.

Has flexpool.io implemented a own farmer in go?

Yes. I posted about it in this forum under Pools.