Scalable DIY SATA JBOD - Will store over 250 Disks!

What JBOD enclosure did you get?

Thanks for sharing. I’m looking forward to your bought-jbod solution!

1 Like

I’ll create a new thread with more detail but I’m using old Dell SC200’s. Got 9 of them full of 4tb drives for a little over $3000 shipped - less than $7/TB all in! I replaced about half of the drives with 18tb/16tb SATA drives and they work great. Plus they daisy-chain to each other so cabling is a piece of cake!

2 Likes

That is one heck of a deal. I wish I had access to USA markets :confused:

This thread is a treasure for farming gear information, thanks for keeping it up

2 Likes

Are you going to mod the servers for lower noise emissions? That’s a big issue I’m expecting with buying and running an actual chia server.

Take a look at that thread:

That farmer/harvester was a very strong/clean setup with locally attached 500TB disk space. For whatever reason, Chia node couldn’t handle that load. Changing to Flex fixed the problem. And no, that was not dust storm related.

I would assume that with that amount of disk space you will be doing self-pooling, as such may not have the same feedback as pools provide (e.g., everything looks cool locally, still no wins).

Still, it would be nice to see, how much you can push it.

They are definitely loud! I was running them in my laundry room, but I’ve already run out of space in my 27U rack so I had to get a full 42U rack for the garage (wouldn’t fit in laundry room). I also installed 2 more 240v plugs in my garage under the breaker box to run everything. So noise won’t be as big of an issue for me since they are out of my living space now.

1 Like

I’m not sure of the specifics of his setup or why he’d be having problems, but I’ve had no issues. I’m up to about 435tb in plots so far and adding another hundred or so a day. When I first set everything up and copied plots from drive to drive, I could get 8 file copies going at once, each with over 75MB/sec transfer. I’m using an old 8 lane 6gbps LSI SAS card in a Dell r720 with dual E5-2650’s, so 16 cores total. Only 64gb of RAM. I’m also running 8 forks alongside Chia. My lookup times are all sub-second. I’m actually looking at moving to an even older Dell r610 just because I think the r720 is overpowered for a farmer. The CPUs just twiddle their thumbs. :laughing:

Liveshot:

2 Likes

The power consumption for your mb+ is mostly CPU and SAS/SATA controllers. Everything else is kind of in the same ballpark across different platforms. Maybe one option would be to switch to E5-2650L v2? It is 10 cores processor, but with a lower clock, thus draws a tad less power.

2 Likes

Are you plotting with them too or just harvesting? Are you still trying to run Storj and/or other storage networks in parallel?

Have the Chia forks paid out so far?

Just full nodes/farming/harvesting, no plotting. Although I have 3 other plotters that are constantly transferring plots over the network - you’ll notice the network traffic in the screenshot above showing an incoming plot.

Yep, still running Storj as well! Screenshot taken while Storj running in background.

I haven’t traded or sold anything yet - everything just goes to cold wallets. The forks might not ever be worth anything but I figure I might as well farm them since I have plenty of spare CPU cycles…

That washer dryer hookup thou :sweat_smile:

1 Like

It’s impressive setup.

Can you guide me with something. Why are you running 16 vm for each forks ? I thought that we can run all the forks from single os setup or machine.

Yes, you certainly can run all forks from a single machine. Originally I was doing this for security - this was back when forks first came out and so I was concerned about running them on the same machine as my main farmer. I don’t run separate VMs anymore. Here are my latest updates: https://chiaforum.com/t/the-journey-to-one-petabyte/

Sorry to hijack or dig up this older thread, but I stumbled upon that discussion.

@enderTown since you have a lot of experience with those JMB585 Sata controllers on PCIe to Sata adaptors, as well as JMB575 1-to-5 Sata multiplier cards.

I recently bought the latter (ADP6ST0-J02 acc. to the PCB). I hooked it up to a (sacrificial :sweat_smile:) test system with just one old 500GB spare Sata drive at first to check whether it is working at all. I noticed right away that it got significantly hot to the touch. The tiny headspreader is glued on securely so I can’t easily check which chip is actually used. I assume JMB575. At least that’s what the box and description say.

Is it normal that those multipliers get that hot?
Did you hook them up via the 15 pin Sata connector or USB?

I then connected a secondary drive, but it wasn’t recognized in Windows. Any idea what I am doing wrong?

Thanks a lot in advance!

Those look to be the newer versions of the ones I have - mine don’t have SATA power connectors on them if you look at pics above and they also don’t have heat spreaders. I never noticed the chips getting very hot. I bet those newer versions are faster though!

As for the second drive not working, that usually means that your host SATA connection doesn’t support port multipliers. The first one is just passed through but the other 4 ports won’t work. Are you hooking it straight to the SATA ports on motherboard? Most motherboards don’t support PMs - you’ll need to get an add-in PCI card that supports them. See above for examples of those too!

2 Likes

Actually, some time ago, I purchased one such multiplier as well. My server (TYAN S5512 / Xeon e3-1220L v2 - yes, it is 2 cores only, as it is a harvester) was running Win 10 Pro, and as you stated just one port was functional. However, when I installed Linux on that box, all was fine - all ports started to work. So, maybe Linux is more forgiving, and compensates better than Windows.

1 Like

Hello @enderTown and Fellow miners!

Id have a question to those 12v to 5 volt converters:

10 Harddisks are connected in parallel to one 12->5v converter and to the 12 v of the psu.

At the same Time, the converters are connected in parallel to the psu. Is that correct?

Yep that’s right! :heavy_check_mark: :heavy_check_mark: :heavy_check_mark:

1 Like

Thank you for your reply! So I received a PCIe multiplier card or to be precise an m.2 to 5x SATA card, which uses the JMB585 chip, which supposedly supports FIS-based switching. If I connect the aforementioned port multiplier (JMB575 based) to it, Windows still will only recognize one drive.

What is odd. It seems to randomly pick one of the (currently) two drives connected for testing purposes.

Are there drivers needed for Windows?

EDIT:
Yes, but it is hard to get decent information from AliExpress vendors.
I did a lot of trial and error searching for JMB585 bridge drivers, as well as JMB575 pm drivers and found that for me using the following worked: 10 Port SATA III to PCIe 3.0 x1 NON-RAID Expansion Card

1 Like