I have Raspberry Pi 4 with 24 HDD problems HDD not showing up

Chia Farming & Harvesting
1

Hi First I tried it with Rasbian 64 bit because of the 8gb ram. There are 2x 16tb USB hubs they are powered. Each HDD has also an extra power supply. about 18HDD work fine at the pi if I want to connect more it dont work.

Than the disks dissapear and I need to reboot otherwise they wont get recognized.

Here comes the funny part with my normal PC it works fine I connect the 2 USB hubs and it works. WTF

Than I tired winShit11 on the raspberry than some drives are showing up some dont but atleast I dont need to reboot to try if they are connecting.

Please does someone know why they are disconnecting? from the pi or why does this setup cant work? but on normal motherboard it does and that is driving me crazy.

I tried USB 3 Ports and Also only using the USB2 ports same result.

Im so desperate I have this since weeks and I tried so many things I cant figure it out. please please help if someone knows something. What can i Do

And no the heater in the abck of the picture is not on xD. They have all normal temperatures. xD

IMG_20220113_191503
IMG_20220113_1915031920×1440 183 KB

1 Like
2
3

I’ve had an occasional issue on my PI 4 harvester where connecting a new drive to the hub causes all the already connected devices to disconnect and haven’t figured out why. What I do is connected everything up but use the individual buttons on the hub to switch off all the ports, then turn them on one by one giving each drive a chance to spin up and connect. It all works fine when I do that, sometimes it all works just fine without having to do that though. The hubs themselves count as 4-5 USB devices each so you’re already going to be 8-10 down on the total of 32. My PC USB chipset supports up to 64 USB devices so that could well be why the same setup works on your PC.

4

I found this link that explains USB devices and hubs etc:

https://acroname.com/blog/how-many-usb-devices-can-i-connect

1 Like
5

Check out this page
How many external HDDs can you have in a Raspberry Pi 4 8gb? - Chia Farming & Harvesting - Chia Forum

member kreaninw is working on your same issue, maybe you can swap ideas…

6

Hi,

It’s nothing strange that your pi cant handel as many USB connections a s your desktop. Also I’m going to write a bigger post on Pi harvesting but here is the low down.

  1. You can connect 24 HDDs to a pi 4 through the regular USB ports if you only use USB 2, you can use the USB 3 ports but make sure your using a USB 2 cable to force your hubs to act like USB 2 hubs. This is because USB 3 uses more connectors than than USB 2. You can test this by just connecting one of your 16 port hubs (empty) and running the lsusb | wc -l command once on the USB 3 port and then on the USB 2.
  2. You can get a number of extra USB connections (maybe 24 HDDs) if you use POE to power your pi and convert the usb-c port to a regular usb connection. But that comes with having to buy a hat plus a special switch and so on, so you do the math if its worth it for you.
  3. I have 3 PIs with 24 hdds and running ubuntu on them and it happen on all of them that I sometimes after boot dont see any USB connections at all, sometimes I have to reboot several times before the USB ports start working. Since this is happening on all of them I’m guessing its a result of pushing the PIs USB capabillites.
2 Likes
7

This is why many of us with more than 12 or so external drives have abandoned PI’s in favor of SFF PC’s. For about the same price, you can get an i5 with 8GB RAM, 128gb SSD, WiFi, BT, and Ethernet, with none of the headaches. PI’s are great, just not great for farming with a lot of USB drives. Great for someone with a handful of drives set up as a remote harvester. PI’s have had problems weathering dust storms running as full nodes. See the thread linked above for a rundown of all of the issues we’ve experienced.

1 Like
8

Thanks you all for your ideas. would be awesome if something would work. Still nothing is working -.-
does someone have stuff that works. ive also read about usb limit break raspberry and stuff but does this work? now even on ymy main mainboard with 24 drives it sometimes disconnects. I really dont get it why.

9

I wish these drive would cost under $2000.00

Nimbus Data shares pricing for its 50TB and 100TB ExaDrive SSDs - Storage - News - HEXUS.net

10

I recently went through exactly this building a remote harvester. The Raspberry Pi 4 is limited to 32 USB devices and I was never able to get more than 16 drives to connect using USB 3 and 20 using the USB 2 ports. I did manage to get 20 drives to be recognized if I used USB 2, but was nervous at the lack of interface speed so I wound up leaving only 16 drives on USB 3 and moved the rest to another Pi.

Here’s what I found…

I use a 16 port USB hub. This presents itself as 4 X 4 port USB hubs. Right off the bat I’ve lost 4 of 32 devices. When connected via USB 3.0, the system also adds 4 more USB 2.0 devices to the system, leaving at most 24 devices. But the Pi creates 3 root hub devices (USB2, USB3, and a Via Hub for Ethernet), all of which count against that total, leaving a maximum of 21 addresses open.

When I plugged in my second 16 port hub, only half of the ports were recognized. The Pi created 2 USB 3.0 hubs and 2 USB 2.0 hubs, but nothing I plugged into any USB port on it or the Pi was recognized. There were simply too many USB devices.

I suspect possibly using a better USB hub might have been an option. I have 2 different 16 port hubs and all show as 4 X 4 port hubs when connected. I suspect that may be common.

So in short, you should be able to get 16 drives to mount using USB 3.0, or as many as 24 drives if using USB 2.0.

11

Lookup time is not really affected by USB 2 vs 3. So if your only farming and not transferring plots to the drive you can use the usb 2, trust me.

12

With some luck when they release the Raspberry PI-5 the USB problems will go away…

13

As others mentioned, RP4 is limited to 32 devices on USB3 and some infernal devices already use up some of these. If you monitor kernel or syslog you will see the disconnects and can trace down the problem. You could safely use USB2 which will work just fine for harvesting and USB3 you will likely need to use for SSD HDD if you are planning to use it as a full node as MMC will not be fast enough. USB-C can be converted to additional USB3 port but then you have to power the pi via POE or pins directly. Lastly there is a known issue with power leak from powered hubs and you maybe running in to that. To work around the power leak just putt a little 4 port non-powered hub between RPI and the 16 port powered hub. Honestly the best option is to use 20 or less HDDs per RPi and simply stack them up as multiple harvesters :wink:

14

image
image1454×996 157 KB

15

nothing works, all drives got unmounted and than this in the error log but what it means and how to solve:
</>Feb 11 17:54:02 raspberrypi kernel: [ 640.987378] sd 0:0:0:0: [sda] tag#12 CDB: opcode=0x85 85 06 20 00 00 00 00 00 00 00 00 00 00 00 e5 00
Feb 11 17:54:02 raspberrypi kernel: [ 640.999346] xhci_hcd 0000:01:00.0: xHCI host not responding to stop endpoint command.
Feb 11 17:54:02 raspberrypi kernel: [ 640.999355] xhci_hcd 0000:01:00.0: USBSTS: HSE EINT
Feb 11 17:54:02 raspberrypi kernel: [ 641.031364] xhci_hcd 0000:01:00.0: Host halt failed, -110
Feb 11 17:54:02 raspberrypi kernel: [ 641.031368] xhci_hcd 0000:01:00.0: xHCI host controller not responding, assume dead
Feb 11 17:54:02 raspberrypi kernel: [ 641.031667] xhci_hcd 0000:01:00.0: HC died; cleaning up
Feb 11 17:54:02 raspberrypi kernel: [ 641.031840] usb 1-1: USB disconnect, device number 2
Feb 11 17:54:02 raspberrypi kernel: [ 641.031852] usb 1-1.2: USB disconnect, device number 3
Feb 11 17:54:02 raspberrypi kernel: [ 641.031859] usb 1-1.2.1: USB disconnect, device number 4
Feb 11 17:54:02 raspberrypi kernel: [ 641.032306] usb 2-2: USB disconnect, device number 2
Feb 11 17:54:02 raspberrypi kernel: [ 641.032319] usb 2-2.1: USB disconnect, device number 4
Feb 11 17:54:02 raspberrypi kernel: [ 641.032326] usb 2-2.1.1: USB disconnect, device number 7
Feb 11 17:54:02 raspberrypi kernel: [ 641.034413] usb 1-1.2.2: USB disconnect, device number 5
Feb 11 17:54:02 raspberrypi kernel: [ 641.036893] usb 1-1.2.3: USB disconnect, device number 6
Feb 11 17:54:02 raspberrypi kernel: [ 641.036912] usb 1-1.2.3.3: USB disconnect, device number 8
Feb 11 17:54:02 raspberrypi kernel: [ 641.045156] sd 0:0:0:0: [sda] Synchronizing SCSI cache
Feb 11 17:54:02 raspberrypi kernel: [ 641.046575] sd 10:0:0:0: [sdk] Synchronizing SCSI cache
Feb 11 17:54:02 raspberrypi kernel: [ 641.059635] scsi host12: uas_eh_device_reset_handler FAILED to get lock err -19
Feb 11 17:54:02 raspberrypi kernel: [ 641.059669] scsi 12:0:0:0: Device offlined - not ready after error recovery
Feb 11 17:54:02 raspberrypi kernel: [ 641.299551] sd 0:0:0:0: [sda] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:02 raspberrypi kernel: [ 641.299612] sd 10:0:0:0: [sdk] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:02 raspberrypi kernel: [ 641.367666] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x81, streams are being disabled already
Feb 11 17:54:02 raspberrypi kernel: [ 641.394214] usb 2-2.1.2: USB disconnect, device number 12
Feb 11 17:54:02 raspberrypi kernel: [ 641.400174] sd 1:0:0:0: [sdb] Synchronizing SCSI cache
Feb 11 17:54:02 raspberrypi kernel: [ 641.413515] usb 1-1.2.4: USB disconnect, device number 7
Feb 11 17:54:03 raspberrypi kernel: [ 641.655390] sd 1:0:0:0: [sdb] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:03 raspberrypi kernel: [ 641.675925] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x81, streams are being disabled already
Feb 11 17:54:03 raspberrypi kernel: [ 641.686938] usb 2-2.1.3: USB disconnect, device number 13
Feb 11 17:54:03 raspberrypi kernel: [ 641.728405] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:03 raspberrypi kernel: [ 641.737684] usb 2-2.1.4: USB disconnect, device number 14
Feb 11 17:54:03 raspberrypi kernel: [ 641.762407] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:03 raspberrypi kernel: [ 641.771295] usb 2-2.2: USB disconnect, device number 6
Feb 11 17:54:03 raspberrypi kernel: [ 641.771310] usb 2-2.2.1: USB disconnect, device number 15
Feb 11 17:54:03 raspberrypi kernel: [ 641.776663] sd 4:0:0:0: [sde] Synchronizing SCSI cache
Feb 11 17:54:03 raspberrypi kernel: [ 642.015391] sd 4:0:0:0: [sde] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:03 raspberrypi kernel: [ 642.039900] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x81, streams are being disabled already
Feb 11 17:54:03 raspberrypi kernel: [ 642.046355] usb 2-2.2.2: USB disconnect, device number 16
Feb 11 17:54:03 raspberrypi kernel: [ 642.053404] sd 5:0:0:0: [sdf] Synchronizing SCSI cache
Feb 11 17:54:03 raspberrypi kernel: [ 642.291400] sd 5:0:0:0: [sdf] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:03 raspberrypi kernel: [ 642.312630] usb 2-2.2.3: USB disconnect, device number 17
Feb 11 17:54:03 raspberrypi kernel: [ 642.314516] sd 6:0:0:0: [sdg] Synchronizing SCSI cache
Feb 11 17:54:04 raspberrypi kernel: [ 642.559491] sd 6:0:0:0: [sdg] Synchronize Cache(10) failed: Result: hostbyte=0x07 driverbyte=0x00
Feb 11 17:54:04 raspberrypi kernel: [ 642.587943] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x81, streams are being disabled already
Feb 11 17:54:04 raspberrypi kernel: [ 642.599513] usb 2-2.2.4: USB disconnect, device number 18
Feb 11 17:54:04 raspberrypi kernel: [ 642.633159] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:04 raspberrypi kernel: [ 642.644580] usb 2-2.3: USB disconnect, device number 9
Feb 11 17:54:04 raspberrypi kernel: [ 642.644598] usb 2-2.3.1: USB disconnect, device number 19
Feb 11 17:54:04 raspberrypi kernel: [ 642.686771] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:04 raspberrypi kernel: [ 642.690108] usb 2-2.3.2: USB disconnect, device number 20
Feb 11 17:54:04 raspberrypi kernel: [ 642.740211] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:04 raspberrypi kernel: [ 642.742874] usb 2-2.3.4: USB disconnect, device number 21
Feb 11 17:54:04 raspberrypi kernel: [ 642.792310] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:04 raspberrypi kernel: [ 642.796873] usb 2-2.4: USB disconnect, device number 11
Feb 11 17:54:04 raspberrypi kernel: [ 642.796889] usb 2-2.4.2: USB disconnect, device number 30
Feb 11 17:54:04 raspberrypi kernel: [ 642.830954] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:55:46 raspberrypi kernel: [ 744.718922] v3d fec00000.v3d: MMU error from client CLE (4) at 0x1f61000, pte invalid
g

Feb 11 17:54:04 raspberrypi systemd[616]: media-pi-Seagate\x20Expansion\x20Drive4.mount: Succeeded.
Feb 11 17:54:04 raspberrypi systemd[1]: media-pi-Seagate\x20Expansion\x20Drive4.mount: Succeeded.
Feb 11 17:54:04 raspberrypi ntfs-3g[1920]: Unmounting /dev/sdj2 (Seagate Expansion Drive)
Feb 11 17:54:04 raspberrypi ntfs-3g[1920]: Failed to sync device /dev/sdj2: Eingabe-/Ausgabefehler
Feb 11 17:54:04 raspberrypi ntfs-3g[1920]: Failed to close volume /dev/sdj2: Eingabe-/Ausgabefehler
Feb 11 17:54:04 raspberrypi kernel: [ 642.830954] xhci_hcd 0000:01:00.0: WARN Can’t disable streams for endpoint 0x82, streams are being disabled already
Feb 11 17:54:04 raspberrypi udisksd[438]: Cleaning up mount point /media/pi/Seagate Expansion Drive5 (device 8:178 no longer exists)
</>

16

Something diffrent, you have your rig next to a heater not so smart I guess.

17

To the OP, one of my raspberry pi harvesters started having a similar issue after running fine for several months. I was getting drives randomly disconnecting and the kernel log full of errors relating to the usb bus. I swapped out the 10 port hub with another, tried the usb2 ports instead of usb3 plus loads of other things and nothing helped. Eventually did a fresh install of Raspberry PI OS 64bit on a brand new SD card and the problem seems to have gone! I’m wondering if that’s something you’ve tried?

18

It might be that your Sd card is being burned up, worn out. Can you setup a SSD to boot from on the PI?

19

I looks like that was the issue for me. The card i had been using wasn’t new and just came out of my drawer of spares so could well have been in a dashcam or other project in the past! Lesson learnt for me as sd cards are cheap enough to replace with new .

20

Here’s something to look at.
How to Boot Raspberry Pi 4 / 400 From a USB SSD or Flash Drive | Tom’s Hardware (tomshardware.com)

1 Like