Turns out you where right after all.
At first updating the drivers seemed to work but then problems started to return.
Later I switched to a completely different farmer and still was showing problems.
After digging through event viever I managed to identify the offending disk. This was not as obvious as you want, but after a few looks it stood out. Removed it and now problems are gone completely. It was one of three 14tb expension desktops.
Weird thing is though that scandisk didnt find any problems with it. Crystal disk shows good health as well.
I am now replotting it after a format and will see if it wants to play ball again.