After another reboot it randomly decided to work again.

Time to move all this crap to FreeBSD, fighting weird Linux bugs is such a waste of my energy sometimes.