For all of you facing the undervoltage issues:
I tried a lot of different power supplies, disconnected all peripherals etc to no avail.
In the end the culprit were neither power supply, cable, or peripherals, but simply my raspberry was overclocked!
Just curious if overclock is set on by default. Were you using the default octoprint image? I have this issue of undervoltage as well. I'm going to check rasp config when I get home. Thanks for the idea!