Think of this as a very expensive/intensive plugin to build and maintain. For whomever accepts the challenge, they'll be rewarded with months of work and little financial reward. If you want something like this then the best way is to offer someone money to build it otherwise, it's not likely going to happen.
I can say from experience that 3D rendering and the involved libraries and subsystems on Raspbian/Debian/Linux are problematic and subject to breaking with every major release of the operating system. They're pretty much guaranteed to require hardware acceleration from the GPU and tweaks to the RAM ratio between CPU/GPU. It's going to be a headache for anyone who takes this on.