Feature request: Rendering forground and background in seperate passes for mixed reality videos

[MartinSStewart]

I'd like to record myself playing inside beat saber (like this https://www.youtube.com/watch?v=gV1sw4lfwFw) without having to set up PCVR and rely on a wired/wireless connection to my PC.

In order to do that, the foreground (everything closer to the 3rd person camera than the player's headset) and the background (everything farther away from the 3rd person camera than the player's headset) need to be rendered as two separate videos so that the player can display a green screened video of themselves as a layer in between. Without these two layers, anything in the foreground will appear behind the player.

Additionally the foreground video would need to preserve its alpha channel in order for things to look correct. For example, if a wall is between the player and the camera, they should still be somewhat visible through the partially transparent wall.

I'm guessing the odds of this being implemented are low but alternatively maybe someone could point me to some other mod that makes this possible (without requiring PCVR)?

[Metalit]

There's not currently a way to do this on quest, and it would be pretty hard to implement in replay, as you've guessed. In addition to the completely new instrumentation that would be required to connect to a green screen camera (and also actually perform the green screen effect), the surprisingly annoying process of combining the audio and video would also need to be expanded to layer the 3 videos on top of each other. The actual ingame camera setup shouldn't be too unreasonable, but it would be pretty much impossible to have it work with distortion effects like shockwaves or PC-style walls.
If you're willing to do some more work for it, I could probably hide a few settings in the config file that would produce the two separate videos with the correct cutoff and transparency, which you could then put into some editing software and manually layer and sync up with separate green screen footage. Anything more than that is off the table unless I get a lot more requests for the feature.

[MartinSStewart]

Sorry, I wasn't clear in my request. I'm not expecting the green screen video to get uploaded to the headset. Instead your replay tool would generate a foreground and background pass and I would manually combined them with my green screen video in Blender.

If you're willing to do some more work for it, I could probably hide a few settings in the config file that would produce the two separate videos with the correct cutoff and transparency, which you could then put into some editing software and manually layer and sync up with separate green screen footage. Anything more than that is off the table unless I get a lot more requests for the feature.

So in other words, this sounds perfect.