Be able to add an overlay (a webcam feed with greenscreen processing) to an existing VR capable flight simulator so that the user can see their physical controls and the sim utilizing green screen tech.
I need a way to run a flight simulator (XPlane, MSFSX, etc) within Unreal Engine 4. Any advice/direction is greatly appreciated. Also a solution that doesn't involve using Unreal is also valid, but I prefer to stick with Unreal.
What I Have So Far
I currently have a way to display a webcam stream on a plane surface in Unreal with the green screen processing occurring in a blueprint.
Ideas/Examples That I Would Need Advice On
-Running the flight simulator directly
-Running the simulator on a monitor and using some form of screen cast software to send to Unreal
-Using an existing free flight simulator UE4 project (not prefered)