How do display visuals of one player on multiple monitors, while using Unreal Engine and MATLAB Simulink to start the program?

Question

Kaitlyn Woolf 2023-8-31

0
链接

此问题的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2015591-how-do-display-visuals-of-one-player-on-multiple-monitors-while-using-unreal-engine-and-matlab-simu

回答： MathWorks Support Team 2023-10-12

I am using MATLAB R2021b and Unreal Engine. How can I split the visuals of a single person driving in a driving simulator, which operates on Unreal Engine, and display them on two screens?

3 个评论
显示 1更早的评论隐藏 1更早的评论

Kaitlyn Woolf 2023-8-31

Hi Nishan,

I wish to show some parts of the scene in one window and other parts on a different window.

I want to take the real-time scenes of a single driver and display them across multiple (two) monitor screens.

The purpose of this is that eventually I want to use multiple projectors to project the scene on a curved projection screen, and this seems like it is a good initial step, considering it does not involve edgeblending and etc.

Kaitlyn Woolf 2023-8-31

Excuse me

I wish to show some parts of the scene on one monitor and other parts on a different monitor.

请先登录，再进行评论。

请先登录，再回答此问题。

Answer 1

MathWorks Support Team 2023-10-12

0
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2015591-how-do-display-visuals-of-one-player-on-multiple-monitors-while-using-unreal-engine-and-matlab-simu#answer_1331784

在 MATLAB Online 中打开

To display visuals of a single person driving on multiple monitors using MATLAB R2021b and Unreal Engine you can use one of the following two workflows:

Using the Simulink 3D Animation Toolbox:

You can do this by placing two "Simulation 3D Camera" blocks in your Simulink model and adjust the parameters so that they cover the parts of the scene that you desire. To visualize the camera images that are output by the "Image" port of that block, use a "Video Viewer" or a "To Video Display" block. This will open the view from each camera in a separate window.

Using the Image Processing Toolbox and the Image Acquisition Toolbox:

You can do this by following the steps below:

Set up the driving simulation in Unreal Engine and ensure it is working correctly with a single screen.
Use the MATLAB Simulink Integration with Unreal Engine to capture the rendered frames. You can use the "From Video Device" block in the "Image Acquisition Toolbox" library to capture the frames as an input signal.
Display each stream on its respective screen using the "imshow" function. Use the "ScreenNumber" Name-Value pair to specify the monitor where you want each stream to be displayed (0 represents the primary monitor and higher numbers represent additional monitors).

The following code will display the driving simulation visual on two screens:

Please note that this code example assumes two screens connected to the primary computer, and that each half needs to be displayed on a separate screen.

% Capture frames from Unreal Engine using Simulink
videoInput = Simulink.Signal;
videoInput.DataType = 'uint8';
videoInput.SampleTime = -1;
videoInput.Complexity = 'real';
videoInput.Name = 'VideoInput';
% Split the frames into two halves
frameWidth = size(videoInput, 2);
halfWidth = frameWidth / 2;
leftHalf = videoInput(:, 1:halfWidth);
rightHalf = videoInput(:, halfWidth+1:end);
% Display each half on its respective screen
figure('Position', [0 0 halfWidth size(videoInput, 1)]);
imshow(leftHalf, 'InitialMagnification', 'fit', 'Border', 'tight', 'ScreenNumber', 1);
figure('Position', [halfWidth 0 halfWidth size(videoInput, 1)]);
imshow(rightHalf, 'InitialMagnification', 'fit', 'Border', 'tight', 'ScreenNumber', 2);

For a different monitor configuration or to split the visuals in a different way, the code can be modified accordingly.

0 个评论
显示 -2更早的评论隐藏 -2更早的评论

请先登录，再进行评论。

Answer 2

Nishan Nekoo 2023-9-5

1
链接

此回答的直接链接

https://ww2.mathworks.cn/matlabcentral/answers/2015591-how-do-display-visuals-of-one-player-on-multiple-monitors-while-using-unreal-engine-and-matlab-simu#answer_1302146

Kaitlyn, one way to do this might be to place two Simulation 3D Camera blocks in your Simulink model and adjust the parameters so that they cover the parts of the scene that you desire.

To visualize the camera images that are output by the Image port of that block, use a Video Viewer or To Video Display block. This will open the view from each camera in a separate window.