Immersive Video
Get Premiere Footage Ready (GoPro)
When shooting 360 videos there are several important steps along the way to making sure your footage is ready to edit in premiere.
First, You must make sure your go pro settings are correct. 360 video, 5.6k Resolution, 30 FPS.
If the camera is not already on 360, press the icon in the bottom left corner of the screen. This will change to 360 modes.
You are now set up to start recording some video, but you are not done yet. Once you have your footage, off of the go pro, it will be in a format called 360.
You will need to get the official GoPro Player and open your 360 files with it. Once open, Go to file Export As and select 4k.
You will then get the menu below. Again, the Resolution should be 4k. The Codec should be H.264. Finally, turn off World Lock and Horizon Level. Keeping this setting on will still footage spin.
You can Name and Save your video. It is now ready to be edited in premier pro.
Happy Filming!
Getting started with Unreal Live-Action Cinematics
This guide is a work in progress.
About
This guide provides an OVERVIEW of Unreal live-action cinematic video. Covered in this guide include tutorials to get familiar with Unreal, tools and hardware required, the checklist of operations, and an overview of the template project. To avoid confusion, this guide does not cover the capturing and exporting video from Unreal. Another guide will be posted.
This guide makes use of OpenXR systems but no one will be wearing the headset in a traditional sense.
Prerequisites
New to Unreal?
Checklist of items:
- Meta VR headset with Meta Link. Other headsets in theory could be used, but I found Meta Link behaves better when the headset goes to sleep. We will use an HMD because SteamVR requires one. Note: SteamVR will use the OpenXR runtime.
- SteamVR. This will be the default OpenXR runtime and will be what we used to capture the Canon DSLR movement.
- Vive Ultimate Trackers with the Vive HUB. A vive tracker will be mounted to the Canon DSLR to track its movement to Unreal.
- Canon DSLR Camera with a connection from mini HDMI to USB. For recording the live-action elements in front of a green screen.
- Unreal and the target set on the desktop shortcut (see below)
- Microphone for Unreal PC. To to help with scene slating
- Any additional equipment. Such as lighting, props, mics, etc.
Order to activate equipment
OpenXR equipment is still early technology and can sometimes lose tracking, freeze, and other challenges. Keep in mind you may need to restart devices, re calibrate, and more. The good news is every year bugs, software, and hardware improves.
At the time of this writing, the following should be turned on and checked for calibration in this order:
- Start Vive HUB. Verify tracker is working.
- Start Meta Link
- Start SteamVR. Verify the app sees the headset, 2 controllers, and a Vive tracker. SteamVR should be the default OpenXR runtime.
- Set the Vive tracker in SteamVR to anything BUT a controller, hand, etc. I usually use Left Foot.
- Put on VR headset. Make sure you are in the SteamVR home environment. Use the menu button on the left controller to bring up the SteamVR menu. Select the button to calibrate the Vive tracker. Follow the in headset instructions.
- Verify the Unreal Desktop icon has the target flag set to -XRtrackingonly. Right click on the desktop icon, select Properties, select Shortcut, and verify the the Target says -XRtrackingonly.
- Open your project by launching from the Unreal Desktop icon. DO NOT USE the Epic Games Launcher, the app icon for your project, or some other way as the flag above won't get called and Live Link may not cooperate.
Verify plugins are enabled in your project
- OpenXR
- OpenXRViveTracker
- Vive OpenXR - This is a local plugin enabled in the Plugins directory of your project. It can be downloaded here if it is not included in the template project.
- LiveLink
- LiveLinkXR
Overview of template project
x
Where to go from here?
The next steps would be to prepare both the studio and the Unreal world for cinematic capture. This takes time and planning, particularly with lighting, perspective, and positioning of both real-life and CGI objects. Consider recording a few tests and making a composite before officially recording your takes. Another guide will be posted on an overview on capturing within the Unreal environment and exporting the footage.