澳门现金网_申博信用网-官网

图片

Canon EOS VR System technology explained

Everything you need to know about shooting immersive VR content with Canon’s dual lenses – the difference between stereoscopic and monoscopic, the 180° VR advantage, and why interpupillary distance matters.

Immersive VR content is easier to shoot, edit and experience than ever before. The innovative dual lenses and VR software at the heart of the Canon EOS VR SYSTEM – alongside the growing availability of untethered VR headsets – are transforming the way in which stereoscopic VR videos and stills are created and consumed.

The roots of Virtual Reality run deep – all the way back to 1838, in fact, when the first stereoscope was conceived, although we had to wait until the mid-1980s for the first VR head-mounted display (HMD) to become available. Since then, advances in imaging technology and computing power have made more realistic VR content accessible.

It was a step-change in imaging technology – the launch of the high-performance Canon RF mount, with its large diameter and short back focus – that made the EOS VR SYSTEM possible. Canon’s complete solution for capturing stereoscopic 180° VR includes a line-up of stereoscopic VR lenses, software and plug-ins that help more people to create high-quality immersive content more often. Virtual reality is an increasing part of many of our lives, be it for training, education or entertainment, and the EOS VR SYSTEM facilitates a more seamless content creation process.

Here we'll run through some VR basics and explain the difference between VR formats, what a dual lens is, and why interpupillary distance is an important consideration when you’re looking to maximise the 3D effect.

A man using Canon's EOS VR Utility software to process footage of ballet dancers captured by a Canon dual fisheye lens.

Canon's EOS VR SYSTEM at work: the pair of fisheye images captured by one of Canon's dual fisheye lenses, visible on the screen of the laptop at the right of this picture, are processed in Canon's EOS VR Utility software (on the main screen). The system greatly simplifies the creation of immersive VR content.

180° VR vs 360° VR

Two popular VR formats are 180° and 360°. With 360° VR, the viewer is surrounded by the environment and can look in all directions, including behind them. "Street view" apps normally use this type of presentation. The 360° content can be captured in various ways, depending on the end use. It can be done via a consumer "action"-type camera with two back-to-back lenses and sensors, or a professional setup using larger cameras and rigs. In either case, though, the output has to be stitched together to generate the 360° environment, and this can result in visible stitch lines, parallax problems or other alignment issues. Shooting stereoscopic 360° VR is even more complex, requiring more expensive and bulkier equipment, such as a dedicated multi-lens/sensor all-in-one camera or a multi-camera rig arrangement.

A head-mounted display (HMD) or VR headset will provide a more immersive experience when viewing 360° VR or 180° VR. Giving users the freedom to explore VR content in 360° has limitations, though. It’s harder to direct a viewer to a point of interest, for example, or to keep their attention focused on a story or message. Creating a 3D effect in a 360° VR environment is also more complex and costly as it requires a left and right image for each camera view/position.

For content creators who want to immerse the viewer in an environment but also focus their attention in the right place, such as in a training film, concert or documentary, 180° VR is the preferred format. Unlike in 360° VR, there’s no need to worry about what’s behind the camera with 180° VR, as only the forward-facing (half sphere) part of the environment is visible. It makes the VR shooting workflow much easier, since there’s no need for the camera operator to "hide" somewhere and remotely control the camera. Compared with capturing 360° content, the camera operator can be more mobile when shooting 180° VR, and lighting, microphones and other equipment can be positioned behind the camera.

The Canon EOS VR SYSTEM has been designed to further streamline the capture of 180° VR while ensuring professional image quality. Using a single camera and a single "dual" lens, two images are recorded side-by-side on a single sensor, providing a single file that simplifies the VR conversion and editing process.

A composite image showing both the left-eye and right-eye view of hands crafting a colourful model of a bird, taken using a Canon RF-S 7.8mm F4 STM DUAL lens.

An example of a spatial 3D image, captured in this case using a Canon RF-S 7.8mm F4 STM DUAL lens – you'll notice that the left-eye and right-eye views are subtly different, which replicates the way binocular vision works. A spatial image provides a 3D view where the whole image is visible at the same time, whereas VR images fill the viewer’s field of view and place the viewer "within" the environment, with the ability to look around to some extent, for a more immersive experience.

Monoscopic or stereoscopic?

Broadly speaking, there are two types of VR content: monoscopic and stereoscopic. Both types of VR can deliver 180° or 360° views. But where monoscopic provides a 2D image, stereoscopic delivers a more realistic and immersive 3D experience.

Monoscopic is the easiest type of VR to capture and display. It is created from a single image which is shot from one direction using a single lens or array of lenses. Monoscopic’s 2D view means that specialist equipment is not required to view the content, and it can be explored on a flat screen, such as a computer monitor, mobile phone or tablet. It’s for this reason that monoscopic VR is widely used in real estate and tourism, as well as "street view" applications.

VR headsets can also be used to fill the viewer’s field of view with monoscopic content, but there will be no 3D effect. The same single image will be displayed to both eyes, so there’s no sense of depth.

Stereoscopic content captured by the RF 5.2mm F2.8L DUAL FISHEYE or RF-S 3.9mm F3.5 STM DUAL FISHEYE lens produces a more realistic and immersive experience. It uses two images of the same scene – one for each eye – which are captured simultaneously but from slightly different angles. These discrete images can be directed to each eye in a VR headset, where the difference in shooting angle creates a parallax and a sense of 3D depth.

An illustration showing the path of light through the two lenses of a Canon RF 5.2mm F2.8L DUAL FISHEYE lens to the camera sensor.

The light path to the sensor in the Canon RF 5.2mm F2.8L DUAL FISHEYE lens. This produces two perfectly synchronised, high-resolution fisheye images on the sensor at the same time, which can then be processed using Canon's EOS VR Utility – right.

A computer monitor displaying two circular images of a forest path, captured with a VR lens. The monitor is placed on a white desk, and a memory card reader is connected to it.

What is a dual lens for VR?

Two lenses are required to capture the separate images needed for immersive stereoscopic and 180° VR content. This normally entails a dedicated stereoscopic camera or separate cameras and lenses in specialist rigs, which are often difficult and time-consuming to align. Canon’s stereoscopic and VR lenses streamline this process, with their dual lens design enabling compatible 澳门现金网_申博信用网-官网 System mirrorless cameras and Cinema EOS video cameras to record immersive stills and video.

A dual lens makes for a more efficient shooting and post-production workflow. Not only are the left and right images perfectly aligned and captured in sync on the camera sensor, but two electro-magnetic diaphragms (EMDs) – one for each lens – ensure precise, coordinated aperture adjustments for consistent exposure across both images. The result is a single file that doesn’t require the left and right image outputs to be matched in post-production – the colours and brightness level for both images will be the same, helping to cut down the grading required.

A diagram showing dual lenses and subjects at different distances. Lenses with a baseline length of 60mm are optimised for subjects 0.5m – 2m away.

Lenses with a baseline length of 60mm such as the Canon RF 5.2mm F2.8L DUAL FISHEYE are optimised for a subject distance of 0.5m – 2m. At this distance, the 3D effect is maximised and comfortable to view. It is not optimal, however, for subjects closer to the camera than 0.5m or further away than 2m.

A diagram showing dual lenses and subjects at different distances. Lenses with a shorter baseline length are optimised for subjects closer than 0.5m away.

If you are shooting subjects closer to the camera, a shorter baseline length is beneficial to achieve a good difference between the left and right images and thus a satisfactory 3D effect. The RF-S 7.8mm STM DUAL lens has a baseline length of 11.8mm, providing a greater 3D effect when the subject is as close as 0.2m – 0.5m. With a small baseline length, however, shooting subjects further away will result in less difference between the left and right images, producing less of a 3D effect.

What is the interpupillary distance – and how does it affect the 3D effect?

The distance between the lenses in a dual or dual fisheye lens plays an important role in determining how far the stereoscopic or VR lens needs to be from the subject to create the best 3D effect.

The distance between the centres of the dual lenses in a VR or stereoscopic lens is known as the interpupillary distance or baseline length. The average interpupillary distance of human eyes is about 63mm, so lenses that have a baseline length of 60mm, such as the Canon RF 5.2mm F2.8L DUAL FISHEYE and RF-S 3.9mm F3.5 STM DUAL FISHEYE, give a natural and realistic 3D effect.

Lenses with a baseline length of 60mm produce the strongest 3D effect at shooting distances of 0.5 metres to 2 metres. Focusing on subjects that are closer or further away will result in a noticeable reduction in the 3D effect.

A larger baseline length will be required to optimise the 3D effect for subjects further away, while a lens with a small baseline length provides a stronger separation of the two images at shooting distances below 0.5m. The RF-S 7.8mm F4 STM DUAL offers a baseline length of just 11.8mm, which maximises the 3D effect at a shooting distance of 0.2m to 0.5m, making it ideal for creating dynamic close-ups.

 Two converted fisheye views compared. The 180° field of view on the left includes extraneous objects such as lights and a chair at the sides of the image, while the 140° view does not.

The difference between 180° (left) vs 140° (right) fields of view. In the former, unwanted objects such as lights (left and right), studio furniture (left) and even tripod legs (foot of frame) may be visible, meaning more care needs to be taken with framing. For this reason, 180° shooting often requires a tripod with a boom arm (including counterweights). For 140° shooting, a standard tripod can be used without the need for a boom arm or other equipment.

VR lens angle of view

While the baseline length determines where the depth perception will be the strongest, the angle of view of the lens dictates how much of a scene it’s able to capture horizontally, vertically and diagonally (corner to corner) – although it's usually just one that’s quoted: as these lenses create two circular images, the angle of view measurement is the diameter of the circle, which is the same in every direction.

VR lenses with short focal lengths can capture a wider viewing angle than those with longer focal lengths, and this can create greater immersion when viewed with a VR headset. The Canon RF 5.2mm F2.8L DUAL FISHEYE captures an expansive 190° angle of view, for example, which fills the field of view of a person viewing your content.

The field of view – or the portion of the scene that’s visible to the viewer at any one time – is affected by several factors, including the lens’s angle of view and the slight loss that occurs during the process of converting the VR file. The captured field of view of the RF-S 3.9mm F3.5 STM DUAL FISHEYE, for example, is 144°, with the outputted field of view being 140° after the file is processed in Canon's EOS VR Utility. The viewing angle of a VR headset also has an impact on what can be seen at any one time. Headsets that offer a wide field of view enable the viewer to see more of the scene without having to move their head.

With an outputted field of view of 180°, the Canon RF 5.2mm F2.8L DUAL FISHEYE pulls more into view than the RF-S 3.9mm F3.5 STM DUAL FISHEYE. However, the latter’s slightly shallower angle of view makes it easier to frame a scene without unwanted objects such as tripod legs appearing in shot. The RF-S 7.8mm F4 STM DUAL has a much narrower outputted field of view of 60°, which is equivalent to the central angle of view of human eyes. This makes for a natural, comfortable viewing experience, as well as making it easier to frame shots without distractions, similar to shooting photos and videos with a standard lens.

Spatial video vs 180° immersive video

The more focused field of view outputted by the RF-S 7.8mm F4 STM DUAL creates spatial content rather than frame-filling immersive 180° VR. Both spatial video and immersive video are able to deliver a 3D viewing experience via a VR headset. They are both capable of a convincing sense of depth, but while immersive content fills a viewer’s field of view and places the viewer within the scene, spatial content is displayed in a smaller window in front of the viewer – like watching a 3D TV screen in a virtual environment.

Marcus Hawkins

Related articles

Which 3D/VR Dual lens is best for you?

Canon’s 3D/VR lenses compared – which stereoscopic prime is best for the type of immersive 3D content you want to shoot?

Immersive 3D VR with the amazing dual fisheye lens

How Martin Bissig takes the viewer right into the action in 180° VR captured with the 澳门现金网_申博信用网-官网5 and Canon's revolutionary dual fisheye lens.

Filming Swan Lake with a dual fisheye lens

Clive Booth shares the inspirational story of bringing a classic ballet to neurodiverse audiences through immersive storytelling.

Meet the Canon RF 5.2mm F2.8L Dual Fisheye

Capture the world in virtual reality with this groundbreaking stereoscopic L-series lens.

Get the newsletter

Click here to get inspiring stories and exciting news from Canon Europe Pro