Category: Uncategorized

Far reaching effort

The future is being built by collaborative efforts between minds and expertise far removed from each other geographically but coming together on real time.  HaptX and partners transmit touch across the Atlantic. The application could be very effective and will be ‘far reaching’ in the true sense.


HaptX and partners build first robotic hand to transmit touch across the Atlantic


What is Digital MR?

I noticed many news sites speculating wildly about VRVANA and the Totem this week. Business Insider says:

‘…the Vrvana Totem is said to be able to overlay full, colorized digital images over the real-world. That would be a step above rivals like the Microsoft HoloLens, which only project transparent “ghost” images within a limited field-of-view. If the Vrvana Totem lives up to those lofty promises, it could give Apple a major leg up in augmented reality, which the company sees as the next major computing platform.’

The fact that the Totem uses video cameras to show the ‘real world’ has been totally missed which is a key difference from HoloLens, Magic Leap, Daqri or ODG devices. In reality, the device is more like AR on a tablet but in stereo than devices that mix optical and digital views together. The problem is most people reporting on these devices just do not understand enough about how they work or have even tried them to appreciate what they can and can’t do well.

CEO of VRVANA Bertrand Nepveu gave me a personal demonstration of the Totem at Siggraph in 2016 and I was quite impressed.

Any MR device that uses digital cameras to show the outside world also has to deal with adding latency to the real world which optical ‘pass through’ devices don’t have to contend with. This latency or lag can easily stop the experience from feeling ‘real’. The latency on the Totem was not too bad and I found flying a virtual helicopter around the show floor and landing it on the stand quite engaging.

Digital MR devices do have their advantages though over their optical cousins. Here are some of the key ways:

  • The field of view (FOV) of the visible world and digital world always match as they are both being displayed on the same screen.
  • The FOV can be much larger than current Optical MR devices.
  • The visual quality/feel of both the real and digital world are the same as they are both being displayed on the same screen. This creates a more seamless blend of both worlds. With perfect registration and alignment of elements across the view.
  • Occlusion is much easier to do allowing virtual objects to go in front or behind real world objects completely seamlessly. Digital objects can more easily appear to interact with the real world.
  • VR and Optical MR devices still don’t have stereo cameras (as its actually quite hard to match position across optical/video/tracking sensors) so you can’t record your stereo view for you or someone else to review. Digital MR devices can do this very easily. Note this can work best on 2D screen with 3D glasses rather than an HMD as the view will not have independent control of head position.
  • With Digital MR, the fact that the real word is also digital, means light can be subtracted from it, which is something optical MR devices cannot do. What this means is that if you want your virtual object to cast a shadow on the real world or cover up a source of light like a window it can do quite easily. Devices like the HoloLens interpret black virtual objects as transparent as they can’t take away light from your view. Some describe light subtraction as ‘Diminished Reality’ and it will soon become an important ‘next step’ for immersive MR.

In time, it is likely that VR and MR will merge as VR headsets start to incorporate stereo cameras and AR/MR headsets start using some kind of LCD technology to also allow the blocking-out of the real world. The latter is harder than it sounds right now due to registration/alignment difficulties between different display systems.

We are already starting to see devices like the ZED Mini that help you adapt your VR Headset for this.

As Monika Bielskyte of All Future Everything says…

The digital world will soon enough be enmeshed with the physical world in such a way that our ‘reality’ will be the transparency mode that we choose.

Is ‘Windows Mixed Reality’ Digital MR?

The new ‘Windows Mixed Reality’ headsets from five Microsoft partners have 2 digital cameras on the front and are called mixed reality devices yet don’t currently use the cameras for pass-through OR have optical pass-through.

At the moment all the headsets only use their cameras for SLAM tracking or warning you of physical boundaries not creating a blended view of real and virtual worlds. They also use the Windows Holographic platform originally created for the HoloLens to help develop a common platform across a range of devices for working with 3D objects for VR/MR.


Other actual Digital MR Devices

There are quite a few others out there, some old some new.

Keep a look out for them.



Whether it is VR, AR, Optical MR or Digital MR, the important consideration is NOT which technology is better but which best meets your specific needs. You can only compare their abilities for a particular job, not in general against each other, which is something all tech reporters seem to like doing. So look at the visualisation problem you have and then find the device that best solves that problem.


This post originally appeared on

Magic Leap One for Business?

Yesterday I was able to finally try out the Magic Leap One in London, thanks to Maximilian Doelle of Kazendi.

This was possibly the first public demo in Europe so I was quite pleased to get along to it.



Like myself Doelle has used the HoloLens extensively over the last 2 years and was the perfect person to help compare the devices.

Since we first saw the whale breaching the sports hall or the tiny elephant in the child’s hands, our expectations have been particularly high. Of course, since then we have read and seen that it is not really anything like that yet, but still my hopes were pretty high: multi-plane focussing, bigger FOV, eye tracking, smaller form-factor…

The first issue I encountered was that I had to remove my glasses as there is no room to wear them behind the device (unlike the HoloLens). Moreover, the eye tracking would not work if you had them on anyway. Still, I thought to myself, I sometimes DO use the HoloLens without my glasses and I can still see reasonably well.

Too blurry if you normally wear glasses

Wearing the ML1 without my glasses everything was too blurry, I have average short-sightedness but had to get very close to things to read text or properly see what they were. I was instantly unable to test the multi-plane focussing or eye-tracking and without getting custom lenses made for the eye insert, would not be able to use the device at all.

When demoing the device to lots of people at events, half your audience will have a bad experience or none at all. When running workshops with companies to understand what tech could help them, I would not be able to show them what their workflows could look like.


Eyes and peripheral vision occluded

The lenses are tinted to help balance the light levels in your surroundings with the graphics. The problem with this is that you can no longer retain eye contact with people as it is like they are wearing sunglasses. In business situations, this is a real limitation.

The frame of the device appears to have been designed to intentionally block your field of view beyond the waveguides so your real-world view and the augmented view, are closer to each other. This is good for helping you to focus on the area that is augmented but terrible for peripheral vision and a general feeling of not looking through goggles.

Seeing content from the other side of the device


It also is possible to see what people are looking at, if you stand in front of them, which I have not seen with the HoloLens. The waveguides appear to work in reverse projecting the same content behind the person (to the outside observer) to the same distance they see things in front of them!


The device seems mainly optimised for entertainment for one person that buys the device for themselves and gets custom lenses made (if they need glasses). Contact lenses are the best solutions for people that wear glasses but in demo situations, its no use if they are not wearing them already.

All in all, I am disappointed that for us, in enterprise XR consulting, this does not really offer a decent alternative to the HoloLens. Clients would have a lot of issues if they wanted to develop or use this device for the majority of business applications.


This post has originally appeared on
Copyright 2018 Immersion. All rights reserved