What is mixed reality | Fully Explained

Mixed Reality

What is mixed reality?

Mixed reality is the little brother of augmented reality. When augmented reality is played through a portable mobile device such as a smartphone or tablet, mixed reality is played through transparent glass attached to the head. Mixed reality is a significant step forward from augmented reality (AR): the technology behind the Pokémon GO 2016 phenomenon. In a “hybrid” environment, interactive virtual objects can be displayed in an environment, a physical field, a mixture of the real and the virtual. Mixed reality is a combination of real and virtual worlds to create new environments and images in which physical and digital objects coexist and interact in real time. For example, imagine a surgeon with digital overlay during surgery, providing detailed, real-time information about the patient's current condition and processes such as blood pressure and other important details.  invented by Microsoft when they launched Microsoft HoloLens in 2016.

This term was firstly mentioned by Fumio Kishino and Paul Milgram, in a paper, titled "A Taxonomy of Mixed Reality Visual Displays. The paper added the concept of a virtual continuum, which become described as "the combination of training of gadgets provided in any precise show situation, wherein actual environments, are proven at one end of the continuum, and virtual environments, at the other extremum.  

It also differs from augmented reality in its deeper understanding of physical space and the ability to place holograms in this space.

Mixed reality vs Augmented reality

(MR) is more like augmented reality (AR). Both MR and AR are based on real-world environments, and AR enhances their fidelity by overlaying virtual objects on top of them, such as Snapchat filters. However, users cannot interact directly. with closed objects. For example, AR can display 3D virtual boxes on a physical tablet, and MR has the ability to make it easier for the user to lift and open said box. AR is capable of working with screens, while MR is more immersive, which suggests that users have to communicate directly with the 3D environment using head-mounted displays.  There are several MR applications that have taken over these areas. The technology has been applied to training methods for police officers, virtual inspections of engineers, and distance learning for construction workers. It also offers the opportunity to shorten repair cycle times and provide more training solutions for companies looking to develop the skills of their workers without the presence of employees or complex equipment.

Mixed reality examples

 

 

 Mixed reality Examples

This technology is already being used in various ways to enhance our physical world with digital objects and displays. MRI in Education There is a great opportunity to use mixed reality technology in schools and other educational applications, such as teaching new professions. This video went viral when it first came out in 2016, and it features a real whale crashing into the floor for exercise. See how water accumulates on the earth, just like in the real world. This is what makes MR special - a digital object. (water) reliably interacts with the physical world (floor). MR in Entertainment This kind of technology has an obvious element of influence that can impress audiences, even virtual ones.MR Video Calls Video calls are a great way to communicate with people who are not in the room with you, now they can do it too. With mixed reality video calling, you can move your “screen” and interact in new ways. The person on the other end of the call does not need a headset to join. They can even paint on their screen to accurately convey what they are trying to say, and it will place holograms on physical objects in your field of view.

 

Types of mixed reality(MR)

Depending on how the user sees mixed reality, these systems can be divided into two categories:

Transparent optical systems: users can see the real (real) world, communicate directly with the computer to create added (virtual) objects. with HMD with transparent screen. Then in the R-connection this is not done, but the real scene is viewed directly through this screen.

Transparent video system: augmented scenes of the real world with virtual objects are shown to the user in an intermediate form, for example. using a combination of cameras and monitors.

 

Two MR systems are used to attach virtual objects to the real world:

Marker system - special markers placed on the real scene are recognized and replaced by virtual objects at runtime. QR codes or EAN codes can be used as markers in addition to special markers.

Semi-Marker System: A (ad-hoc) marker-free system, unlike an AR marker, does not require a special marker in the coordinates of the real GPS field, Wi-Fi signal, analysis of the camera output (such as image recognition), and other means used to position the virtual object. real scene.  In a semi-marker system, objects of the real world naturally placed in the scene (for example, a TV remote control, a mug, or a book) are used as markers.

Depending on the area in which the MR system operates, MR systems are divided into: Internal MR systems Outdoor MR systems Combined MR systems (both internal and external) Depending on the geometry, the relationship between the real world and virtual objects, MR systems can be divided into: Enhanced MRI systems: there is no direct geometric relationship between virtual objects and the real world (discontinued Google glasses are used only as an example))

Extended MRI system: there is a geometric relationship between virtual objects and the real world .

 

 

Conclusion

Mixed reality research is progressing quite well, although it requires significant financial resources. On the other hand, this technology offers a very immersive experience for its users. Mixed reality allows to bring gaming, education, training, and presentation of various kinds of designs up to an entirely new level. It represents a new form of visualization of real objects, extended with virtual information. Models can be created using 3D modeling tools, including CAD software, and inserted to a real scene. A mixed reality scene can be then created using one of the available augmented reality systems. The correct placement of virtual models inside a scene is ensured either by markers or by a combination of recognizable objects from the real environment and additional information from other sources, such as positioning systems. Together they create a solution that brings a new form of computing resource utilization.