Introducing Magic Leap With Unity3D

What is the difference between Virtual Reality, Augmented Reality and Mixed Reality?

To cut a long story short, here’s the difference between virtual, augmented, and mixed reality technologies:

• Virtual reality (VR) immerses users in a fully artificial digital environment.
• Augmented reality (AR) overlays virtual objects on the real-world environment.
• Mixed reality (MR) not just overlays but interacts with your real world. It anchors virtual objects in the real world.

Begin exploring

To get started you need to download the Unity engine tool for Magic Leap Technical Preview and Magic Leap Lumin SDK.

Lumin Sdk :

https://creator.magicleap.com/downloads/lumin-sdk/unity

Unity Technical Preview :

https://beta.unity3d.com/download/94d3b60453d2/UnityDownloadAssistant.dmg?_ga=2.152723193.1759123696.1522124091-240620625.1522124091

Magic Leap Setup

Step 1 : Install required packages from Magic Leap Package Manager

Download and install the latest Magic Leap Package Manager. Lumin SDK has a lot of magic stuff and tools to help create experiences and apps. We don’t have to cover all that now, so, let’s continue with all this marked packages.

Step 2 : Generate, decorate and experience virtual rooms

With the help of Magic Leap Simulator, You can see your quick changes to Unity Editor without deploying to Magic Leap Headset Devise. This simulator covers the major Lumin SDK features. After creating your own room using Virtual Room Generator, load your room in Magic Leap Simulator. Here you can fully explore your room and test it.

In the Magic Leap Remote – Simulator Mode window

1. Click Start Simulator
2. In the Simulator window, Click the ☰ menu (the one in the Mini Map window) – Click Load Virtual Room
   
3. Navigate to VirtualDevice\data\VirtualRooms\ExampleRooms in your Lumin SDK installation folder.
4. Select an example room of choice
   You can also generate your custom room with Virtual Room Generator

Meshing in Unity

Meshing is a feature of World Reconstruction that detects real world surfaces and constructs a virtual mesh around those objects.

1. Import the Magic Leap Unity Package (Path : /Users/UserName/MagicLeap/tools/unity/v0.11.1).
2. Create an empty GameObject, name it MLSpatialMapper.
3. Attach an MLSpatialMapper Script (AR->Magic Leap->Spatial Mapper) to the MLSpatialMapper GameObject.
4. Create the mesh prefab.
   1. Select MLSpatialMapper and create a child GameObject, named Original.
   2. This object acts as a template for creating the meshes. At runtime, MLSpatialMapper will create meshes and set them in the Mesh field of the MeshFilter attached to the Original GameObject.
   3. Disable the Original GameObject.
   4. Remove any transform offsets.
   5. Add a Mesh Renderer component.
   6. Add a Mesh Filter component
   7. Add a Mesh Collider component
      
5. Launch the application using the Magic Leap Remote(see the Prerequisites). The mesh should appear shaded pink (since no materials have yet been applied).
6. Now let’s apply materials to the mesh.
   1. Create a new material, and name it Wireframe. Assign the Wireframe shader (VR->SpatialMapping->Wireframe).
   2. Create a new material, and name it Occlusion. Assign the Occlusion shader (VR->SpatialMapping->Occlusion).
   3. Assign both materials to the Original GameObject’s MeshRenderer.
7. Create one Cube and add Rigidbody component to it.
8. Launch Simulator and click on play button in Unity.

You will see meshes are derived in scene view in Unity. And your Cube is now interacting with real world. You can put your cube wherever you want in environment.

Now your game characters can come in real world and they can do whatever with respect to real world. Here you can see one demo game in which player is playing with ball in real environment.