Occlusion in Tango AR Camera

Question

I have a simple Tango Unity app which uses the Tango AR Camera prefab to display a 3D object in augmented reality.

Following this question, I wanted to try out the occlusion feature provided by TangoARScreen.

Therefore I have:

However the 3D object never gets hidden by foreground real-world objects. What am I missing?

Is there any sample project that demonstrates this "Enable Occlusion" feature?

score 8 · Answer 1 · answered Jun 28 '16 at 13:59

8

Try to look in the Unity Examples, the one named ExperimentalMeshOcclusion.

I just ran it and the occlusion there works well, so you can see the scene objects and the code being used.

answered Jun 28 '16 at 13:59

Oren

1

This example has its own way to handle occlusion (based on experimental meshing), it doesn't use the "Enable occlusion" feature of `TangoARScreen`. – sdabet Jun 28 '16 at 14:20
All of the Unity3D Tango SDK examples crash for me within about 30 seconds of running, the same happens to others I have spoken to too. How on Earth did you get them to work? Could you tell me which Unity version + which SDK release + which device you are using? – Peter Morris Jan 06 '17 at 15:44

score 4 · Answer 2 · answered Jun 28 '16 at 23:35

4

In order to use occlusion on TnagoARScreen, you have to check the Update Points Mesh checkbox on TangoPointCloud prefab in the scene.

answered Jun 28 '16 at 23:35

xuguo

1

As explicitely mentioned in the question, I have already `added a "Tango Point Cloud" with "Update points mesh" enabled` – sdabet Jun 29 '16 at 03:26

score 3 · Answer 3 · answered Jan 19 '17 at 14:27

3

There is no sample, but here's steps to alter an existing sample to turn it on. Tested working on the Phab2.

Start from the Area Learning Example.
Load the scene in Unity and Open "Tango Point Cloud" Inspector from your Hierarchy.
Tick "Update Points Mesh" under the "Tango Point Cloud" script.
Open the "Tango AR Camera" Inspector.
Tick "Enable Occlusion" under the "Tango AR Screen" script
Run the app and make sure you are testing by placing a mark behind a good sized object, and moving far enough back so that the depth sensor can see the object. Rendering the Point cloud data to screen can help you make sure that you are getting the input from Depth sensor that you expect.

I do find better results using the Experimental sample referenced by @Oren

answered Jan 19 '17 at 14:27

Jethro

I'll try that, but I don't see any difference with what I tried and described in my question, is there any? – sdabet Jan 24 '17 at 11:38
Naa the steps you list are the same, but you might have been starting from a different starting point than the Area Learning Example? I did follow those through myself and it worked on a Mac, and Unity 5.5.0f3 and the latest (a few days ago) updates to Tango. And step 6 is from experience, I thought it wasn't working, until I realised I was too close to my occluding object for the depth sensor to pick it up. It was only when I turned the display of the point cloud on that I realised how picky it can be. – Jethro Jan 24 '17 at 12:18
this is not working for me.. I started from a clean Area Learning Example. Any ideas? – ShadowMan Mar 31 '17 at 13:17

sdabet · Accepted Answer · 2017-07-31T13:34:29.090

0

That seems to have been fixed in latest versions of the Tango SDK.

edited Jul 31 '17 at 13:34

answered Jun 05 '17 at 15:58

sdabet

4 Answers4