#✨-ar-simulation

πŸ“¦ : https://github.com/needle-tools/ar-simulation

phonk73

Whaaa ok, i didn't use RMB while manouvring... (on laptop).. all works like a charm, sorry to waste your time, and thanks!!!

danielupreal

<@272528485732450305> <@519636239658385605> Does AR simulation supports Face Tracking? Would be amazing!

lichtgestalt8673

Hello, I have some questions. I just bought the AR Simulation for my Unity 2021. Project, but I think it is not working like intended. Why is the background blue? and why It seems only the basic plane tracking sample is working... I tried this https://www.youtube.com/watch?v=RLLoR3mZ_fg Tutorial but nothing happend

marwi123

Can you select the simulated environment manager gameobject in your scene? Does it have environments for selection in the inspector?

marwi123

Yes - what happens if you select another environment in edit mode. Look around in the scene - maybe it is not where your camera is for some reason? In the screenshot it looks like it's in the scene

marwi123

and can you check the culling mask of your main cam? Maybe try settings it to none for testing. Can you send a screenshot of what's setup there?

marwi123

You just installed the latest package in a 2021.3 project right? which URP version is installed?

lichtgestalt8673

and like i said the basicplane2 scene is working fine, so the global urp settings should be also ok

marwi123

Yes - just environments are being rendered differently to simulate on-device behaviour (like a real camera image would be rendered).

lichtgestalt8673

so I found a workaround: When you use the RaycastPlanes.Scene - which is working perfectly fine - you can just change the Environment Prefabs with the prefabs in package folder and then build your own scene, the environments will be rendered right πŸ™‚

marwi123

What do you mean exactly with "change the environment prefabs with the prefabs in package folder" ? You drag them into the scene?

marwi123

can you select your URP Renderer asset and check if the AR Simulation camera background renderer feature is there?

marwi123

Ok doing so works of course but beware that rendering will look different on device (e.g. on device a camera image doesnt have occlusion by default, your object's wont cast shadows by default, environment light dont affect your virtual objects by default... those are some of the things why simulated environments are being rendered separately - to match behaviour on device more closely and avoiding fooling yourself when testing in editor)

lichtgestalt8673

You can only call cameraDepthTarget inside the scope of a ScriptableRenderPass. Otherwise the pipeline camera target texture might have not been created or might have already been disposed. UnityEngine.Rendering.Universal.ScriptableRenderer:get_cameraDepthTarget () Needle.XR.ARSimulation.Compatibility.ARSimulationCameraBackgroundRendererFeature:AddRenderPasses (UnityEngine.Rendering.Universal.ScriptableRenderer,UnityEngine.Rendering.Universal.RenderingData&) (at Library/PackageCache/[email protected]/Runtime/Compatibility/ARSimulationCameraBackgroundRendererFeature.cs:150) UnityEngine.Rendering.RenderPipelineManager:DoRenderLoop_Internal (UnityEngine.Rendering.RenderPipelineAsset,intptr,System.Collections.Generic.List`1<UnityEngine.Camera/RenderRequest>,Unity.Collections.LowLevel.Unsafe.AtomicSafetyHandle)

marwi123

Please try upgrading to 1.3.6 (just published) - it should stop the depthTarget warnings <@822427550616780800>

blackclawsk

Is there going to be an updated version for ARFoundation 5.0? 2022.2 makes 5.0 mandatory. They introduce their own XR Simulation but that is a long way from AR Simulation

marwi123

ARSimulation is editor tooling so it doesnt directly run on your mobile device. It is used to simulate augmented reality in the Unity Editor to make development easier and faster

marwi123

Hello <@244434805196849152> sorry for the late reply. Unfortunately we dont have immediate plans to support ARFoundation 5 right now

blackclawsk

<@272528485732450305> So basically ARSimulation won't support 2022.2+ in the foreseeable future? What about when 2022.3 becomes the next lts version?

hybridherbst

We'll evaluate support again at that point. But most likely the answer is "no" since basically Unity went ahead and implmented similar simulation capabilities into AR Foundation 5 - finally, I must say, they should have from the start. Haven't looked into how extensible Unity's solution is, but the business reality is that whenever Unity starts implementing something like this on their own, even if it only has a subset of features, that's what people use (unless it's so crappy that they start looking for alternatives).

robyer1

I had a great run with AR Sim at my old job and even bought a copy myself to play around with which I still use in old Editor versions. Thanks for the great workflow tool while it lasted πŸ’›

jonath4nx

Hi there ! I'm going to try to create my first AR experience using Needle.

Is there any preferences between VUFORIA or ARfoundation process (regarding compatibilities with Needle) ?

Not sure where I have to place the ARcamera and the "image target" inside the project's hierarchy. I assume I can not replace the original prefab camera by the AR one ... Does anyone have a kind of protocole to perform this ?

Any help will be appreciated 🌡

marwi123

Hi Jonathan, Thanks for asking.

ARSimulation simulates data for ARFoundation 3 and 4.

Have you had a look at the samples that come with ARSimulation? They contain an example on how to use tracked images. You can import it via the Package Manager

jonath4nx

Hi <@272528485732450305> , Thanks for your answer. I did not know about the demo, I will check that and cet back to you. Cheers !

vokusz

If marcel says he will take a look, he's one of the only people where I truly believe he will asap. We need more like marcel & herbst πŸ™

marwi123

Hi, are you asking about AR Simulation or Needle Engine? ARSimulation is Unity editor only tooling for, well, simulating AR in Unity

marwi123

But perhaps you're asking about <#918959857091088464> - then you should ask in the <#1024686103598477383>

thinkmariale

I just build the sample box scene, and it all works fine except I don't see the buttons on the browser to run it in ar / vr. Any ideas why?

marwi123

Hi this is the wrong channel <@744239951998222436> please post in <#1024686103598477383>

augmentedcamel

I was wondering if others are also trying to make AR applications for IOS. I feel like quicklook is a bit limiting, how do you handle this? Avoid quicklook at all?

marwi123

Hi this is a channel for our unity package to simulate ar inside the unity editor. Please ask this question in a separate post in <#1024686103598477383> πŸ˜‰ thank you

marwi123

Hi, what error do you get exactly? And which versions are you using (Unity, ARFoundation, ARSimulation)

elvis75k

<@272528485732450305> i've tested right now the same meshing scene on unity 2022.3.19 (intel) AR Foundation 5.1.2 and it works fine on an Apple Silicon M2. The same Unity version with Silicon native , meshing does not produce any mesh and the ARMeshManager component is self disabled in editor play. AR simulation is 1.3.7

lastdragoncb

Hi all! I'm checking out The Unity/Needle combo and I have a couple of questions. 1.) Even if we self host the files on our server, there is no reason we can't use the AR features of Needle? In other words, it doesn't need to be hosted on the Needle Cloud after exporting from Unity for AR to work? 2.) I've seen plenty of examples of room scale and image tracking AR using needle on the site, but was curious if Needle can do face tracking/deformation like 8th wall can? 3.) If #2 is not an option directly within Needle itself, could Needle Unity Exports somehow be combined with 8th wall 3js/A-frame for the face tracking stuff?

The demos I saw were very impressive, and I'm stoked to be able to export to 3js flavor WebGL from Unity.

marwi123

Hey this channel is for a different tool (AR simulation is a unity package for simulating/testing AR in the Unity Editor) and not Needle Engine.

Could you post the questions again in https://forum.needle.tools or <#1166424502008303696> ? Thank you!