ZED Depth Viewer Unable to Get Data from the Virtual Camera

[shaswat-shukla-cloud]

Here are the specifications -

1. Windows 11 Machine
2. Isaac Sim 5.0.0
3. ZED SDK 5.1
4. CUDA 12.9
5. Microsoft Visual 2019. Also tried with Microsoft Visual 2022 and got the same problem
6. I launch the IsaacLab environment from inside an Anaconda environment.

Main Problem - I followed this tutorial to enable the ZED X Camera with Isaac Sim but I am not seeing any data or any kind of scene in ZED Depth Viewer- https://www.stereolabs.com/docs/isaac-sim

1. ZED Diagnostic - Please see screenshot below. I believe the camera test fails because I am not using a physical camera. Instead, I am trying to setup the virtual camera. Also, ZED Diagnostic suddenly crashes and I am unable to save the results from the diagnostic.

2. Following the tutorial, I do see the ZED X Camera in Isaac Sim Assets Tab

3. I cloned the git repo because I was not seeing the Zed X extension. Then, I correctly added the path to the registry. After doing this, I see the ZED X Camera extension in Isaac Sim

4. When I enable the extension, I get this warning in the conda terminal, which I am not sure is a point of concern or not

5. Then, I created the Action Graph as mentioned in the tutorial. However, when I create the ZED Camera Helper node, I get the following warning

6. Here is how it looks like after creating the action graph

7. Then, I add the target in ZED Camera prim property

8. As soon as I hit the play button, I get a warning. It can be seen in the screenshot below -

9. This is what I get in the console after clicking the play button. First I get a warning about "not being able to find a node type", then a type error and then a warning about "unhandled attribute".

10. Finally, when I open ZED Depth Viewer, I don't see anything, not even being connected to any camera.

11. Here is the IP Address and port number -

So, is this a ZED X installation problem or something with the ZED Camera extension inside Isaac Sim?

[Alessio-Parmeggiani]

Hello, same issue also on my side with Ubuntu 22.04. I didn't use Visual Studio as I think is something for Windows only.
Let me know if you find a fix!

[Bvallon-sl]

Can you try using the latest plugin version (v4.1)? There is no release available yet, so you will need to retrieve it directly from the main branch.

[Alessio-Parmeggiani]

Can you try using the latest plugin version (v4.1)? There is no release available yet, so you will need to retrieve it directly from the main branch.

I tested the new version (4.1) on Isaac Sim 5.1 and I get the same errors:

2025-11-03T08:25:49Z [41,785ms] [Warning] [omni.graph.core.plugin] Could not find node type interface for 'sl.sensor.camera.bridge.OgnZEDSimCameraNode'
Traceback (most recent call last):
  File "/home/tom/Desktop/ISAAC_SIM/zed-isaac-sim/exts/sl.sensor.camera/sl/sensor/camera/nodes/SlCameraStreamer.py", line 48, in compute
    state.annotator = ZEDAnnotator(
                      ^^^^^^^^^^^^^
  File "/home/tom/Desktop/ISAAC_SIM/zed-isaac-sim/exts/sl.sensor.camera/sl/sensor/camera/annotators.py", line 73, in __init__
    self.build_annotators()
  File "/home/tom/Desktop/ISAAC_SIM/zed-isaac-sim/exts/sl.sensor.camera/sl/sensor/camera/annotators.py", line 175, in build_annotators
    self.build_graph(cams)
  File "/home/tom/Desktop/ISAAC_SIM/zed-isaac-sim/exts/sl.sensor.camera/sl/sensor/camera/annotators.py", line 237, in build_graph
    self.zed_.get_attribute("inputs:port").set(self.port)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: Invalid NodeObj object in Py_Node in getAttribute

Extension panel shows that I am using the updated version:

Is this version compatible with Isaac Sim 5.1 or should I test it with Isaac Sim 5.0?

EDIT: My bad! I missed the building command in the installation instructions.
After the build command everything works correctly with IPC disabled but if I enable IPC ZED_Depth_viewer crashes with the following error:

[2025-11-03 12:57:11 UTC][ZED][WARNING] Simulated ZED camera used.
[2025-11-03 12:57:11 UTC][ZED][WARNING] [Init]  Invalid calibration file. On Linux, call export LC_ALL="C" and restart your application.
[2025-11-03 12:57:11 UTC][ZED][WARNING] Self Calibration Disabled.
Stack trace (most recent call last) in thread 20161:
#6    Object "[0xffffffffffffffff]", at 0xffffffffffffffff, in 
#5    Object "/lib/x86_64-linux-gnu/libc.so.6", at 0x7735fa3268bf, in 
#4    Object "/lib/x86_64-linux-gnu/libc.so.6", at 0x7735fa294ac2, in 
#3    Object "/lib/x86_64-linux-gnu/libstdc++.so.6", at 0x7735fa6dc252, in 
#2    Object "/usr/local/zed/lib/libsl_zed.so", at 0x7735fc80c294, in sl::UDPInput::decode()
#1    Object "/usr/local/zed/lib/libsl_zed.so", at 0x7735fc8078da, in sl::UDPInput::readIPCDataInternal()
#0    Object "/lib/x86_64-linux-gnu/libc.so.6", at 0x7735fa3a6bd5, in 
Segmentation fault (Invalid permissions for mapped object [0x773578043000])
Segmentation fault (core dumped)