NERSC adapter: filesystem ls intermittent timeouts

[osmiumzero]

Summary

GET /filesystem/ls/{resource_id}?path=... works intermittently for scratch paths but consistently fails for home directory paths with:

Timed out waiting for job submission

The filesystem operations appear to be implemented via background Slurm jobs on login nodes, which makes them unreliable for interactive use.

Impact

Minor — filesystem listing is useful for verifying job output but not critical for the pipeline since job status can be checked via the compute status endpoint.

Environment

• NERSC Perlmutter
• API: https://api.iri.nersc.gov/api/v1
• Scratch path: /pscratch/sd/t/timjdunn/ (intermittent success)
• Home path: /global/u1/t/timjdunn/ (always fails)
• Date: 2026-03-03

[gabor-lbl]

These commands always run on perlmutter in the calling user's home directory so maybe that explains the intermittent success for pscratch? I'll look into this some more.

[gabor-lbl]

I cannot reproduce this. Both home and pscratch dirs work fine with ls for me. I used the "homes" resource in the command.