Skip stable diffusion models in torchbench, get tests and benchmarks green (#167896)

Summary:
X-link: pytorch/pytorch#167896
Approved by: https://github.com/aorenste, https://github.com/shunting314
ghstack dependencies: #167609

Reviewed By: jeanschmidt

Differential Revision: D87148821

fbshipit-source-id: abe626d382e67cc8da67d4888cb1e6606d7e75ee

Author: zou3519

userbenchmark/dynamo/dynamobench/torchbench.yaml

@@ -189,6 +189,10 @@ skip:
     - hf_Whisper
     - hf_distil_whisper
     - timm_vision_transformer_large
+    # https://github.com/pytorch/pytorch/issues/167895
+    - stable_diffusion
+    - stable_diffusion_text_encoder
+    - stable_diffusion_unet
 
   device:
     cpu: