Update distributed_inference.md to correct syntax

2025-12-23 12:54:48 +08:00 · 2025-12-11 13:46:43 +05:30
1 changed files with 4 additions and 4 deletions
--- a/docs/source/en/training/distributed_inference.md
+++ b/docs/source/en/training/distributed_inference.md
@@ -297,9 +297,9 @@ if __name__ == "__main__":

 The script above needs to be run with a distributed launcher, such as [torchrun](https://docs.pytorch.org/docs/stable/elastic/run.html), that is compatible with PyTorch. `--nproc-per-node` is set to the number of GPUs available.

-/```shell
-`torchrun --nproc-per-node 2 above_script.py`. 
-/```
+```shell
+torchrun --nproc-per-node 2 above_script.py
+```

 ### Ulysses Attention

@@ -332,4 +332,4 @@ transformer = AutoModel.from_pretrained(
 pipeline = DiffusionPipeline.from_pretrained(
    CKPT_ID, transformer=transformer, torch_dtype=torch.bfloat16,
 ).to(device)
-```
+```