# Which data parallel does trainer use? DP or DDP?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021%3E%5C
**Category:** 🤗Transformers\
**Created:** [March 24, 2022, 6:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021 "2022-03-24T06:03:27Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [August 30, 2025, 2:42am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021%2F5 "2025-08-30T02:42:00Z")

</div>

Hmm… Have you tried [launching it via `accelerate` or `torchrun`](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-run-single-node-multi-gpu-training-with-hf-trainer%2F19503)%3F

```bash
# single node, 2 GPUs
torchrun --nproc_per_node=2 train.py
# or
accelerate launch --num_processes=2 train.py

```

### [Accelerator selection](https://huggingface.co/docs/transformers/v4.56.0/en/accelerator_selection)

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhich-data-parallel-does-trainer-use-dp-or-ddp%2F16021)._