# Multiple GPUs are being used despite \`--num\_processes 1\`

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-gpus-are-being-used-despite-num-processes-1%2F100203%3E%5C
**Category:** 🤗Accelerate\
**Created:** [July 31, 2024, 5:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-gpus-are-being-used-despite-num-processes-1%2F100203 "2024-07-31T05:35:16Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![seanswyi](https://avatars.discourse-cdn.com/v4/letter/s/6f9a4e/32.png) [@seanswyi](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fseanswyi)%5C
**Post date:** [July 31, 2024, 5:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultiple-gpus-are-being-used-despite-num-processes-1%2F100203%2F1 "2024-07-31T05:35:17Z")

</div>

I’m launching my script via `accelerate launch --num_processes 1 train.py`. However, the following code is printing the following output:

```Python
# Code
logger.warning(
        "Process rank: %s, device: %s, n_gpu: %s, distributed training: %s, 16-bits training: %s",
        training_args.local_rank,
        training_args.device,
        training_args.n_gpu,
        bool(training_args.local_rank != -1),
        training_args.fp16,
)

```

```plaintext
# Output
Process rank: 0, device: cuda:0, n_gpu: 4, distributed training: True, 16-bits training: True

```

Why is `n_gpu` 4, and why is the value of `local_rank` not being set to the default value of `-1`?

The code runs fine when I set `CUDA_VISIBLE_DEVICES=0`, but I would think that HF Accelerate would handle this without having to set environment variables.