A small Python library that automatically sets CUDA_VISIBLE_DEVICES to the least-loaded GPU on multi-GPU systems and can be used by:

1. Putting import setGPU before any import that will use a GPU like Torch, TensorFlow, or JAX.
2. Defining an alias such as alias setGPU='eval $(python3 -m setGPU)' and calling that to set the GPU in the shell before running another program that uses the GPU.

pip install git+https://github.com/bamos/setGPU.git

• Jongwook Choi's gpustat library (pip install gpustat)

This code is in the public domain.