赞
踩
1, 在yaml中 Turn on GPU access with Docker Compose | Docker Docs
- services:
- test:
- image: nvidia/cuda:12.3.1-base-ubuntu20.04
- command: nvidia-smi
- deploy:
- resources:
- reservations:
- devices:
- - driver: nvidia
- count: 1
- capabilities: [gpu]
To allow access only to GPU-0 and GPU-3 devices:
- services:
- test:
- image: tensorflow/tensorflow:latest-gpu
- command: python -c "import tensorflow as tf;tf.test.gpu_device_name()"
- deploy:
- resources:
- reservations:
- devices:
- - driver: nvidia
- device_ids: ['0', '3']
- capabilities: [gpu]
2, 执行以下命令
docker run --rm -ti --gpus device=1 -p 8080:8080 -e DEBUG=true -e MODELS_PATH=/models -e THREADS=1 -v $PWD/models:/models quay.io/go-skynet/local-ai:master-cublas-cuda12
Copyright © 2003-2013 www.wpsshop.cn 版权所有,并保留所有权利。