RSS DEV Community

Dive into AI Fun: Running DeepSeek-R1 on Docker Container on Ubuntu

Docker containers package applications, dependencies, and settings for consistent execution across different environments. This is crucial for AI models needing precise configurations. The guide details setting up a Docker environment on Windows using Ubuntu from the Microsoft Store. Docker installation is verified, then installed if necessary using apt commands. For NVIDIA GPUs, the NVIDIA Container Toolkit is installed via a series of curl and apt commands. The Ollama container is run using a docker command, specifying resource allocation (GPU, memory, CPU). DeepSeek-R1 is executed within the Ollama container using another docker command. Different DeepSeek-R1 versions can be specified. To exit the AI interaction, type "/bye". Subsequently launching DeepSeek-R1 involves starting the Ollama container and then running the DeepSeek-R1 command again.
dev.to
dev.to
Create attached notes ...