DEV Community

How to Install and Run Sarvam – M Locally?

Sarvam-M is a multilingual language model built upon Mistral-Small, excelling in Indian languages, mathematics, and programming. It significantly outperforms its base model, showing substantial improvements across various benchmarks. The model features a hybrid reasoning mode, smoothly transitioning between complex problem-solving and casual conversation. Sarvam-M supports both Indic scripts and romanized versions, catering to diverse multilingual needs. Its strong reasoning abilities make it suitable for tasks demanding high accuracy in logic, math, and coding. The provided guide details a step-by-step process for local installation using a GPU-powered virtual machine. This involves setting up a NodeShift account, creating a virtual machine, and installing necessary software and libraries. Alternative installation via a browser using Gradio is also explained. Both methods facilitate running the model and interacting with it through a user-friendly interface. The guide concludes by highlighting Sarvam-M's versatility and potential for various applications.
favicon
dev.to
dev.to
Image for the article: How to Install and Run Sarvam – M Locally?