The control center for running local models (SLMs) and fine-tuning.
The AI Toolkit for Visual Studio Code is an extension that simplifies downloading, running, and testing Local LLMs (like Phi-3, Mistral, Llama) directly within your editor.
In VS Code, click the Extensions icon (blocks) on the left sidebar (or press Ctrl+Shift+X).
Type "AI Toolkit". Look for the one by Microsoft.
Click Install. A new icon (often looking like a sparkly box) will appear in your sidebar.
Click the new icon. You will see a "Model Catalog" where you can download optimized models to run offline.