How to Use LM Studio

Getting started with LM Studio

In this guide, you will learn how to set up LM Studio, browse and download language models from Hugging Face, and run them locally on your machine. By the end, you'll be able to interact with LLMs using a simple chat interface.

Step 1: Sign up and set up

1. Visit lmstudio.ai.
2. Click on the "Download" button to get the desktop application for your operating system (Windows, macOS, or Linux).
3. Install LM Studio by following the on-screen instructions.
4. Open the application. There is no sign-up required; you can start using it immediately.

Step 2: Your first model

1. In LM Studio, click on the "Models" tab located in the left sidebar.
2. Browse through the available models from Hugging Face. You can filter by categories or search for specific models.
3. Select a model by clicking on it. You will see details and a "Download" button.
4. Click "Download" to start downloading the model. Wait for the download to complete.
5. Once downloaded, go back to the "Chat" tab in the sidebar.
6. Select the model you just downloaded from the dropdown menu at the top of the chat interface.
7. Type your prompt in the text input field and press "Enter" to get a response from the model.

Step 3: Get better results

• Experiment with different models by repeating the download process. Each model has unique strengths, so try a few to see which one suits your needs best.
• Use the settings icon in the top right corner of the chat interface to adjust parameters like temperature and max tokens for more controlled responses. A lower temperature (e.g., 0.2) yields more focused answers, while a higher temperature (e.g., 0.8) generates more creative outputs.

Pro tip

If you want to save time, create a list of your favourite models by clicking the star icon next to them in the "Models" tab. This allows you to quickly access your preferred models without browsing each time.

Common mistake to avoid

Avoid downloading too many models at once, as this can overwhelm your system and lead to performance issues. Focus on one or two models that fit your needs before expanding your selection.