Apps Artificial Intelligence CSS DevOps Go JavaScript Laravel Linux MongoDB MySQL PHP Python Rust Svelte Vue

Running LLMs on Your Local Computer

1 min read .
Updated on
Running LLMs on Your Local Computer

Have you ever wanted to run a large language model (LLM) directly on your own computer without depending on a cloud service? Tools such as Ollama make it possible to manage and run language models locally from a laptop or desktop.

This article walks through the basic setup and shows how to run a model on Linux and macOS.

Installing Ollama on Linux

For Linux, the installation process is straightforward:

  1. Open a terminal Open your preferred terminal application.

  2. Run the installation command Execute the following command:

curl -fsSL https://ollama.com/install.sh | sh

This downloads and runs Ollama’s official installation script.

Installing Ollama on macOS

On macOS:

  1. Download the installer Visit Ollama for macOS and download the ZIP file.

  2. Extract and install it Open the ZIP file and follow the normal installation steps.

Running Ollama

After installation, you can start working with models:

  1. Start the Ollama service

    ollama serve

    This starts the Ollama service so it is ready to accept requests.

  2. List installed models

    ollama list

    You can also browse the Ollama model library to find models to run.

  3. Run a model

    ollama run gemma2:2b

    Replace gemma2:2b with another model name when needed.

Conclusion

Ollama provides a convenient way to experiment with LLMs on your own machine. Local execution can improve privacy, give you more control over the runtime environment, and avoid relying on a remote service for every request.

For additional models and features, visit the official Ollama website.

AI

Related Posts

Object Detection with YOLOv8: Using a Pre-Trained Model on Images
Updated on
Object Detection with YOLOv8: Using a Pre-Trained Model on Images
In this article, we will experiment with YOLOv8 for object detection in images. YOLO (You Only Look Once) is one of the best-known object detection algorithms. YOLOv8 offers fast performance and accurate results. Fortunately, the ultralytics library makes it straightforward to use. What You Need Before you begin, make sure you have: Python The ultralytics library If it is not installed yet, install it with pip: Copy pip install ultralytics Simple Code Example Here is a short example that detects objects with YOLOv8:
AI
Practical Guide to SMS Spam Detection with BERT and PyTorch
Updated on
Practical Guide to SMS Spam Detection with BERT and PyTorch
In this article, we will explore SMS spam detection with BERT. BERT (Bidirectional Encoder Representations from Transformers) is a widely used NLP model architecture that can be adapted to many text tasks, including classification. PyTorch and Hugging Face Transformers provide a convenient way to work with BERT models. What You Need Before you begin, make sure you have: Python PyTorch Hugging Face Transformers An SMS dataset, such as the SMS Spam Collection, if you plan to fine-tune a classifier Install the required libraries with:
AI
Real-Time Object Detection with YOLOv8 and OpenCV
Updated on
Real-Time Object Detection with YOLOv8 and OpenCV
YOLO (You Only Look Once) is one of the most popular object detection approaches. In this article, we will use YOLOv8 with OpenCV to perform real-time object detection through a webcam. Prerequisites Make sure you have: Python 3.8+ The ultralytics library for YOLOv8 The opencv-python library for webcam access Install the dependencies with pip: Copy pip install ultralytics opencv-python Example Code The following Python example performs object detection from a webcam stream:
AI
Using YOLOv8 for Object Detection with Labels and Confidence Scores
Updated on
Using YOLOv8 for Object Detection with Labels and Confidence Scores
In this article, we will use YOLOv8 to detect objects in an image and print each object’s label and confidence score. YOLO (You Only Look Once) has long been a popular choice for object detection, and YOLOv8 provides a convenient Python API through the ultralytics package. Here is how to use it. Prerequisites Make sure Python and the ultralytics library are installed on your system. If needed, install the package with pip:
AI
chevron-up