Skip to content

Instantly share code, notes, and snippets.

View FlorSanders's full-sized avatar

Flor Sanders FlorSanders

5 followers · 7 following
View GitHub Profile
@FlorSanders
FlorSanders / JetsonNano2GB_LlamaCpp_SetupGuide.md
Created April 11, 2024 15:17
Setup llama.cpp on a Nvidia Jetson Nano 2GB

Setup Guide for llama.cpp on Nvidia Jetson Nano 2GB

This is a full account of the steps I ran to get llama.cpp running on the Nvidia Jetson Nano 2GB. It accumulates multiple different fixes and tutorials, whose contributions are referenced at the bottom of this README.

Procedure

At a high level, the procedure to install llama.cpp on a Jetson Nano consists of 3 steps.

  1. Compile the gcc 8.5 compiler from source.