Loopskey-logo
Back to content
CourseTechnology

Local LLMs with llamafile

By External Provider

Price

Free

Go to content

Opens coursera.org in a new tab

Level

BEGINNER

Duration

2 h

About this course

In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examples

What you will learn

  • Package open-source AI models into portable llamafile executables
  • Deploy llamafiles locally across Windows, macOS and Linux
  • Monitor system metrics like GPU usage when running models