Getting Started with On-Premise, Open Source Generative AI

What does Open Source mean? 

Open Source Software Licences

On Premise vs Cloud Computing

Choose a toolchain

• Set up Ollama 

• Set up Open WebUI

• Choose models to install e.g. Llama, Mistral, gemma, Phi etc.

Adding Stable Diffusion for image generation

Torture Test some common models. Which model performs best?

Fine Tuning a model

An introduction to HuggingFace

Review alternatives to Ollama.

Reflection: 

• How well did the LLMs perform? 

• In what instances did they work well? 

• How do they compare to ChatGPT?

• Can you think of uses for an LLM running within your organisation?