All courses
Course · 2 days
“AI under control”
Local language models in the company, with no data sent to the cloud. Two days of hands-on labs: from starting a model, through the interface and API, to working with company documents, automation and security.
Course agenda
Day 1 — models, Ollama, Open WebUI and APIs
- Introduction and Lab 0 — environment check
- Module 1. What a language model is
- Module 2. Cloud or on-premises
- Module 3. Choosing hardware and a model
- Lab 1. Ollama: installation, models and throughput measurement
- Lab 2. Open WebUI in Docker
- Lab 3. The Ollama API and the OpenAI-compatible API
- Module 4. Prompt engineering in a company
Day 2 — RAG, automation, security and operations
- Module 5. RAG — answers grounded in documents
- Lab 4. A knowledge base from PDF documents and quality tests
- Lab 5. Automating an administrator’s work
- Module 6. Fine-tuning models (LoRA) — an overview
- Module 7. Security
- Lab 6. nginx with TLS, access control and backups
- Module 8. Operations
- Lab 7. An IT-department assistant from scratch, following a checklist
The discussion of GDPR and the AI Act is technical and introductory. It does not replace legal advice.
If you would like to discuss this course for your team, write to us — we will get back to you and agree dates and terms.
Write to us about this course