DeepSeek-R1 explored

Why DeepSeek-R1 was a significant step for Open Source AI.

February 9, 2025 · 11 min · 2303 words · Patrick Schnaß

A view on BLT

Byte Latent Transformer (BLT), a tokenizer-free architecture for NLP.

January 2, 2025 · 5 min · 927 words · Patrick Schnaß

LLM Quantization in a nutshell

An exploration of LLM quantization methods.

January 28, 2024 · 5 min · 876 words · Patrick Schnaß

What is PEFT?

Fine-tuning of Large Language Models with Parameter Efficient.

November 1, 2023 · 11 min · 2201 words · Patrick Schnaß

Hands on with Retrieval Augmented Generation

Build a Chatbot that uses Retrieval Augmented Generation to retrieve domain specific knowledge.

October 7, 2023 · 5 min · 978 words · Patrick Schnaß

What is RAG?

Retrieval Augmented Generation is an Architecture used for NLP tasks.

September 29, 2023 · 8 min · 1596 words · Patrick Schnaß

Generalized Models vs Specialized Models

Intuition and hints for deciding between one generalized and multiple specialized models.

September 5, 2023 · 7 min · 1421 words · Patrick Schnaß

Attention is all you need?

Explore the Transformer Architecture.

August 30, 2023 · 4 min · 805 words · Patrick Schnaß

Road to GCP Professional Data Engineer

My learning journey to get certified

July 2, 2023 · 2 min · 255 words · Patrick Schnaß

What are Large Language Models?

What are the ideas and concepts behind GPT Language Models?

May 2, 2023 · 5 min · 1051 words · Patrick Schnaß