Pre-trained model

Language models

A pre-trained model has already learned from huge generic corpora before being made available. Rather than training a model from scratch, you start from this base and specialise it if needed (fine-tuning, RAG). This is what makes AI accessible: most of the investment has already been made by the labs.

In practice at Gensai

Gensai builds on market pre-trained models (Mistral, Claude, OpenAI, Gemini) and specialises them through context rather than retraining.

Same theme

LLM (Large Language Model)SLM (Small Language Model)DLLM (Diffusion Large Language Model)Hallucination (AI)Prompt chaining Foundation model Generative AI Transformer Token Context window Prompt Prompt engineering Context (AI)Memory (AI)Fine-tuning

Pre-trained model

In practice at Gensai

Go deeper

Same theme