Tags → #llms
-
Low-Rank Adaptation (LoRA)
Explore how Low-Rank Adaptation (LoRA) enables efficient fine-tuning of LLMs through low-rank matrix decomposition and adaptive scaling.
-
Understanding the Internal Mechanics of LLMs
Understanding the internal mechanics of LLMs involves exploring tokenization, attention mechanisms, transformers, training, and inference processes.