Training a Model on Multiple GPUs with Data Parallelism

about 24 hours ago

This article is divided into two parts; they are: • Data Parallelism...

Train a Model Faster with torch.compile and Gradient Accumulation

1 day ago

This article is divided into two parts; they are: • Using `torch.

Training a Model with Limited Memory using Mixed Precision and Gradient Checkpointing

3 days ago

This article is divided into three parts; they are: • Floating-point Numbers...

Practical Agentic Coding with Google Jules

3 days ago

If you have an interest in agentic coding, there's a pretty good...

Evaluating Perplexity on Language Models

4 days ago

This article is divided into two parts; they are: • What Is...

3 Smart Ways to Encode Categorical Features for Machine Learning

5 days ago

If you spend any time working with real-world data, you quickly realize...

Pretraining a Llama Model on Your Local GPU

5 days ago

This article is divided into three parts; they are: • Training a...

Rotary Position Embeddings for Long Context Length

6 days ago

This article is divided into two parts; they are: • Simple RoPE...

How to Fine-Tune a Local Mistral or Llama 3 Model on Your Own Dataset

8 days ago

Large language models (LLMs) like Mistral 7B and Llama 3 8B have...

5 Agentic Coding Tips & Tricks

9 days ago

Agentic coding only feels "smart" when it ships correct diffs, passes tests...

The Real Cost of Inaction: How Silos Hurt Productivity for Data Scientists (Sponsored)

10 days ago

Top 5 Vector Databases for High-Performance LLM Applications

10 days ago

Building AI applications often requires searching through millions of documents, finding similar...