Uncategorized
Causality Versus Correlation
That two things move together does not mean one moves the other.
Uncategorized
Uncategorized
The Bitter Lesson: Computation Over Cleverness
Again and again, the elaborate hand-built method loses to the simple method that scales.
Uncategorized
Scaling: When Quantity Becomes Capability
Make a system larger, feed it more, and something changes in kind, not just degree.
Uncategorized
Interpretability and the Wish to See Inside the Black Box
A system can be accurate and still be opaque.
Uncategorized
Specification Gaming: Optimizing the Letter, Not the Spirit
Ask precisely for the wrong thing and you will receive it.
Uncategorized
The Alignment Problem: Goals We Cannot Fully Specify
We build systems to pursue objectives, but our true wishes exceed what we can write down.
Uncategorized
Exploration Versus Exploitation: The Explorer’s Dilemma
Act on what you know, or seek what you don't? Every agent that learns from its choices faces this fork.
Uncategorized
Transfer: Knowledge That Moves Between Tasks
What is learned in one place can pay off in another.
Uncategorized
Distillation: Compressing One Mind Into a Smaller One
A large model's competence need not stay large.