AI alignment vs Guardrails

Why they differ

Alignment shapes what the model itself tends to do; guardrails are separate checks placed around it that catch what alignment misses.

AI alignment

AI risk & governance

The work of making an AI system aim for what people actually intend, and refuse what they would not accept.

Formal

The field and practice of steering an AI system's goals and behaviour to match the intentions and values of its makers and users - helpful, honest, refusing harmful requests - including in situations it was never tested on.

In plain English

Like King Midas, who wished that everything he touched would turn to gold and got exactly that - including his food. The wish was granted to the letter, not to the meaning.

In practice

A research team at a Danish university adapts an open model to Danish, then has people rate its answers so it learns to admit when it is unsure and to refuse step-by-step help with building weapons.

Why it matters

A capable system that pursues a slightly wrong goal can cause harm at scale; as AI agents act more on their own, the gap between what we asked for and what we meant matters more.

Guardrails

AI risk & governance

Checks placed around an AI system that block unsafe requests going in and harmful or leaking answers coming out.

Formal

Rules, filters and small checking models that run before and after a large language model, screening input and output against a policy - blocking jailbreak attempts, removing personal data, forcing an allowed format - independently of how the model was trained.

In plain English

Like the barriers along a mountain road - they do not steer the car, but they stop it from going over the edge when the driver makes a mistake.

In practice

A webshop's customer service manager has every chat message pass a filter that flags jailbreak wording, and every reply pass a second one that hides card numbers before the customer sees it.

Why it matters

Training never makes a model fully safe, so outside checks give a second, testable line of defence that the owner can change quickly without training the model again.

Shared connections

Jailbreak