Machine learning basics
Machine learning by trial and error, where a system acts, gets a reward or a penalty, and slowly learns which actions pay off.
Formal
A form of machine learning in which an agent acts in a setting, receives a reward signal for the results, and learns a way of choosing actions that brings the most reward over time, without being shown the right action.
In plain English
Like teaching a dog a trick with treats; nobody explains the trick, the dog just learns which moves earn a treat.
In practice
A region's energy manager tests a system that adjusts the ventilation in a hospital wing; it earns a reward for using less power and a penalty each time a ward gets too warm or too cold.
Why it matters
The system learns exactly what the reward measures, not what you meant, so a badly chosen reward can teach it to cheat or to please instead of to be right.