Dialogue and human feedback

Models were taught to answer the way a person finds useful: plain words, on point, following the request. People compared candidate answers, and the model was tuned on those comparisons.

Training on human preference turned a language model into an interlocutor. Natural language became the universal interface to computing.