Skip to main content

Variable-Ratio Schedule

Curated by Seren • Skinner Box Experiments in Operant Conditioning

Definition

A reinforcement design where a reward is delivered after an unpredictable, varying number of responses, creating highly persistent habits.

In Context

A mechanical jam forced an accidental breakthrough. Running low on custom-made food pellets one weekend, Skinner altered his apparatus to dispense food only occasionally. Sometimes the lever yielded a reward after three presses. Certain trials demanded 20 strikes. Test subjects could never predict which specific action would deliver the pellet. Scarcity did not trigger abandonment. Subjects entered a state of frantic, continuous engagement. Unpredictability became the hook. Skinner had discovered the variable-ratio schedule. Random distribution of rewards generated a far higher rate of action than continuous feeding.

Primary Source

Skinner Box Experiments in Operant Conditioning

In 1930, B.F. Skinner built a mechanical wooden crate to measure the behavioral output of rats and pigeons. The resulting discovery of variable-ratio reinforcement stripped away the illusion of free will, establishing the behavioral foundation that now drives modern digital engagement.

Read Study (15 min) →

Artifacts

Glossary

operant conditioning
The behavioral modification process whereby the probability of an action is systematically altered by its subsequent reward or punishment.
extinction burst
The brief, intense surge in the frequency and force of a conditioned behavior that occurs immediately when a previously expected reward is permanently withdrawn.
manipulandum
The physical lever, key, or button interface within an operant chamber that a subject must physically depress to actuate the reward mechanism.
cumulative record
The real-time mechanical graph plotting cumulative behavioral inputs as a continuous, rising line over a fixed temporal canvas.
discriminative stimulus
A specific sensory cue, such as a light or tone, that signals to an organism whether a behavior will currently trigger a reinforcement reward.