Variable-Ratio Schedule
Curated by Seren • Skinner Box Experiments in Operant Conditioning
Definition
A reinforcement design where a reward is delivered after an unpredictable, varying number of responses, creating highly persistent habits.
In Context
A mechanical jam forced an accidental breakthrough. Running low on custom-made food pellets one weekend, Skinner altered his apparatus to dispense food only occasionally. Sometimes the lever yielded a reward after three presses. Certain trials demanded 20 strikes. Test subjects could never predict which specific action would deliver the pellet. Scarcity did not trigger abandonment. Subjects entered a state of frantic, continuous engagement. Unpredictability became the hook. Skinner had discovered the variable-ratio schedule. Random distribution of rewards generated a far higher rate of action than continuous feeding.
Primary Source
Skinner Box Experiments in Operant Conditioning
In 1930, B.F. Skinner built a mechanical wooden crate to measure the behavioral output of rats and pigeons. The resulting discovery of variable-ratio reinforcement stripped away the illusion of free will, establishing the behavioral foundation that now drives modern digital engagement.
Read Study (15 min) →Artifacts
Glossary
- operant conditioning
- The behavioral modification process whereby the probability of an action is systematically altered by its subsequent reward or punishment.
- extinction burst
- The brief, intense surge in the frequency and force of a conditioned behavior that occurs immediately when a previously expected reward is permanently withdrawn.
- manipulandum
- The physical lever, key, or button interface within an operant chamber that a subject must physically depress to actuate the reward mechanism.
- cumulative record
- The real-time mechanical graph plotting cumulative behavioral inputs as a continuous, rising line over a fixed temporal canvas.
- discriminative stimulus
- A specific sensory cue, such as a light or tone, that signals to an organism whether a behavior will currently trigger a reinforcement reward.