Operant Conditioning: Reinforcement Schedules, Contingencies & Behavior Modification

Operant conditioning (instrumental learning) is the behavioral framework by which organisms learn the relationship between their voluntary actions and the environmental consequences that follow. Formulated initially by Edward L. Thorndike and systematized by B.F. Skinner, operant psychology posits that behavior is shaped and maintained by its consequences.

For CUET PG Psychology (HUQP20), Unit 5 questions in this domain focus heavily on:

1. Historical & Conceptual Roots: Edward Thorndike's Law of Effect and B.F. Skinner's distinction between respondent and operant behaviors.
2. The Three-Term Contingency: Antecedent Discriminative Stimulus ($S^D$), Operant Response ($R$), and Consequential Stimulus ($S^R$).
3. The 2×2 Operant Matrix: Positive Reinforcement, Negative Reinforcement (Escape vs. Avoidance), Positive Punishment, and Negative Punishment (Response Cost / Time-out).
4. Primary, Secondary, and Generalized Reinforcers: Token economies and resistance to satiation.
5. The Four Basic Schedules of Intermittent Reinforcement: Fixed Ratio (FR), Variable Ratio (VR), Fixed Interval (FI), Variable Interval (VI), cumulative recorder curves (scallop vs. break-and-run), and the Partial Reinforcement Extinction Effect (PREE).
6. Advanced Behavioral Paradigms: Shaping via successive approximations, chaining, David Premack's Principle, Keller and Marian Breland's Instinctive Drift, and the Overjustification Effect.

1. Theoretical Foundations: Thorndike to Skinner

The Three-Term Contingency ($S^D - R - S^R$)

Skinner defined the unit of operant analysis through the Three-Term Contingency:

$S^D \to R \to S^R$

1. Discriminative Stimulus ($S^D$): The antecedent cue setting the occasion for behavior. Indicates that reinforcement is available if the response is emitted.
   • $S^\Delta$ (S-Delta): An antecedent stimulus signaling that reinforcement is unavailable (extinction).
2. Operant Response ($R$): The voluntary motor behavior emitted by the organism.
3. Consequential Stimulus ($S^R$ / $S^P$): The rewarding or aversive environmental event produced directly by the behavior.

2. The Master 2×2 Operant Contingency Matrix

All operant conditioning rests on two variables:

1. The Nature of the Consequence: Is a stimulus Added / Presented ($+$) or Removed / Withdrawn ($-$)?
2. The Effect on Future Behavior: Does the future frequency of the response Increase ($\uparrow$) or Decrease ($\downarrow$)?

[!CAUTION] NTA Exam Watch: Students frequently confuse Negative Reinforcement with Punishment.

• Reinforcement ALWAYS increases behavior. Negative reinforcement strengthens behavior by removing an aversive state (e.g., taking an aspirin to end a headache; fastening a seatbelt to silence an annoying chime).
• Punishment ALWAYS decreases behavior.

Subtypes of Negative Reinforcement: Escape vs. Avoidance

• Escape Conditioning: The organism emits a behavior that terminates an ongoing, currently present aversive stimulus (e.g., jumping out of freezing water; escaping a room filled with smoke).
• Avoidance Conditioning: The organism emits a behavior in response to a warning signal ($S^D$) to prevent the aversive stimulus from ever occurring (e.g., pressing a lever during a warning buzzer to avoid an electric shock).
  • Mowrer's Two-Process Theory of Avoidance (1947):
    1. Process 1 (Classical Conditioning): The warning cue ($CS$) is paired with shock ($UCS$), eliciting conditioned fear ($CR$).
    2. Process 2 (Operant Conditioning): The avoidance response terminates the warning cue ($CS$), escaping fear, which acts as negative reinforcement.