S09 Lecture Outline LEARNING –

I. Learning

a. What is learning?

  1. A lasting change in behavior or mental processes due to experience.
  2. Associative Learning: Our minds naturally connect events that occur in sequence
  1. Behavioral Perspective
•Classical Conditioning
•Associate two related stimuli
•Response naturally elicited by one stimulus
comes to be elicited by a different stimulus
•Operant Conditioning
•Associate a response and its consequences
•Behaviors are emitted (in the presence of specific stimuli) to earn rewards or avoid punishments
  1. Cognitive Perspective
  1. Behavioral Learning
  2. Classical Conditioning
  3. Define
  4. Key Players
  5. Ivan Pavlov (1849 –1936)
  6. Russian physician, Nobel prize in 1904, studied digestive secretions
  7. “discovered “ classical conditioning when he found that dogs began to salivate in response to stimuli associated with receiving food,
  8. first person to apply scientific method to the study of learning by association
  1. John Watson
  2. Early Behaviorist
  3. Attempted to understand behavior in terms of observable stimuli and observable responses
  4. First to perform experiments using classical conditioning with humans
  5. Conducted the “ Little Albert” experiments*
  1. Key Concepts and Terms
  2. Stimulus - Response
  3. Unconditioned Stimulus(US): A stimulus that always elicits a specific unconditioned response in the absence of any training
  4. Unconditioned Response(UR): A response that is always elicited by a specific unconditioned stimulus in the absence of any training.
  5. Neutral Stimulus- A stimulus that does not elicit a specific response.
  6. Acquisition - the initial stage of learning, during which a response is established and gradually strengthened.
  7. Conditioned Stimulus(CS): a previous NS that acquires the ability to elicit a specific response
  8. Conditioned Response(CR): A response similar to the UCR that is elicited by the CS .
  9. Extinction - Weakening of a conditioned association in the absence of an unconditioned stimulus (presentation of CS without US leads to a lessening of responding and then no response)
  10. Spontaneous Recovery - Reappearance of an extinguished conditioned response after a time delay
  11. Generalization - CR triggered by stimulus similar to the CS
  12. Discrimination - CR is not elicited by stimuli similar to CS; CR is elicited only by a specific CS
  13. Vicarious Learning
  14. Aversive Conditioning
  15. Conditioned Avoidance
  16. Higher Order Conditioning
  17. Examples of Classical Conditioning
  18. Pavlov’s Dogs
  19. Little Albert
  20. Phobias
  21. Daily Activities
  22. Taste aversion
  1. Thoughts of Classical Conditioning

•Pavlov and Watson underestimated importance of cognitive processes (thoughts, expectancies, perceptions)

•Biological predispositions -constrain ability to learn particular associations

•Evolutionary history- Conditioning may serve a function of survival and reproduction ---by responding to cues that help gain food, avoid danger, defeat rivals, locate mates, etc.

  1. Group Exercise -Elements of Classical Conditioning
  1. Operant Conditioning
  2. Define: Operant behavior produces consequences Behavior is strengthened if followed byreinforcement or diminished if followed by punishment
  3. Key Players
  4. Edward Thorndike and the “Law of Effect”
  5. B.F. Skinner “Father of Operant Conditioning”
  6. Believed that the most powerful influences on behavior are its consequences
  7. Designed operant chamber to test the effects of reinforcement on behavior
  8. Soundproof chamber with a bar or key that an animal presses or pecks to release a food or water reward
  9. Contains a device to record responses
  10. Limits available responses thus increases likelihood that the desired response will occur.
  1. Explored the effects of reinforcement on learning, including the effects of primary and secondary reinforcers, immediate and delayed reinforcers and various reinforcement schedules
  1. Key Concepts and Terms
  2. Operant behavior– complex or voluntary behaviors that produce consequences
  3. Reinforcer - An event or stimulus that makes the behavior it follows more likely to occur again
  4. Positive Reinforcement -A pleasant event that follows an operant response and increases the likelihood that the response will recur
  5. Shaping - Reinforcing behavior that successively approximates a desired goal behavior. Shaping works by gradually guiding behavior toward the desired goal
  6. Successive approximations of goal behavior - Starting with existing behavior, reward behaviors that increasingly resemble desired behavior
  7. Negative Reinforcement - strengthens a given response by removing aversive stimuli.
  8. Avoidance Training- Learning a desirable behavior to prevent the occurrence of something unpleasant.
  1. Types of Reinforcers
  2. Primary Reinforcer- A reinforcer that is rewarding in itself, such as food, water, and sex that have an innate basis because of their biological value to an organism.
  3. Secondary Reinforcer -A reinforcer that acquires its reinforcing power through association with a primary reinforcer
  1. Developing Reinforcer Preferences
  2. Token economy
  3. The Premack Principle – Preferred activity reinforces less preferred activity
  1. Punishment

An aversive stimulus (event) that decreases the likelihood that an ongoing behavior will recur.

How does this punishment differ from negative reinforcement?

Reinforcers increase the rate of responding.

Punishers decrease the rate of responding

  1. Positive Punishment
  2. Negative Punishment
  3. Problems with Punishment
  4. Punishment as last resort
  5. For punishment to be effective it should be swift, sufficient, and certain (consistent).

b. Punishment is generally not as effective as the skillful application of reinforcement.

Group Exercise – Reinforcement or Punishment?

  1. Contingencies of Reinforcement
  2. Continuous Reinforcement- each correct response is reinforced *learning occurs rapidly, extinction occurs rapidly
  3. Intermittent or Partial Reinforcement – reinforcement does not follow every response -most effective way to maintain behaviors that have already been learned

* slower acquisition, greater resistance to extinction

  1. Schedules of Reinforcement
  2. Ratio Schedules – delivery of reinforcement depends on the number of responses
  3. Fixed Ratio Schedule
  4. Variable Ratio Schedule
  5. Interval Schedules- delivery of reinforcement depends on the passage of time.
  6. Fixed Interval Schedule
  7. Variable Interval Schedule

Fixed: the required sequence of responses is unchanging

Variable: required sequence of responses changes

Fixed Ratio

Reinforced after a fixed number of responses

Faster response =more rewards

Example: being paid for producing a specific number of items (as in a factory setting)

Brief pause in behavior that returns to very high rate of responding

Variable-ratio schedule:

Reinforced after unpredictable number of responses

very hard to extinguish because of unpredictability Examples: playing a slot machine, fishing, sales

Fixed-interval schedule

Reinforced first response after fixed time period

Choppy start/stop responding

Rapid responding at time for reinforcement

Example: receiving a salary paycheck every two weeks

Variable-interval schedule

Reinforced first response after variable time period

Produces slow steady responding

Example: surprise quizzes

  1. Group Exercise or worksheet - Schedules of Reinforcement
  1. Contrasts and Combinations of Classical and Operant Conditioning
  2. Group Exercise or worksheet
  3. Other

•Biological predisposition - we best learn behaviors similar to our natural behaviors, unnatural behaviors instinctively drift back toward natural ones.

•Overjustification Effect -A person may see a reward, rather than intrinsic interest, as the motivation for performing the task. This is known as the overjustification effect.

•Self reinfocment of behavior

  1. Cognitive Learning - learning that depends on mental processes that are not directly observable
  2. Social or Observational Learning

Form of cognitive learning in which new responses are acquired after watching others’ behavior and the consequences of their behavior

  1. Cognitive Maps

A mental representation of physical space that may be called on to solve problems when stimuli in the environment change

  1. Insight Learning

Occurs rapidly as a result of understanding all the elements of a problem. Problem solving occurs by means of a sudden reorganization of perceptions

  1. Cognitive-Behavioral Learning

IV. Biological Mechanisms in learning

  1. Long-term potentiation –
    Biological process involving physical changes that strengthen the synapses in groups of nerve cells; believed to be the neural basis of learning