STYLETHREAD -- LET'S TALK SHOP!

lol, dizzy, it sounds like you’ve been doing your own B.F. Skinner experiments! Skinner was a behaviorist psychologist who did a really famous food pellet experiment with rats. Skinner was all about "operant conditioning," meaning "the behavior is followed by a consequence, and the nature of the consequence modifies the organism’s tendency to repeat the behavior in the future."

And here are the details of his rat-pellet experiment:

Imagine a rat in a cage. This is a special cage (called, in fact, a "Skinner box") that has a bar or pedal on one wall that, when pressed, causes a little mechanism to release a foot pellet into the cage. The rat is bouncing around the cage, doing whatever it is rats do, when he accidentally presses the bar and -- hey, presto! -- a food pellet falls into the cage! The operant is the behavior just prior to the reinforcer, which is the food pellet, of course. In no time at all, the rat is furiously peddling away at the bar, hoarding his pile of pellets in the corner of the cage.

A behavior followed by a reinforcing stimulus results in an increased probability of that behavior occurring in the future.

What if you don’t give the rat any more pellets? Apparently, he’s no fool, and after a few futile attempts, he stops his bar-pressing behavior. This is called extinction of the operant behavior. A behavior no longer followed by the reinforcing stimulus results in a decreased probability of that behavior occurring in the future.

Now, if you were to turn the pellet machine back on, so that pressing the bar again provides the rat with pellets, the behavior of bar-pushing will "pop" right back into existence, much more quickly than it took for the rat to learn the behavior the first time. This is because the return of the reinforcer takes place in the context of a reinforcement history that goes all the way back to the very first time the rat was reinforced for pushing on the bar!

Schedules of reinforcement

Skinner likes to tell about how he "accidentally -- i.e. operantly -- came across his various discoveries. For example, he talks about running low on food pellets in the middle of a study. Now, these were the days before "Purina rat chow" and the like, so Skinner had to make his own rat pellets, a slow and tedious task. So he decided to reduce the number of reinforcements he gave his rats for whatever behavior he was trying to condition, and, lo and behold, the rats kept up their operant behaviors, and at a stable rate, no less. This is how Skinner discovered schedules of reinforcement!

Continuous reinforcement is the original scenario: Every time that the rat does the behavior (such as pedal-pushing), he gets a rat goodie.

The fixed ratio schedule was the first one Skinner discovered: If the rat presses the pedal three times, say, he gets a goodie. Or five times. Or twenty times. Or "x" times. There is a fixed ratio between behaviors and reinforcers: 3 to 1, 5 to 1, 20 to 1, etc. This is a little like "piece rate" in the clothing manufacturing industry: You get paid so much for so many shirts.

The fixed interval schedule uses a timing device of some sort. If the rat presses the bar at least once during a particular stretch of time (say 20 seconds), then he gets a goodie. If he fails to do so, he doesn’t get a goodie. But even if he hits that bar a hundred times during that 20 seconds, he still only gets one goodie! One strange thing that happens is that the rats tend to "pace" themselves: They slow down the rate of their behavior right after the reinforcer, and speed up when the time for it gets close.

Skinner also looked at variable schedules. Variable ratio means you change the "x" each time -- first it takes 3 presses to get a goodie, then 10, then 1, then 7 and so on. Variable interval means you keep changing the time period -- first 20 seconds, then 5, then 35, then 10 and so on.

In both cases, it keeps the rats on their rat toes. With the variable interval schedule, they no longer "pace" themselves, because they no can no longer establish a "rhythm" between behavior and reward. Most importantly, these schedules are very resistant to extinction. It makes sense, if you think about it. If you haven’t gotten a reinforcer for a while, well, it could just be that you are at a particularly "bad" ratio or interval! Just one more bar press, maybe this’ll be the one!

This, according to Skinner, is the mechanism of gambling. You may not win very often, but you never know whether and when you’ll win again.

Here’s the thing though, I don’t want to date a rat. 

laken1 wrote:

---

Sweet Potato Queen rule - treat em like shit & don't give em any. That's how you hook them. I just joking of course but it's kinda true..... I have another book that I need to pull & send to you Dizzy- it's something like "it's not me, it's YOU" - a dating book that is so hysterical & actually is right on & sounds a lot like your theory.

---