Can You Teach A Computer To 'Feel' Suspense? | KERA News

Can You Teach A Computer To 'Feel' Suspense?

Aug 17, 2015
Originally published on August 17, 2015 6:48 pm

Siri is just the beginning.

Soon enough — like it or not — we are all going to be talking a lot more with computers, at least according to Brian O'Neill, a professor of computer science at Western New England University. They will be tutoring our students and tending to us in our old age. And a big part of their job will be telling stories.

It's about more than just entertainment. Teachers use storytelling in all subjects, including science and math classes. Doctors say understanding patients' stories improves health care. There's even evidence a good yarn can treat high blood pressure.

But O'Neill says there is a problem: Computers are boring storytellers.

"Right now we can get them to tell things that maybe are like very simple stories, but they're not interesting," he says. "And we're going to want those stories to be interesting."

The first step toward fixing this problem, as O'Neill sees it, is to teach computers how to recognize one of the key features of an entertaining story: suspense. To do that he needs a simple definition of suspense that he can program into a computer.

Here is the one he likes most: "We feel suspense when we have less and less hope for a character escaping a bad situation. The less hope we have, the more suspense we feel," he says.

Last year O'Neill wrote a computer program called Dramatis that he hoped, operating from that narrow definition, would be able to detect suspense in a Hollywood blockbuster. Dramatis can't actually watch a movie, but it can read a dumbed-down version of a script.

When the hero reaches a dangerous point in the plot, Dramatis asks itself: "If I were in this position, what could I do to get out?" In essence, it tries to imagine an escape plan. And the more implausible that plan seems, the more suspense Dramatis registers.

O'Neill and his colleagues put his computer program to the test by feeding it suspenseful movie scenes, including Grace Kelly's confrontation with a murderous neighbor in 1954's Rear Window, a very fateful moment for Professor Dumbledore in 2009's Harry Potter and the Half-Blood Prince and James Bond's treacherous poker game in 2006's Casino Royale.

Dramatis began dutifully reading and calculating.

In the Casino Royale scene, for example, Dramatis tracks 007 as he is poisoned by his archenemy during a poker game. Bond excuses himself, then swallows copious amounts of salt water to try to induce vomiting. But this first plan fails.

There is now less hope for a peaceful resolution for our protagonist and, accordingly, Dramatis increased the scene's suspense rating.

Next, Bond staggers out to his gadget-rigged Aston Martin and phones MI5 in London. The spy agency's doctors tell him to use a defibrillator to jump-start his heart immediately before he passes out. Bond hooks up the leads, and tries pressing the button to release a charge. But, over and over again, that doesn't work.

Dramatis, Brian O'Neill says, starts "feeling more suspense because we know what the plan was," and that plan is proving unsuccessful.

Finally, we learn that a wire is accidentally loose. And before Bond can reconnect it, he collapses from the poison.

"Now we have a much harder task, and we're going to feel even more suspense now," O'Neill says, "because it's much harder to come up with somebody else who can save James Bond."

In the end, Bond's sidekick Vesper Lynd zaps him back to life. But as things became worse for Bond, the Dramatis delivered higher and higher suspense ratings.

Since Dramatis had only been reading a written description of the scene, not watching it, O'Neill was later able to tweak the script to create a new version where Bond's escape is easier. O'Neill also created alternative, easier-to-escape versions of the Rear Window and Harry Potter sequences.

Finally, O'Neill had both Dramatis and human test subjects read both versions of the movie scenes and compare them. (Since Dramatis can only read — not watch — a movie, O'Neill gave the humans written descriptions of the movie scenes to level the playing field.) At the end of the experiment, the computer and the people were in agreement: The versions where heroes escape easier were less suspenseful to both readers.

So, does this mean Dramatis understands suspense as a human does?

Livia Polanyi, a professor of linguistics at Stanford University who specializes in narrative says this work is a meaningful advancement for computerized storytelling; Dramatis does a lot right.

But, she says, the computer still does not fully grasp what makes us feel suspense. It cannot detect music, anguished faces and, most importantly, the way we humans connect with the characters. If we don't care about them, we don't care what happens to them.

"I think we have to really account for what actually causes us to identify, to empathize and to care," Polanyi says.

Teaching empathy to a computer will take considerably more time, but for Brian O'Neill and other researchers trying to develop a less boring computer, Dramatis is a good first step.

Copyright 2015 NPR. To see more, visit http://www.npr.org/.

Transcript

AUDIE CORNISH, HOST:

This next story is about a robot and James Bond - not a plot for a new movie, but using Bond to try to teach a computer how to feel suspense. NPR's Chris Benderev introduces us to the project and the scientist behind it.

CHRIS BENDEREV, BYLINE: Brian O'Neill is a professor of computer science at Western New England University, and he believes that very soon, like it or not, we're all going to be talking more with computers. They'll be tutoring our students and taking care of our elderly, delivering jokes and rehashing their days. They'll be telling little stories like we all do, but, he says, there is a problem. Computers are super boring.

O'NEILL: Right now we can get them to tell things that maybe are, like, very simple stories, but they're not interesting. And we're going to want those stories to be interesting.

BENDEREV: To get to that point, he says, computers have to be able to recognize suspense. And to do that they'll need a very simple definition. Here is the one that he came up with.

O'NEILL: We feel suspense when we have less and less hope for a character escaping a bad situation. The less hope we have the more suspense we feel.

BENDEREV: Using that definition, he wrote a computer program called Dramatis that he hoped would be able to detect suspense in a Hollywood blockbuster. It can't actually watch a movie, but it can read a dumbed-down version of the script. When the hero reaches a dangerous point in the plot, Dramatis asks itself...

O'NEILL: If I were in this position, what could I do to get out?

BENDEREV: It tries to think up an escape plan. And the more that plan feels like a long shot, the higher it rates the suspense. Brian O'Neill put Dramatis to the test by feeding it this scene from a 2006 James Bond movie.

(SOUNDBITE OF FILM, "CASINO ROYALE")

DANIEL CRAIG: (As James Bond) Should we up the blinds?

O'NEILL: In "Casino Royale," James Bond is playing a poker game.

(SOUNDBITE OF FILM, "CASINO ROYALE")

UNIDENTIFIED ACTOR: (As character) So it's $14,500,000 and it's up to you, Mr. Bond.

O'NEILL: A very high-stakes poker game in order to bankrupt this villain who's funding terror.

BENDEREV: Bond takes a sip from his drink, but then he realizes it's been poisoned.

(SOUNDBITE OF FILM, "CASINO ROYALE")

CRAIG: (As James Bond) Deal me out.

O'NEILL: Quickly excuses himself from the table, grabs a salt shaker and a glass.

BENDEREV: He tries to drink a lot of salt water to make himself vomit, but this first escape plan...

O'NEILL: It doesn't do the job because the next thing we see is him staggering out into the street.

BENDEREV: New plan - Bond gets to his car and he phones London.

(SOUNDBITE OF FILM, "CASINO ROYALE")

TOBIAS MENZIES: (As Villiers) Bond's been poisoned. He's going into cardiac arrest.

BENDEREV: He pulls out a defibrillator to shock his heart.

O'NEILL: He starts pushing the button and it's not working, so we start feeling more suspense because we know what the plan was. Judi Dench is shouting that...

(SOUNDBITE OF FILM, "CASINO ROYALE")

JUDI DENCH: (As M) Push the damn button.

O'NEILL: We start to see that the wire's disconnected and that's when James Bond starts to pass out. Now we have a much harder task and we're going to feel even more suspense now because it's much harder to come up with somebody else who can save James Bond.

BENDEREV: In the end, Bond's sidekick zaps him back to life. But as things were getting worse and worse for our hero, Dramatis was delivering higher and higher suspense ratings. Later, Brian O'Neill had Dramatis and human subjects evaluate other movie scenes. And overall, the humans and the computer's suspense ratings matched up.

So does this mean Dramatis understands suspense? Livia Polanyi studies narrative at Stanford University, and she says Dramatis does a lot right. But it is still a long way off from fully grasping what makes us feel suspense; most importantly, our connection with the characters. If we don't care about them, we don't care what happens to them.

LIVIA POLANYI: I think we have to really account for what actually causes us to identify, to empathize and to care.

BENDEREV: Teaching empathy to a computer - that will take a while. But for Brian O'Neill, Dramatis is a good first step. Chris Benderev, NPR News. Transcript provided by NPR, Copyright NPR.