Truth, lies, and meaning in slow motion images

34
Rogers 1 Truth, lies, and meaning in slow motion images In A. Shimamura (Ed) Psychocinematics: Exploring Cognition at the Movies. Oxford University Press. Sheena Rogers, PhD Professor of Graduate Psychology Chair, Institute for Visual Studies James Madison University MSC 7401 70 Alumnae Drive Harrisonburg VA 22807 Email [email protected] Phone 434 249 2244 Fax 540 568 4747

Transcript of Truth, lies, and meaning in slow motion images

Rogers' 1'

Truth, lies, and meaning in slow motion images

In A. Shimamura (Ed) Psychocinematics: Exploring Cognition at the Movies. Oxford

University Press.

Sheena Rogers, PhD

Professor of Graduate Psychology

Chair, Institute for Visual Studies

James Madison University

MSC 7401

70 Alumnae Drive

Harrisonburg

VA 22807

Email [email protected]

Phone 434 249 2244

Fax 540 568 4747

Rogers' 2'

!

? ?

Slow motion images in film and video are often thought to truthfully represent events in

the real world, hence they are used in action replays and courts of law as evidence. While

such films preserve information about what, who, where and how often, a close look at a

variety of film and video images and empirical work from the author’s laboratory

demonstrate that some properties of the physical world are transformed. These

transformations could be considered lies in some contexts but they can also be the basis

of powerful aesthetic experiences when used artfully in film. The author’s three level

framework of image meaning is used to organize possible psychological responses to

slow motion images.

Art

Awe

Chills

Event perception

Film

Perception

Rodney King

Slow motion

Truth

Video

Rogers' 3'

? : : : : ? :

A pretty girl with scarlet hair walks alone in a London crowd. A sweet, sad song plays. A

young man walks toward her, oblivious. They are in slow motion, bouncing softly as they

step, inevitably approaching. Their eyes meet and lock: A story is about to begin. A love

story of course – the music, the connection across a crowd, the slow motion and soft

focus all prepare us to expect a sweet, romantic drama of the kind we have seen many

times before. The film is Mike Nichols’ Closer (2004). The set up is a con. In the few

minutes of the opening scene Nichols’ has put us where he wants us – in a state of

innocent, dreamy expectation – ready to be hurled along the emotional roller coaster of

the movie. Closer is anything but the corny, sappy drama the opening scene portends and

the contrast is powerful.

A bride struggles to run through grass, vines snaking around her legs. She is light, almost

floating, and no match for the tough cords that bind her and prevent her escape. Her face

is panicked. The scene is in slow motion and thus we know that it is not the bride’s

reality we see. It is an image in her head and the scene is a depiction of her desperate

state of mind as she sinks into a terrible depression. (Melancholia, Lars von Trier, 2011.)

Slow motion is common in film and video and is used to produce a wide variety of

effects from the narrative to the aesthetic to the purely descriptive. The scenes I just

described are typical in film. Think of Andrew’s (Zach Braff) apathy and depression in

Garden State (Braff, 2004), depicted memorably through a dream scene in which he sits

motionless staring straight ahead, a passenger in a plane that shakes and rolls in slow

Rogers' 4'

motion. The soda cans on the flight attendant’s cart wobble and fall lightly. The cart and

the doomed plane itself are flexing and no longer rigid: The laws of physics are

apparently suspended. Stephen Spielberg’s Saving Private Ryan (1988) uses slow motion

and varied shutter speeds to put us inside the soldiers’ shell-shocked heads and to create

the jittery look of period news footage. Arthur Penn’s fatal ambush scene in Bonnie and

Clyde (1967) manages to be romantic (and relatively bloodless) and at the same time

intense and exhilarating through rapid-fire cuts and alternating slow and normal motion.

A sweating and bloodied boxer hitting the ground hard (Raging Bull, 1980; Rocky, 1976)

is now a cliché but nonetheless beautiful: gleaming muscled flesh floats to the ground,

softens on impact, bounces painlessly. An updated version in contemporary action

movies - The Matrix, 1999; Hero, 2002 - emphasizes the beauty of human movement (or

arrows, bullets, and yards of floating silks) through slow motion moments that carry the

other worldliness we saw in Melancholia and Garden State even further. Earthly physical

laws no longer apply, the characters are magical, and the depicted world clearly is not our

own. The potential of slow motion images to be profoundly beautiful has long been

realized in film. The climactic explosion in Antonioni’s Zabriskie Point (1970), its

cinematic awesomeness matched frame for frame by Pink Floyd’s thrill inducing

soundtrack, is arguably over the top but still bringing in crowds on YouTube.

? ? :'Normal speed film is shot at 24 frames per second (Hz) and then projected with two or

three repeats of each frame to produce a visually smooth and continuous 48 or 72 Hz (see

Shimamura, this volume, p. X). The best quality slow motion image requires many more

Rogers' 5'

frames per second to be shot which, when played back at the standard frame rate, slows

time and reveals hitherto unseen mysteries. While entertaining us, such images also serve

to educate. “By varying the speed of the camera (assuming the projector speed remains

constant) we can make … a tool that can be applied to time in the same ways that the

telescope and the microscope are applied to space, revealing natural phenomena that are

invisible to the naked eye.” (Monaco, 1981, p. 76.) This tool has revealed the

deformation of a golf ball hitting a steel plate at 150 mph (USGA); the biomechanics of a

race horse galloping (Discover Magazine) and even the perfect golf swing of Tiger

Woods (Nike). (URL’s to these and all cited videos are listed at the end of the chapter.) A

search on YouTube for slow motion clips will reveal many more examples, some

professionally produced and some by amateurs. “Droplet collisions at 5000fps” (by the

Slow Mo Guys) at playback is 200 times slower than normal, but many startling images

are shot at 1000 Hz or less, and most current domestic HD palm camcorders will record

at satisfyingly high frame rates and produce smooth slow motion images.

? : : : : ? :

“It doesn’t take many viewings of slow and fast motion made with primarily scientific

purposes in mind before it becomes obvious that the variable speed of the motion picture

camera reveals poetic truths as well as scientific ones” (Monaco, 1981, p. 77).

The contrast between my examples of slow motion in movies and slow motion in the

short clips found on YouTube is revealing. Hero and The Matrix use slow motion to

Rogers' 6'

create the feeling that the action takes place in other worlds, other realities. Garden State

and Melancholia attempt to infect us with their characters’ depressed mood state. Closer

opens with a (misleading) cue to a genre. What the film examples have in common is that

truth, in the scientific sense, is not a concern. We would never react to the legendary

scene in The Matrix where Neo (Keanu Reeves) dodges a bullet by saying “That could

not have happened”. Instead, we suspend disbelief and take note of the clue that we are

not in Kansas anymore (and conclude that Neo is indeed the Chosen One). Andrew’s

apathy and alienation (Garden State) and Justine’s clinical depression (Melancholia)

slow down the workings of their minds but the representation of this interior state in the

movie through slow motion images presents poetic truths not scientific ones. On the other

hand, the point of the scientific and educational slow motion images is the display of

truth – especially previously unknown truths. You think a golf ball is hard? Look how it

flattens like a pillow against the wall. And a pricked water balloon? Who knew the water

would hold its global form for a moment once the rubber walls are gone?

Truth in the context of this chapter will refer to the extent to which a slow motion film

captures reality and, by reality, I mean the specific real world events being recorded by a

film or video camera, even if these events are themselves part of a fictional narrative. I

consider that such truths are foundational to our more elaborated experience of a film. I

propose that there are three levels of meaning possible in our experience of film and other

moving images. First we must understand what is there and what event is unfolding (at a

very elementary level), then we can go on to make sense of the event with higher level

psychological processes involving thought, ideas and inferences, sometimes using

Rogers' 7'

knowledge drawn from outside the film itself, concerning the narrative, style and form,

socio-historical context, and so on. Ultimately, after we have achieved these two levels of

understanding and appreciation, our encounters with film (and other art forms) sometimes

generate additional meaning and insights that result in profoundly affecting aesthetic

experiences.

To distinguish these levels of meaning in film it is helpful to think of the foundational

level of viewers’ film experience (Level I), where the subject matter of this chapter

largely resides, as based on sensory and perceptual processes that do not require any

special experience with motion pictures. Filmmaking techniques such as continuity

editing and the careful deployment of the variable speed settings on a motion picture

camera are devices filmmakers use to create a sequence of moving images that direct our

attention and feed meaningful information about objects and events in the world of the

film to our perceptual systems (see Smith, in press, and the responses to his target article

in the same volume for more on attention, perception, and continuity editing). Once this

sensory foundation is laid, the filmmaker can proceed to help us build additional layers

rich in meaning, drawing on our experience of film and of the world, and on our ability to

think, to reflect and to evaluate (Level II). As human beings, our emotions are

inseparable from our perceptual and cognitive processes but emotions, too, have a

foundational level tied closely to basic sensory and bodily processes, and a higher level

that is more reflective and exploratory. A full appreciation of a film requires our

engagement at this second level where sensation, perception, knowledge, thoughts, ideas,

evaluations, and emotions come together to produce (hopefully) a memorable aesthetic

Rogers' 8'

experience. Occasionally, film viewers (and consumers of other art forms) report peak

aesthetic experiences that seem qualitatively different from our daily enjoyment of

movies. These experiences seem to indicate a third level of meaning is possible, and

indeed, some film and video artists actively pursue it in their work, as we will see later

(Level III). For now, we will focus on Level I meaning in our discussion of truth and lies

in slow motion images. (For more on attention, perception, and the levels of meaning

possible in our experience of motion pictures, see Rogers, in press.)

Moving images inherit, and perhaps enhance, the property of apparent truthfulness from

their still cousins: photographs. “Photographs furnish evidence. Something we hear

about, but doubt, seems proven when we are shown a photograph of it… A photograph

passes for incontrovertible proof that a given thing happened. The picture may distort; but

there is always a presumption that something exists, or did exist, which is like what is in

the picture.” (Sontag, 1973, 1977, p. 5). Slow motion images, by giving us time to look,

by revealing brief details, appear to give us even more access to the truth than normal

moving images, and these in turn are potentially more truthful than still images as they

carry incrementally more information about objects and events. (See Rogers, 1995, 2000,

and 2007 for extended accounts of the information available in still and moving images,

stereoscopic images, and virtual reality).

When I ask students and colleagues to talk to me about slow motion images they

invariably claim that such images are more truthful than moving images at normal speed.

They bring up sports examples, particularly action replays, which are intended to show us

Rogers' 9'

“what happened”. Sports and news footage both have the authority of scientific slow

motion images. Their ability to depict the truth is taken for granted and we expect to trust

the evidence of our senses. Which horse’s nose crossed the line first? Was the ball over

the line? Did the player’s hand touch the ball? And sometimes, What was the player’s

intention? For a startling example of this last question, see the online video, “Football

blooper –slow motion-” for replays of the moment when one soccer player mistakes the

head of another for the ball. A head is, after all, about the right size and shape and in this

case it was on the ground about where the ball would have been. The slow motion image

allows us to see exactly WHO, touched exactly WHAT, WHERE, WHEN and HOW

OFTEN. We will see later that the question WHY? And, With how much force? And

other aspects of our understanding of the nature of the event are not entirely a matter of

inference and interpretation but are supported by rather basic perceptual processes.

? : : ? :

Amateur video of newsworthy incidents is now commonplace. Almost everyone carries a

cell phone and many cell phones are capable of video recording. When we see these

videos on the television news we believe we are seeing a record of the events as they

unfolded. It seems to us as viewers that the camera is an optical instrument separating us

from the depicted events in the same way our binoculars separate us from a bird in a tree.

The bird is really there, really singing, and we see it. A cop calmly sprays seated student

protesters with tear gas, and we see it, but through the lens of someone else’s cell phone

camera. The grieving father of a two-year old boy killed in an attack on his neighborhood

by Syrian government forces was really there, really weeping, and we see it. We see it

Rogers' 10'

with our own eyes and we reject the claim by Zouheir Jabbour, the Charge d’Affaires at

the Syrian Embassy in Washington DC, that the image is a lie. "In the time of

computers,” Jabbour said in an interview with Melissa Block on NPR’s All Things

Considered, “you can fabricate whatever you like and go to Al Jazeera and go to Al

Arabiya and you can see all that fabrication." He does not deny that someone filmed a

crying man holding his toddler. Jabbour wants us to treat the horrifying news images

coming out of Syria as I write as if they were fiction – with actors, pretend emotions,

props, special effects, and even directors, cinematographers and editors contributing to

the construction of a story. The realism of the photographic and video images is not in

question – the truthfulness of the story being told is.

Almost everyone believes that the camera itself doesn’t lie. Philosopher Kendall Walton

argues that a photographic image (still, video, or film) is transparent (Walton, 1984). He

means that photographic images have a special status compared to, “paintings, drawings,

and other “hand-made” pictures” (ibid, p. 246). While the photograph is not the same

thing as the thing depicted – this takes realism too far – Walton’s claim is that it is

possible to see the thing depicted with the aid of the photograph.

“Photography is an aid to vision also, and an especially versatile one. With the

assistance of the camera, we can see not only around corners and what is distant

or small; we can also see into the past. We see long deceased ancestors when we

look at dusty snapshots of them. … Photographs are transparent. We see the

world through them. I must warn against watering down this suggestion, against

Rogers' 11'

taking it to be a colorful, or exaggerated, or not quite literal way of making a

relatively mundane point. I am not saying that the person looking at the dusty

photographs has the impression of seeing his ancestors – in fact, he doesn’t have

the impression of seeing them “in the flesh”, with the unaided eye. I am not

saying that photography supplements vision by helping us to discover things we

can’t discover by seeing. … My claim is that we see, quite literally, our dead

relatives themselves when we look at photographs of them.” (Walton, 1984, p.

251-252.)

Walton’s transparency claim appears to provide a solid basis for our use of still and

moving photographic images to decide whether a ball is in or out, whether a soccer player

was offside, or fouled another player. It allows us to trust that scientific images of water

droplets colliding, golf balls flattening, or seeds germinating (in time lapse, or ‘fast

motion’ images) show us the unseen truth about these processes. Indeed, the transparency

claim encourages us to take our amateur street images beyond the court of public opinion

(and the news media) and in to a court of law, to use them as evidence of wrong-doing.

Objections to their use as truth-sayers seem to be restricted to arguments like Zouheir

Jabbour’s – that they could be fictional (faked, posed) or tampered with (Photo-shopped,

edited). It is hard to resist Walton’s claim that photographic images are transparent, that

the camera is a device to assist us in seeing what is really there, but I will propose here

that slow motion images provide a challenge to our intuitions about the inherent

truthfulness of photographic moving images.

Rogers' 12'

By ‘truthfulness’ I mean that the image can show us what really happened; that our

perception of the event shown in a moving image matches the reality of the event in all

relevant ways. In a slow motion image, of course, the speed of the event will be

misrepresented and viewers understand this and are aware of it if the frame rate is far

enough from normal. What they may not be aware of is that while slowing the image

maintains some aspects of the original event and simply allows us a better look, it also

changes some aspects of the event for us perceptually and these changes can result is a

change in the meaning of the event. Changes in meaning are exactly the effects that

filmmakers are interested in of course. If we think of the raw material of the filmmaker’s

art as the subjective experience of the viewer, and not the physical stuff of cameras, film,

pixels and so on, then frame rate, shutter speed, and continuity editing are the tools by

which our experience while watching the film is shaped (see Rogers, in press, for a

discussion of the idea of continuity editing and the filmmaker as cognitive scientist).

And, to be clear, if the filmmaker can readily shape our experience of events, then we

should begin to worry about the use of film and video in high stakes situations such as

courts of law, and we should especially worry about any decision by the defense or

prosecution to show such images in slow motion in the supposed interest of greater

veracity.

I would like to draw your attention to an interesting side effect of watching an event in

slow motion images. In the movie examples at the beginning of the chapter, I noted how

Alice and Dan in Closer (Natalie Portman and Jude Law) bounced softly as they walked.

The depressed bride Justine in Melancholia (Kirsten Dunst) appears light, almost

Rogers' 13'

floating. Soda cans fall lightly in the shuddering plane in Garden State. And we laugh

when the blue-shirted soccer player’s boot connects with the yellow-shirted player’s

head: His head is oddly light, the kick mysteriously gentle. The perceived weight of

depicted objects has changed – slow motion seems to make things appear lighter. Objects

drift rather than plummet to the floor. The force with which feet hit the ground, or with

which objects collide, seems reduced. The magical ‘other-worldly’ feeling produced by

slow motion battles in The Matrix, Hero, and other films in their respective genres is the

result of our awareness that Earthly laws of physics have apparently changed. In fact, one

YouTube commentator remarking on Neo’s dodging-bullets scene writes, “i like how

moving so fast also means you can lean backwards and wiggle your arms around....and

not fall over. coz f*** gravity (sic).” (“Bullet time” comment).

YouTube comments on extreme slow motion video of objects deforming on impact with

other objects (a very popular genre including lots of punched or slapped faces) show that

viewers often doubt the veracity of the images. See the comments on the online video

“Golf ball hitting steel super slow mo” for examples, most of which are not polite enough

to be quoted here but, paraphrasing, they strongly insist the images are faked. Some

videos loudly cite their scientific bona fides in order to counter our tendency to reject the

truth revealed in extreme slow motion images as lies and special effects (see the USGA

version of the golf ball event, and the Discovery.com show, “Time Warp”). Viewers

struggle to believe that a golf ball or a human face can undergo the wildly elastic

deformations under very forceful impacts that are visible in extreme slow motion images

(5000 Hz, 7000 Hz and up). It is not visible at normal speed, we have never seen it in real

Rogers' 14'

life, and hence it cannot be true. Even at relatively moderately increased frame rates, that

only slow events a little, we are often aware when watching the image that something is

not quite ‘right’, even when the slowing is not itself detectable. In the movies, such

scenes tempt film scholars to view them over and over, perform a shot-by-shot analysis,

and to study interviews with the filmmakers in order to figure them out. (The Omaha

beach landing scene in Saving Private Ryan and the ambush scene in Bonnie and Clyde

are popular examples.) The occasional awareness that something is not quite right in a

movie does not mean that viewers always know exactly what is not right, nor does it

mean that they notice every single time reality has been altered. Most of the time viewers

see the version of reality the filmmaker has presented to them and accept it. The viewers’

perception of the event no longer matches the event itself: The slow motion film has lied

about something. Of course, if the filmmaker’s intent is to communicate a poetic truth

about the beauty of athletic movements, or about the mood state of a character, the loss of

scientific truth about the weight of objects, or about the force of an impact matters little.

There are situations where such truths matter, however, and they are important enough to

demand that we develop a better understanding of the possibility of truth and lies in the

meaning of slow motion images. The empirical methods common in research on visual

perception can help us with this enterprise, and are part of the new field of

Psychocinematics. In the following example we will see how the scientific method

illuminates questions previously tackled only by humanities scholars, bringing additional

insights to society’s understanding of how images work and when they can be trusted.

Rogers' 15'

: : ? ? : : ? : A

One night in March 1991, George Holliday pulled out his new home video camera to

shoot a drama unfolding in front of him in the dark. The California Highway Patrol had

pulled over a speeding motorist following a high-speed chase. The LAPD arrived to assist

in the arrest. The motorist was Tasered and beaten with steel batons. Other police officers

stood by and watched. Holliday’s footage of the beating quickly hit television news

channels around the world and Rodney King, a Black American motorist, became a

household name in a story of White American police brutality. (A link to a clip of the

video is provided in the list at the end of this chapter.) A year later, four police officers

were acquitted of using excess force in the arrest and Los Angeles burst into riot-fueled

flames. News reports of the case focused on issues of race, civil rights, brutality, and

police training (Gray, 2007). Soon after, academic circles were abuzz with concern about

a little discussed fact in the news media: The jury that acquitted the four cops had been

shown Holliday’s footage in slow motion with the sound removed. Cultural studies

scholars attempted to explain how manipulation of the footage allowed the defense to

build a narrative of their choosing, taking advantage of the jury’s human tendency to trust

that the camera showed them what really happened that night.

“In the courtroom … lawyers for the defense slowed down the video and removed

the sound. Frame by frame, they used the tape to illustrate a narrative in which the police

perceived King as a PCP-crazed threat who fully controlled his own beating; King, they

argued, could have ended the beating merely by lying still on the ground.” (Bernstein,

2000, p. 121.)

Rogers' 16'

Defense lawyers froze the images, wrote on them, and circled a raised foot.

Grossberg, Radway and Olson (1995) examined the effect of these interventions and of

slow motion in particular in distancing King’s erratic behavior from the Tasering event.

The film’s “slowed motion stretched the links between action and reaction until they

could be broken.” (ibid, p. 515). Grossberg et al and Bernstein have had an important

insight. While it might appear at first glance that these scholars are making a case similar

to Jabbour’s – that the images were manipulated to such a degree that they amount to a

fabrication – experimental research in my own laboratory suggests that slowing the image

leads to the irresistible perception of a different reality than the one Holliday encountered

that night. One of the jurors who acquitted the officers admits as much in an interview

with Ted Koppel of ABC News. The unidentified juror first gives the defense version of

the story, but then makes a crucial addition:

'The cops were simply doing what they'd been instructed to do,' the juror was quoted as

saying. 'They were afraid he was going to run or even attack them.'

Mr. Koppel said the juror criticized the video as unsteady and out of focus, and

questioned the seriousness of Mr. King's injuries.

'A lot of those blows, when you watched them in slow motion, were not connecting,' the

juror was quoted as saying. 'Those batons are heavy, but when you looked at King's

body three days after the incident, not that much damage was done.' (Seth Mydans,

New York Times, April 29th, 1992. Emphasis added.)

Rogers' 17'

The juror is telling us what he or she saw in the slow motion video: the blows ‘were not

connecting’, the steel batons were known to be heavy but ‘not that much damage was

done’. News reports detail broken bones and numerous cuts and bruises resulting from

the 56 baton strikes, and images of a battered Mr King are readily found on the internet

(The Los Angeles Daily News has a timeline, an image gallery, transcripts, and numerous

news stories). The juror’s experience of the slow motion images of forceful impact events

as gentle, as barely or not connecting, should sound familiar. Alice and Dan’s footfalls in

the opening scene of Closer land softly. Justine is so light as she runs in Melancholia it

seems the encircling vines tether her like the string on a balloon. The heavy soda cans

look light and empty as they fall slowly to the ground. And remember we laughed when

the soccer player’s boot connected with the head of an opponent, partly out of surprise

and empathy, but also because the blow seemed barely to connect, the kick looks rather

gentle in the slow motion action replay. We have also noticed how soft and elastic even

quite hard objects can appear when they are struck forcefully and the event is viewed in

slow motion (the golf ball, and people’s heads and other body parts). No close ups of

Rodney King’s head being struck by a heavy steel baton exist, but his body bounces

gently with each blow. In slow motion the baton wielding arm is raised and lowered in

what seems to be a careful, controlled way and the strikes fall softly. At normal speed the

strikes appear frenzied, vicious, hard.

? : : ? ?'Experiments in my laboratory demonstrate the key perceptual effects of forceful impact

events viewed in slow motion. My students and I videotaped a variety of events using the

Rogers' 18'

maximum frame rate on a Sony HD Handycam video recorder, a high-end domestic

camera (240 frames per second stretches a 3 second event to 12 seconds in playback).

The events include hands clapping, people jumping, a boxer pounding a punch bag, Jello

dropping on to a tabletop, a light plastic and a heavy metal baseball bat striking a pillow

topped with loose leaves, or with flour, and a hammer striking one light bulb gently till it

breaks, and another more forcefully. Each of these images was edited to play back at

normal speed, slightly fast (about twice normal speed), slightly slow (about half normal

speed), and slow (about a fourth normal speed), and trimmed to a similar length (just a

few seconds for each event). Twenty observers watched five films at all four speeds in a

random order, and they were asked to rate the events on a variety of dimensions. How

forceful was the impact (from very gentle to very forceful on a 7-point scale)? How soft

or hard was the material (from very soft/flexible to very hard/rigid)? How much effort

was exerted in the blow (from very little effort to a great deal of effort)? And finally, how

natural did the image appear (from very unnatural/fake to very natural/no special

effects)?

The results of these laboratory studies showed that the amount of force observers

perceived in each impact event was directly controlled by the speed of the playback. The

slower the motion the more gentle the impact appeared to be. Similarly, the amount of

effort the unseen actor appeared to put in to the act of striking an object, clapping, and so

on, also varied directly with the speed of the playback. At faster playback speeds, more

effort was perceived, at slower playback speeds, less effort was perceived, as we had

predicted. All materials that deformed visibly on impact were perceived as softer in slow

Rogers' 19'

motion, firmer in fast motion. The exception was the light bulb, which shattered and was

always reported as brittle, although the slow motion versions of this event often raised a

laugh as the bulb was hit the first time and, not breaking, bounced unnaturally before

exploding with a subsequent blow.

What is important about these laboratory findings is that the degree of perceived force,

perceived effort, and the perceived rigidity of the material varied smoothly with the

change in the speed of the image motion. The smooth functional relationship between the

pairs of variables suggests that image characteristics are entirely responsible for

perception. Observers are not decoding a visual trope – a slow motion image does not

signify a gentle impact event. Perception was not categorical so that slow motion images

were perceived and grouped one way, normal or fast motion images another way. Instead,

we can infer that the dynamics of the moving image are perceived in the same way a

directly-witnessed, real event would be perceived if the objects were moving at the

speeds depicted in the video clips. Faster impact events in real life are, after all, more

forceful than slow ones. Rigid materials give way more slowly than soft ones. Extreme

deformations of an object could indicate extreme forces but the “Golf ball hitting a steel

plate at 150 mph” video suggests that we are more likely to perceive the material as

unexpectedly soft, than to perceive the true degree of the force that caused it.

We can conclude from the study that some aspects of events shown in slow motion

images, such as the force of an impact, are not decoded or consciously interpreted by the

Rogers' 20'

viewer; they are perceived directly and they are irresistible1. Within the range of speeds

we used in the study reported here, images rarely looked unnatural. (An extension of the

research could consider conditions when images are slowed to the point that slow motion

is detected and foul play suspected.) Observers could not readily say whether a particular

image was slowed, speeded, or normal. After all, hand claps and baton strikes can be

slow or fast. These were not the extreme slow motion images that raise cries of disbelief

on YouTube. They were subtle, believable, and powerfully misleading. Each brief event

was perceived as truthful. Observers responded as though they were witnessing events

just as they had occurred. If these video clips had been evidence in a courtroom observers

might have said, as did the juror interviewed by Ted Koppel, “a lot of those blows …

were not connecting… not much damage was done”. The jurors in the trial of the police

officers who beat Rodney King were lied to when they were shown George Holliday’s

home video in slow motion. A video of an event is presented as truthful, as transparent to

use Walton’s term (Walton, 1984). Jurors had no reason to suspect that they were not

seeing “quite literally” (Walton, p. 252) the events as they happened and, indeed, we have

no reason to doubt that the video is a truthful record of much of what happened that night

even when shown in slow motion. The video truthfully depicts 56 baton blows, identifies

the individuals who delivered them, and the location of each impact on King’s body. It

truthfully shows the order of events, and the location of the people present. In slow

motion, however, blows appear less forceful, the receiving body appears softer, more

cushiony, the assailants appear less frenzied, somewhat gentler, more purposeful. For a

''''''''''''''''''''''''''''''''''''''''''''''''''''''''1'The'idea'that'images'are'systems'of'codes'or'symbols'that'must'be'read'like'a'language'rather'than'carriers'of'natural'meaning'that'can'be'perceived'directly'is'popular'among'many'film'scholars,'and'has'its'origin'in'the'work'of'linguist'Ferdinand'de'Saussure'(Monaco,'1981).'

Rogers' 21'

jury asked to consider whether excessive force was used, these alterations to the truth

matter. Both a filmmaker who employs slow motion in a movie, and a defense lawyer

who chooses to present slow motion images as evidence in a courtroom are shaping the

subjective experience of an audience. Both are in a sense deceptive but when we bought a

ticket for the movie theater we signed on to an expectation of fiction and any technique

the filmmaker employs to create that fiction is fair. It should go without saying that

different standards should be in place in a courtroom.

A : : : ? : : A

Our diversion to a Californian courtroom and to my laboratory might leave some readers

impatient to return to a discussion of film. There is clearly much more to film than its

ability to mislead us about the weight of a baton, or the force of an impact. These

alterations to the physical properties of the world we perceive are intentional in

filmmaking, but they are subservient to greater aesthetic goals. As we have seen, the

filmmaker uses the slow motion images to create an experience and to deliver meaning. I

suggested at the beginning of the chapter that it is useful to organize our experience of

meaning in the appreciation of film into three levels. Most of our discussion of slow

motion images in the present chapter concerns the first of those levels. So that we don’t

lose sight of the bigger picture, however, and to avoid the risk of giving the impression

that I underestimate the complexity and richness of the film viewer’s experience, I will

place this work in the context of an organizing framework of psychological aesthetics,

Rogers' 22'

and consider how slow motion images can be the source of additional layers of meaning

at the second and third level in my proposed hierarchy.

A : :

The name I give to this foundational level is intended to remind us that Level 1 concerns

natural meaning (which some might argue is barely ‘meaning’ at all) detectable through

basic psychological and physiological processes. Most film research in sensation,

perception and attention fits here given that it is concerned with universal processes that

require no particular experience with film and other moving images. In the present

chapter I have considered how slow motion images can irresistibly alter the meaning of

an event, specifically the perceived weight of objects, their rigidity, the forces with which

one object strikes another, and the effort with which a person applies such force in a

striking action. Additional research is needed to explore these and other aspects of the

perception of slow motion in film. Variables that influence perceived cause and effect,

actors’ intentions, mood states, and the emotional impact of a film sequence, are all

amenable to laboratory investigation. Grossberg et al (ibid, p. 515), for example,

suggested that slow motion severed the links “between action and reaction”. The exact

point that such a causal link is perceptually broken is an empirical question, readily tested

in a laboratory. Manipulation of purpose-made or pre-existing film sequences is likely

to be the most informative strategy. A researcher could shoot planned sequences for

varied playback speeds, re-edit a movie sequence or systematically change the playback

speed of the sequences that comprise strongly affecting scenes such as Bonnie and

Clyde’s death scene, and then study film viewers’ perceptual, cognitive and emotional

Rogers' 23'

responses. I caution against reductionist strategies such as the simulation of slow motion

through computer generated imagery (CGI): While CGI has potential to improve control

over selected variables, better psychophysics can come at the expense of better

understanding, and then we have not done good science. The risk of excluding key

dynamic information from the sequence, even unintentionally, is huge and it is costly.

Human perception evolved to discover meaning in complex arrays of informative

variables in natural environments. To the extent that filmmakers attempt to capture these

complex arrays in order to shape our experience, we should do our best to study this

process as it operates with real film and video footage as far as possible. (See Epstein &

Rogers, 2003, for a discussion of the larger theoretical issue of the perception of

complexes of visual variables).

Our judgements about perceptions of weight, force, rigidity and so on color our

understanding of the nature of the world they belong to, and the intentions and mental

states of the people in it, but as soon as we reflect on these percepts we have left Level I

behind and entered Level II. Level I meanings are available in all moving images

whether they are made as art, science or documentary reports. Level I is not devoid of

emotional or aesthetic experiences, however, and we can experience an emotional or

aesthetic response to slow motion images made for reasons other than art. One viewer of

Nike’s “Tiger Woods’ perfect swing” on YouTube left the following comment. “Every

time I watch this I get goosebumps”. The extreme slow motion image is professionally lit

and shot, Tiger’s movements are elegant and flawless. The visual perfection of the image

itself could produce the commentator’s reaction but it is notable that the image is

Rogers' 24'

accompanied by stirring music that rises to a crescendo at the peak of the swing.

Empirical work by neuroscientist Oliver Grewe and his colleagues has demonstrated that

carefully constructed music with certain dynamic patterns, including crescendos, can

trigger goose bumps, spine tingles and aesthetic ‘chills’ (Grewe, Nagel, Kopiez, and

Altenmüller, 2007). The slow motion explosion scene in Antonioni’s Zabriskie Point

certainly benefits from Pink Floyd’s understanding of the power of music to stimulate the

sympathetic nervous system and thrill our bodies as well as our minds. I believe that

Grewe et al’s work provides us with an important clue about the nature of Level I

aesthetic experiences: they are bodily or somatic reactions to some physical properties of

the work, just as the perception of the weight of objects and the forces affecting them can

be perceived from the dynamics of a moving image. Similarly, conscious understanding

of the meaning of the experience of chills is not necessarily present but can come later

with experience and reflection.

My student Sarah Gottleib and I have been gathering first person reports about a wide

variety of aesthetic experiences. One report we found illustrates how chills come first,

and can precede a later, more developed, Level II experience:

“It was my favorite thing and least favorite thing to do at the same time. The first

time I remember ‘feeling’ music, Tamoko (after a few years of taking lessons)

played some piece she had been working on, but I remember sitting and watching

her and having complete physical sensations running through my body. These

chills, these Goosebumps, this electricity and butterflies in the stomach, and I

thought, ‘Wow, that’s cool,’ and I didn’t really know what to make of it at the

Rogers' 25'

time. But then it happened again when I saw her or someone else play or listened

to music that was that emotional, and I said, ‘I think that feeling happens to me

from listening to music; I think it happens when I hear music that I really like.”

(Musician and performance artist Andrew W-K, 2006.)

Andrew W-K was able to describe the chill experience he had while listening to music

but, while it was exciting, it was not a profound experience, it had no intellectual content

and it did not immediately have any emotional content. It did, however, act as an

incentive to begin a life in music and we can imagine that his experiences with music are

now much richer.

A ? ? : ,: ? : :

Noticing a crescendo in music or seeing that walking characters bounce and sway lightly

on their feet in a slow motion sequence are both experiences of Level I perceptual

meanings. Feeling chills in response to the former, of feeling unhurried, relaxed,

expectant in response to the latter are experiences of Level I emotional meaning: Both are

irresistible, involuntary, universal. Level I meanings by themselves would not hold our

interest for long, however, and they are not why we choose to go to the movies. There are

much richer meanings to be had from film and video and not surprisingly most film

scholarship is focused on them. Knowing that the slow motion approach in the opening

scene of Mike Nichols’ Closer signifies the commencement of a sweet romantic drama is

an example of a Level II meaning. Familiarity with the genre and with the trope of the

slow motion encounter shot are essential to understanding the scene. Enjoyment of the

Rogers' 26'

discovery that the drama will not be sweet is an example of a Level II emotional meaning

– it requires reflection and conscious thought. Level II meanings include all the times we

interpret a symbol, make sense of style or form, infer an actor’s intent, connect what we

see to what we know, or understand a filmmaker’s larger thesis. If Lars von Trier did his

work well on Melancholia, viewers will not only begin to really feel Justine’s darkening

mood and share her foreboding that the end of the world is coming but they will also

consider his proposal that it doesn’t matter anyway, it’s all pointless. Depressed people

have a much more realistic understanding of the meaning of life than the rest of us: No

point panicking. Let’s just make a magic cave, hold hands and accept the inevitable. If

the cataclysmic final scene leaves you shaking and struggling to make sense of the film,

then you are wrestling with and perhaps reveling in the best of Level II meanings. If you

experience in addition, or perhaps instead, a moment of intense clarity, a profound insight

into the true nature of the universe, however briefly, then von Trier has given you more –

he has given you an opportunity to access Level III meaning.

A ? : : : :

The experience of Level III meanings is rather rare and should not be thought of as the

ultimate goal of all film viewing or all filmmaking. Most filmmakers are aiming to

produce a satisfying story, a good laugh (or a scare), some thrills, or perhaps an exposé or

commentary on contemporary culture. Profoundly moving aesthetic experiences are often

beside the point. I place the peak aesthetic experiences that characterize Level III at the

top level of my framework not because they are a goal but because, on the rare occasions

Rogers' 27'

that they happen, they seem to happen to prepared minds, following the appreciation of

Level III meanings.

While Level III experiences should not be considered a goal for all film viewers or all

filmmakers, they are in fact the goal of some filmmakers and video artists. The

transcendental style in film explicitly pursues the kind of experience I have in mind. The

work of Japanese master Yasujiro Ozu is a case in point, and I have described his work in

this context elsewhere (eg Rogers, in press). Paul Schrader’s Transcendental style in film:

Ozu, Bresson, Dreyer provides an excellent introduction to the style in the work of three

filmmakers (Schrader, 1988). Video artist Bill Viola frequently uses slow motion images

to create breath-taking moving image artwork that explores perception, memory and

subjective experience. We will examine one of these works to see how a single slow

motion sequence can potentially generate all three levels of film meaning.

On first encounter, Viola’s Quintet of Remembrance (2000) appears to be a vibrantly

colored, still photograph on a large video screen. Five actors stand close to each other,

shot from the waist up, each one is in his or her own world. Lingering, the viewer notices

that each character’s expression has shifted subtly. A patient viewer who waits longer

discovers that each face slowly transforms through a range of emotions: “compassion,

shock, grief, anger, fear, and rapture” (The Metropolitan Museum of Art, 2006.) The five

were filmed in extreme slow motion - just one minute of action is stretched out over

sixteen minutes in play back. Like many of Viola’s works, the Quintet series that includes

the present work is an expression of his study of Zen Buddhism. Slow motion is used as a

Rogers' 28'

device to encourage the viewer to settle fully in to the moment of the encounter with the

work, to take time, to notice the smallest detail and value it. In this case we are given the

gift of time to notice the fleeting micro-expressions in another’s face and bring to

conscious awareness our own instinctive reaction to the emotions of others: A surge of

empathy as we see the beginnings of grief in one character, a spike of fear and an urge to

retreat as we see anger set the tiny muscles in the face of another. Level I meanings are

sensory and bodily: we see the slowly transforming faces, feel the actors moving through

treacle-thick air like trapped flies, and our bodies and brains involuntarily respond. The

recognition of emotional states, and our instinctive urge to approach or avoid them, are

Level I experiences because they involve no reflection, no thought or ideas on our part as

viewer. We might experience a physical chill, or goose bumps. As soon as we begin to

examine our own reaction, to evaluate the work, to notice that it is a riff on Hieronymus

Bosch's Christ Mocked (The Crowning with Thorns) (ca. 1490–1500, National Gallery,

London), to note that we are enjoying it, we are building the richer layer of meaning that

typifies Level II in my framework. On a good day, when we encounter the work relaxed

and in a open frame of mind, and we allow ourselves time to fully engage with it, we

might be lucky and find that our experience takes on a new quality: it transcends the

moment itself and, however briefly, puts us in touch with the beginningless and endless

ebb and flow of human emotion, a timeless tide, the boundaries between ourselves and

others suspended. Psychologists identify this experience as awe (Keltner and Haidt,

2003). For 18th century philosopher, Edmund Burke, it is an experience of the sublime

(Burke, 1757/1958). I identify the experience with a third level of aesthetic meaning. The

truth experienced at these peak moments is a different kind of truth to that treated earlier

Rogers' 29'

in the chapter. It is not truth about the form a droplet takes when it hits the surface of a

puddle, or truth about the weight of an object, or the force of an impact. It is not even a

truth about the real objects and events that formed the scene before the camera. Level III

truths are a feeling that we have understood something important, something timeless,

perhaps for the first time.

? : : : : ? :

In this chapter I have attempted to show that slow motion images can be understood to

carry meaning at three different levels. Still and moving photographic images are widely

believed to be truthful, even transparent, presentations of the objects and events that were

the subject of the image. A close look at a variety of slow motion image sequences in

movies and videos, including footage of the police beating of Rodney King, together with

empirical evidence from my laboratory, reveal that some aspects of reality are

systematically transformed by slow motion. These transformations to the Level I

meanings of moving images, such as the physical properties of depicted objects and the

forces that act upon them, are deceptive and therefore in some settings (such as a

courtroom) could be considered to amount to visual lies. Level I meanings are

experienced below the level of conscious awareness and thus they are irresistible by the

viewer. They include both perceptual and emotional experiences that are often tightly

bound to each other, such as when we respond rapidly and intuitively with an emotional

response to an expression of emotion by another. Aesthetic chills are included in this

foundational level of aesthetic experience because there is evidence that chills can be

experienced without understanding of their origin or their relation to the artwork that

Rogers' 30'

produced them. The more complex Level II meanings of slow motion images arise from

the social and cultural context of the use of such images in film and video, and these

require conscious reflective processing involving both cognition and emotion. Very rich

and satisfying experiences are possible at this level. Finally, I described a very special

and rare category of experience at Level III that can on occasion be produced by a

carefully constructed moving image presented to a well-prepared mind. Slow motion

images are capable of transmitting great truths but the lesson of this chapter is that they

also have the potential to lie. These ‘lies’, however, can be the basis of powerful aesthetic

experiences when used artfully in film.

John G. Avildsen, Rocky (1976)

Mike Nichols, Closer (2004).

Lars van Trier, Melancholia (2011).

Martin Scorsese, Raging Bull (1980).

Stephen Spielberg, Saving Private Ryan (1988)

Andy and Lana Wachowski, The Matrix (1999)

Yimou Zhang, Hero (2002) (Ying Xiong Chinese title)

Michelangelo Antonioni, Zabriskie Point (1970)

Rogers' 31'

:

Bernstein, R. (2000). Rodney King, Shifting Modes of Vision, and

Anna Deavere Smith's Twilight: Los Angeles, 1992. Journal of Dramatic Theory and

Criticism, 121-134.

Block, M. Interview with Zouheir Jabbour. All Things Considered. National

Public Radio. Aired February 24th, 2012.

A link to the story is on a related blog here: http://www.npr.org/blogs/thetwo-

way/2012/02/24/147368559/syrian-official-army-is-protecting-syrian-people-from-

armed-groups

Burke, Edmund. (1757/1958). A Philosophical Enquiry into the Origin of Our

Ideas of the Sublime and Beautiful. London.

Epstein, W. and Rogers, S. (2003). Percept-percept couplings revisited. In U.

Savardi (Ed.) Festschrift in honore di Paolo Bozzi. Padova: Cleup.

Gray, M. (2007). The L.A. riots: 15 years after Rodney King. Time Specials.

http://www.time.com/time/specials/2007/la_riot/article/0,28804,1614117_1614084_1614

831,00.html Retrieved February 23rd, 2012.

Grewe, O., Nagel, F., Kopiez, R. and Altenmüller, E. (2007). Listening to music

as a re-creative process: physiological, psychological, and psychoacoustical correlates of

chills and strong emotions. Music Perception 24(3), 297–314.

Grossberg, L., Radway, J. and Olson, M.J. (1995) Trials of the Post-Modern,

Cultural Studies 9(3).

Keltner, D. and Haidt, J. (2003). Approaching awe, a moral, spiritual, and

aesthetic emotion. Cognition and Emotion, 17(2), 297-314.

Rogers' 32'

Monaco, J. (1977, 1981). How to read a film: The art,, technology, language,

history, and theory of film and media. Revised edition. Oxford: Oxford University Press.

Mydans, S. Los Angeles policemen acquitted in taped beating. New York Times,

April 29th, 1992.

http://www.nytimes.com/learning/general/onthisday/990429onthisday_big.html

Retrieved February 26th, 2012.

Rogers, S. (1995). Perceiving pictorial space. In W. Epstein and S. Rogers. (ed.s)

Perception of Space and Motion. Volume 5 in Handbook of Perception and Cognition,

(2nd Edition). San Diego: Academic Press.

Rogers, S. (2000). The emerging concept of information. Ecological Psychology,

12(4) 335-343.

Rogers, S. (2007). Through Alice's glass: the creation and perception of other

worlds in movies, pictures and virtual reality. In J.D. Anderson and B. Fisher Anderson

(Ed.s). Moving image theory: Ecological considerations, 2nd Edition. Carbondale, IL:

Southern Illinois University Press.

Rogers, S. (in press). Auteur of attention: Filmmaker as cognitive scientist.

Projections: The Journal for Movies and Mind.

Schrader, P. (1988). Transcendental style in film: Ozu, Bresson, Dreyer. Da Capo

Press.

Smith, T.J. (in press). The attentional theory of cinematic continuity.

Projections: The Journal for Movies and Mind.

Sontag, S. (1973, 1977). On Photography. New York: Farrar, Straus and Giroux,

Noonday Press.

Rogers' 33'

"Bill Viola: The Quintet of Remembrance (2001.395a-i)". In Heilbrunn Timeline

of Art History. New York: The Metropolitan Museum of Art, 2000–.

http://www.metmuseum.org/toah/works-of-art/2001.395a-i (October 2006).

Walton, K. L. (1984). Transparent pictures: On the nature of photographic

realism. Critical Enquiry, 11(2), December, 246-277.

Andrew W-K http://www.themusicedge.com/moxie/news/featartist/andrew-wk-

the-wolf-howls.shtml Retrieved July 7, 2006.

!

: :

“Bullet time”. http://www.youtube.com/watch?v=WhxbYTMNMxo Retrieved February

23rd, 2012.

Discover Magazine. “Galloping horse in super slow motion”.

http://www.youtube.com/watch?v=OcD1_jvhc_g Retrieved February 23rd, 2012.

“Rodney King beating video ©George Holliday”

http://www.youtube.com/watch?v=xZDrZDEqeKk Retrieved February 26th, 2012.

USGA, “REAL Golf Ball hitting steel in slow motion by the USGA”

http://www.youtube.com/watch?v=00I2uXDxbaE&list=UUsZsn_S93Zs8JOdKMRbklmg

&index=10&feature=plcp Retrieved February 23rd, 2012.

Rogers' 34'

“Football blooper –slow motion-” http://www.youtube.com/watch?v=MQBeNvAO7C0

Retrieved February 23rd, 2012.

“Golf ball hitting steel super slow mo”

http://www.youtube.com/watch?v=aMqM13EUSKw

Slow Mo Guys, “Droplet collisions at 5000fps”. http://www.youtube.com/watch?v=cNI-

LIVs-to. Retrieved February 23rd, 2012.

“Tiger Woods’ perfect swing”. http://www.youtube.com/watch?v=cHcP6X7dEUo

Retrieved February 23rd, 2012.