Mental representations of affect knowledge

31
Mental representations of affect knowledge Lisa Feldman Barrett Boston College, USA Thyra Fossum The Pennsylvania State University, USA The circumplex structure derived from similarity ratings of affect words is assumed to be a conceptual representation of affect anchored in semantic knowl- edge. Recently, it been suggested that this structure is not based on semantic knowledge at all, but may instead reflect a type of episodic knowledge: The degree to which emotions covary in everyday life. In two experience-sampling studies, we compared the semantic and the episodic hypotheses by comparing participants’ similarity ratings to the observed covariations in their own affective experience computed from their momentary reports. In Study 2, participants also provided estimates of the degree to which their emotions covaried. Evidence from both studies indicate that similarity judgements are related both to semantic and episodic information, indicating that a pure episodic account of similarity ratings, and the mental representation of affect that they reflect, is untenable. Much of the psychological knowledge that we have generated is based on what people tell us in response to the questions we ask. No where is this more true than in research on emotion. We ask participants to judge the similarity of emotion words, the emotional content contained in facial expressions, pictures, or movies, or their own feeling states. Based on what participants can tell us, we infer something about the nature of emotion knowledge, emotional experience, or both, depending on what we think the questions assess. This last inferential step is often where the process of knowledge accumulation breaks down, because researchers do not always agree about which information participants rely upon when making judgements of emotion. The purpose of this paper is to COGNITION AND EMOTION, 2001, 15 (3), 333–363 Correspondenc e should be addressed to Lisa Feldman Barrett at the Department of Psychology, 427 McGuinn Building, Boston College, Chestnut Hill MA 02167, USA; [email protected] Many thanks to Michael Ross, Jim Russell, Paula Niedenthal, Ulrich Schimmack, and Rainer Reisenzein for their comments on early drafts of this manuscript. Also thanks to Daniel Schacter for his input on the semantic-episodic knowledge distinction. Preparation of this article was facilitated by a grant from the National Science Foundation to Lisa Feldman Barrett (SBR 9727896). # 2001 Psychology Press Ltd http://www.tandf.co.uk/journals/pp/02699931.html DOI:10.1080/0269993004200196

Transcript of Mental representations of affect knowledge

Mental representations of affect knowledge

Lisa Feldman BarrettBoston College USA

Thyra FossumThe Pennsylvania State University USA

The circumplex structure derived from similarity ratings of affect words isassumed to be a conceptual representation of affect anchored in semantic knowl-edge Recently it been suggested that this structure is not based on semanticknowledge at all but may instead reflect a type of episodic knowledge The degreeto which emotions covary in everyday life In two experience-sampling studies wecompared the semantic and the episodic hypotheses by comparing participantsrsquosimilarity ratings to the observed covariations in their own affective experiencecomputed from their momentary reports In Study 2 participants also providedestimates of the degree to which their emotions covaried Evidence from bothstudies indicate that similarity judgements are related both to semantic andepisodic information indicating that a pure episodic account of similarity ratingsand the mental representation of affect that they reflect is untenable

Much of the psychological knowledge that we have generated is based on whatpeople tell us in response to the questions we ask No where is this more truethan in research on emotion We ask participants to judge the similarity ofemotion words the emotional content contained in facial expressions picturesor movies or their own feeling states Based on what participants can tell us weinfer something about the nature of emotion knowledge emotional experienceor both depending on what we think the questions assess This last inferentialstep is often where the process of knowledge accumulation breaks downbecause researchers do not always agree about which information participantsrely upon when making judgements of emotion The purpose of this paper is to

COGNITION AND EMOTION 2001 15 (3) 333ndash363

Correspondence should be addressed to Lisa Feldman Barrett at the Department of Psychology427 McGuinn Building Boston College Chestnut Hill MA 02167 USA barretlibcedu

Many thanks to Michael Ross Jim Russell Paula Niedenthal Ulrich Schimmack and RainerReisenzein for their comments on early drafts of this manuscript Also thanks to Daniel Schacter forhis input on the semantic-episodic knowledge distinction Preparation of this article was facilitatedby a grant from the National Science Foundation to Lisa Feldman Barrett (SBR 9727896)

2001 Psychology Press Ltdhttpwwwtandfcoukjournalspp02699931html DOI1010800269993004200196

address one such disagreement regarding similarity ratings and the representa-tion of emotion that they index

The affective circumplex

A large body of research has accumulated to suggest that people hold a generalmental representation of affect in the form of a circular structure or circumplexIn abstract terms a circumplex is an empirically derived dimensional structurethat represents the conceptual mental structure of a group of stimuli (Guttman1954 1966) A circumplex structure is typically derived from a dimensionalanalysis (eg factor analysis or multidimensional scaling) of proximity ratings(eg similarity ratings) for a set of stimuli (eg affect terms) The proximityjudgements are typically taken to be the index of this mental structure (egShepard 1962 1974 1980 Tversky 1977) such that the dimensions resultingfrom their analysis are thought to represent the underlying attributes or prop-erties of that mental structure

Dimensional analyses of similarity ratings indicate that valence and arousalserve as the primary dimensions of the affect circumplex (Russell amp FeldmanBarrett 1999) Valence refers to the hedonic quality or pleasantness of anaffective experience and arousal refers to subjective feelings of activationassociated with an affective experience All affective stimuli (ie emotions suchas anger sadness and fear as well as nonemotional affective states like fatiguesleepiness and placidity) can be defined as combinations of these two inde-pendent dimensions Emotion terms array along valence and arousal dimensionsbecause these two properties represent core affective features of emotion con-cepts In addition to these basic components emotion representations containother elements of emotion knowledge that differentiate discrete emotions likefear anger and sadness Thus the valence and arousal dimensions representnecessary but not sufficient components of emotion concepts Additionalknowledge would for example differentiate among discrete emotion conceptslike fear and anger In essence the valencearousal circumplex is like a veryprimitive representation or cognitive map of affective space

This cognitive map is considered essentially nomothetic (ie it is thought toapply equally to all persons within a culture) It is highly robust and emergeswhenever individuals label or communicate their own or othersrsquo affectiveexperiences The valencearousal circumplex structure has been identified inproximity ratings of emotion terms (eg Block 1957 Bush 1973 Feldman1995a Russell 1980) in perceptions of facially expressed emotion (egAbelson amp Sermat 1962 Adolphs Tranel Damasio amp Damasio 1994 Cliff ampYoung 1968 Dittmann 1972 Fillenbaum amp Rapaport 1971 Green amp Cliff1975 Russell amp Bullock 1985 Russell Lewicka amp Niit 1989 Schlosberg1952 1954 Shepard 1962) as well as in self- reported affective states

334 FELDMAN BARRETT AND FOSSUM

(Almagor amp Ben-Porath 1989 Feldman 1995a Feldman Barrett 1998Feldman Barrett amp Russell 1998 Reisenzein 1994 Russell 1980)

The assumption until recently has been that the mental representation ofaffect represented by similarity ratings and depicted by the circumplex isanchored by information stored in semantic memory On this view valence andarousal reflect semantic components of emotion concepts Semantic memoryrefers to a corpus of impersonal conceptual knowledge shared by members ofthe same culture (Tulving 1972) This view of the circumplex derives fromthree sources First the circumplex is consistent with the semantic differentialwork by Osgood (Osgood Suci amp Tannenbaum 1957) who demonstrated thatthere are three major components of meaning in natural language (evaluationactivity and potency) Second evidence indicates that direct semantic ratings ofaffect terms are highly correlated (rs greater than 93) with dimension coordi-nates (Feldman 1995a) Third valencearousal circumplexes derived fromsimilarity ratings of affective language are highly replicable across individualsword sets and have been found across many cultures (Russell 1983 1991Russell et al 1989) suggesting that valence and arousal represent all-purposesemantic knowledge that individuals use when generating some judgementabout an affective stimulus

Recently Schimmack and Reisenzein (1997) have challenged the idea thatsimilarity ratings of affect words and the mental representation that they indexare anchored by peoplersquos abstract semantic knowledge (also see Conway ampBekerian 1987) Instead they suggest that the similarity ratings reflect a type ofknowledge stored in episodic memory The degree to which emotions covary ina personrsquos everyday life Episodic memory is defined as past events that aredefinable with respect to time and place (Tulving 1972) They are typically butnot exclusively personal in nature (Maguire amp Mummery 1999 Nadel ampMoscovitch 1998) Unlike semantic knowledge which represents conceptualinformation about things episodic knowledge is about specific events (Nadel ampMoscovitch 1998) that typically require conscious recollection (Tulving 1985)According to the episodic hypothesis similarity judgements are computed notby accessing abstract semantic information but by comparing exemplar-basedrepresentations of how often affective experiences occur together From thisperspective respondents rate the similarity of two emotions on the basis of theirbeliefs about how often the two were actually experienced together Affectiveexperiences that co-occur frequently will be judged as similar whereas thosethat co-occur infrequently will be judged as dissimilar In this scenario thevalence and arousal dimensions that derive from analyses of similarity ratingsrepresent summaries of how often emotional states co-occur rather thansemantic information per se Although Schimmack and Reisenzein (1997) allowfor the existence of semantic representations of emotion concepts they arguethat similarity judgements are not based on such knowledge On the episodic

MENTAL REPRESENTATIONS OF AFFECT 335

view then the valence and arousal dimensions that derive from dimensionalanalyses of similarity ratings reflect the co-occurrences of emotional states

The issue of whether similarity ratings are semantically or episodicallyderived is crucial to understanding the role of the circumplex in emotion theoryThe original theory associated with the circumplex is that it represents generalconceptual knowledge about affect used to generate a conscious representationof feeling states be they affective or emotional (Russell amp Feldman Barrett1999) In contrast an episodic view suggests that the mental representation is theresult of conscious representations of feelings states Furthermore on thesemantic view it has been suggested that variations in the way that semanticknowledge is applied in the generation process result in individual differences inthe co-occurrence of conscious emotional states (Feldman 1995a FeldmanBarrett 1998) That is the co-occurrence is produced by the way in which themental representation is accessed and applied resulting in episodic experiencesthat differ across individuals In contrast an episodic view suggests that themental representation itself reflects the specific co-occurrences of emotion thatare stored in episodic memory for a particular person

An episodic interpretation of circumplex structure

For an episodic hypothesis to be tenable accurate episodic information must becontained in the circumplex representation Similarity ratings must be based atleast in part on actual experienced emotion covariations and not some generaltheory of co-occurrence According to Reisenzein and Schimmack (1999)similarity ratings are computed based on respondentsrsquo experience of whichemotions tend to co-occur (or closely follow one another in time) Specificallythey suggest that participants implicitly generate covariation estimates whenjudging the similarity between emotions such that these estimates should cor-respond closely to the correlation between emotion experienced during emotionepisodes As a result the affect covariation information represented in episodicmemory that is used to generate similarity judgements lsquolsquoshould be a fairlyaccurate reflection of the actual co-occurances of affectsrsquorsquo that people encounterin their lives (p 552) Indeed evidence suggests that episodic representationslike emotion covariation estimates are at least in part constructed from theinformation provided in context-specific everyday experience (McKenzie1994 for reviews see Alloy amp Tabachnik 1984 Crocker 1981) The purpose ofthe present article was to examine the degree to which mental representations ofemotion contain actual covariation information (ie the degree to whichemotions covaried in everyday life)

OVERVIEW OF THE PRESENT STUDIES

This article contains two studies that assessed the relationship betweenproximity judgements of affect terms and actual observed covariations in

336 FELDMAN BARRETT AND FOSSUM

experienced affective states Using an experience-sampling method participantsin two studies made ratings of their affective state three times a day over anextended observation period These data allowed us to compute observed co-occurrences in everyday experience Observed co-occurrences were thencompared to participantsrsquo proximity ratings of emotion Two types of proximityratings were examined

First we compared observed emotion covariations with similarity judge-ments (Studies 1 and 2) To date no study has empirically compared covaria-tions in idiographically derived emotion ratings from real life experience withsimilarity judgements The two studies that have examined the correspondenceidiographically either did not report a direct empirical comparison of the two(Zevon amp Tellegen 1982) or had participants rate how they believed theywould feel in a series of emotion eliciting situations (Reisenzein amp Schimmack1999 Study 4) Such hypothetical responses tap propositional knowledge thatmay or may not be an accurate index of actual emotion covariation in daily life(for a discussion of bias in hypothetical responses see Greenwald amp Banaji1995 Ross 1989)

Second we compared observed emotion covariations with emotion covar-iation estimates (in the form of conditional probability judgements Study 2only) According to previous research conditional probability judgements areconstructed in part from the information provided in context-specific everydayexperience (McKenzie 1994 for reviews see Alloy amp Tabachnik 1984Crocker 1981) If participants generate accurate covariation estimates as sug-gested by Reisenzein and Schimmack (1999) then there should be a strongcorrespondence between their observed emotion covariations and their condi-tional probability judgements (ie how often they believe two emotions co-occur in their experience) To date no study has empirically compared covar-iations in idiographically derived emotion ratings from real life experience withestimated covariation judgements One study has investigated the nomotheticcorrespondence in cross-sectionally derived ratings (Schimmack amp Hartmann1997) and a second study compared conditional probability judgements toidiographically derived responses to hypothetical situations (Reisenzein ampSchimmack 1999 Study 4)

STUDY 1 RE-ANALYSIS OF FELDMAN (1995A)

Study 1 examined whether accurate covariation information is contained insimilarity judgements by reanalysing a dataset containing experience-samplingratings of 16 affective experiences (Feldman 1995a) In this study participantsprovide detailed quantitative descriptions of their affective experiences as soonas they occurred across a 90-day period allowing an estimate of observedemotion co-occurrence Our aim was to determine whether the covariations thatwe observed in participantsrsquo affect ratings were related to their similarity ratings

MENTAL REPRESENTATIONS OF AFFECT 337

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

address one such disagreement regarding similarity ratings and the representa-tion of emotion that they index

The affective circumplex

A large body of research has accumulated to suggest that people hold a generalmental representation of affect in the form of a circular structure or circumplexIn abstract terms a circumplex is an empirically derived dimensional structurethat represents the conceptual mental structure of a group of stimuli (Guttman1954 1966) A circumplex structure is typically derived from a dimensionalanalysis (eg factor analysis or multidimensional scaling) of proximity ratings(eg similarity ratings) for a set of stimuli (eg affect terms) The proximityjudgements are typically taken to be the index of this mental structure (egShepard 1962 1974 1980 Tversky 1977) such that the dimensions resultingfrom their analysis are thought to represent the underlying attributes or prop-erties of that mental structure

Dimensional analyses of similarity ratings indicate that valence and arousalserve as the primary dimensions of the affect circumplex (Russell amp FeldmanBarrett 1999) Valence refers to the hedonic quality or pleasantness of anaffective experience and arousal refers to subjective feelings of activationassociated with an affective experience All affective stimuli (ie emotions suchas anger sadness and fear as well as nonemotional affective states like fatiguesleepiness and placidity) can be defined as combinations of these two inde-pendent dimensions Emotion terms array along valence and arousal dimensionsbecause these two properties represent core affective features of emotion con-cepts In addition to these basic components emotion representations containother elements of emotion knowledge that differentiate discrete emotions likefear anger and sadness Thus the valence and arousal dimensions representnecessary but not sufficient components of emotion concepts Additionalknowledge would for example differentiate among discrete emotion conceptslike fear and anger In essence the valencearousal circumplex is like a veryprimitive representation or cognitive map of affective space

This cognitive map is considered essentially nomothetic (ie it is thought toapply equally to all persons within a culture) It is highly robust and emergeswhenever individuals label or communicate their own or othersrsquo affectiveexperiences The valencearousal circumplex structure has been identified inproximity ratings of emotion terms (eg Block 1957 Bush 1973 Feldman1995a Russell 1980) in perceptions of facially expressed emotion (egAbelson amp Sermat 1962 Adolphs Tranel Damasio amp Damasio 1994 Cliff ampYoung 1968 Dittmann 1972 Fillenbaum amp Rapaport 1971 Green amp Cliff1975 Russell amp Bullock 1985 Russell Lewicka amp Niit 1989 Schlosberg1952 1954 Shepard 1962) as well as in self- reported affective states

334 FELDMAN BARRETT AND FOSSUM

(Almagor amp Ben-Porath 1989 Feldman 1995a Feldman Barrett 1998Feldman Barrett amp Russell 1998 Reisenzein 1994 Russell 1980)

The assumption until recently has been that the mental representation ofaffect represented by similarity ratings and depicted by the circumplex isanchored by information stored in semantic memory On this view valence andarousal reflect semantic components of emotion concepts Semantic memoryrefers to a corpus of impersonal conceptual knowledge shared by members ofthe same culture (Tulving 1972) This view of the circumplex derives fromthree sources First the circumplex is consistent with the semantic differentialwork by Osgood (Osgood Suci amp Tannenbaum 1957) who demonstrated thatthere are three major components of meaning in natural language (evaluationactivity and potency) Second evidence indicates that direct semantic ratings ofaffect terms are highly correlated (rs greater than 93) with dimension coordi-nates (Feldman 1995a) Third valencearousal circumplexes derived fromsimilarity ratings of affective language are highly replicable across individualsword sets and have been found across many cultures (Russell 1983 1991Russell et al 1989) suggesting that valence and arousal represent all-purposesemantic knowledge that individuals use when generating some judgementabout an affective stimulus

Recently Schimmack and Reisenzein (1997) have challenged the idea thatsimilarity ratings of affect words and the mental representation that they indexare anchored by peoplersquos abstract semantic knowledge (also see Conway ampBekerian 1987) Instead they suggest that the similarity ratings reflect a type ofknowledge stored in episodic memory The degree to which emotions covary ina personrsquos everyday life Episodic memory is defined as past events that aredefinable with respect to time and place (Tulving 1972) They are typically butnot exclusively personal in nature (Maguire amp Mummery 1999 Nadel ampMoscovitch 1998) Unlike semantic knowledge which represents conceptualinformation about things episodic knowledge is about specific events (Nadel ampMoscovitch 1998) that typically require conscious recollection (Tulving 1985)According to the episodic hypothesis similarity judgements are computed notby accessing abstract semantic information but by comparing exemplar-basedrepresentations of how often affective experiences occur together From thisperspective respondents rate the similarity of two emotions on the basis of theirbeliefs about how often the two were actually experienced together Affectiveexperiences that co-occur frequently will be judged as similar whereas thosethat co-occur infrequently will be judged as dissimilar In this scenario thevalence and arousal dimensions that derive from analyses of similarity ratingsrepresent summaries of how often emotional states co-occur rather thansemantic information per se Although Schimmack and Reisenzein (1997) allowfor the existence of semantic representations of emotion concepts they arguethat similarity judgements are not based on such knowledge On the episodic

MENTAL REPRESENTATIONS OF AFFECT 335

view then the valence and arousal dimensions that derive from dimensionalanalyses of similarity ratings reflect the co-occurrences of emotional states

The issue of whether similarity ratings are semantically or episodicallyderived is crucial to understanding the role of the circumplex in emotion theoryThe original theory associated with the circumplex is that it represents generalconceptual knowledge about affect used to generate a conscious representationof feeling states be they affective or emotional (Russell amp Feldman Barrett1999) In contrast an episodic view suggests that the mental representation is theresult of conscious representations of feelings states Furthermore on thesemantic view it has been suggested that variations in the way that semanticknowledge is applied in the generation process result in individual differences inthe co-occurrence of conscious emotional states (Feldman 1995a FeldmanBarrett 1998) That is the co-occurrence is produced by the way in which themental representation is accessed and applied resulting in episodic experiencesthat differ across individuals In contrast an episodic view suggests that themental representation itself reflects the specific co-occurrences of emotion thatare stored in episodic memory for a particular person

An episodic interpretation of circumplex structure

For an episodic hypothesis to be tenable accurate episodic information must becontained in the circumplex representation Similarity ratings must be based atleast in part on actual experienced emotion covariations and not some generaltheory of co-occurrence According to Reisenzein and Schimmack (1999)similarity ratings are computed based on respondentsrsquo experience of whichemotions tend to co-occur (or closely follow one another in time) Specificallythey suggest that participants implicitly generate covariation estimates whenjudging the similarity between emotions such that these estimates should cor-respond closely to the correlation between emotion experienced during emotionepisodes As a result the affect covariation information represented in episodicmemory that is used to generate similarity judgements lsquolsquoshould be a fairlyaccurate reflection of the actual co-occurances of affectsrsquorsquo that people encounterin their lives (p 552) Indeed evidence suggests that episodic representationslike emotion covariation estimates are at least in part constructed from theinformation provided in context-specific everyday experience (McKenzie1994 for reviews see Alloy amp Tabachnik 1984 Crocker 1981) The purpose ofthe present article was to examine the degree to which mental representations ofemotion contain actual covariation information (ie the degree to whichemotions covaried in everyday life)

OVERVIEW OF THE PRESENT STUDIES

This article contains two studies that assessed the relationship betweenproximity judgements of affect terms and actual observed covariations in

336 FELDMAN BARRETT AND FOSSUM

experienced affective states Using an experience-sampling method participantsin two studies made ratings of their affective state three times a day over anextended observation period These data allowed us to compute observed co-occurrences in everyday experience Observed co-occurrences were thencompared to participantsrsquo proximity ratings of emotion Two types of proximityratings were examined

First we compared observed emotion covariations with similarity judge-ments (Studies 1 and 2) To date no study has empirically compared covaria-tions in idiographically derived emotion ratings from real life experience withsimilarity judgements The two studies that have examined the correspondenceidiographically either did not report a direct empirical comparison of the two(Zevon amp Tellegen 1982) or had participants rate how they believed theywould feel in a series of emotion eliciting situations (Reisenzein amp Schimmack1999 Study 4) Such hypothetical responses tap propositional knowledge thatmay or may not be an accurate index of actual emotion covariation in daily life(for a discussion of bias in hypothetical responses see Greenwald amp Banaji1995 Ross 1989)

Second we compared observed emotion covariations with emotion covar-iation estimates (in the form of conditional probability judgements Study 2only) According to previous research conditional probability judgements areconstructed in part from the information provided in context-specific everydayexperience (McKenzie 1994 for reviews see Alloy amp Tabachnik 1984Crocker 1981) If participants generate accurate covariation estimates as sug-gested by Reisenzein and Schimmack (1999) then there should be a strongcorrespondence between their observed emotion covariations and their condi-tional probability judgements (ie how often they believe two emotions co-occur in their experience) To date no study has empirically compared covar-iations in idiographically derived emotion ratings from real life experience withestimated covariation judgements One study has investigated the nomotheticcorrespondence in cross-sectionally derived ratings (Schimmack amp Hartmann1997) and a second study compared conditional probability judgements toidiographically derived responses to hypothetical situations (Reisenzein ampSchimmack 1999 Study 4)

STUDY 1 RE-ANALYSIS OF FELDMAN (1995A)

Study 1 examined whether accurate covariation information is contained insimilarity judgements by reanalysing a dataset containing experience-samplingratings of 16 affective experiences (Feldman 1995a) In this study participantsprovide detailed quantitative descriptions of their affective experiences as soonas they occurred across a 90-day period allowing an estimate of observedemotion co-occurrence Our aim was to determine whether the covariations thatwe observed in participantsrsquo affect ratings were related to their similarity ratings

MENTAL REPRESENTATIONS OF AFFECT 337

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

(Almagor amp Ben-Porath 1989 Feldman 1995a Feldman Barrett 1998Feldman Barrett amp Russell 1998 Reisenzein 1994 Russell 1980)

The assumption until recently has been that the mental representation ofaffect represented by similarity ratings and depicted by the circumplex isanchored by information stored in semantic memory On this view valence andarousal reflect semantic components of emotion concepts Semantic memoryrefers to a corpus of impersonal conceptual knowledge shared by members ofthe same culture (Tulving 1972) This view of the circumplex derives fromthree sources First the circumplex is consistent with the semantic differentialwork by Osgood (Osgood Suci amp Tannenbaum 1957) who demonstrated thatthere are three major components of meaning in natural language (evaluationactivity and potency) Second evidence indicates that direct semantic ratings ofaffect terms are highly correlated (rs greater than 93) with dimension coordi-nates (Feldman 1995a) Third valencearousal circumplexes derived fromsimilarity ratings of affective language are highly replicable across individualsword sets and have been found across many cultures (Russell 1983 1991Russell et al 1989) suggesting that valence and arousal represent all-purposesemantic knowledge that individuals use when generating some judgementabout an affective stimulus

Recently Schimmack and Reisenzein (1997) have challenged the idea thatsimilarity ratings of affect words and the mental representation that they indexare anchored by peoplersquos abstract semantic knowledge (also see Conway ampBekerian 1987) Instead they suggest that the similarity ratings reflect a type ofknowledge stored in episodic memory The degree to which emotions covary ina personrsquos everyday life Episodic memory is defined as past events that aredefinable with respect to time and place (Tulving 1972) They are typically butnot exclusively personal in nature (Maguire amp Mummery 1999 Nadel ampMoscovitch 1998) Unlike semantic knowledge which represents conceptualinformation about things episodic knowledge is about specific events (Nadel ampMoscovitch 1998) that typically require conscious recollection (Tulving 1985)According to the episodic hypothesis similarity judgements are computed notby accessing abstract semantic information but by comparing exemplar-basedrepresentations of how often affective experiences occur together From thisperspective respondents rate the similarity of two emotions on the basis of theirbeliefs about how often the two were actually experienced together Affectiveexperiences that co-occur frequently will be judged as similar whereas thosethat co-occur infrequently will be judged as dissimilar In this scenario thevalence and arousal dimensions that derive from analyses of similarity ratingsrepresent summaries of how often emotional states co-occur rather thansemantic information per se Although Schimmack and Reisenzein (1997) allowfor the existence of semantic representations of emotion concepts they arguethat similarity judgements are not based on such knowledge On the episodic

MENTAL REPRESENTATIONS OF AFFECT 335

view then the valence and arousal dimensions that derive from dimensionalanalyses of similarity ratings reflect the co-occurrences of emotional states

The issue of whether similarity ratings are semantically or episodicallyderived is crucial to understanding the role of the circumplex in emotion theoryThe original theory associated with the circumplex is that it represents generalconceptual knowledge about affect used to generate a conscious representationof feeling states be they affective or emotional (Russell amp Feldman Barrett1999) In contrast an episodic view suggests that the mental representation is theresult of conscious representations of feelings states Furthermore on thesemantic view it has been suggested that variations in the way that semanticknowledge is applied in the generation process result in individual differences inthe co-occurrence of conscious emotional states (Feldman 1995a FeldmanBarrett 1998) That is the co-occurrence is produced by the way in which themental representation is accessed and applied resulting in episodic experiencesthat differ across individuals In contrast an episodic view suggests that themental representation itself reflects the specific co-occurrences of emotion thatare stored in episodic memory for a particular person

An episodic interpretation of circumplex structure

For an episodic hypothesis to be tenable accurate episodic information must becontained in the circumplex representation Similarity ratings must be based atleast in part on actual experienced emotion covariations and not some generaltheory of co-occurrence According to Reisenzein and Schimmack (1999)similarity ratings are computed based on respondentsrsquo experience of whichemotions tend to co-occur (or closely follow one another in time) Specificallythey suggest that participants implicitly generate covariation estimates whenjudging the similarity between emotions such that these estimates should cor-respond closely to the correlation between emotion experienced during emotionepisodes As a result the affect covariation information represented in episodicmemory that is used to generate similarity judgements lsquolsquoshould be a fairlyaccurate reflection of the actual co-occurances of affectsrsquorsquo that people encounterin their lives (p 552) Indeed evidence suggests that episodic representationslike emotion covariation estimates are at least in part constructed from theinformation provided in context-specific everyday experience (McKenzie1994 for reviews see Alloy amp Tabachnik 1984 Crocker 1981) The purpose ofthe present article was to examine the degree to which mental representations ofemotion contain actual covariation information (ie the degree to whichemotions covaried in everyday life)

OVERVIEW OF THE PRESENT STUDIES

This article contains two studies that assessed the relationship betweenproximity judgements of affect terms and actual observed covariations in

336 FELDMAN BARRETT AND FOSSUM

experienced affective states Using an experience-sampling method participantsin two studies made ratings of their affective state three times a day over anextended observation period These data allowed us to compute observed co-occurrences in everyday experience Observed co-occurrences were thencompared to participantsrsquo proximity ratings of emotion Two types of proximityratings were examined

First we compared observed emotion covariations with similarity judge-ments (Studies 1 and 2) To date no study has empirically compared covaria-tions in idiographically derived emotion ratings from real life experience withsimilarity judgements The two studies that have examined the correspondenceidiographically either did not report a direct empirical comparison of the two(Zevon amp Tellegen 1982) or had participants rate how they believed theywould feel in a series of emotion eliciting situations (Reisenzein amp Schimmack1999 Study 4) Such hypothetical responses tap propositional knowledge thatmay or may not be an accurate index of actual emotion covariation in daily life(for a discussion of bias in hypothetical responses see Greenwald amp Banaji1995 Ross 1989)

Second we compared observed emotion covariations with emotion covar-iation estimates (in the form of conditional probability judgements Study 2only) According to previous research conditional probability judgements areconstructed in part from the information provided in context-specific everydayexperience (McKenzie 1994 for reviews see Alloy amp Tabachnik 1984Crocker 1981) If participants generate accurate covariation estimates as sug-gested by Reisenzein and Schimmack (1999) then there should be a strongcorrespondence between their observed emotion covariations and their condi-tional probability judgements (ie how often they believe two emotions co-occur in their experience) To date no study has empirically compared covar-iations in idiographically derived emotion ratings from real life experience withestimated covariation judgements One study has investigated the nomotheticcorrespondence in cross-sectionally derived ratings (Schimmack amp Hartmann1997) and a second study compared conditional probability judgements toidiographically derived responses to hypothetical situations (Reisenzein ampSchimmack 1999 Study 4)

STUDY 1 RE-ANALYSIS OF FELDMAN (1995A)

Study 1 examined whether accurate covariation information is contained insimilarity judgements by reanalysing a dataset containing experience-samplingratings of 16 affective experiences (Feldman 1995a) In this study participantsprovide detailed quantitative descriptions of their affective experiences as soonas they occurred across a 90-day period allowing an estimate of observedemotion co-occurrence Our aim was to determine whether the covariations thatwe observed in participantsrsquo affect ratings were related to their similarity ratings

MENTAL REPRESENTATIONS OF AFFECT 337

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

view then the valence and arousal dimensions that derive from dimensionalanalyses of similarity ratings reflect the co-occurrences of emotional states

The issue of whether similarity ratings are semantically or episodicallyderived is crucial to understanding the role of the circumplex in emotion theoryThe original theory associated with the circumplex is that it represents generalconceptual knowledge about affect used to generate a conscious representationof feeling states be they affective or emotional (Russell amp Feldman Barrett1999) In contrast an episodic view suggests that the mental representation is theresult of conscious representations of feelings states Furthermore on thesemantic view it has been suggested that variations in the way that semanticknowledge is applied in the generation process result in individual differences inthe co-occurrence of conscious emotional states (Feldman 1995a FeldmanBarrett 1998) That is the co-occurrence is produced by the way in which themental representation is accessed and applied resulting in episodic experiencesthat differ across individuals In contrast an episodic view suggests that themental representation itself reflects the specific co-occurrences of emotion thatare stored in episodic memory for a particular person

An episodic interpretation of circumplex structure

For an episodic hypothesis to be tenable accurate episodic information must becontained in the circumplex representation Similarity ratings must be based atleast in part on actual experienced emotion covariations and not some generaltheory of co-occurrence According to Reisenzein and Schimmack (1999)similarity ratings are computed based on respondentsrsquo experience of whichemotions tend to co-occur (or closely follow one another in time) Specificallythey suggest that participants implicitly generate covariation estimates whenjudging the similarity between emotions such that these estimates should cor-respond closely to the correlation between emotion experienced during emotionepisodes As a result the affect covariation information represented in episodicmemory that is used to generate similarity judgements lsquolsquoshould be a fairlyaccurate reflection of the actual co-occurances of affectsrsquorsquo that people encounterin their lives (p 552) Indeed evidence suggests that episodic representationslike emotion covariation estimates are at least in part constructed from theinformation provided in context-specific everyday experience (McKenzie1994 for reviews see Alloy amp Tabachnik 1984 Crocker 1981) The purpose ofthe present article was to examine the degree to which mental representations ofemotion contain actual covariation information (ie the degree to whichemotions covaried in everyday life)

OVERVIEW OF THE PRESENT STUDIES

This article contains two studies that assessed the relationship betweenproximity judgements of affect terms and actual observed covariations in

336 FELDMAN BARRETT AND FOSSUM

experienced affective states Using an experience-sampling method participantsin two studies made ratings of their affective state three times a day over anextended observation period These data allowed us to compute observed co-occurrences in everyday experience Observed co-occurrences were thencompared to participantsrsquo proximity ratings of emotion Two types of proximityratings were examined

First we compared observed emotion covariations with similarity judge-ments (Studies 1 and 2) To date no study has empirically compared covaria-tions in idiographically derived emotion ratings from real life experience withsimilarity judgements The two studies that have examined the correspondenceidiographically either did not report a direct empirical comparison of the two(Zevon amp Tellegen 1982) or had participants rate how they believed theywould feel in a series of emotion eliciting situations (Reisenzein amp Schimmack1999 Study 4) Such hypothetical responses tap propositional knowledge thatmay or may not be an accurate index of actual emotion covariation in daily life(for a discussion of bias in hypothetical responses see Greenwald amp Banaji1995 Ross 1989)

Second we compared observed emotion covariations with emotion covar-iation estimates (in the form of conditional probability judgements Study 2only) According to previous research conditional probability judgements areconstructed in part from the information provided in context-specific everydayexperience (McKenzie 1994 for reviews see Alloy amp Tabachnik 1984Crocker 1981) If participants generate accurate covariation estimates as sug-gested by Reisenzein and Schimmack (1999) then there should be a strongcorrespondence between their observed emotion covariations and their condi-tional probability judgements (ie how often they believe two emotions co-occur in their experience) To date no study has empirically compared covar-iations in idiographically derived emotion ratings from real life experience withestimated covariation judgements One study has investigated the nomotheticcorrespondence in cross-sectionally derived ratings (Schimmack amp Hartmann1997) and a second study compared conditional probability judgements toidiographically derived responses to hypothetical situations (Reisenzein ampSchimmack 1999 Study 4)

STUDY 1 RE-ANALYSIS OF FELDMAN (1995A)

Study 1 examined whether accurate covariation information is contained insimilarity judgements by reanalysing a dataset containing experience-samplingratings of 16 affective experiences (Feldman 1995a) In this study participantsprovide detailed quantitative descriptions of their affective experiences as soonas they occurred across a 90-day period allowing an estimate of observedemotion co-occurrence Our aim was to determine whether the covariations thatwe observed in participantsrsquo affect ratings were related to their similarity ratings

MENTAL REPRESENTATIONS OF AFFECT 337

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

experienced affective states Using an experience-sampling method participantsin two studies made ratings of their affective state three times a day over anextended observation period These data allowed us to compute observed co-occurrences in everyday experience Observed co-occurrences were thencompared to participantsrsquo proximity ratings of emotion Two types of proximityratings were examined

First we compared observed emotion covariations with similarity judge-ments (Studies 1 and 2) To date no study has empirically compared covaria-tions in idiographically derived emotion ratings from real life experience withsimilarity judgements The two studies that have examined the correspondenceidiographically either did not report a direct empirical comparison of the two(Zevon amp Tellegen 1982) or had participants rate how they believed theywould feel in a series of emotion eliciting situations (Reisenzein amp Schimmack1999 Study 4) Such hypothetical responses tap propositional knowledge thatmay or may not be an accurate index of actual emotion covariation in daily life(for a discussion of bias in hypothetical responses see Greenwald amp Banaji1995 Ross 1989)

Second we compared observed emotion covariations with emotion covar-iation estimates (in the form of conditional probability judgements Study 2only) According to previous research conditional probability judgements areconstructed in part from the information provided in context-specific everydayexperience (McKenzie 1994 for reviews see Alloy amp Tabachnik 1984Crocker 1981) If participants generate accurate covariation estimates as sug-gested by Reisenzein and Schimmack (1999) then there should be a strongcorrespondence between their observed emotion covariations and their condi-tional probability judgements (ie how often they believe two emotions co-occur in their experience) To date no study has empirically compared covar-iations in idiographically derived emotion ratings from real life experience withestimated covariation judgements One study has investigated the nomotheticcorrespondence in cross-sectionally derived ratings (Schimmack amp Hartmann1997) and a second study compared conditional probability judgements toidiographically derived responses to hypothetical situations (Reisenzein ampSchimmack 1999 Study 4)

STUDY 1 RE-ANALYSIS OF FELDMAN (1995A)

Study 1 examined whether accurate covariation information is contained insimilarity judgements by reanalysing a dataset containing experience-samplingratings of 16 affective experiences (Feldman 1995a) In this study participantsprovide detailed quantitative descriptions of their affective experiences as soonas they occurred across a 90-day period allowing an estimate of observedemotion co-occurrence Our aim was to determine whether the covariations thatwe observed in participantsrsquo affect ratings were related to their similarity ratings

MENTAL REPRESENTATIONS OF AFFECT 337

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

of those same affect terms If similarity judgements of emotion words reflectepisodic knowledge of emotion covariation then similarity judgements shouldstrongly correspond to the observed co-occurrence of affective experiences

Methods

At the beginning of the study participants provided similarity ratings of 16affect terms The 16 terms were chosen to represent the circumplex space toensure that all of its octants were equally represented (enthusiastic peppyhappy satisfied calm relaxed quiet still sleepy sluggish sad disappointed nervous afraid surprised aroused) Each term served either as the referent oras the subject in a given pairing resulting in 120 judgements Participants wereasked to rate the similarity of the word pairs according to the meanings of thewords (1 = extremely dissimilar through 4 = unrelated 7 = extremely similar)Terms appeared equally spaced throughout the measure (see Davison 1983)The adjective pairs were presented in a single random order

Participants then rated their momentary affective state using a series of 88terms that included those target 16 terms Participants indicated on a 7-pointscale the extent to which each of these 88 mood adjectives described theiremotional state (0 = not at all 3 = a moderate amount 6 = a great deal) byresponding to the following instruction lsquolsquoIndicate to what extent you feel thisway right now that is at the present momentrsquorsquo Participants completed aquestionnaire in the morning (7 am to 12 pm) afternoon (12 pm to 5 pm)and evening (5 pm to 12 am) every day for 90 consecutive days Theyreturned completed forms on Monday Wednesday and Friday of each weekThe experimenters contacted participants within 48 hours if they failed to returna questionnaire and they interviewed participants three times during the study toensure compliance with the research procedures Full details about the procedurecan be found in Feldman (1995a) Data were available for the 16 participants (ofthe 24 in the original study) who completed both the similarity judgements andthe momentary emotion ratings

Results

Intercorrelations between the 16 circumplex markers across the period ofobservation were calculated for each participant These 120 intercorrelationsrepresented the measured covariation between self-reported affective states foreach participant1 Each participantrsquos observed covariations were compared tohisher similarity judgements across the 120 word pairs One correlationcoefficient was generated for each participant The resulting correlations ranged

1All correlation coefficients were subjected to a Fisherrsquos r-to-z transformation before being usedin additional analyses

338 FELDMAN BARRETT AND FOSSUM

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

from r = 31 to r = 72 with a mean of r = 55 and a standard deviation of 017This finding has two interpretations It may indicate the correlation was 55 forevery participant and that there was substantial sampling error in estimating thecorrelation Alternatively it may indicate that on average experiencedcovariations were related to the similarity ratings but the true strength of thisrelationship was stronger for some participants than for others Althoughsampling error surely existed in this dataset we suspect that the latter possibilityis more likely

To demonstrate that true strength of the similarity-observed covariationrelationship did not fluctuate randomly but was systematically stronger fromsome individuals than for others we conducted three additional analyses Firstwe demonstrated that there were large individual differences in emotioncovariation yet respondentsrsquo similarity ratings strongly agreed with one anotherAn affective structure was constructed for each participant by submitting hisherobserved covariations to a principle axis factor analysis followed by plotting ofthe factor loadings (Feldman (1995a) The resulting structures varied from cir-cular to elliptical Two of the affective structures reported in Feldman (1995a)are reproduced in Figure 1a to illustrate this variation Such variation indicatesthat the pattern of emotion covariation differed across individuals (for a fullexplanation see Feldman 1995a) The affective circumplex derived from anindividual differences multidimensional scaling (MDS) of the similarity ratings(using INDSCAL) presented in Figure 1b was a circular structure that washighly consistent across participants The small variations in the MDS solutionacross participants were not significantly related to variations in observedemotion covariations (Feldman 1995a) Thus the results suggested that thesimilarity ratings produced a circular structure with very little variation acrossparticipants but the covariations in the self-report data produced structures ofvarying shape across participants

Second we investigated whether the strength of the similarity-observedcovariation relationship changed systematically with the pattern of observedcovariations in experienced affect Specifically we hypothesised that as theobserved covariations produced a self-report structure approaching a circularshape the more the strength of the relationship between the observed covaria-tions and the similarity ratings would increase A circularity index for eachparticipantrsquos self-report structure was established by computing a ratio of thepercentage of variance accounted for by the two factors anchoring eachstructure The higher the index the more circular the structure a value of oneindicated a perfectly circular structure The lower the index the more ellipticalthe structure This index was then compared to the similarity-covariationcorrelations As predicted the magnitude of the similarity-covariation corre-spondence was influenced by the degree to which respondentsrsquo self-reportstructure were circular (r = 42 p lt 05) Thus the correspondence between

MENTAL REPRESENTATIONS OF AFFECT 339

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Fig

ure

1(a

)an

d(b

)V

aria

tions

inem

otio

nst

ruct

ure

Figu

rem

odif

ied

from

Fel

dman

(199

5a)

(c)

The

circ

umpl

exst

ruct

ure

ofaf

fect

deri

ved

from

sim

ilar

ity

judg

emen

ts

Val

ence

isth

eho

rizo

ntal

axis

and

arou

sal

isth

eve

rtic

alax

is

Fig

ure

take

nfr

omFe

ldm

anB

arre

tt(1

998)

340

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

participantsrsquo observed emotion covariations and their similarity ratingsincreased as the self-report structures came to resemble the circular structure ofthe similarity ratings

Finally we directly tested whether the similarity of two emotions wouldincrease with the number of episodes in which they co-occurred and decreasewith the number of episodes in which each emotion occurred alone The averagecorrelations between pairs of pleasant (enthusiastic happy and calm) andunpleasant (nervous sad and sluggish) affects were calculated across partici-pants Participants were divided into groups on the basis of whether theirpairwise correlation fell above or below the median for that pair This procedurewas performed separately for each affect pair t-tests were then calculated todetermine whether participants with a large covariation between two emotionsjudged those states to be more similar than did those with a small covariationThe results presented in Table 1 do not support the hypothesis that thecovariation between two affective experiences influenced their judged similar-ity The analyses were replicated with another set of pleasant (peppy satisfiedand relaxed) and unpleasant (afraid disappointed sleepy) emotions partici-pants with large covariations did not differ from those with small covariations intheir similarity judgments of the pairs of emotion words

TABLE 1Judged similarity of emotion pairs by participants high or low in actual

emotion covariation

Amount of covariation

Small Large t p

First set of emotion pairsEnthusiastichappy 66 55 159 nsEnthusiasticcalm 19 30 184 009Calmhappy 50 48 039 nsNervoussad 46 34 171 010Sluggishnervous 31 28 049 nsSluggishsad 56 50 071 ns

Second set of emotion pairsSatisfiedpeppy 49 54 075 nsPeppyrelaxed 19 23 062 nsSatisfiedrelaxed 56 59 072 nsAfraiddisappointed 41 266 174 010Sleepyafraid 24 24 000 nsSleepydisappointed 54 51 033 ns

Note df = 14 Individuals were divided into groups using a median split procedure

MENTAL REPRESENTATIONS OF AFFECT 341

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Discussion

Taken together the results of Study 1 cast doubt on the hypothesis that similarityratings are computed based on respondentsrsquo experience of which emotions tendto co-occur First individuals varied from one another in the co-occurrence oftheir affective experiences but did not vary substantially in their similarityratings Of course it is possible that the variation observed in the co-occurrencesare due to random error but additional evidence suggests that they are mean-ingfully related to external variables and therefore cannot be considered randomfluctuations (Feldman Barrett amp Gross in press) Second judgements of emo-tion similarity were not uniformly related to observed co-occurrences inexperienced affect This relationship was stronger for individuals who displayeda circular affective structure and weaker for those with a more ellipticalstructure Finally individuals who displayed large correlations between specificpairs of emotions did not differ in their similarity judgements of those emotionpairs from individuals who displayed smaller pairwise correlations

STUDY 2

Study 2 replicated and extended the findings from Study 1 Once again anidiographic method was utilised to examine the degree to which mental repre-sentations of emotion contained accurate episodic information In Study 2mental representations were indexed both by similarity ratings and by condi-tional probability ratings of affect word pairs Observed co-occurrences (derivedfrom experience-sampling ratings of emotion three times per day over 60 days)were then compared to emotion covariation estimates (in the form of conditionalprobability judgements) and to similarity ratings of affect terms taken bothbefore and after the experience-sampling procedure Using these data weexamined three hypotheses

First we sought to determine whether the pre-sampling proximity ratings(ie the similarity and conditional probability ratings) were related to thecovariance information (the predictive correspondence hypothesis) Secondbecause our momentary rating procedure may have cued individuals to recalltheir actual experience more accurately (Linton 1986) we investigated whetherpeople would adjust or calibrate their proximity ratings to their actual affectiveexperiences after reporting on their experience over a two month period (thecalibration hypothesis) Third we explored the possibility that both types ofproximity ratings contained semantic knowledge (the semantic hypothesis)

The predictive correspondence calibration and semantic hypotheses wereexamined using path analyses (Pedhauzer 1982) In traditional path analysis thezero-order correlations between variables are decomposed in the mannerspecified by the hypotheses being tested and path coefficents are estimated usingstandardised regression weights obtained from a series of regression analysesOne path model was estimated for the similarity ratings and another for the

342 FELDMAN BARRETT AND FOSSUM

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

conditional probability judgements Figure 2 portrays the ways in which theobserved emotion covariations were related to proximity (ie similarity orconditional probability) judgements taken both before and after the experience-sampling portion of the study Path p21 represented the predictive correspon-dence effect (ie the degree to which accurate covariance information and inpre-experience-sampling ratings were related) this path reflected the assump-tion that the profile of emotion covariations is stable for one individual acrosstime Analyses of two experience-sampling datasets (Feldman 1995a FeldmanBarrett 1998) support this assumption

Path p32 represented the calibration effect (ie the degree to which indivi-dualsrsquo calibrated their judgments to the co-occurrence of affective experiencesthat they documented during the 60 days of experience-sampling procedure)this path reflected the degree to which similarity or conditional probabilityratings were sensitive to actual covariation experiences over and above theinfluence of the pre-sampling ratings

Path p31 represented the additional emotion knowledge effect (ie the degreeto which the pre- and post-sampling ratings shared variance that was not anaccurate reflection of the observed covariations) The direct effect of the pre-sampling similarity or conditional probability ratings on the post-samplingratings once the influence of the observed covariances was controlled wasevidence that additional emotion knowledge (whether rooted in semanticinformation in erroneous beliefs about covariation or in some other source ofinformation) was contained in the proximity ratings That is the path representsthe emotion knowledge not based on immediate experiences of emotioncovariations that participants are bringing to bear when making similarityratings or when making estimates of emotion covariation

We explored the extent to which this additional knowledge containedsemantic information According to a large body of previous research affectterms can be defined on the basis of the valence and the level of arousal that they

Figure 2 Framework for estimating the predictive accuracy and calibration hypotheses

MENTAL REPRESENTATIONS OF AFFECT 343

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

denote (for a review see Russell 1980) Although valence and arousal do notconstitute all the semantic information associated with affect terms they makeup a large proportion of it (see Russell amp Feldman Barrett 1999) To testwhether the additional knowledge contained any semantic information wecompared the size of path p31 in Figure 2 with the size of that path whensemantic ratings were included in the models predicting the post-samplingjudgements That is we evaluated whether the unique relationship between pre-and post-sampling proximity ratings (after removing the effect of the observedcovariations) was mediated by semantic knowledge The direct semantic ratingswere obtained from an independent sample of participants If semantic knowl-edge is a component of path p31 then the size of that path would be significantlyreduced when the semantic ratings were added as predictors to the regressionmodel that estimated the post-sampling proximity ratings (Kenny Kashy ampBolger 1997)

Method and participants

Participants were 42 students in the Department of Psychology at the Pennsyl-vania State University All participants received extra credit for their partici-pation and had an opportunity to partake in a cash lottery

The original sample contained 64 participants Because of the time-consuming nature of this study the drop-out rate among participants wasmoderately high Thirteen participants (20of the original sample) dropped outof the study of their own accord and three participants (5 of the originalsample) were excluded from the sample because they missed more than 10 oftheir required momentary emotion ratings Data from 6 more participants weredeleted because they contained a large number of retrospective ratings (seebelow)

Measures

Momentary affect measure The measure of momentary emotionalexperiences used in this study included 88 affect terms that anchored all octantsof the affective circumplex Participants indicated on a 7-point scale the extentto which each of these 88 affect adjectives described their emotional state(0 = not at all 3 = a moderate amount 6 = a great deal) by responding to thefollowing instruction lsquolsquoIndicate to what extent you feel this way right now thatis at the present momentrsquorsquo Sixteen affect-related terms were sampled torepresent the circumplex space (excited lively cheerful pleased calm relaxedidle still dulled bored unhappy disappointed nervous fearful alertaroused) The 16 emotion terms were selected on the basis of their frequencyof use (Francis amp KucEuml era 1982) Each term was both in common use and was

344 FELDMAN BARRETT AND FOSSUM

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

comparable in frequency to all the other terms selected Very uncommonemotion terms (eg euphoric) and extremely common terms (eg happy) werenot chosen

The intercorrelations between the 16 circumplex markers were calculated foreach participant across the experience-sampling period These 120 inter-correlations represented the observed covariation between self-reported affec-tive states for each participant all correlations were submitted to a Fisher r-to-ztransformation before use in further analyses

Similarity measure Participants rated the similarity of all possible pairs ofthe 16 circumplex markers (120 word pairs) Each term served both as thereferent and as the subject in each pairing resulting in 240 judgementsParticipants were asked to rate the similarity of the word pairs according to themeanings of the words (1 = extremely dissimilar through 4 = unrelated7 = extremely similar) Terms appeared equally spaced throughout the measure(see Davison 1983) The adjective pairs were presented in a single randomorder The 240 similarity ratings were reduced to 120 ratings by averaging theratings across the corresponding word pairs This procedure was followed for theratings taken both before and after the momentary sampling procedure

Conditional probability measure Participants rated the conditional prob-ability of all possible pairs of the 16 circumplex markers again resulting in 240judgements Participants were asked to estimate how frequently theyexperienced each emotion in the presence of every other emotion (1 = never3 = sometimes 6 = always) Terms appeared equally spaced throughout themeasure and the adjective pairs were presented in a single random order(although this order was different than that used for the similarity ratings) Theconditional probability ratings served as estimates of participantsrsquo beliefsconcerning the co-occurrence of their emotional experiences The conditionalprobability ratings for corresponding word pairs were averaged producing 120ratings for the 120 word pairs This procedure was followed for the ratings takenboth before and after the momentary sampling procedure

Procedure

At the beginning of the study participants completed a battery of questionnairesincluding the similarity measure and the conditional probability measure Par-ticipants were then presented with instructions for the momentary emotionratings Participants completed an emotion questionnaire in the morning (7 amto 12 pm) afternoon (12 pm to 5 pm) and evening (5 pm to 12 am) everyday for 60 consecutive days They returned completed forms on MondayWednesday and Friday of each week The experimenters contacted participantswithin 48 hours if they failed to return a questionnaire and they interviewed

MENTAL REPRESENTATIONS OF AFFECT 345

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

participants three times during the study to ensure compliance with the researchprocedures

After participants completed the study the experimenters explained thepurpose of the study and then asked a number of questions regarding partici-pation Subjects estimated the percentage of time that they used recall tocomplete their questionnaires Six participants (approximately 9 of the totalsample) reported doing so more than 25of the time and were deleted from thefinal sample None of the 42 remaining participants missed more than 5of theobservations and the average observations missed was 1 Some participantscompleted emotion ratings on more days than were required and these obser-vations were included in the study The number of usable observations rangedfrom 171 to 206 with a mean of 181 and a standard deviation of 557 Noparticipant reported awareness of the hypotheses under investigation When weasked participants to describe their reactions to the momentary emotion mea-surements participants reported that they found the experience to be mildly tomoderately time-consuming but not stressful No participants reported that theirparticipation in the study was significantly disruptive

Semantic data

An independent sample of 65 undergraduate psychology students at the Penn-sylvania State University judged the type of valence and the amount of arousaldenoted by each of the 88 affect terms included on the momentary emotionmeasure Participants were asked to rate the pleasantness or unpleasantness ofeach emotional state on a 7-point scale (1 = extremely unpleasant 4 = neutral7 = extremely pleasant) and to rate the amount of bodily activation associatedwith each emotional state (1 = extremely low key 4 = neutral 7 = extremelykeyed up) The mean rating for each word was computed A valence-basedproximity matrix was calculated by taking the absolute value of the differencebetween the mean valence ratings for all 120 pairs of emotion words Thesmaller the absolute value between two means the more similar those terms inthe valence they denoted The arousal-based proximity matrix was calculatedanalogously using the mean arousal ratings

Results

The hypotheses to be tested using path analysis reduced down to one statisticalquestion What were the average relationships between the observed covaria-tions the conditional probability ratings or the similarity ratings and the directsemantic ratings We compared the various ratings across the 120 word pairswithin each individual and then averaged these relationships across individualsWe expected individual differences in the sizes of these relationships but wewere primarily interested in the averaged estimates in this report

346 FELDMAN BARRETT AND FOSSUM

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

We used hierarchical linear modelling (HLM Bryk amp Raudenbush 19871992 Bryk Raudenbush Seltzer amp Congdon 1989) to compute path coeffi-cients Conceptually HLM analyses calculate one regression equation at thelevel of the individual (eg regressing post-sampling similarity ratings on thepre-sampling ratings for each individual across 120 pairs of words) and thenfinds the average of that estimate across individuals The variance across theindividual estimates is also computed Practically HLM models within-subjectand between-subject variation simultaneously thus allowing us to model eachsource variation while taking the statistical characteristics of the other level intoaccount As a result the person-level coefficients are treated as random effectswhen computing the average estimate Individuals who produce more reliableestimates are weighted more in the computation of the average estimate and indoing so HLM controls for reliability differences across individuals therebyprotecting against spurious findings due to differences in measurement erroracross individuals A more detailed explanation of the statistical analyses ispresented in the Appendix2

The paths presented in Figure 2 were estimated using two HLM regressionanalyses for the similarity ratings and two for the conditional probabilityratings one to model the relationship between pre-sampling ratings andobserved emotion covariations (predictive correspondence path p21) and asecond that regressed the post-sampling ratings on both the pre-sampling ratings(additional emotion knowledge path p31) and the observed covariations (cali-bration path p32)

Predictive correspondence

On average participantsrsquo pre-sampling proximity ratings reflected some con-sistent information in the actual co-occurrence of emotional states The esti-mates for the predictive correspondence path p21 are presented in the first twodata columns of Table 2 The average predicted correspondence effect for thesimilarity ratings was p21= 57 t = 1601 p lt 001 The magnitude of this findingis almost identical to that observed in Study 1 The average predicted corre-spondence effect for the pre-sampling conditional probability ratings was

2Using a conventiona l regression approach to analyse the present dataset we would run a seriesof regression analyses for each participant comparing the relevant variable across the 120 pairs ofemotion words The result would be one set of regression coefficients for each participant and wouldrepresent an attempt to model the within-subject variance in the emotion ratings The regressioncoefficients from these within-subject anlayses would be considered the outcome variables andaveraged across individuals to obtain mean estimates of the path coefficients A version of thisanalysis strategy was used in the second study reported by Schimmack and Reisenzein (1997) Thistwo-step ordinary least-squares analytic procedure can be less than optimal however because it doesnot take into account the estimation error in the within-subject regression coefficients (Kenny et al1997)

MENTAL REPRESENTATIONS OF AFFECT 347

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

p21 = 58 t = 1334 p lt 001 These findings indicated that the indices of emotionrepresentation taken before the experience-sampling portion of the study con-tained some covariance information approximately 33 of the variance in thepre-sampling proximity ratings was accounted for by the observed covariationsParticipants varied significantly from one another in the size of their unstan-dardised paths SD = 04 w2 (41 N = 42) = 37202 p lt 0001 and SD = 006 w2

(41 N = 42) = 55013 p lt 001 suggesting the possibility that the similarityratings and covariation estimates made by some participants contained morecovariation information than did those made by other participants

Calibration

On average participants modestly calibrated their mental representations to theiractual experience The estimates for the calibration path p32 are presented inthe third and fourth data columns of Table 2 The average calibration effect forthe similarity ratings was p32= 21 t = 778 p lt 001 and for the conditionalprobability ratings was p32= 28 t = 1109 p lt 0001 Although modest theeffects indicated that on average participantsrsquo judgements did become some-what more accurate after the momentary sampling procedure Participants variedsignificantly from one another in the size of their unstandardised pathsSD = 073 w2 (41 N = 42) = 28362 p lt 0001 and SD = 056 w2 (41N = 42) = 20997 p lt 001 suggesting the possibility that some participantscalibrated more so than did others

Additional emotion knowledge A semantichypothesis

The results presented thus far demonstrated that on average judgementsrepresenting what people know about emotion be they similarity ratings orcovariance estimates do contain some accurate covariance information Inaddition individuals did modestly calibrate these judgments to new informationabout their experience when cued over a two month period The results pre-sented in Table 3 indicate however that indices representing emotion structurealso contained other sources of knowledge The average effect representing

TABLE 2Predictive accuracy and calibration of proximity judgements

Predictive correspondenc e Calibration

Ratings b B b B

Similarity 011 057 099 021Conditional probability 015 058 112 028

348 FELDMAN BARRETT AND FOSSUM

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

additional emotion knowledge contained in the similarity ratings was p31= 66t = 1778 p lt 0001 and in the conditional probability ratings was p31= 058t = 1540 p lt 001 These findings indicate that participantsrsquo pre- and post-sampling ratings shared considerable variance that was independent of thecovariations evident in their self-reports of experience Participants varied sig-nificantly from one another in the size of their unstandardised paths SD = 021w2 (41 N = 42) = 43814 p lt 0001 and SD = 024 w2 (41 N = 42) = 41324p lt 001 suggesting the possibility that the ratings made by some participantscontained more noncovariation based emotion knowledge than did those madeby other participants

Next we explored the hypothesis that at least part of this knowledge wassemantic by observing whether a significant portion of the variance shared bythe pre- and post-sampling proximity ratings would be accounted for by thesemantic ratings of the affect terms HLM regression analyses were conducted toestimate the size of the p31 paths as described above with the sole exception thatthe semantic proximity matrices were added as predictors to the regressionanalyses Path p31rsquo represented the relationship between the pre- and post-sampling proximity ratings after controlling for the effects of the observedcovariations and after the mediating effects of the semantic ratings wereremoved One HLM analysis was conducted for the post-sampling similarityratings and one for the post-sampling covariation estimates The size ofresulting additional knowledge paths are presented in the right half of Table 3Both valence-based and arousal-based semantic matrices were significantlyrelated to the proximity ratings indicating that they may be potential mediatorsof the additional knowledge effect

To examine whether the semantic proximity matrices significantly accountedfor any portion of the additional emotion knowledge effect we compared thestandardised regression coefficients from the original analysis as portrayed inFigure 1 (p31 = 66 and p31 = 58) with those from the models where themediating effects of the semantic ratings were included (p31rsquo = 048 and

TABLE 3Additional emotion knowledge contained in proximity judgements

Semantic knowledge Additional knowledgeAdditional controlling forknowledge Valence Arousal semantic information

Ratings b B b B b B b B

Similarity 061 066 011 007 036 021 045 048Conditional probability 059 058 015 011 018 012 046 045

Note All coefficients were significant at p lt 001

MENTAL REPRESENTATIONS OF AFFECT 349

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

p31rsquo = 45 Baron amp Kenny 1986 Kenny et al 1997) The additional emotionknowledge contained in the similarity ratings was significantly reduced by boththe valence-based and arousal-based semantic information z = 392 p lt 001 andz = 843 p lt 0001 this was also true for the covariance estimates z = 658p lt 0001 and z = 849 p lt 0001 These findings suggest that semanticknowledge was contained in both the similarity ratings and in the covarianceestimates over and above any contribution of the observed covariances Asignificant portion of the emotion knowledge contained in those judgements wasleft unexplained by the semantic information however indicating that addi-tional sources of knowledge must be influencing the proximity judgements

Subsidiary analyses

Additional analyses were conducted to further examine the relationshipsbetween the proximity judgements and semantic knowledge First as proximityratings both the similarity ratings and the conditional probability estimates areindices of the mental representation of emotion Previous research has shown astrong correspondence between the two (Schimmack amp Reisenzein 1997)Because they both contain semantic emotion knowledge it is possible that thestrong association between the two may be due in part to this semanticknowledge

We first replicated the finding that the two types of proximity ratings werehighly related Both the pre-sampling similarity ratings and the pre-samplingconditional probability judgements were subjected to a weighted Euclideanmultidimensional scaling analysis3 Plots of the Stress values by the number ofdimensions for the MDS solution revealed a clear elbows at the two dimensionalsolution for both analyses suggesting the suitability of the two dimensionalMDS solution for both the similarity and pre-sampling conditional probabilityratings Stress = 16 RSQ = 86 and Stress = 17 RSQ = 83 respectively4 TheMDS solutions for the similarity ratings and the conditional probability judge-ments are presented in Figures 3a and b respectively Both solutions produced acircular structure anchored by two dimensions The congruence coefficient forthe two solutions (Davison 1983) was 98 indicating an excellent matchbetween the two configurations The congruence coefficient for the two post-sampling solutions was 97 The similarity ratings and the conditionalprobability judgements produced almost identical structures

3The primary approach to ties (allowing data to become untied) was used in the analysis becauseit typically results in a better fit to the data (Davison 1983 p 86)

4Although Kruskal and Wish (1978 p 56) caution against accepting solutions with a Stress valueabove 10 the lsquolsquoelbowrsquorsquo in the plot clearly appeared for the two-dimensional solution Furthermorethe two-dimensional solution was superior to other solutions with additional dimensions on the basisof the relative interpretability of the various solutions (Davison 1983)

350 FELDMAN BARRETT AND FOSSUM

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

The strong correspondence between the similarity and conditional probabilityjudgements was confirmed by additional HLM analyses Using the pre-samplingratings we regressed the similarity ratings onto the conditional probabilityratings On average the similarity ratings were substantially related to theconditional probability judgements (B = 71 t = 2350 p lt 001) although thisrelationship was stronger for some individuals than for others SD = 020 w2 (41N = 42) = 33838 p lt 001

Further HLM analyses indicated that the correspondence between thetwo types of proximity judgements was in part due to semantic knowledgethat the two shared The similarity ratings continued to be related to partici-pantsrsquo conditional probability estimates even after the influence of theobserved covariations in emotional experiences was controlled (B = 55t = 1616 p lt 001) although once again this relationship was stronger forsome than for others SD = 020 w2 (41 N = 42) = 30106 p lt 001 A pathcoefficient of 55 indicates that additional emotion knowledge contained inthe covariation estimates over and above that abstracted from actual experi-ence was also contained in the similarity ratings When the variance dueto direct semantic ratings were partialled out the relationship between thesimilarity ratings and the covariation estimates decreased significantly toB = 32 t = 1235 p lt 001 although once again the magnitude of this effectvaried significantly across individuals SD = 018 w2 (41 N = 42) = 15492p lt 001) The observed decrease was due both to the valence-based and tothe arousal-based semantic information (z = 491 p lt 0001 and z = 1325p lt 0001) Analyses of the post-sampling judgements produce exactly thesame findings These findings indicate that the similarity and conditional

Figure 3 (a) The circumplex structure of affect derived from the pre-sampling similarity judge-ments Valence is the horizontal axis and arousal is the vertical axis (b) The circumplex structure ofaffect derived from the pre-sampling conditional probability judgements Valence is the horizontalaxis and arousal is the vertical axis

MENTAL REPRESENTATIONS OF AFFECT 351

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

probability ratings shared significant content that was semantically basedalthough the strength of their correspondence was not completely accountedfor by the semantic ratings

GENERAL DISCUSSION

The circumplex model of affect has a long history in the psychological literature(Russell 1980 Schlosberg 1941 1952 1954 Woodworth 1938 Wundt 19121924) For some time it was assumed that general semantic knowledge aboutpleasuredispleasure and activation was represented by this circumplex structureThis assumption was challenged by Schimmack and Reisenzein (1997) whosuggested that the similarity ratings that produce the structure contain episodicbut not semantic knowledge of emotion

Semantic or episodic

Taken together the findings from Studies 1 and 2 clearly indicate that a pureepisodic account of similarity judgements like that presented by Schimmack andReisenzein (1997) is not supported Using an episodic or exemplar theory ofknowledge they argued that every experienced co-occurrence leaves a uniquememory trace and that on presentation of a cue (ie a request to compute asimilarity judgement) all stored episodic traces (eg Semon 19091923) orsome assemblage of exemplars (Kahneman amp Miller 1986) are activated andsomehow combined to result in a proximity judgement The most activatedtraces connect the cue to stored knowledge and a response is generated Theresults of the two studies presented here are not consistent with this viewhowever

A conservative view would interpret the results as more consistent withmixed semantic-episodic theory From this standpoint mental representations ofaffect are composed of a mixture of detail (specific memories of associated co-occurrence experiences) and more abstract conceptual knowledge boundtogether in representations (eg Conway Gardens Perfect Anderson amp Cohen1997) such that both types of knowledge are implicated in similarity compu-tations Clearly similarity ratings and co-occurrences of actual affectiveexperience are related Both studies indicated that about one-third of the var-iance in similarity ratings was accounted for by observed emotion covariationsFurthermore participants modestly calibrated their proximity judgements totheir actual experience after they had been cued about their affective experiencefor a 60-day period indicating that they can take advantage of episodicallygenerated experience to compute both similarity and conditional probabilityjudgements In addition to covariance information proximity ratings also con-tained other sources of knowledge some of which appeared to be semanticRatings of valence- and arousal-based semantic information obtained from a setof independent judges contributed unique variance to both sets of proximity

352 FELDMAN BARRETT AND FOSSUM

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

ratings indicating that the circumplex (which derives from those ratings) doesindeed contain semantic information

The view that mental representations of affect are composed of both semanticand episodic knowledge is broadly consistent with current thinking on the natureof memory Although memory was traditionally classified exclusively intoepisodic or semantic components (Tulving 1972) most researchers now assumethat the two are inextricably linked Some believe that memory for specificevents and for general facts are subsumed in one general declarative memorysystem (eg Echienbaum 1997 Squire amp Knowlton 1995) Others believe thatsemantic and episodic memory are organised in a hierarchical way such thatepisodic memory is a specific subsystem of semantic memory (Tulving 19831984) and depends on semantic memory for its integrity (Tulving 1985 for areview see Barba Parlato Jobert Samson amp Pappata 1998) Recentneuroscience evidence basically supports this view (eg Barba et al 1998Maguire amp Mummery 1999 Wiggs Weisberg amp Martin 1998)5

Episodic memory is dependent on semantic knowledge such that the retrievalof episodic knowledge is supported by semantic memory (Nadel amp Moscovich1998) Various parts of an experience are structurally disaggregated in the brainfor purposes of storage and must be re-aggregated when attempting to retrievean episode from memory (Nadel amp Moscovich 1998 Schacter 1996)Retrieving episodes or exemplars from memory is necessarily a reconstructiveact and one that can be influenced by semantic knowledge Thus it very wellmay be as Schimmack and Reisenzein (1997) claim that similarity ratings arebased on covariation estimates These estimates may be generated however onthe basis of semantic knowledge (Borkenau amp Ostendorf 1987 DrsquoAndrade1974 Schweder 1975 1977 Schweder amp DrsquoAndrade 1979) This suggestion issupported by the finding that conditional probability judgements for affect wordpairs which were used as estimates of episodic knowledge of co-occurrencewere in fact related to the semantic information about affect obtained from aseparate set of judges

Another reason to suspect that the conditional probability ratings were sub-stantially influenced by semantic knowledge has to do with how the questionswere asked Participants in the current studies as well as those in Schimmackand Reisenzein (1997) were to make judgements of covariation without refer-ence to context (ie time or place) leading to the likelihood that these aggre-gated episodic ensembles constitute a semanticised version of episodicknowledge (Nadel amp Moscovitch 1998) Although participants may have had toretrieve specific instances or episodes those episodes were summarised such

5Cortical and limbic networks implicated in semantic and episodic memory show both commonand unique regions although the exact pattern of neurological findings is still a matter of considerabledebate (for reviews see Barba et al 1998)

MENTAL REPRESENTATIONS OF AFFECT 353

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

that the memory lost its connection to time and place both of which arenecessary components of a pure episodic memory

Although episodic knowledge can be dependent on semantic memory it isalso the case that episodic memory helps to consolidate semantic knowledge(Nadel amp Moscovitch 1998) although little is known about how this transitionoccurs (Conway et al 1997) It is generally assumed that semantic knowledgederives from a series of episodes in the course of which semantic structure isextracted from experience (McClelland McNaughton amp OrsquoReilly 1995 Nadelamp Moscovitch 1998) The knowledge acquired in any given episode goesbeyond the specifics of that episode to include broader knowledge gained as aresult of having had that experience

Nowhere is this interplay between semantic and episodic memory more likelythan in the case of developing emotion knowledge As children we derive ourknowledge of emotion and emotion terms both from instruction about emotionconcepts and from our actual experience Emotion concepts probably begin asfairly stereotyped scripts or schemas (eg Fehr amp Russell 1984 ShaverSchwartz Kirson amp OrsquoConnor 1987) as children are socialised to learn thesemantic interpersonal and behavioural elements associated with specificemotion labels (Harris 1993) Children as young as two readily label theiremotional experiences (Bretherton McNew amp Beeghly-Smith 1981) Theyrapidly learn the type of psychological events and abstract situations that areassociated with particular emotion labels (eg fear sadness happiness angerguilt and so forth eg Harris Olthof Meerum Terwogt amp Hardman 1987)and they are also aware of the typical actions and expressions that are supposed toaccompany a particular emotional state (Trabasso Stein amp Johnson 1981)These concepts then become developed and elaborated with accumulating epi-sodic experience Individuals incorporate elements of their actual experience intotheir semantic representations of emotion concepts with repeated use such thattheir resulting semantic representations become more idiographically tailoredregarding the possible class of objects that can cause an emotional response therelational contexts associated with the response and the behavioural repertoirethat exists for dealing with the response and the larger situation

As a result emotion terms may come to be defined over time in part as afunction of our beliefs about how often distinct emotional experiences occurtogether (ie episodic influencing semantic) In addition however our con-sciously accessible emotional experience is defined in part from our semanticknowledge of emotion language That is we likely rely on semantic informationwhen applying emotion labels to our emotional experiences which are in turnencoded in episodic memory (ie semantic influencing episodic) Thus wederive our knowledge of emotion in part from our actual experience and overtime conversely we likely also rely on semantic information when applyingemotion labels to our immediate experiences are then available to be encoded inepisodic memory

354 FELDMAN BARRETT AND FOSSUM

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

The question then is not whether there is episodic influence on mentalrepresentations of emotion Of course there is The question rather is whetherthe general valence and arousal information depicted in the circumplex repre-sents episodic knowledge If it does then would expect to see the considerableidiographic variability in the similarity ratings that we see in the self-reportbased structures The fact that similarity ratings seem not to vary substantiallyacross individuals however is inconsistent with a strong episodic view Ratherthe evidence seems more consistent with the view that similarity ratings areprimarily computed using some general knowledge that all individuals sharethat is abstracted from specific emotional experiences Episodic variation inemotion representations may be present in other more subtle aspects of emotionconcepts

So an empirical resolution to the semantic-episodic question seems un-satisfying because it appears as if everything is related to everything else Butperhaps this is about as accurate as we can be given the procedures that we haveused to test these competing hypotheses It is probably impossible to preciselyestimate semantic and episodic components in similarity judgements or themental representation that they index Behavioural studies such those reportedhere and those by Schimmack and Reisenzein (1997) cannot precisely distin-guish between episodic and semantic sources of knowledge in an experimentaltask Given the interrelationship between semantic and episodic memory it isprobably virtually impossible to devise behavioural tasks that are pure measuresof one or the other (cf Barba et al 1998) Despite this ambiguity the twostudies reported here make several things clear First a pure episodic view ofsimilarity ratings is not tenable Second the interpretation of the findings likelyprovide an underestimate of the semantic contribution because semanticknowledge may be involved in computing covariation estimates as it plays a rolein consciously representing our affective experience (and the co-occurrences inthose experiences) in episodic memory Thus the strong relationship betweensimilarity ratings and observed emotion covariations may result from theirshared semantic components rather than from the fact that similarity compu-tations are rooted in episodic experience

Additional issues

The results raised two additional issues that might benefit from further studyFirst further study is needed to identify the specific facets of emotion knowl-edge that contribute to mental representations of emotion over and abovesemantic and accurate covariation information The additional knowledgecontained in the similarity and conditional probability ratings was partiallysemantic but a substantial portion of those ratings remained unexplainedPerhaps such knowledge is based on dominance (Russell amp Mehrabian 1977)affiliation (Russell 1991) or social desirability (Feldman Barrett 1996) Or

MENTAL REPRESENTATIONS OF AFFECT 355

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

perhaps it is related to beliefs about the situational determinants of emotions(Conway amp Bekerian 1987 Feldman Barrett Lane Sechrest amp Schwartz2000) although it is unclear whether these beliefs accurately represent the trueinfluences on how individuals use emotion knowledge to consciously label theiremotional states (Russell 1987 Weiss amp Brown 1977 as cited in Nisbett ampRoss 1980 Wilson Laser amp Stone 1982) Unfortunately we did not assess anyof these facets in the present study

Second there was considerable variation in the relationships between theobserved covariances the proximity ratings and the semantic components Thisvariation might possibly reflect sampling error or other types of artifactualvariance (eg restriction in range for some individuals) but it might alsosuggest that the configuration of episodic and semantic components in proximityratings may substantively differ across individuals There is also the possibilityof individual differences in the organisation of emotion knowledge acrossdifferent people such that some individuals may have more overlap betweentheir semantic and episodic knowledge of emotion terms than do othersAlthough not a primary concern in the present study these findings are certainlyworthy of serious consideration in future research on the organisation of emotionknowledge

Potential limitations

Of course it is possible to argue with our interpretation of the results Forexample it might be argued that momentary affective experiences were assessedonly three times a day in the present study and may not provided enoughtemporal resolution to assess moment-to-moment emotion covariations accu-rately As a result the role of actual covariation information may be larger orsmaller than estimated in the present study Alternatively it could also be arguedthat participantsrsquo assessments of emotion were randomly sampled from theirdaily lives and so they likely constitute a reasonable estimate of emotion co-occurrences

A more serious criticism of the present study is that we cannot claim supportfor any particular directional hypotheses because the data are only correlationalAs recommended by regression experts (Pedhauzer 1982) the zero-ordercorrelations between variables were decomposed into their various componentsvia regression analyses according to the hypotheses being tested It is possible touse other theories to decompose the relationships between the measuredvariables in ways that are different from those presented here however Yeteven if paths are reversed and alternative causal models estimated with theresult that the zero-order correlations are parsed somewhat differently thefindings send approximately the same message similarity ratings and covaria-tion estimates are associated with covariation information semantic knowledgeas well as additional as yet unspecified knowledge about emotion

356 FELDMAN BARRETT AND FOSSUM

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Another potential criticism of our findings is that they are inconsistent withSchimmack and Reisenzein (1997) who reported two studies that they considerstrong support for the episodic model of similarity ratings The strength of theirposition comes from the finding that their participants made asymmetricalsimilarity judgements when emotion terms were presented as both the subjectand the referent of the comparison According to Schimmack and Reisenzein(1997) a semantic theory assumes that similarity judgements are symmetrical(ie happiness and calm will be judged to be equally similar regardless of whichemotion serves as the subject of the comparison and which serves as thereferent) An episodic theory predicts that similarity judgments can be asym-metrical however (ie the similarity ratings of happiness and calm will varydepending on which emotion serves as the subject of the comparison) Dis-tinctive features of a concept decrease similarity more if the concept serves asthe subject of the comparison than if it serves as the referent (Tversky 1977)Schimmack and Reisenzein (1997) assumed that an emotionrsquos distinctivenessincreased (1) with the number of episodes in which it occurs alone (as opposedto occurring with another emotion) or (2) as the frequency of the emotionincreases Thus they predicted and found that an emotion with a lowerconditional probability or higher frequency would be judged by respondents asless similar if it served as the subject of the similarity comparison rather than asthe referent Furthermore they found that asymmetrical similarity judgementswere related to beliefs about the frequency and conditional probability ofoccurrence of emotions but were unrelated to the semantic properties of theemotion concepts In addition respondents judged the similarity of emotionpairs more rapidly when a frequent emotion was the referent of the comparisonwhich was interpreted as support for the hypothesis that frequency of experience(or distinctiveness) of an emotion affects similarity judgements depending onthe wordrsquos position in the comparison Support for the covariation hypothesiswas most robust when respondents were judging emotion terms denotingunpleasant emotions In fact they only used unpleasant emotion terms in thesecond study they reported

We are less convinced that asymmetries are the definitive evidence thatmental representations of emotion as indexed by similarity ratings are pri-marily episodic in nature First the asymmetries documented by Schimmackand Reisenzein (1997) could have been the result of response bias Asymme-tries in similarity judgements are generally weak (Holyoak amp Gordon 1983Tversky amp Gati 1978) and if they exist at all they may be produced byresponse bias (Nosofsky 1991) For example Schimmack and Reisenzein(1997) reported that participants largely agreed with one another in theirasymmetry of their similarity judgements Given the individual differences inactual emotion covariations documented in the present study as well as inother studies (eg Feldman Barrett 1998) such agreement should have beenhighly unlikely

MENTAL REPRESENTATIONS OF AFFECT 357

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Second the asymmetries documented by Schimmack and Reisenzein (1997)may have been augmented by the experimental procedures Participants weretold to focus their attention on the subject of the comparison were informedas to which emotion term would serve as the subject of the comparison andwere instructed to think about this emotion In addition the subject of thecomparison was presented in large letters to increase its visual salience andthe presentation of the referent emotion was delayed to provide participantswith more time to focus on the subject of the comparison Any of these pro-cedures could have produced more pronounced asymmetry effects and soconfidence in the existence of asymmetrical similarity judgements requiresfurther investigation

Finally Schimmack and Reisenzein (1997) describe a process by whichsimilarity ratings are generated that is inconsistent with their findings Schim-mack and Reisenzein (1997) argued that the episodic knowledge contained insimilarity judgements is not prestored in memory but is thought to be computedfrom exemplar knowledge that is accessible at the time when judgements arerequested That is this information is derived from memory-based rather thanon-line recall strategies (Hasties amp Park 1986 McConnell Sherman ampHamilton 1994) If episodic knowledge is constructed at the time of recall thenthe judgements made on the basis of that knowledge should be influenced bywhatever is most accessible at that time This influence might derive fromheuristics implicit theories or goals and motivations that are present oraccessible at the time when the judgements are made (for reviews see Fiske ampTaylor 1991 Greenwald amp Banaji 1995 Nisbett amp Ross 1980 Ross 1989)Typically we do not expect to see much consistency in memory-based judge-ments (McConnell et al 1994) In this context it is interesting to note thatSchimmack and Reisenzein (1997) reported very high inter-rate agreement intheir conditional probability ratings (above 90)

CONCLUSIONS

A sceptic might review the results of this study and conclude that they do notdetermine much because everything that was measured was related to every-thing else Another equally valid conclusion however is that mental repre-sentations of emotion like most psychological phenomena appear to bemultiply determined They contain accurate covariation information semanticinformation that is unique from the information contained in actual emotioncovariations as well as additional sources knowledge yet to be specified Thesimilarity ratings contained as much additional knowledge as they did accuratecovariation information Even the conditional probability judgements asestimates of covariation contained a substantial additional knowledge compo-nent Taken together the study did not serve to conclusively determine the

358 FELDMAN BARRETT AND FOSSUM

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

extent to which semantic knowledge is contained in similarity ratings but itclearly indicated that the ratings are not primarily grounded in episodicknowledge

Manuscript received 31 July 1998Revised manuscript received 31 July 2000

REFERENCES

Abelson RP amp Sermat V (1962) Multidimensional scaling of facial expressions Journal ofExperimental Psychology 63 546ndash554

Adolphs R Tranel D Damasio H amp Damasio A (1994) Impaired recognition of emotion infacial expressions following bilateral damage to the human amygdala Nature 372 669ndash672

Alloy LB amp Tabachnik N (1984) Assessment of covariation by humans and animals The jointinfluence of prior expectations and current situational information Psychological Review 91112ndash149

Almagor M amp Ben-Porath YS (1989) The two-factor model of self-reported mood A cross-cultural replication Journal of Personality Assessment 53 10ndash21

Barba GD Parlato V Jobert A Samson Y amp Pappata S (1998) Cortical networks implicatedin semantic and episodic memory Common or unique Cortex 34 547ndash561

Baron RM amp Kenny DA (1986) The moderator-mediato r distinction in social psychologica lresearch Conceptual strategic and statistical considerations Journal of Personality and SocialPsychology 51 1173ndash1182

Block J (1957) Studies in the phenomenolog y of emotions Journal of Abnormal and SocialPsychology 54 358ndash363

Borkenau P amp Ostendorf F (1987) Retrospective estimates as act frequencies How accurately dothey reflect reality Journal of Personality and Social Psychology 52 626ndash638

Bretherton I McNew S amp Beeghly-Smith M (1981) Early person knowledge as expressed ingestural and verbal communication When do infants acquire a theory of mind In M Lamb amp LSherrod (Eds) Infant social cognition Hillsdale NJ Erlbaum

Bryk AS amp Raudenbush SW (1987) Application of hierarchical linear models to assessingchange Psychological Bulletin 101 147ndash158

Bryk AS amp Raudenbush SW (1992) Hierarchical linear models Newbury Park CA SageBryk AS Raudenbush SW Seltzer M amp Congdon RT (1989) An introduction to HLM

Computer program and userrsquos guide Chicago University of Chicago PressBush LE (1973) Individual differences multidimensional scaling of adjectives denoting feelings

Journal of Personality and Social Psychology 25 50ndash57Cliff N amp Young FW (1968) On the relation between unidimensiona l judgments and multi-

dimensional scaling Organizationa l Behavior and Human Performance 3 269ndash285Conway MA amp Bekerian DA (1987) Situational knowledge and emotions Cognition and

Emotion 1 145ndash191Conway MA Gardiner JM Perfect TJ Anderson SJ amp Cohen GM (1997) Changes in

memory awareness during learning The acquisition of knowledge by psychology under-graduates Journal of Experimental Psychology General 126 393ndash413

Crocker J (1981) Judgment of covariation by social perceivers Psychological Bulletin 90 272ndash292

DrsquoAndrade RG (1974) Memory and the assessment of behavior In T Blalock (Ed) Measurementin the social sciences (pp 159ndash186) Chicago IL Aldine-Atherton

Davison ML (1983) Multidimensional scaling Toronto Wiley

MENTAL REPRESENTATIONS OF AFFECT 359

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Dittmann AT (1972) Interpersonal messages of emotion New York SpringerEchienbaum H (1997) How does the brain organize memories Science 277 330ndash332Fehr B amp Russell JA (1984) Concept of emotion viewed from a prototype perspective Journal of

Experimental Psychology General 113 464ndash486Feldman LA (1995a) Valence focus and arousal focus Individual differences in the structure of

affective experience Journal of Personality and Social Psychology 69 153ndash166Feldman LA (1995b) Variations in the circumplex structure of emotion Personality and Social

Psychology Bulletin 21 806ndash817Feldman Barrett L (1996) Hedonic tone perceived arousal and item desirability Three compo-

nents of self-reported mood Cognition and Emotion 10 47ndash68Feldman Barrett L (1998) Discrete emotions or dimensions The role of valence focus and arousal

focus Cognition and Emotion 12 579ndash599Feldman Barrett L amp Gross J (in press) Emotion representation and regulation A process model

of emotional intelligence In T Mayne amp G Bonnano (Eds) Emotion Current issues and futuredirections New York Guilford Press

Feldman Barrett L Lane R Sechrest L amp Schwartz G (2000) Sex differences in emotionalawareness Personality and Social Psychology Bulletin 26 1027ndash1035

Feldman Barrett L amp Russell JA (1998) Independence and bipolarity in the structure of currentaffect Journal of Personality and Social Psychology 74 967ndash984

Fillenbaum S amp Rapaport A (1971) Structures in the subjective lexicon New York AcademicPress

Fiske ST amp Taylor SE (1991) Social cognition Reading MA Addison-WesleyFrancis WN amp Kucera H (1982) Frequency analysis of English usage Lexicon amp grammar

Boston Houghton MifflinGreen RS amp Cliff N (1975) Multidimensional comparisons of structures of vocally and facially

expressed emotion Perception and Psychophysics 17 429ndash438Greenwald AG amp Banaji MR (1995) Implicit social cognition Attitudes self-esteem and

stereotypes Psychological Review 102 4ndash27Guttman L (1954) A new approach to factor analysis The radex In PF Lazarsfeld (Ed)

Mathematical thinking in the social sciences (pp 258ndash348) New York Columbia UniversityPress

Guttman L (1966) Order analysis of correlation matrices In RB Cattell (Ed) Handbook ofmultivariate experimental psychology Chicago IL Rand-McNally

Harris PL (1993) Understanding emotion In M Lewis amp JM Haviland (Eds) Handbook ofemotions (pp 237ndash246) New York Guilford Press

Harris PL Olthof T Meerum Terwogt M amp Hardman CE (1987) Childrenrsquos under-standing of situations that provoke emotion International Journal of Behavioral Development10 319ndash343

Hasties R amp Park B (1986) The relationship between memory and judgment depends on whetherthe judgment task is memory-based or on-line Psychological Review 93 258ndash268

Holyoak KJ amp Gordon PC (1983) Social reference points Journal of Personality and SocialPsychology 44 881ndash887

Kahneman D amp Miller DT (1986) Norm theory Comparing reality to its alternatives Psycho-logical Review 93 136ndash153

Kenny DA Kashy DA amp Bolger N (1997) Quantitative methods in social psychology In DGilbert S Fiske amp G Lindsey (Eds) Handbook of social psychology (4th ed) New YorkMcGraw-Hill

Kruskal JB amp Wish M (1978) Multidimensional scaling Beverly Hills CA SageLinton M (1986) Ways of searching and the contents of memory In DC Rubin (Ed) Auto-

biographical memory (pp 50ndash67) Cambridge UK Cambridge University Press

360 FELDMAN BARRETT AND FOSSUM

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Maguire EA amp Mummery CJ (1999) Differential modulation of a common memory retrievalnetwork revealed by positron emission tomography Hippocampus 9 54ndash61

McClelland JL McNaughton BL amp OrsquoReilly RC (1995) Why there are complementar ylearning systems in the hippocampus and neocortex Insights from the successes and failues ofconnectionis t models of learning and memory Psychological Review 102 419ndash457

McConnell AR Sherman SJ amp Hamilton DL (1994) On-line and memory-based aspects ofindividual and group target judgments Journal of Personality and Social Psychology 67173ndash185

McKenzie CRM (1994) The accuracy of intuitive judgment strategies Covariation assessmentand bayesian inference Cognitive Psychology 26 209ndash239

Nadel L amp Moscovich M (1998) Hippocampal contributions to cortical plasticity Neuro-pharmacology 37 431ndash439

Nisbett R amp Ross L (1980) Human inference Strategies and shortcomings of social judgmentEnglewood Cliffs NJ Prentice Hall

Nosofsky RM (1991) Stimulus bias asymmetric similarity and classification Cognitive Psy-chology 25 94ndash140

Osgood CE Suci GJ amp Tannenbaum PH (1957) The measurement of meaning Urbana ILUniversity of Illinois Press

Pedhauzer EJ (1982) Multiple regression in behavioral science (2nd ed) New York HoltRinehart and Winston

Reisenzein R (1994) Pleasure-activation theory and the intensity of emotions Journal of Per-sonality and Social Psychology 67 525ndash539

Reisenzein R amp Schimmack U (1999) Similarity judgments and covariations of affects Findingsand implications for affect structure research Personality and Social Psychology Bulletin 25539ndash555

Ross M (1989) Relation of implicit theories to the construction of personal histories PsychologicalReview 96 341ndash357

Russell JA amp Mehrabian A (1977) Evidence for a three-factor theory of emotions Journal ofResearch in Personality 11 273ndash294

Russell JA (1980) A circumplex model of affect Journal of Personality and Social Psychology39 1161ndash1178

Russell JA (1983) Pancultural aspects of the human conceptual organization of emotions Journalof Personality and Social Psychology 45 1281ndash1288

Russell JA (1987) Comments on articles by Fridja and by Conway and Bekerian Cognition andEmotion 1 193ndash197

Russell JA (1991) Culture and the categorization of emotions Psychological Bulletin 110426ndash450

Russell JA amp Bullock M (1985) Multidimensional scaling of emotional facial expressionSimilarity from preschooler s to adults Journal of Personality and Social Psychology 381290ndash1298

Russell JA Lewicka M amp Niit T (1989) A cross-cultural study of a circumplex model of affectJournal of Personality and Social Psychology 57 848ndash856

Russell JA amp Feldman Barrett L (1999) Core affect prototypical emotional episodes and otherthings called emotion Dissecting the elephant Journal of Personality and Social Psychology 76805ndash819

Schacter DL (1996) Searching for memory The brain the mind and the past Cambridge MAHarvard University Press

Schimmack U amp Hartmann K (1997) Individual differences in the memory representation ofemotional episodes Exploring the cognitive processes in repression Journal of Personality andSocial Psychology 73 1064ndash1079

MENTAL REPRESENTATIONS OF AFFECT 361

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

Schimmack U amp Reisenzein R (1997) Cognitive processes involved in similarity judgments ofemotion Journal of Personality and Social Psychology 73 645ndash661

Schlosberg H (1941) A scale for the judgment of facial expressions Journal of ExperimentalPsychology 29 497ndash510

Schlosberg H (1952) The description of facial expressions in terms of two dimensions Journal ofExperimental Psychology 44 229ndash237

Schlosberg H (1954) Three dimensions of emotion Psychological Review 61 81ndash88Semon R (1923) Mnemic psychology (B Duffy Trans) Concord MA George Allen amp Unwin

(Original work published 1909)Shaver P Schwartz J Kirson D amp OrsquoConnor C (1987) Emotion knowledge Further

exploration of a prototype approach Journal of Personality and Social Psychology 521061ndash1086

Shepard RN (1962) The analysis of proximities Multidimensional scaling with an unknowndistance function Psychometrika 27 219ndash246

Shepard RN (1974) Representation of structure in similarity data Problems and prospects Psy-chometrika 39 373ndash422

Shepard RN (1980) Multidimensional scaling tree-fitting and clustering Science 210 390ndash398Shweder RA (1975) How relevant is an individual difference theory of personality Journal of

Personality 43 455ndash484Shweder RA (1977) Likeness and likelihood in everyday thought Magical thinking in judgments

about personality Current Anthropology 18 637ndash648Shweder RA amp DrsquoAndrade RG (1979) Accurate reflection or systematic distortion A reply to

Block Weiss and Thorne Journal of Personality and Social Psychology 37 1075ndash1084Squire LR amp Knowlton B (1995) Memory hippocampus and brain systems In M S Gazzaniga

(Ed) The cognitive neurosciences (pp 825ndash837) Cambridge MA MIT PressTrabasso T Stein N amp Johnson LR (1981) Childrenrsquos knowledge of events A causal analysis of

story structure In G Bower (Ed) Learning and motivation (Vol 15 pp 237ndash282) New YorkAcademic Press

Tulving E (1972) Episodic and semantic memory In E Tulving amp W Conaldson (Eds) Orga-nization of memory (pp 381ndash403) New York Academic Press

Tulving E (1983) Elements of episodic memory Oxford UK Oxford University PressTulving E (1984) Precis of elements of episodic memory Behavioral and Brain Science 2

223ndash268Tulving E (1985) Memory and consciousness Canadian Psychology 26 1ndash12Tversky A (1977) Features of similarity Psychological Review 76 31ndash48Tversky A amp Gati I (1978) Studies in similarity In E Rosch amp BB Lloyd (Eds) Cognition and

categorization (pp 79ndash98) Hillsdale NJ ErlbaumWeiss J amp Brown P (1977) Self-insight error in the explanation of mood Unpublished manu-

script Harvard UniversityWiggs CL Weisberg J amp Martin A (1998) Neural correlated of semantic and episodic memory

retrieval Neuropsychologia 37 103ndash118Wilson TD Laser PS amp Stone JI (1982) Judging predictors of onersquos own mood accuracy and

the use of shared theories Journal of Experimental Social Psychology 18 537ndash556Woodworth RS (1938) Experimental psychology New York HoltWundt W (1924) An introduction to psychology (R Pintner Trans) London Allen amp Unwin

(Original work published 1912)Zevon MA amp Tellegen A (1982) The structure of mood change An idiographicnomothetic

analysis Journal of Personality and Social Psychology 43111ndash122

362 FELDMAN BARRETT AND FOSSUM

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363

APPENDIX A

All paths reported in this report were estimated using the HLM computer program (Bryk et al 1989)For illustrative purposes we will present a breakdown of the conditional probability rating analysesused to estimate the paths for Figure 1 Two hierarchical linear regressions were used to calculate thepaths for this analysis The within-subject level of the first hierarchical linear model estimatedpredictive correspondenc e hypothesi s (p21 in Figure 1) using the model

OCij = b0+ b1CPPREij + rij (1)

where OCij is participant jrsquos observed covariation for the ith pair of emotions b1 is the relationshipbetween participant jrsquos observed covariations and hisher pre-sampling conditional probability rat-ings (p21 in Figure 1) CPPREij is participant jrsquos pre-sampling estimate of the degree to which the ithpair of emotions are experienced together b0 is the value of the observed covariation in j whenCPPREij= 0 and rij is a within-subject residual component The between-subjec t level of the firsthierarchical linear model allowed us to assess the average of the within-subject evidence for thepredictive correspondenc e hypothesis as well as between-subjec t variance by estimating the degreeto which the within-subjects coefficients (b0 b1) for participants varied from one another

Because we were not interested in intercept differences we only present the modelling of theslopes (the b1 coefficients) as follows

b1j = b10+ u1j (2)

where b1j is the relationship between the observed covariation estimates and pre-sampling condi-tional probability ratings of participant j b10 is the mean relationship between the two for allparticipants (ie the mean p21 value) and u1j represents the random variation in this relationship(ie variation in values of p21)

The within-subject level of the second hierarchical linear model estimated the calibrationhypothesis (ie the direct effect of participantsrsquo actual emotion covariations on their post-samplingconditional probability ratings p32 in Figure 1) and the additional knowledge path (p32 in Figure 1)using the model

CPPOSTij = b0+ b1OCij+ b2CPPREij + rij (3)

where CPPOSTij is participant jrsquos post-sampling conditional probability estimate for the ith pair ofaffect words b0 is the mean estimate for participant j b1 is the direct effect of participant jrsquos actualemotion covariations on hisher post-sampling conditional probability estimates (p32 this effectrepresents the relationship between participant jrsquos actual emotion covariations and post-samplingconditional probability estimates controlling for hisher pre-sampling) OCij is participant jrsquos cor-relation for the ith pair of emotions b2 is the effect of participant jrsquos pre-sampling estimates on hisher post-sampling estimates (p31 this effect represents the effect of participant jrsquos pre-samplingbeliefs about emotion covariation on hisher post-sampling beliefs controlling for the actual cov-ariation in hisher emotional experiences) CPPREij is participant jrsquos pre-sampling estimate of thedegree to which the ith pair of emotions are experienced together b0 is the value of CPPOST whenthe predictions are zero and rij is a within-subject residual component

The between-subjec t level of the second hierarchical linear model allowed us to assess the averagewithin-subject regression parameters of interest and the between-subjec t variance in thoseparameters as follows

b1j = b10+ u1j (4)b2j = b20+ u2j (5)

where b10 is the mean calibration effect for all participants (ie the mean p32 value) b20 is the meanadditional knowledge effect (ie the mean p31 value) u1j represents the variation in the calibrationeffect (ie variation in values of p32) and u2j represents the variation in influence of additionalknowledge on the post-sampling conditional probability ratings (ie variation in values of p31)

MENTAL REPRESENTATIONS OF AFFECT 363