psychology
Narrative thinking lingers in spontaneous thought
BELLANA, B.1,2, MAHABAL, A.3, HONEY, C. J.1
1Department of Psychological & Brain Sciences, Johns Hopkins University; 2Department of Psychology, Glendon Campus, York University; 3Pinterest
Authors’ Note: Correspondence can be addressed to Buddhika Bellana ([email protected])
CRediT authorship contribution statement: Buddhika Bellana: Conceptualization (equal); Investigation (lead); Formal analysis (lead); Writing – original draft (lead); Writing – review and editing (equal). Abhijit Mahabal: Writing – review and editing (equal). Christopher J. Honey: Conceptualization (equal); Writing – review and editing (equal); Funding acquisition (lead).
Narrative thinking lingers in spontaneous thought
BELLANA, B.1,2, MAHABAL, A.3, HONEY, C. J.1
1Department of Psychological & Brain Sciences, Johns Hopkins University; 2Department of Psychology, Glendon Campus, York University; 3Pinterest
What we think about at any moment is shaped by what preceded it. Why do some experiences, such as reading an immersive story, feel as if they linger in mind for longer than others? In this study, we hypothesize that the stream of our thinking is especially affected by "deeper" forms of processing, emphasizing the meaning and implications of a stimulus rather than its immediate physical properties or low-level semantics (e.g., reading a story vs. reading disconnected words). To test this idea, we presented participants with short stories that preserved different levels of coherence (word-level, sentence-level, or intact narrative), and we measured participants’ self-reports of lingering and spontaneous word generation. Participants reported that stories lingered in their minds after reading, but this effect was greatly reduced when the same words were read with sentence or word-order randomly shuffled. Furthermore, the words that participants spontaneously generated after reading shared semantic meaning with the story’s central themes, particularly when the story was coherent (i.e., intact). Crucially, regardless of the objective coherence of what each participant read, lingering was strongest amongst participants who reported being ‘transported’ into the world of the story while reading. We further generalized this result to a non-narrative stimulus, finding that participants reported lingering after reading a list of words, especially when they had sought an underlying narrative or theme across words. We conclude that recent experiences are most likely to exert a lasting mental context when we seek to extract and represent their deep situation-level meaning.
Significance Each waking moment of our lives is embedded in a stream of thought. We know that our current position in this stream constrains what we think about next, but we have little understanding of why some experiences have a longer lasting influence than others. Across a series of experiments, we show that deep processing – a kind of thinking where one attends to the meaning and implications of a stimulus as opposed to its immediate physical properties – generates a lasting mental context that can shape our spontaneous thoughts for several minutes. These data provide new insight into why some experiences, like stories and movies, will linger in our minds after they end. Introduction Experience is remoulding us every moment, and our mental reaction on every given thing is really a resultant of our experience of the whole world up to that date.
- William James (1890, p. 234) Human thought is history-dependent: how we think and what we think about at any moment is shaped by what came before (1, 2). A simple example of this phenomenon can be seen in semantic priming, in which our ability to identify a given word is heightened following the activation of related concepts (3, 4). For example, it is easier to recognize the word “butter” after being exposed to the word “bread”. A more sophisticated picture is described by theories of drifting mental context. Here, an internal representation of context is continually updated as we recursively encode and retrieve the moments of our lives (5, 6). These models of mental context are powerful because they explain how one thought becomes part of a broader trajectory. Moreover, models of mental context can be extended to include many dimensions of mental context, accounting for influences in the semantic (7), spatial (8) and emotional (9) domains. Given that our mental context has a wide-reaching influence on memory (10), comprehension (11) and decision-making (12), it is natural to ask: which kinds of content influence the trajectory of our thoughts most strongly? For example, avid readers report that the experience of a novel does not end upon closing the book, but can linger in their minds for hours or days (13, 14) (Figure 1). Similarly, the content from role-playing video games also has a propensity to linger in mind (15, 16). More generally, social information (17, 18) and emotional experiences (19–21) appear to exert long-lasting influences on our mental context. Intuitively, it seems that these meaningful, ‘real-world’ experiences affect our subsequent thoughts in a manner that goes beyond lexical or semantic priming. But why should these particular types of processing – narrative, social and emotional – linger in our thoughts? We hypothesize that the stream of our spontaneous thoughts is especially affected by "deeper" and more elaborated forms of mental processing. Here, shallower levels of processing correspond to extracting the immediate physical features of a stimulus or arbitrary associations decoupled from our world-knowledge, while deeper levels of processing entail extracting and representing more abstract features that concern what an input implies (22). Moreover, we propose that the deepest levels of processing are those in which we access an especially rich bed of existing associations to contextualize an input, such as when we evaluate self-relevance (23) or build mental models of naturalistic situations (24–26). For example, we can attend to the words that make up a novel, in terms of what they look like or their individual semantic meanings – but only when they are read in their broader context, and word meanings are
considered in relation to one another, can we appreciate the complex progression of events, characters, goals, actions and emotions that they imply. We expect that lingering can be elicited both by properties of the stimulus and by our orientation towards it. Stories contain high-level semantics and situational information, and so the process of comprehending a narrative is likely to require deep meaning-centered processing, leading to lingering. However, there is also an endogenous component to what is processed deeply: we may struggle to interest ourselves in a popular TV narrative, but at the same time find ourselves engrossed in the plight of an ant struggling to carry an outsized breadcrumb down the leg of our dinner table. We predict that the extent to which we engage deeply in our thinking about the ant, specifically considering it in terms of the broader situation or narrativizing its activities (e.g., where is it going and why is it so motivated?), will cause ant-related thoughts to linger after the ant leaves our immediate perception. We began testing our hypothesis by examining whether deep processing (e.g., attending to situation-level meaning in coherent stories) shapes our spontaneous thoughts, more so than relatively shallow processing (e.g., attending to lower-level semantic meaning, at the level of individual sentences or words). Specifically, participants read passages of text (~2500 words) that were either kept intact, or with sentence or word order randomly scrambled. Before and after reading, participants performed a free association task, in which they freely typed words for five minutes. We then used document classification (27) and natural language processing tools (28) to quantify the extent to which story themes were expressed in each participant’s thoughts, before and after reading. We found that when participants read coherent narratives, the themes of the story lingered for several minutes in their subsequent free association chains, more so than in participants who read scrambled versions of the same text. This observation was replicated across multiple stories. Moreover, we also observed the lingering effect when participants narrativized a list of words, but not when they judged their perceptual properties (e.g., italic type). Overall, regardless of the objective coherence of the text, participants’ subsequent experience of lingering was predicted by whether they felt transported into the material while reading. Taken together, our data indicate that deep and elaborative styles of thinking, such as the construction of situation models while reading stories, produce an especially long-lasting mental context.
Figure 1. Stories linger in our mind and shape our spontaneous thoughts. Here we present an artistic rendition of the phenomenon of a lingering narrative. A woman has just put down a copy of Alice’s Adventures in Wonderland by Lewis Carroll, but the ideas from the story persist in her mind, shaping the trajectory of her spontaneous thoughts even after she has put down the book. Specifically, we see that content from the story (e.g., the White Rabbit, running late; a tea party with the Mad Hatter) constrain her upcoming thoughts (e.g., being late for a work meeting; a tea party of her own). Illustrated by Grace Ji.
Results Two-hundred and forty online participants read versions of the short story So Much Water So Close To Home by Raymond Carver in one of three randomly assigned conditions (Intact: n = 80, Sentence-Scrambled: n = 80, Word-Scrambled: n = 80) (Figure 2A). In each condition, participants were shown the exact same words, with the only difference being their order. Participants read the text at their own pace, one sentence at a time. They performed a 5-minute, unconstrained free association task before and after the reading (Figure 2B). Following free association, participants described the core themes of the story and rated the extent they felt transported while reading the text. Next, participants completed a test of story comprehension and rated the extent to which the text lingered in their mind after reading. Scrambling limits deep processing. First, we confirmed that our scrambling procedure indeed limited the extent participants were able to extract narrative meaning from the text, an example of deep processing. To this end, we examined a measure of narrative transportation, or participants’ self-reported sense of being transported into the ‘world’ of the story while reading. Transportation was measured using a 13-item modified version of the Narrative Transportation scale (29). Transportation requires participants to attend to deeper, narrative-level meaning (30) as opposed to word-level semantics. Some example questions include: “While I was reading the text, I could easily picture the events in it taking place”, “I found myself thinking of ways the text could have turned out differently” and “I was mentally involved in the text while reading it” (see Supplemental Information). Results are reported as proportions, with 1 as maximal transportation. Participants in the Word-scrambled condition reported feeling the least transported while reading, with progressively more transportation in the Sentence-scrambled and Intact conditions [MWord-scrambled = 0.41; MSentence-scrambled = 0.52; MIntact = 0.64; Intact vs. Word-
scrambled: t(158) = 11.74, p < 0.0001, d = 1.86; Sentence vs. Word-scrambled: t(158) = 4.89, p < 0.0001, d = 0.77; Intact vs. Sentence-scrambled: t(158) = 6.32, p < 0.0001, d = 1.00; for additional details, see Supplemental Results and Figure S2]. Similarly, scrambling also impaired performance on a 24-item multiple choice comprehension test, with the Intact condition reporting the highest scores [MWord-scrambled = 0.45; MSentence-scrambled = 0.67; MIntact = 0.83; Intact vs. Word-scrambled: t(158) = 14.65, p < 0.0001, d = 2.32; Sentence vs. Word-scrambled: t(158) = 9.87, p < 0.0001, d = 1.56; Intact vs. Sentence-scrambled: t(158) = 6.33, p < 0.0001, d = 1.00; for additional details, see Supplemental Results and Figure S1]. Therefore, scrambling the story indeed limited the extent to which participants were able to engage with the deep, situation-level meaning of the text. Stories elicit a lasting influence on spontaneous thought. Do stories linger in our minds and shape our spontaneous thoughts, more so than incoherent sequences of words and sentences? To answer this question, we examined participants’ self-report of lingering. At the end of the experiment (~10 minutes later), participants indicated the extent to which the text continued to linger in their mind, using a scale of 1 (Not At All) to 7 (Very Much) (Figure 2C). We found that self-reported lingering depended on the narrative coherence of the stimulus (One-way ANOVA of Condition [Intact/Sentence-scrambled/Word-scrambled], Condition: F(2,237) = 36.88, p < 0.0001, η2G = 0.24). Participants who read the Intact story reported the strongest sense of lingering, significantly higher than those in the Sentence-scrambled [t(158) = 3.58, p = 0.0012, d = 0.57] or Word-scrambled conditions [t(158) = 8.72, p < 0.0001, d = 1.38]. Participants who read the Sentence-scrambled version of the story, which still maintained some of its coherence, also reported a stronger sense of lingering than participants in the Word-scrambled condition [t(158) = 4.88, p < 0.0001, d = 0.77]. Thus, although participants read all of the same words across all conditions, they reported more lingering as the situation-level coherence of their reading material increased. It is worth noting that, in the open-ended descriptions of their experience, participants often described lingering with an unintentional quality, distinguishing it from volitional rehearsal (e.g., “In the first round, the words I typed were considerably more organic than those in the second round, as I could not really get the story out of my head after reading it, so many of the associations were related to extraneous thoughts or associations with the story itself”). All open- ended descriptions are reported in Supplemental Information. Given that participants reported coherent narratives lingered in their minds, we reasoned that this lingering should bias their spontaneous thought and could manifest in their free-association data. To test this, we used document classification (27) to measure the difference in the content of free association chains generated pre- vs. post-story (for details, see Methods). In brief, for each condition (Intact, Sentence-Scrambled and Word-Scrambled) we trained a linear support vector machine classifier to predict whether a given free association chain was generated before or after reading. The input to the model was a vector of word counts from a single word- chain, indicating the number of times each unique word from all free association chains was mentioned in that chain. The output of the model was a binary prediction of whether the word- chain was “pre-story” or “post-story”. Classification accuracy was the proportion of correct classifications across all free association chains (chance level = 50%). If stories linger in a manner that reliably affects the content of free association, then the classifier should be able to discriminate between pre- and post-story chains, and this effect should be larger for a more coherent narrative.
Consistent with our predictions, the classifier was able to discriminate between pre- and post- story chains above chance for participants in the Intact (68% classification accuracy, p < 0.002) and Sentence-scrambled conditions (68% accuracy, p < 0.002), but not the Word-scrambled condition (52% accuracy, p = 0.34) (Figure 2D). Therefore, both subjective measures (self- reported lingering) and objective measures (semantic bias in free association chains) indicate that narrative information lingers, and that this effect far exceeds what is elicited by decontextualized words. Although, document classification did not differ across the Intact and Sentence-scrambled conditions, we next present evidence consistent with our hypothesis and participants’ self-report data, indicating that coherent stories are more reliable drivers of lingering mental contexts.
Figure 2. Stories, not words, elicit a lasting influence on spontaneous thought. (A) Schematic of the experimental paradigm. For details, see Methods and Supplemental Information. (B) Schematic of free association task. Participants freely typed words for 5-minutes, before and after reading the story. (C) Histograms of participants’ responses to the question: “To what extent did the text linger in your mind after reading it?”. Participants provided their rating on a 7-pt scale: 7 = very much, 1 = not at all. Black dashed line represents the mean rating per condition. (D) Histograms of how accurately a document classifier could discriminate between pre- and post-story free association. Classifiers were trained within-condition (n = 80), using a leave-one-subject-out cross-validation procedure with 500 bootstraps. Dashed lines represent the mean classification accuracy. Null distributions were estimated by randomly shuffling the labels of the held-out subject’s word chains (pre, post) and recalculating classification accuracy over 500 permutations. Likelihood of achieving median classification from the null distribution was calculated using a permutation test [ns p > .05; * p =< .05; ** p =<.01; Note: minimum p-value estimate for this analysis is p < 0.002].
Stories linger more than sentences. Reading a series of words, without any overarching coherence, did not produce a lasting influence on spontaneous thought. However, document classification accuracy was similar for both the Intact and Sentence-scrambled versions of the Carver story, suggesting that sentence-level coherence may be sufficient to produce a lasting
effect on spontaneous thought. To further examine whether Intact or Sentence-scrambled stories differ in the extent to which they linger in our minds, we collected three further datasets of the Intact and Sentence-scrambled manipulations: (I) a replication of the original Carver story (Carver-Replication); (II) a rewrite of the Carver story, conveying the same plot using different words (Carver-Rewrite); and (III) an entirely different story, Roy Spivey by Miranda July (July). Within the three new datasets (n = 160 per story, with n = 80 per condition), the extent of self- reported lingering was again reduced by scrambling (Two-way ANOVA of Condition [Intact/Sentence-scrambled] and Story [Carver-Replication, Carver-Rewrite, July], Condition: F(1,474) = 57.29, p < 0.0001, η2G = 0.11; Story: F(2,474) = 4.95, p = 0.007, η
2 G = 0.02;
Condition * Story: F(2,474) = 2.46, p = 0.08, η2G = 0.01) (Figure 3A). Once again, participants who read the Intact story reported a stronger sense of lingering than those who read the Sentence-scrambled version [t(478) = 7.49, p < 0.0001, d = 0.68], indicating that coherence at the sentence-level fails to elicit a sense of lingering to the same extent as an intact narrative (for comprehension and transportation data, see Supplemental Information). Moreover, support vector machine classifiers trained on free association data from the Intact condition were able to predict whether a chain was produced pre- or post-story above chance for all stories (Carver- Replication: 74% accuracy, p < 0.002; Carver-Rewrite: 60% accuracy, p = 0.036; July: 81% accuracy, p < 0.002). Classifiers trained on free association data from the Sentence-scrambled conditions, however, only exceeded chance performance for one story only (Carver-Replication: 55% accuracy, p = 0.13; Carver-Rewrite: 62% accuracy, p = 0.004; July: 51% accuracy, p = 0.42) (Figure 3B). Thus, we found that, across four independent datasets, coherent narratives influenced the contents of subsequent thought more reliably than sentences or words.
Figure 3. Stories, not sentences, elicit a lasting influence on spontaneous thought. (A) Histograms of participant responses, across three separate experiments, to the question: “To what extent did the text linger in your mind after reading it?”. Participants provided their rating on a 7-pt scale: 7 = very much, 1 = not at all. Black dashed line
represents the mean rating per condition. (B) Histograms of how accurately a document classifier could discriminate between pre- and post-story free association across three separate experiments. Classifiers were trained within- condition per experiment (n=80), using a leave-one-subject-out cross-validation procedure with 500 bootstraps. Dashed lines represent the mean classification accuracy. Null distributions were estimated by randomly shuffling the labels of the held out subject’s wordchains (pre, post) and recalculating classification accuracy over 500 permutations. Likelihood of achieving median classification from the null distribution was calculated using a permutation test [ns p > .05; * p =< .05; ** p =<.01; Note: minimum p-value estimate for this analysis is p < 0.002].
Story themes are upregulated in post-story free association. Across all four datasets (Carver, Carver-Replication, Carver-Rewrite, July), document classifiers could discriminate pre- and post-story free association chains – but what was changing in the free associations? We visualized the difference between pre- and post-reading patterns by calculating a “bias score” for each unique free associate. The bias score for each word measured the difference in the probability a free associate occurs in chains before and after the story (Figure 4).
Figure 4. Biases in free association content. Bias in free association content from pre- to post-story is plotted for each dataset and condition. Bias was defined as the proportion of post-story free association chains that contained a given word [p(Post)] minus the proportion of pre-story free association chains containing the same word [p(Pre)]. p(Post) and p(Pre) were both calculated separately for participants in a given condition and dataset, and thus were calculated based on the total of 80 free association chains. Therefore, positive values reflect words that are more likely to occur in post-story free association as compared to pre-story. Negative values reflect words that are more likely to occur in pre-story free association as compared to post-story. For legibility, only free associates that occurred in at least 16% of free association chains or showed a 10% bias for pre- or post-story are displayed. Size of points represents a given word’s p(Pre).
Words that occurred more often in post-story free association, across-participants, reflected story content (Figure 4). For example, the Carver story was centered around the discovery of the body of a young woman and the narrator’s suspicion that her husband, who found the body on a camping trip, may have committed murder. Participants in the Intact condition from the Carver dataset were more likely to produce words such as “river”, “murder”, “dead” and “funeral” post-story as compared to participants in the Sentence or Word-scrambled conditions, even though each condition was composed of the exact same words. Associates related to murder and death were also more prominent post-story for Carver-Replication and Carver-Rewrite, which employed the same story. In the July dataset, where participants read a story about a chance romantic encounter between a celebrity and the narrator, words like “number”, “man”,
“phone”, “loss”, “spy”, and “four” were more prominent post-story. These words relate to the story’s plot, in which a celebrity (a famous actor in spy movies) shared his phone number with the narrator, withholding a single digit (“4”) that he asked she commit to memory. Overall, the persistence of story-related themes and content may underlie the detectable change in spontaneous thought after the story ends. Next, we directly measured the persistence of story themes in post-story spontaneous thought using a semantic analysis based on word embeddings (Global Vector embeddings; GloVe; (28)). We quantified the semantic similarity between a participant’s free association chains and the story’s core themes using a metric we defined as “theme similarity”: the maximum cosine similarity between a given free associate and each of the story’s 10 “theme words”. To derive these themes, participants generated 10 words that they believed related to the central themes and ideas of the text they had read immediately following post-story free association. For each story, we selected the 10 theme words that were mentioned most frequently across participants (for details, see Methods). We then converted each free associate and each story theme to a 300-dimensional vector using the GloVe embeddings, allowing us to estimate the semantic similarity between words. Thus, we could measure the average “theme similarity” of free associates generated before and after reading each story (Figure 5A).
Figure 5. Word-embeddings reveal a lasting influence of story themes on post-story free association, especially after reading an intact story. (A) Theme similarity pre- and post-story across all experiments. Theme similarity was averaged, per subject, across all associates produced pre- and post-story. Grey lines show the change in theme similarity within-subject. Group means are displayed using black circles. Error bars represent 95% confidence intervals. For display purposes, significance was estimated with paired-sample t-tests comparing pre- vs. post-story theme similarity. Note that points in panel A were randomly jittered by .15 on the Y axis to reduce overlap and improve legibility. [ns p > .05; * p =< .05; ** p =<.01, *** p =< .001, **** p =< .0001]. (B) Timecourse of post-story theme similarity displayed using 10-associate windows. Effect size was calculated using Cohen’s d, comparing theme similarity post-story minus pre-story within each window. Error bars represent 95% confidence intervals. Statistically significant effects (p < 0.05) are denoted with a +.
Coherent stories were most likely to elicit a lingering effect in which their themes shaped post- story thought (Figure 5). Across all four datasets, the change in theme similarity from pre-story to post-story covaried with the level of scrambling of the text (Three-way ANOVA of Phase [Pre/Post], Condition [Intact/Sentence-scrambled], and Story [Carver/Carver-Replication/Carver- Rewrite/July]; Phase * Condition: F(1,632) = 11.20, p = 0.0009, η2G = 0.007; for additional control analyses, see Supplemental Information). Participants showed more theme similarity post-story for both the Intact and Sentence-scrambled conditions, but the effect size was twice as large for the Intact condition [Intact: Pre = 0.260, Post = 0.286, t(319) = 8.42, p < 0.0001, d = 0.56; Sentence-scrambled: Pre = 0.263, Post = 0.275, t(319) = 4.06, p < 0.0001, d = 0.28]. A separate paired t-test further confirmed no difference in theme similarity between pre- to post- story when the narrative was scrambled at the word-level [Word-scrambled: Pre = 0.272, Post = 0.271, t(79) = -0.08, p = 0.93, d = -0.01]. Finally, we also confirmed that the difference between post-story and pre-story theme similarity was positively correlated with self-reported lingering across all datasets [r = 0.25, t(718) = 6.97, p < 0.0001]. Stories linger for longer than sentences or words. Next, we sought to examine the timecourse of lingering. To this end, we divided free association chains into sequences of 10- word bins and calculated theme similarity for each bin separately. Given the average across- dataset production time for a single free associate was 4888 ms, a 10-word bin is approximately 49 seconds of the full 5-minutes of free association. The difference between post- and pre-story theme similarity was then represented as a Cohen’s d effect size with 95% confidence intervals. Overall, the difference between post and pre-story theme similarity was highest immediately after the story ended, and the effect tended to persist over more free associates, particularly when the story was coherent. Measuring the number of 10-associate bins in which the post minus pre-story Cohen’s d value was different from 0 (p < 0.05, uncorrected) and averaging across experiments, we found that we could detect lingering story themes for approximately 3 bins (~147 seconds) for the Intact condition, 1 bin (~49 seconds) for Sentence-scrambled and 0 bins (~0 seconds) for Word-scrambled (Figure 5B). Therefore, story themes tended to persist for longer into post-story free association after reading coherent stories, as compared to their constituent sentences and words. Transporting stories linger. Why do coherent stories linger in our minds? On the one hand, there are differences in the stimulus: coherent stories may contain types of information that are absent in scrambled sequences of words or sentences (e.g., agents, actions, intentions, embedded in broader situations evolving over time). On the other hand, lingering may also arise from a difference in how we engage with the stimulus. In order to measure the role of each participants’ engagement with the story, we evaluated whether participant-level narrative transportation ratings could predict subjective and objective measures of lingering, independently of whether participants were reading intact or scrambled text. Each individual’s sense of immersion was a better predictor of their degree of lingering than the objective coherence of the text they read (Figure 6). To test the predictive power of transportation, we included it in a 10-fold cross-validated regression model with backwards stepwise feature selection (see Methods). Regression models included participant-level measures of: transportation by the story; comprehension of the story; and experimental condition (i.e., Intact / Sentence-scrambled / Word-scrambled). When predicting self-reported lingering, the final model contained two variables, in which transportation accounted for the bulk of the variance, with an additional contribution from comprehension [final model: R2 = 0.51; F(2,1437) = 739.6, p < 0.0001; transportation: b = 1.00, t(1437) = 31.92, p < 0.0001; comprehension: b = 0.12, t(1437) = 4.04, p < 0.0001]. When predicting the difference between
post and pre-story theme similarity, the final model only contained transportation [final model: R2 = 0.009; F(1,1438) = 5.14, p = 0.024; transportation: b = 0.03, t(1438) = 2.3, p = 0.024]. Thus, the extent to which an individual felt transported into the story world was an important determinant of post-story lingering, explaining more out-of-sample variance than their experimental condition (Intact/Scrambled) or their comprehension of the story.
Figure 6. Transportation into the story world predicts its lasting influence. Scatterplots display the relationship between participant-level measures of self-reported transportation (Green & Brock, 2000) and self-reported lingering The colour of each point represents the experimental condition: blue = Intact, red = Sentence-scrambled and green = Word-scrambled. Transportation predicted lingering even in the Sentence-scrambled and Word-scrambled conditions, highlighting the importance of an individuals’ own immersion in the content, irrespective of what the content is, in predicting its lasting influence on thought. [ns p > .05; * p =< .05; ** p =<.01, *** p =< .001, **** p =< .0001].
Deeply-processed words linger. The extent to which a participant felt transported while reading a text predicted the likelihood of the story themes lingering in their spontaneous thought. Interestingly, comprehension of the narrative did not predict lingering as strongly. This is consistent with our hypothesis that lingering is not a function of whether participants encoded the stimuli or not, but from the depth of processing they employed. Encoding a given experience can entail attending to its surface-level features (e.g., the verbatim text in a written story) to the broader meaning it represents (e.g., constructing a situation model from the written text; (25, 30)), and the more likely we are to attend to its deeper meaning, the more likely it will linger in our minds (for related ideas, see (22)). If deeper processing can drive lingering, then stories would not be alone in their propensity to linger: the content of any text should linger if participants attempt to create overarching situation or mental models. Therefore, we conducted an additional experiment in which participants encoded a fixed list of words, and we manipulated the depth of processing that they applied during encoding. Thus, rather than scrambling a story to reduce situation-level coherence, we presented participants with a constant non-narrative stimulus and manipulated the depth with which they engaged with it. Three hundred and twenty participants were exposed to a list of 268 words (of which 201 words were related to ideas and characters from the Carver story, and the remaining words chosen to be distinctive yet unrelated to the story, see Methods) while performing one of four cover tasks. Cover tasks ranged from orienting participants towards the surface-level features of the word-list (i.e., whether or not a word was italicized), to the word- level meaning (i.e., whether or not a word represented something tangible) or the list-level
meaning (i.e., whether or not a word belonged to a latent theme or story embedded in the word- list; see Methods). Words were ordered so that the main characters, locations and events were mentioned early, allowing participants to get a sense of the list-level meaning if they were instructed to seek it. For example, the first 15 words were: “Claire”, “Stuart”, “couple”, “small- town”, “Stuart”, “buddies”, “camping”, “fishing”, “find”, “girl”, “dead”, “Claire”, “suspicion”, “mistrust”, “murder”. Unrelated decoy words were selected to have high positive valence, for example: “cheerful”, “bliss”, “luxury”, “peaceful”, “happy”, “magical”. Decoy words were pseudorandomly interspersed within the list with an average of 6.01 (SD = 3.47) story words between consecutive decoys (for full list, see Supplemental Information).
Figure 7. Lingering following a list of words. (A) Histograms revealed participants’ self-reported lingering increased with deeper processing of a non-narrative stimulus (thematic word-list). Participants provided their rating on a 7-pt scale: 7 = very much, 1 = not at all. Black dashed line represents the mean rating per condition. (B) Results of document classification, however, show no evidence of a detectable change in words used in pre- vs. post-task free association. Classifiers were trained within-condition per experiment (n=80), using a leave-one-subject-out cross- validation procedure with 500 bootstraps. Dashed line represents the mean classification accuracy. Null distributions are plotted in gray. (C) Bias in free association content from pre- to post-task is plotted for each condition. Bias was defined as the proportion of post-task free association chains that contained a given word [p(Post)] minus the proportion of pre-task free association chains containing the same word [p(Pre)]. p(Post) and p(Pre) were both based on the total of 80 free association chains per condition. For legibility, only free associates that occurred in at least 16% of free association chains or showed a 10% bias for pre- or post-task are displayed. Size of points represents a given word’s p(Pre). (D) Theme similarity pre- and post-task highlights some evidence for an increase in similarity to list themes after deeply processing the word list. Grey lines show the change in theme similarity within-subject. Group means are displayed using black circles. Error bars represent 95% confidence intervals. For display purposes, significance was estimated with paired-sample t-tests comparing pre- vs. post-task theme similarity [ns p > .05; * p =< .05; ** p =<.01, *** p =< .001, **** p =< .0001].
Although all participants saw an identical list of words, and although they were all encoding the words as confirmed by their cover-task performance (see Supplemental Information), they reported very different levels of lingering (One-way ANOVA of Condition [Italic/Tangible/Theme/Story], Condition: F(3,316) = 35.43, p < 0.0001, η2G = 0.25) (Figure 7A).
Participants in the Story and Theme conditions reported the strongest sense of post-task lingering, followed by Tangible and Italic [Story vs. Theme: t(158) = 1.54, p = 0.91, d = 0.24; Story vs. Tangible: t(158) = 5.75, p < 0.0001, d = 0.91; Story vs. Italic: t(158) = 9.31, p < 0.0001, d = 1.47; Theme vs. Tangible: t(158) = 4.14, p = 0.0003, d = 0.65; Theme vs. Italic: t(158) = 7.64, p < 0.0001, d = 1.21; Tangible vs. Italic: t(158) = 3.50, p = 0.001, d = 0.55]. Therefore, participants who were instructed to process the words deeply (i.e., Story and Theme conditions) were more likely to report stronger post-task lingering. Although processing depth was strongly associated with self-reported lingering, there was relatively weak objective evidence of lingering in post-story free associates. Support vector machine classifiers failed to predict whether a chain was produced pre- or post-task above chance for all conditions (Story: 57% accuracy, p = 0.056; Theme: 54% accuracy, p = 0.176; Tangible: 56% accuracy, p = 0.072; Italic: 44% accuracy, p = 0.842; Figure 7B). Although data- driven document classifiers failed to detect any reliable changes in free association pre- vs. post-task, plotting bias scores did reveal that some story-related words (e.g., “murder”) were more likely to occur post-task. This was specifically true for participants in the Story condition, who were required to infer the events of a latent story from the word list (Figure 7C). This was further corroborated when examining theme similarity from word-embeddings (Figure 7D), which revealed a weak, though significant, interaction between task condition and phase [2-way ANOVA of Phase [Pre/Post] and Condition [Italic/Tangible/Theme/Story]; Phase * Condition: F(3,316) = 3.40, p = 0.02, η2G = 0.009]. Paired t-tests indicated that participants in both the Story and Theme conditions showed more theme similarity post-task as compared to pre-, which was not true for participants in the Italic or Tangible conditions [Italic: Pre = 0.278, Post = 0.272, t(79) = -1.30, p = 0.20, d = -0.15; Tangible: Pre = 0.272, Post = 0.281, t(79) = 1.67, p = 0.10, d = 0.20; Theme: Pre = 0.270, Post = 0.283, t(79) = 4.06, p = 0.009, d = 0.32; Story: Pre = 0.278, Post = 0.292, t(79) = 2.51, p = 0.014, d = 0.32]. Although the effect sizes reported here are smaller than those we observed with Intact stories (d = 0.56), attending to the latent across- element meaning in a list of words also produced evidence for a lasting mental context. Discussion What determines whether a past experience persists in our mind? Despite the prominence of history-dependence in our models of the human mind and memory (5–7, 31, 32), we have little empirical evidence to support our intuitive sense that ‘meaningful’ experiences resonate with us, shaping our thoughts well after they end. Here, we empirically demonstrate that depth of processing determines the extent to which an input will linger in mind. Interpreting a text in terms of the situations it implies, instead of evaluating the semantic meaning of its individual sentences or words, is more likely to result in it exerting a lingering influence on the trajectory of our subsequent thoughts. Participants who read short stories reported that the text lingered in their minds for several minutes, but this effect was greatly reduced amongst those who read the same stories with sentences or words in a shuffled order (Figure 2C & 3A). Although participants’ experiences of lingering varied, many described the ongoing mental presence of the text as something unbidden or even distracting: “I think maybe the story stayed with me and affected me a little. I tried to not let it influence me and to go where the words took me”. Thus, the lingering phenomenon does not appear to reflect intentional rehearsal, but rather a latent constraint on participants’ spontaneous thought.
Quantitative analyses of participants’ freely generated word sequences revealed that they were altered after reading the coherent story (Figure 2D & 3B), and their words were semantically closer to the story’s themes (Figure 4 & 5). Critically, these lingering influences were strongest amongst participants who reported being ‘transported’ into the story world, regardless of the objective coherence of the text they read (Figure 6). We further generalized these observations to a case in which all participants read the same word list, but only some of them sought out a latent story or theme within the sequence (Figure 7). Overall, these data indicate that information will persist in our thinking when we seek to extract and represent its deeper situation-level meaning. We found that the extent to which a past experience lingered in a participant’s mind was strongly dependent on whether they encoded it deeply, as a situation. A relationship between history-dependence and situation-level meaning can also be seen when imaging the brain during story comprehension. For example, functional magnetic resonance imaging (fMRI) studies reveal pronounced history-dependence in higher-order association cortices (e.g., regions of the default mode network; DMN), only when participants watch or listen to a coherent story (33, 34). Therefore, the way DMN regions respond to what is onscreen at a given moment in time depends on how the current event fits within the narrative context of what happened several minutes into the past (32, 35, 36). The finding that deeply processed stories linger in mind (immediately after an experience) is also consistent with the behavioural finding that stories and situations persist in the form of lasting memories. Information presented in story form is better remembered than non-narrativized information (37), narrative coherence benefits memory for naturalistic events (38), and the act of studying a word-list as if it were a story markedly improves recall (39) (for review, see (40)). Beyond improving memory, stories also have lasting consequences on how we behave and what we believe (41–44). Other examples of situation-level information, like social interactions and emotions, also share this ‘sticky’ or enduring quality: persisting in our thoughts (17–19) and shaping how we learn and remember (20, 21). Critically, by using free association and a story-scrambling procedure, we were able to directly quantify this lingering phenomenon in spontaneous thought while implicating it with narrative-level coherence. Why should attending to situation-level meaning elicit a lasting mental context? A potential explanation comes from the levels of processing framework of human memory (22, 45). The levels of processing framework stems from work on perception, where the perceptual process was conceptualized as a hierarchical series of tests at different levels of analysis (46). Early levels are concerned with the physical properties of a stimulus, while later levels examine more abstract stimulus properties such as meaning and implication. According to levels of processing, the persistence of the stimulus in memory is a function of these levels of analysis: stimuli that are processed at later (‘deeper’) levels are more likely to form lasting representations in memory. For example, studying a word list by deciding whether or not each word is capitalized results in poorer recognition than studying them based on their fit in a sentence (47). However, depth of processing does not stop at word level semantics. We contend that engaging with the situation-level meaning of a text is a prime example of even deeper meaning-centered
processing and should result in persistent representations in memory1.
1 Although levels of processing traditionally concern persistence in memory rather than
spontaneous thought, there is reason to consider these constructs are related. For example, overall memory performance is positively correlated with history-dependence (i.e., temporal clustering) in freely recalled word lists (48). Also, the extent to which a recent social experience
What are the mechanistic neural underpinnings of “deep processing”? These questions are important and unanswered (45), but we offer a speculative hypothesis for future work. In particular, deep processing of the meaning and implications of an input may result in lingering by via a propensity to drive activity in higher-order association cortices (e.g., regions of the DMN) (31, 32). Higher-order association cortices possess distinctively slow-drifting intrinsic dynamics, likely due to their elevated levels of local-circuit and inter-regional recurrence (49, 50). Thus, if deep processing especially involves these brain regions, they are well-placed to generate lasting neural reverberations and, perhaps, lingering mental contexts. The notion that parsing situation-level meaning is an example of deep processing is consistent with hierarchical models of discourse comprehension. Kintsch (1998) conceptualized comprehension as a multilayered system, beginning with a ‘surface code’ to provide a verbatim representation of a text’s words and syntax, and ending with a ‘situation model’ that summarizes the broader happenings they describe. The act of constructing and elaborating on a situation model requires a reader to move beyond the text itself and consider its deeper structure (30). In line with levels of processing, deep processing resulted in a persistent representation: participants who were most likely to succeed in constructing a situation model (i.e., those in the Intact condition), were also most likely to show evidence of the text lingering in spontaneous thought (Figures 3 & 4). Critically, our feature selection procedure indicated that a sense of transportation into the story world predicted lingering over and above the objective coherence of the text that was read (Figure 6). Also, participants who read a list of words as if it were a story reported more lingering (Figure 7). Therefore, the objective narrative coherence of the text mattered less than the extent to which an individual was able to deeply engage with it, via the construction of an immersive situation model. From this perspective, it is not surprising that our document classifier occasionally exceeded chance levels at predicting pre- vs. post-story free association from participants in the sentence-scrambled conditions (Figure 2B & 3B). Transportation amongst participants who read the sentence-scrambled texts was not at floor (Supplemental Information, Figure S2), which may result in group-level lingering, although less reliably than for a coherent story. The construction of situation models is not the only route to a lasting mental context: participants also reported a comparable extent of lingering after judging whether each word in a list belonged to a common theme (Figure 7). This “Theme” task did not explicitly require participants to encode the words in terms of situations, but did require that they carefully attend to how each word may be related to one another. In particular, they needed to examine words beyond their surface-level features in order and develop a latent theme over the course of the list. From the perspective of the levels of processing framework, then, participants in the Theme condition are still deeply processing the word list. Thus, it seems that situation-level thought (or narrative thinking) is not the only example of deep meaning-centered processing. Other kinds of deep thinking, concerning what a stimulus implies rather than its physical properties, should also form lasting mental contexts. Take the example of cognitive fixedness in problem solving (51, 52). After solving a series of problems using a complex algorithm, we often continue applying this unnecessarily complex solution even in the face of simpler problems. Luchins (1942) elicited this kind of lasting mental context using problems about measuring water volume with different sized cups -- a far cry from a story. Accordingly, one important feature of ‘deep thinking’ could be a sense of immersion – where one is lost in the performance of a certain computation (53), whether it be performing a series of arithmetic steps or elaborating on the
permeated thoughts during a post-task rest period predicts subsequent memory for the original experience (17). Lingering in spontaneous thought may be a natural consequence (or antecedent) of robustly encoded memories.
happenings in a story world. Therefore, the dimension that differentiate stories and situations from other paths to deep thinking may be our natural affinity for narrative information (54, 55) as opposed to the possibility that stories have a unique propensity to linger in our minds. Having considered which kinds of processing increase mental lingering, we must finally ask: ‘why linger at all’? In an ever-changing world, why should any of our experiences colour the trajectory of our thoughts for minutes after they end? One explanation may be that experiences that linger are better consolidated into memory. In rodents, hippocampal neural ensembles associated with recent experiences are spontaneously reactivated during sleep (56) and post- task wakefulness (57) (for evidence in humans, see (58)). Critically, interrupting this ‘hippocampal replay’ impairs memory formation (59). An intriguing possibility may be that lingering in spontaneous thought is a behavioural correlate of this hippocampal replay mechanism. Given our hypothesis that deep processing drives lingering, experiences associated with deep thinking may be preferentially replayed, in turn helping us prioritize significant or meaningful events in memory (60, 61). Furthermore, memory consolidation does not retain all details equally: idiosyncratic details tend to be lost while the central ‘gist’ is preserved (62, 63). Perhaps the reverberation of overarching story themes in spontaneous thought may be a mechanism in which these central details are preferentially reactivated and strengthened in memory. Future studies examining the consequences of lingering on memory are necessary to test these ideas. Conclusion Philosophers and psychologists have noted that our stream of thought continually echoes recent and distant memories, and that each moment informs the meaning of the next (1, 2). Here we demonstrated that the extent of history-dependence is not a fixed parameter. Instead, the extent to which our past lingers into subsequent thought increases as a function of processing depth (22, 45). The more we consider the deep situation-level meaning of an experience, the more likely it will exert a lasting mental context and shape the trajectory of our subsequent thoughts. Methods Experiment 1: Free association, pre- and post-story Experimental procedure. Participants were recruited via Amazon Mechanical Turk (AMT) or Prolific. Data were collected for four separate versions of the experiment (Carver, Carver- Replication, Carver-Rewrite and July; for details, see Stimulus). All versions comprised the same sections: (I) Math; (II) Pre-story free association; (III) Self-paced reading, (IV) Post-story free association; (V) Themes generation; (VI) Narrative transportation; (VII) Comprehension; (VIII) Demographics and Strategy; (IX) Self-reported lingering. Additional methodological information can be found in the Supplemental Information. Free association: Participants were introduced to a task called the “word chain game”, in which they were asked to type any words that came to mind for a total of five minutes. The task consisted of a blank white screen with a cue word in black font (e.g., WATER) and an empty field for text entry below it. The cue word remained onscreen for 2000 ms upon task onset and then faded away over 500 ms. Participants were instructed to type whatever words came to mind, as they came to mind, into the text entry field. The cue word acted as a starting point, to help participants begin generating their own free associations. Cue words were manually
selected by the experimenter to be related to the story. Each story was associated with two cue words, one for pre-story free association and one for post, counterbalanced across participants (Carver/Carver - Rewrite: “water”, “body”; July- “plane”; “secret”). After typing each word, participants were instructed to press enter, causing the word to disappear from the text field and reappear in the cue position for 500 ms before fading away entirely. This procedure ensured that participants did not have continued access to the words they had previously generated. This task designed to be freeform, with the only additional instruction being that participants should avoid stringing words into sentences. Self-paced reading: Participants progressed through the text at their own pace by pressing space bar after reading each sentence. All stories were between 2,158 to 2,798 words in length, ranging between 196 to 268 sentences.
Theme generation: Participants freely generated up to 10 words relating to the central themes and ideas of the text they read. Narrative transportation: Participants completed a modified version of the Narrative Transportation Questionnaire (29), a 13-item scale assessing the extent to which participants were transported into the story while reading it (e.g., “While I was reading the text, I could easily picture the events in it taking place”; “I could picture myself in the scene of the events described in the text”; “The text affected me emotionally”). Participants responded to each item on a 7- point scale ranging from Not At All (1) to Very Much (7). All scores were summed and reported as proportions, where 1 is the highest achievable score of transportation.
Comprehension: Story comprehension was measured using a 26-item 4-alternative-forced- choice test. Half of the content questions were very general (e.g., “Which of the following beverages figured most prominently in the passage?”) while the remaining half were specific and plot-focused (e.g., “How did Claire’s husband encounter the body?”). Questions for both stories can be found in Supplemental Information. Self-reported lingering: Following standard demographics questions and open-ended questions asking participants about the strategies they employed during the Math and Free association sections, participants were asked about their subjective experience of the text “lingering” in their minds. Specifically, participants were asked to (i) describe any differences they felt between pre- and post-story free association and (ii) provide a rating of their experience of the text lingering in their minds (i.e., “To what extent did the text linger in your mind after reading it?”) on a scale of 1 (Not At All) to 7 (Very Much). Participants were further asked to “please describe any differences you may have felt between playing the word chain game before and after reading the text” with an open-ended response (for descriptions, see Supplemental Information). Narrative Stimuli. Participants read one of 3 stories: (1) So Much Water So Close To Home by Raymond Carver (Carver; Carver-Replication); (2) a rewrite of Carver, conveying the same narrative information using different words (Carver-Rewrite); and (3) Roy Spivey by Miranda July (July). These stories were chosen because they were easy to read (at a Grade 5 reading level, or below; see Supplemental Information) and short (under 3000 words), yet still immersive and evocative. Story-scrambling. In the Intact condition, participants read each sentence, one at a time, in the order of the published story. In the Sentence-scrambled condition, participants read the identical sentences, however, the order of the sentences was randomly shuffled. In the Word-scrambled
condition (specific to the original Carver story), the story was parsed into 5-sentence segments and the original sentences were then repopulated by randomly drawing the same number of words from all the words belonging to a segment. In this way, we created a document that contained the same words are the Intact story, in a similar (large-scale) order to the original text, while largely obscuring the overall meaning. Note that the shuffling procedure was applied to the stimulus once, and all participants in the scrambled conditions read the same Sentence- or Word-scrambled version of the story. Furthermore, we modified the self-paced reading task in the Word-scrambled task to ensure that participants read each word. To this end, we included 66 yes/no probe trials interspersed within the reading task (following a Poisson distribution with a mean of 4 sentences): during yes/no probe trials, the story text was replaced with a single word in red font below the question “Was this word in the previous sentence?”. 50% of the probe trials were targets and 50% were foils. Target and foil words were manually selected by the experimenter to reflect a comparable distribution of parts of speech as the original text, ensuring participants would have to pay attention to all the words in each sentence to achieve above chance performance. Participants. 1012 participants took part in Experiment 1 and were recruited via Amazon Mechanical Turk (versions: Carver, Carver-Rewrite, July) or Prolific (version: Carver- Replication). MTurk data were collected over the span of June 2019 – March 2020. Prolific data were collected during September 2020. The experiment lasted approximately 45 minutes. Participants were paid $6.00 USD for their participation and provided informed consent before participating. All research was conducted in accordance with the requirements of the Johns Hopkins University Homewood Institutional Review Board. After exclusions and quality-assurance checks (see Supplemental Information), a total of 720 participants were included in the final sample (Nmale = 360; Nfemale = 354, with 6 participants selecting “None of the above / Prefer not to identify”). Eighty participants were included in each condition, per story: Carver [Intact/Sentence-scrambled/Word-scrambled], Carver-Replication [Intact/Sentence-scrambled], Carver-Rewrite [Intact/Sentence-scrambled], and July [Intact/Sentence-scrambled]. Analysis of free association chains. Document classification. To determine whether pre- vs. post-story free association chains were statistically discriminable, we used a support vector machine (SVM, implemented in R; (64)) to perform document classification. A document-term matrix was computed from all free association chains belonging to participants from a given condition, for a given story. Each row of the matrix represented a free association chain, with columns for every unique word from all free association chains, and the matrix values composed of each word’s raw count in each chain. Each participant is associated with two rows in the document-term matrix: one for pre- story free association and another for post. Word counts were rescaled between 0 and 1 by mean centering each column (i.e., word) within-subject, and then dividing the full column by the across-subject standard deviation. Using a leave-one-subject-out cross validation procedure, we trained a linear SVM to discriminate between pre- and post-story free association chains in the document-term matrix. We repeated this analysis 500 times and report the mean as our estimate of true classification accuracy. To determine whether classification accuracy was above chance, we generated a null distribution of 500 accuracy values. The null accuracy values were generated using the same procedure as described above, after randomly shuffling the pre- post- labels from the test dataset for each fold in cross validation procedure. We then computed the proportion of null accuracy values greater than the empirical classification accuracy.
Word-embeddings and “theme similarity”. To test whether story themes were present in post- story free-association, we measured the similarity of vectors representing free associates and vectors representing “core story themes”. Each associate and theme word was mapped onto a 300-dimensional vector (GloVe; version: Wikipedia 2014 + Gigaword 5; (28)). Free associates without corresponding vectors in pretrained corpus were dropped from subsequent analyses. For each story, we defined “theme words” as the 10 words mentioned most frequently across participants during the theme generation task, collapsing across conditions. Theme words for each story are were: Carver [“murder”, “death”, “funeral”, “fishing”, “girl”, “family”, “camping”, “river”, “beer”, “sex”], Carver-Rewrite [“murder”, “funeral”, “wife”, “husband”, “death”, “fishing”, “camping”, “suspicion”, “mystery”, “friends”], and July [“four”, “celebrity”, “plane”, “airplane”, “husband”, “secret”, “number”, “affair”, “actor”, “famous”]. We quantified similarity of each free associate to the story themes, before and after reading. To this end, we calculated a measure we refer to as “theme similarity”. For the n-th free associate, which was represented by embedding vector An, the theme similarity was calculated via its maximal cosine similarity across all theme words:
theme similarity(𝐴𝑛 ) = max
𝑖 (
𝐴𝑛 ∙ 𝐵𝑖
∥ 𝐴𝑛 ∥∙∥ 𝐵𝑖
∥ )
where Bi is the embedding vector for the i
th theme word. Theme similarity was calculated for every word in each free association chain and then averaged per chain. Additional information and control analyses are reported in Supplemental Information. Experiment 2: Depth-of-processing word-list variant. Experimental procedure. Procedures were identical to Experiment 1, except for the fact that the self-paced reading phase was replaced by incidental list-learning and Experiment 2 included additional post-story components: story description and a test of free recall. Incidental list-learning: Participants were presented with a list of 268 words, one at a time. The word list was manually curated to convey the gist of the original Carver story (see Supplemental Methods for the full list). Each word was onscreen for 1 second before it was replaced with two buttons which participants used to make a forced-choice decision. The decision depended on the participant’s randomly-assigned condition: Italic, Tangible, Theme or Story. The depth with which participants encoded the words in the list was manipulated from shallow (Italic) to deep (Theme/Story), while holding the word list itself constant. Participants in the Italic condition decided whether each word was italicized or not (button labels: Italic or Normal). Sixty-seven of the words were italicized, which was approximately 25% of the total list. For the Tangible condition, participants decided whether or not each word was something concrete that could be touched or inhabited (button labels: Tangible or Intangible), again with 25% of words as targets. For the Theme and Story conditions, participants were informed that the list of words they would see was not random – but instead constructed to have a hidden meaning. In the Theme condition, participants were told that the majority of words (75%) would share a common theme, while a subset of the words (25%) would be unrelated decoys. Specifically, participants were instructed that theme words would “feel like they share something with one another, like they belong in the list”. In the Story condition, participants were told that the majority of words (75%)
would be ordered in such a way that they could tell a story, while a subset of the words (25%) would be unrelated decoys. Participants were instructed that a story “takes place somewhere”, has “characters who have their own thoughts, feelings and emotions”, and follows “these characters through a series of situations that affect their lives”. In the Theme and Story conditions, participants had to decide whether each word was a decoy (button labels: Decoy or Theme; Decoy or Story, respectively). To help participants develop a sense of which words belonged to the hidden theme or story, the first 15 words in the words list all belonged to the story or theme. These words were presented in blue lettering, to make them more distinctive. Participants in the Story and Theme conditions were instructed that font colour indicated that a word was not a decoy, while participants in the Italic and Tangible conditions were instructed to make their decisions irrespective of font colour. Decoy words were pseudorandomly interspersed within the list with an average of 6.01 (SD = 3.47) story words between consecutive decoys. Across all conditions, participants received feedback for each decision in the form of a checkmark or an X that appeared above the button they selected for 500 ms, followed by another 500 ms of a blank screen before the onset of the next word. The decision portion of each trial was self-paced.
Questionnaires, story comprehension and recall: After post-task free association, participants were informed that the list of words they saw in the list learning task had a hidden meaning – specifically, they were ordered in a way that could convey a story. Participants were given the same definition of a story as the participants who were assigned to the Story condition (for details, see description of Story condition above). Next, participants were asked to generate 10- words that related to the central themes and ideas of the hidden story. Considering many participants who were not in the Story condition may have not noticed a hidden story at all, they were encouraged to guess if they were not sure and were allowed to enter fewer than 10-words if they could not generate that many. Next, participants completed an edited version of the Narrative Transportation Questionnaire (29) which sought to measure the extent to which they were transported into the hidden story. Then, participants were asked to (i) type a summary of the hidden story in their own words, and then performed (ii) a free recall test, in which they were asked to recall as many of the words from the original word list as possible. During free recall, participants typed words into the center of a blank screen and pressed Enter to submit them. After pressing Enter, the word disappeared. After free recall, participants the identical multiple choice comprehension test used in Experiment 1 for the Carver story. Finally, participants answered questions about their demographics, the strategies they used, and their subjective experience of lingering, all using an identical format to Experiment 1. Word List. The list of 268 words, as well as the colour and typeface of each word, were identical for all participants in all four incidental learning conditions. The list was designed to convey the gist of the original Carver story, while simultaneously lending itself to the four separate decision tasks (Italic, Tangible, Theme, and or Story). To this end, 201 of the words (~75%) were manually selected from the corpus of participant-generated theme words related to the original Carver story (Experiment 1). The remaining words were highly positively valenced words, selected from (65) and unrelated to the story. The total of 268 words was set to reflect the number of sentences in the original Carver story, such that participants would provide a comparable number of responses across both experiments. For full word list, see Supplemental Information. The first 15 words were all related to the Carver story and were presented in the following order: “Claire”, “Stuart”, “couple”, “small-town”, “Stuart”, “buddies”, “camping”, “fishing”, “find”, “girl”, “dead”, “Claire”, “suspicion”, “mistrust”, “murder”. Some example unrelated decoy words are: “cheerful”, “bliss”, “luxury”, “peaceful”, “happy”, “magical”. The word list was
generated using the following constraints: 25% of words (67 words) had to be italicized, 25% of words had to be tangible (i.e., representing something concrete that could be touched or inhabited), and 25% of words had to be narrative decoys (i.e., unrelated to the story). Only words that were related to the story were selected as targets for the Italic and Tangible conditions to further ensure that participants in these conditions were attending to story-related words. The target words for the Theme and Story conditions (i.e., unrelated decoys; see description of Incidental list-learning task above), were selected to be both highly unrelated to the story content and positively valenced to help participants learn to discriminate them from story-related words. Participants. 769 participants took part in Experiment 2 and were recruited via Amazon Mechanical Turk. Data were collected during July 2020. Participants were paid $6.00 USD for their participation and provided informed consent before participating. All research was conducted in accordance with the requirements of the Johns Hopkins University Homewood Institutional Review Board. After exclusions and quality-assurance checks (see Supplemental Information), a total of 320 participants were included in the final sample (Nmale = 201; Nfemale = 113, with 6 participants selecting “None of the above / Prefer not to identify”). Eighty participants were included in each condition: Italic, Tangible, Theme and Story. Analysis of free association chains. Free association data was analyzed using the same document classification and theme similarity analyses as described in Experiment 1. Using the full sample, the preliminary 10 theme words for this experiment were: “murder”, “Claire”, “Stuart”, “body”, “camping”, “girl”, “death”, “friends”, “crime”, “family”. As proper nouns (e.g., “Claire”, “Stuart”) are unlikely to have the same semantic/distributional properties as the remaining words, they were excluded from the list. Furthermore, as “body” was a cue word in this experiment, it was also excluded. Thus, the final theme words were as follows: “murder”, “camping”, “girl”, “death”, “friends”, “crime”, “family”, “investigation”, “river”, “couple”. As in Experiment 1, the 10 theme words used for a given participant’s theme similarity calculation were selected after excluding that participant’s own theme words. Data Availability. Data and materials are available on Open Science Framework (https://osf.io/dmbx4/). Acknowledgments The authors gratefully acknowledge the support of the Natural Sciences and Engineering Research Council of Canada (postdoctoral fellowship to B.B.), the National Institutes of Mental Health (grant R01MH119099 to C.J.H.) and the Alfred P. Sloan Foundation (research fellowship to C.J.H.). The authors would also like to thank: Tyler Tomita for discussions about machine learning and statistics; Kevin Himberger for advice on online experiments; Heidi Vornbrook Roosa for discussions about narratives and guidance in developing the re-written version of the Carver story; and Donna Addis, Tarek Amer, Kristijan Armeni, Simon Brown, Iva Brunec, Janice Chen, Nick Diamond, Katherine Duncan, Hongmi Lee, Yoonjung Lee, Raymond Mar, Vincent Man, Shima Moghaddam, Morris Moscovitch, and Lisa Musz for thoughtful comments on these data and/or manuscript.
Citation Diversity Statement Recent work in several fields of science has identified a bias in citation practices such that papers from women and other minority scholars are under-cited relative to the number of such papers in the field (66–70). Here we sought to proactively consider choosing references that reflect the diversity of the field in thought, form of contribution, gender, race, ethnicity, and other factors. First, we obtained the predicted gender of the first and last author of each reference by using databases that store the probability of a first name being carried by a woman (71, 72). By this measure (and excluding self-citations to the first and last authors of our current paper), our references contain 13.35% woman(first)/woman(last), 20.68% man/woman, 14.66% woman/man, and 51.31% man/man. This method is limited in that a) names, pronouns, and social media profiles used to construct the databases may not, in every case, be indicative of gender identity and b) it cannot account for intersex, non-binary, or transgender people. Second, we obtained predicted racial/ethnic category of the first and last author of each reference by databases that store the probability of a first and last name being carried by an author of color (73, 74). By this measure (and excluding self-citations), our references contain 5.62% author of color (first)/author of color(last), 15.13% white author/author of color, 15.93% author of color/white author, and 63.32% white author/white author. This method is limited in that a) names and Florida Voter Data to make the predictions may not be indicative of racial/ethnic identity, and b) it cannot account for Indigenous and mixed-race authors, or those who may face differential biases due to the ambiguous racialization or ethnicization of their names. We look forward to future work that could help us to better understand how to support equitable practices in science. References
1. W. James, The principles of psychology (Dover, 1890).
2. H. Bergson, Creative Evolution (Palgrave-Macmillan, 1911).
3. A. M. Collins, E. F. Loftus, A spreading-activation theory of semantic processing.
Psychological Review 82, 407–428 (1975).
4. J. H. Neely, Semantic priming and retrieval from lexical memory: Roles of inhibitionless
spreading activation and limited-capacity attention. Journal of Experimental Psychology:
General 106, 226–254 (1977).
5. M. W. Howard, M. J. Kahana, A Distributed Representation of Temporal Context. Journal
of Mathematical Psychology 46, 269–299 (2002).
6. S. DuBrow, N. Rouhani, Y. Niv, K. A. Norman, Does mental context drift or shift? Current
Opinion in Behavioral Sciences 17, 141–146 (2017).
7. S. M. Polyn, K. A. Norman, M. J. Kahana, A context maintenance and retrieval model of
organizational processes in free recall. Psychological Review 116, 129–156 (2009).
8. N. A. Herweg, et al., Reactivated spatial context guides episodic recall. Journal of
Neuroscience 40, 2119–2128 (2020).
9. D. Talmi, L. J. Lohnas, N. D. Daw, A retrieved context model of the emotional modulation
of memory. Psychological Review 126, 455–485 (2019).
10. N. B. Diamond, B. Levine, Linking Detail to Temporal Structure in Naturalistic-Event
Recall. Psychological Science 31, 1557–1572 (2020).
11. J. D. Bransford, M. K. Johnson, Contextual prerequisites for understanding: Some
investigations of comprehension and recall. Journal of Verbal Learning and Verbal
Behavior 11, 717–726 (1972).
12. K. D. Duncan, D. Shohamy, Memory states influence value-based decisions. Journal of
Experimental Psychology: General 145, 1420–1426 (2016).
13. C. S. Ross, Finding without seeking: The information encounter in the context of reading
for pleasure. Information Processing and Management 35, 783–799 (1999).
14. G. Sabine, P. Sabine, Books That Made the Difference: What People Told Us (The Shoe
String Press, Inc., 1983) (May 27, 2021).
15. A. B. Ortiz De Gortari, M. D. Griffiths, Game Transfer Phenomena and its associated
factors: An exploratory empirical online survey study. Computers in Human Behavior 51,
195–202 (2015).
16. D. Williams, Virtual cultivation: Online worlds, offline perceptions. Journal of
Communication 56, 69–87 (2006).
17. E. Collier, M. L. Meyer, Memory of others’ disclosures is consolidated during rest and
associated with providing support: Neural and linguistic evidence. Journal of Cognitive
Neuroscience 32, 1672–1687 (2020).
18. M. L. Meyer, K. D. Williams, N. I. Eisenberger, Why social pain can live on: Different
neural mechanisms are associated with reliving social and physical pain. PLoS ONE 10, 1–
20 (2015).
19. B. Rimé, P. Philippot, S. Boca, B. Mesquita, Long-lasting Cognitive and Social
Consequences of Emotion: Social Sharing and Rumination. European Review of Social
Psychology 3, 225–258 (1992).
20. A. Tambini, U. Rimmele, E. A. Phelps, L. Davachi, Emotional brain states carry over and
enhance future memory formation. Nature Neuroscience 20, 271–278 (2017).
21. A. J. Rashid, et al., Competition between engrams influences fear memory formation and
recall. Science 353, 383–387 (2016).
22. F. I. M. Craik, R. S. R. Lockhart, Levels of processing: A framework for memory research.
Journal of Verbal Learning and Verbal Behavior 684, 671–684 (1972).
23. C. S. Symons, B. T. Johnson, The self-reference effect in memory: A meta-analysis.
Psychological Bulletin 121, 371–394 (1997).
24. R. A. Zwaan, et al., The Construction of Situation Models in Narrative Comprehension: An
Event-Indexing Model. Psychological Science 6, 292–297 (1995).
25. W. Kintsch, Comprehension: A paradigm for cognition (Cambridge University Press,
1998).
26. D. R. Addis, Mental time travel? A neurocognitive model of event simulation. Review of
Philosophy and Psychology 11, 233–259 (2020).
27. T. Joachims, Text Categorization with Support Vector Machines: Learning with Many
Relevant Features in Proceedings of the European Conference on Machine Learning, C.
Nédellec, C. Rouveirol, Eds. (Springer, 1998), pp. 137–142.
28. J. Pennington, R. Socher, C. Manning, Glove: Global Vectors for Word Representation.
Proceedings of the 2014 Conference on Empirical Methods in Natural Language
Processing (EMNLP), 1532–1543 (2014).
29. M. C. Green, T. C. Brock, The role of transportation in the persuasiveness of public
narratives. Journal of Personality and Social Psychology 79, 701–721 (2000).
30. R. Busselle, H. Bilandzic, Fictionality and perceived realism in experiencing stories: A
model of narrative comprehension and engagement. Communication Theory 18, 255–280
(2008).
31. J. M. Fuster, Network memory. Trends in Neurosciences 20, 451–459 (1997).
32. U. Hasson, J. Chen, C. J. Honey, Hierarchical process memory: memory as an integral
component of information processing. Trends in Cognitive Sciences 19, 304–313 (2015).
33. J. Xu, S. Kemeny, G. Park, C. Frattali, A. Braun, Language in context: emergent features of
word, sentence, and narrative comprehension. NeuroImage 25, 1002–1015 (2005).
34. Y. Lerner, C. J. Honey, L. J. Silbert, U. Hasson, Topographic mapping of a hierarchy of
temporal receptive windows using a narrated story. The Journal of Neuroscience 31, 2906–
15 (2011).
35. C. Ranganath, M. Ritchey, Two cortical systems for memory-guided behaviour. Nature
Reviews: Neuroscience 13, 713–26 (2012).
36. H. Y. S. Chien, C. J. Honey, Constructing and Forgetting Temporal Context in the Human
Cerebral Cortex. Neuron 106, 675-686.e11 (2020).
37. R. A. Mar, J. Li, A. T. P. Nguyen, C. P. Ta, Memory and comprehension of narrative versus
expository texts: A meta-analysis. Psychonomic Bulletin and Review (2021)
https:/doi.org/10.3758/s13423-020-01853-1.
38. B. I. Cohn-Sheehy, et al., Narratives bridge the divide between distant events in episodic
memory. Mem Cogn (2021) https:/doi.org/10.3758/s13421-021-01178-x (August 12, 2021).
39. G. H. Bower, M. C. Clark, Narrative stories as mediators for serial learning. Psychon Sci
14, 181–182 (1969).
40. H. Lee, B. Bellana, J. Chen, What can narratives tell us about the neural bases of human
memory? Current Opinion in Behavioral Sciences 32, 111–119 (2020).
41. G. Gerbner, L. Gross, M. Morgan, N. Signorielli, Charting the Mainstream: Television’s
Contributions to Political Orientations. Journal of Communication 32, 100–127 (1982).
42. P. J. Mazzocco, M. C. Green, J. A. Sasota, N. W. Jones, This Story Is Not for Everyone:
Transportability and Narrative Persuasion. Social Psychological and Personality Science 1,
361–368 (2010).
43. R. A. Mar, Stories and the Promotion of Social Cognition. Current Directions in
Psychological Science 27, 257–262 (2018).
44. L. J. Shrum, J. E. Burroughs, A. Rindfleisch, Television’s cultivation of material values.
Journal of Consumer Research 32, 473–479 (2005).
45. F. I. M. Craik, Remembering: An Activity of Mind and Brain. Annual Review of
Psychology 71, 1–24 (2020).
46. A. M. Treisman, Selective attention in man. British Medical Bulletin 20, 12–16 (1964).
47. F. I. Craik, E. Tulving, Depth of Processing and the Retention of Words in Episodic
Memory. Journal of Experimental Psychology 104, 268–294 (1975).
48. M. K. Healey, N. M. Long, M. J. Kahana, Contiguity in episodic memory. Psychonomic
Bulletin & Review 26, 699–720 (2019).
49. A. T. Baria, et al., Linking human brain local activity fluctuations to structural and
functional network architectures. NeuroImage 73, 144–155 (2013).
50. R. Chaudhuri, K. Knoblauch, M.-A. Gariel, H. Kennedy, X.-J. Wang, A Large-Scale
Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex. Neuron
88, 419–431 (2015).
51. A. S. Luchins, Mechanization in problem solving: The effect of Einstellung. Psychological
Monographs 54, i–95 (1942).
52. J. G. Lu, M. Akinola, M. F. Mason, “Switching On” creativity: Task switching can increase
creativity by reducing cognitive fixation. Organizational Behavior and Human Decision
Processes 139, 63–75 (2017).
53. M. Csikszentmihalyi, I. S. Csikszentmihalyi, Optimal experience: Psychological studies of
flow in consciousness (Cambridge University Press, 1992).
54. J. Bruner, Actual Minds, Possible Worlds (Harvard University Press, 1987) (May 18, 2021).
55. R. C. Schank, R. P. Abelson, “Knowledge and memory: The real story” in Knowledge and
Memory: The Real Story., J. Robert S. Wyer, Ed. (Lawrence Erlbaum Associates, 1995),
pp. 1–85.
56. M. A. Wilson, B. L. Mcnaughton, Reactivation of hippocampal ensemble memories during
sleep. Science 265, 5–8 (1994).
57. D. J. Foster, M. A. Wilson, Reverse replay of behavioural sequences in hippocampal place
cells during the awake state. Nature 440, 680–683 (2006).
58. A. Tambini, L. Davachi, Awake Reactivation of Prior Experiences Consolidates Memories
and Biases Cognition. Trends in Cognitive Sciences 23, 876–890 (2019).
59. D. Dupret, J. O’Neill, B. Pleydell-Bouverie, J. Csicsvari, The reorganization and
reactivation of hippocampal maps predict spatial memory performance. Nature
Neuroscience 13, 995–1002 (2010).
60. E. T. Cowan, A. C. Schapiro, J. E. Dunsmoor, V. P. Murty, Memory consolidation as an
adaptive process. Psychon Bull Rev (2021) https:/doi.org/10.3758/s13423-021-01978-x
(August 12, 2021).
61. V. P. Murty, S. DuBrow, L. Davachi, Decision-making Increases Episodic Memory via
Postencoding Consolidation. Journal of Cognitive Neuroscience 31, 1308–1317 (2019).
62. P. Thorndyke, Cognitive Structures in Comprehension of Narrative Discourse. Cognitive
Psychology 9, 77–110 (1977).
63. M. J. Sekeres, et al., Recovering and preventing loss of detailed memory : differential rates
of forgetting for detail types in episodic memory. Learning & memory (Cold Spring
Harbor, N.Y.) 23, 72–82 (2016).
64. R Core Team, R: A language and environment for statistical computing, reference index
version 3.0.2 (2020) (November 20, 2020).
65. P. S. Dodds, et al., Human language reveals a universal positivity bias. Proceedings of the
National Academy of Sciences of the United States of America 112, 2389–2394 (2015).
66. P. Zurn, D. S. Bassett, N. C. Rust, The Citation Diversity Statement: A Practice of
Transparency, A Way of Life. Trends in Cognitive Sciences 24, 669–672 (2020).
67. S. M. Mitchell, S. Lange, H. Brus, Gendered Citation Patterns in International Relations
Journals1. International Studies Perspectives 14, 485–492 (2013).
68. D. Maliniak, R. Powers, B. F. Walter, The Gender Citation Gap in International Relations.
International Organization 67, 889–922 (2013).
69. N. Caplar, S. Tacchella, S. Birrer, Quantitative evaluation of gender bias in astronomical
publications from citation counts. Nat Astron 1, 1–5 (2017).
70. M. L. Dion, J. L. Sumner, S. M. Mitchell, Gendered Citation Patterns across Political
Science and Social Science Methodology Fields. Political Analysis 26, 312–327 (2018).
71. J. D. Dworkin, et al., The extent and drivers of gender imbalance in neuroscience reference
lists. Nat Neurosci 23, 918–926 (2020).
72. D. Zhou, et al., Gender Diversity Statement and Code Notebook v1.0 (Zenodo, 2020)
https:/doi.org/10.5281/zenodo.3672110 (August 13, 2021).
73. A. Ambekar, C. Ward, J. Mohammed, S. Male, S. Skiena, Name-ethnicity classification
from open sources in Proceedings of the 15th ACM SIGKDD International Conference on
Knowledge Discovery and Data Mining, KDD ’09., (Association for Computing
Machinery, 2009), pp. 49–58.
74. G. Sood, S. Laohaprapanon, Predicting Race and Ethnicity From the Sequence of
Characters in a Name. arXiv:1805.02109 [stat] (2018) (August 13, 2021).