Published Papers:
Banerjee, A., & Urminsky, O. (2022). What you are getting and what you will be getting: Testing whether verb tense affects intertemporal choices. Journal of Experimental Psychology: General.
https://doi.org/10.1037/xge0001192
Prior research has shown that the way information is communicated can impact decisions, consistent with some forms of the Sapir-Whorf hypothesis that language shapes thought. In particular, language structure—specifically the form of verb tense in that language—can predict savings behaviors among speakers of different languages. We test the causal effect of language structure encountered during financial decision-making, by manipulating the verb tense (within a single language) used to communicate intertemporal tradeoffs. We find that verb tense can significantly shift choices between options, owing to tense-based inferences about timing. However, the spontaneous use of verb tense when making choices occurs only in the complete absence of other timing cues and is eliminated if even ambiguous or nondiagnostic time cues are present, although prompted timing inferences persist. We test between multiple competing accounts for how verb tense differentially impacts timing inferences and choices. We find evidence for a cue-based account, such that the presence of other cues blocks the spontaneous use of verb tense in making intertemporal decisions, consistent with the “Good Enough” proposal in psycholinguistics.
(Data publicly available here)
“The Language That Drives Engagement: A Systematic Large-scale Analysis of Headline Experiments. ”
Banerjee, A., & Urminsky, O. (2024). The language that drives engagement: A systematic large-scale analysis of headline experiments. Marketing Science.
https://doi.org/10.1287/mksc.2021.0018
We use a large-scale data set of thousands of field experiments conducted on Upworthy.com, an online media platform, to investigate the cognitive, motivational, affective, and grammatical factors implementable in messages that increase engagement with online content. We map from textual cues measured with text-analysis tools to constructs implied to be relevant by a broad range of prior research literatures. We validate the constructs with human judgment and then test which constructs causally impact click-through to articles when implemented in headlines. Our findings suggest that the use of textual cues identified in previous research and industry advice does impact the effectiveness of headlines overall, but the prior research and industry advice does not always provide useful guidance as to the direction of the effects. We identify which textual characteristics make headlines most effective at motivating engagement in our online news setting.
(Materials publicly available here)
Papers under Revision/Review:
Banerjee, A. & Urminsky, O. (2022)
(IUnder second round review at Journal of Consumer Psychology)
Language is pervasive and hence a common factor in people’s decision making. Prior research has mostly studied the effects of comprehensible language, language that communicates a literal meaning to consumers – on behavior and attitudes. In this paper, we investigate the potential for language that is incomprehensible to a given consumer to nevertheless impact willingness to pay and choice. In particular, we propose that potentially meaningfully incomprehensible language can convey associations beyond literal meaning. We demonstrate that adding text in a foreign language unreadable to the consumer to a known native language description of foreign food significantly increases perceptions of authenticity, uniqueness, and quality, resulting in higher valuations and greater likelihood of choice, while holding the country of origin constant. Thus, we show that, contrary to prior accounts, an incomprehensible cue creates consumer value by instilling feelings of intangible experiences and that those feelings impact decisions. We test our framework using secondary field data as well as experiments, including with consequential choices.
(Data publicly available here)
“Confident judgments of (mis)information veracity are more, rather than less, accurate."
Banerjee, A., & Rocklage, M., Mosleh, M., Rand, D. (TBD)
(Under Review at PNAS Nexus)
Confidence is increasingly viewed as a barrier to recognizing misinformation, as people who are more confident tend to be more likely to believe and share false news. Here, we challenge this view by distinguishing between two types of confidence: general confidence in one’s abilities, and specific confidence in a particular judgment. Using a large, pre-registered study in which participants judge the accuracy of news posts, we demonstrate a striking dissociationbetween these two forms of confidence. While higher general confidence is associated with worse discernment of true versus false headlines (in line with past work), we find that higher confidence in specific judgments is associated with better truth discernment - a finding that we observe among both Democrats and Republicans. These results call for a reevaluation of the role of confidence in the detection of misinformation. Focusing on confidence in specific judgments, rather than general abilities, could play an important role in helping to mitigate belief in misinformation.
(Materials publicly available here)
Working Papers:
“Making amends with the audience: Manager use of public apologies and other amends-making strategies.”
Chaudhry, S. , Banerjee, A., Wu, L., Lupoli, M. (TBD)
What are the building blocks of satisfactory public responses to customer complaints? This project investigates key components for satisfactory public responses to customer complaints using hotel manager responses on TripAdvisor. Managers effectively engage in public relations as third-party observers assess these responses to make lodging decisions. MTurkers code amends-making elements, response satisfaction and future interest in visiting the hotel. We analyze data to pinpoint influential components, highlighting the pivotal role of the "offer of repair" subcomponent in predicting satisfaction. NLP tools further break down language features for managerial guidance.
Ongoing Projects:
“Does Big-Data Correlational Analysis Predict Causal Effects of Language on Decisions?”
Banerjee, A. & Urminsky, O. (TBD)
A substantial research literature has used large-scale correlational text analysis to determine how characteristics of language encountered by people predicts (and presumably causes) their subsequent behavior, such as online engagement or donation decisions. These approaches have high external validity, by analyzing large-scale real- world data and behavior, but are causal interpretations of the findings internally valid? Using a novel large-scale dataset containing thousands of headline experiments, we compare the results of correlational analyses (excluding the experimental variation) with causal analyses (solely using experimental variation) to test what factors increase the likelihood of click-through in an online news setting. We find that not only does experimental data provide higher statistical power, but the correlational findings differ in magnitude, and sometimes even in direction, from the causal findings. Our results suggest that big-data correlational analyses may provide poor predictions of causal effects, underscoring the need for marketers to conduct experiments.
“Heterogeneity in Reader Engagement: Analyzing the Impact of Language- Based Constructs Across Multiple News Types.”
Banerjee, A. & Urminsky, O. (TBD)
Our paper tests the impact of language on online news engagement, highlighting the significant heterogeneity across news sites. Using ChartBeat's extensive dataset, we uncover minimal correlation with prior predictions, challenging the generalizability of existing theories. This necessitates a nuanced, individual-centric approach in behavioral research to understand digital news consumption dynamics.
“Ingredient Jargon in Product Information”
Banerjee, A., Chen, S., Urminsky, O. (TBD)
We investigate how people incorporate incomprehensible jargon in products - like ingredient information - in their decision-making. Specifically, we focus on the associations people make when they encounter unknown ingredient names (including equivalent names for the same substance) that structurally resemble chemical terms vs natural- seeming words, and how that affects their choices of products. We find that when people are given incomprehensible information, for which they lack literal meaning, they still use perceived associations with grammatical cues to make judgments.
“Asymmetric Variety Seeking in Hierarchical Choices”
Banerjee, A.*, & Winet, Y.* (TBD)
People frequently seek variety when choosing hedonic experiences for themselves (McAlister & Pessemier, 1982; Ratner, Kahn & Kahneman, 1999; Simonson, 1990). They also face multiple choices that contain other choices. This research explores how the structure of decision-making hierarchies impacts consumer variety-seeking behavior. When making hierarchical choices—such as selecting a restaurant before choosing a specific dish — consumers tend to seek more variety at higher levels (e.g., restaurant) compared to lower levels (e.g.,dish). This effect occurs in a variety of domains, in a consequential decision, and with both familiar and unfamiliar option sets. We also rule out alternative explanations, showing this effect cannot be explained by a sequence effect or a desire to have a prototypical experience. This work builds on extant work on choice architecture showing how understanding the impact of small changes in the structure of decisions can push consumers to make better decisions, which has important implications for improving consumer well-being.
“Confident Language in Misinformation”
Banerjee, A., & Rocklage, M., Mosleh, M., Rand, D. (TBD)
TBD