If you have ever shipped a product feature whose only real job was to be measured — a dashboard for managers, a leaderboard for sales reps, a quantified-self chart for your own users — you have already written a check the Hawthorne Effect is going to cash. The act of measuring something inside a human system is never neutral. The instrument is part of the experiment, and the experiment is part of the product.
Western Electric’s plant engineers learned this the hard way between 1924 and 1932 at the Hawthorne Works in Cicero, Illinois, when they tried to measure how factory illumination affected output and discovered that the workers’ output kept going up no matter what the lights did. The story has been wrong, then more wrong, then partially right again over the last hundred years. The effect has been pronounced dead, exhumed, reanalysed, and is currently being argued over in clinical-trials journals as I write this. None of which has stopped the term “Hawthorne Effect” from being plastered onto every behavior-change study where someone forgets to control for the obvious.
This post is the version I wish someone had handed me the first time I built an Octalysis-driven workplace gamification design. It separates the four things “Hawthorne Effect” actually means, walks through what the original studies did and didn’t find, surveys the modern replication evidence (it is a mess, and the mess is itself instructive), and then maps the surviving signal onto Core Drive 5 (Social Influence & Relatedness) and Core Drive 2 (Development & Accomplishment) so you can tell when telemetry is helping you and when it is just teaching your users how to perform compliance theatre.
Speed Run Notes
- The Hawthorne Effect is the umbrella claim that being observed changes behavior. John R. P. French named it in the early 1950s from the 1924–1932 Western Electric studies. The original investigators never did.
- The illumination experiments did not show what the legend says. They were never written up. When Levitt & List analysed the recovered data in 2011, the famous patterns turned out to be fiction.
- Levitt & List (2011) traced the lighting “effect” to a Monday artifact, with only weak hints of a real one. Jones (1992) found slender or no evidence of a Hawthorne effect in the relay room data.
- What survives is narrower: novelty, demand characteristics, evaluation apprehension, and a CD5 supervision signal. McCambridge’s 2014 review of 19 studies found the effects exist, but their size can’t be pinned down.
- For Octalysis: telemetry is never neutral. Visible measurement is a CD5 + CD2 lever you are pulling whether you intend to or not. Design the observation surface, or it will design your users.
Table of Contents
- What Is the Hawthorne Effect?
- The Core Findings: What the Hawthorne Studies Actually Did
- What Mayo, Roethlisberger & Dickson Got Right
- Where the Hawthorne Effect Falls Apart
- The Brain on Observation
- Hawthorne Effect vs Other Theories
- The Hawthorne Effect in the Real World
- The Elephant in the Room
- How to Apply the Hawthorne Effect with the Octalysis Framework
- Practical Steps to Apply the Hawthorne Effect
- Frequently Asked Questions
Author Credibility: Yu-kai Chou

Yu-kai Chou created the Octalysis Framework after studying gamification since 2003, years before the term entered mainstream vocabulary. As a Human-Systems Architect & Behavioral Designer, his framework has been applied by LEGO, Microsoft, Porsche, Coca-Cola, Salesforce, and MrBeast, impacting over 1.5 Billion Users.
Chou has taught the Octalysis methodology at Harvard, Stanford, Yale, Tesla, Google, BCG, and IDEO.
His work has been cited by Harvard, Stanford, MIT, Forbes, Wall Street Journal, Wired, US Department of Energy, NIST, NSF, NCBI, US Department of Education, ClinicalTrials.gov, and Google Scholar — with 3,700+ more academic publications. Explore his books here.
The reason I keep harping on the difference between visible and invisible measurement in Octalysis design is that the Hawthorne Effect is the closest thing the field has to a universal pre-existing condition. Every workplace gamification rollout eventually runs into the same question: is the lift we are seeing in week three the design working, or is it the supervision attention that came with the rollout? The honest answer is “almost always both, and the proportion shifts.” Telling them apart is not a research methods problem you can wave away. It is the central design problem of every measurement-rich product surface.
What Is the Hawthorne Effect?
The Hawthorne Effect is the proposition that the act of observing or measuring people inside a study, an experiment, or any data-collection system changes how they behave — and that the change is not the variable the study is trying to measure. The term was coined by the social psychologist John R. P. French, who first used it in 1950 and gave it wide circulation in a 1953 chapter on field experiments. It is often credited to Henry A. Landsberger’s 1958 book Hawthorne Revisited, but the phrase does not appear in that book.
French was describing the puzzling productivity patterns reported from a series of experiments at the Western Electric Hawthorne Works between 1924 and 1932, first by the company’s own engineers and later by Elton Mayo’s Harvard colleagues.
The everyday version of the claim is that, in those experiments, factory workers’ productivity rose whenever the researchers paid attention to them — irrespective of whether the manipulated variable (illumination, rest breaks, working hours) was a treatment or a control condition. The implication, as schoolbook industrial-psychology textbooks have repeated for half a century, is that human attention is itself a productivity multiplier and that any field study running a behavioral intervention has to assume some fraction of its measured lift is just observation.
That is the legend. The actual research record is more complicated, more interesting, and more useful to a behavioral designer than the legend.
Modern usage has fragmented the term into at least four overlapping concepts that are worth keeping separate, because the Octalysis design implications differ for each of them:
- Observation effects. Behavior changes because subjects know they are being watched. This is the closest thing to the original claim and the one with the most surviving evidence.
- Demand characteristics. Subjects infer what the experimenter wants and try to deliver it — described later by Martin Orne in 1962 and arguably the deeper construct that the Hawthorne studies actually tapped.
- Evaluation apprehension. Subjects perform differently because they fear judgement, separately from any inference about what the experimenter wants — Rosenberg, 1965.
- Novelty effects. Behavior changes because the situation is new — the change attenuates as the novelty wears off, regardless of whether anyone is watching.
When a designer says “the lift we saw in our launch week was probably a Hawthorne Effect,” they almost always mean some unspecified blend of these four. The honest version is that they should pick one — because each of the four points at a different intervention.
The Core Findings: What the Hawthorne Studies Actually Did
The Western Electric program at Hawthorne Works ran from late 1924 through 1932. Western Electric’s own engineers started it. Harvard Business School’s Elton Mayo and Fritz Roethlisberger joined from 1928, working alongside Western Electric’s William J. Dickson. The program had four distinct phases that get blurred in popular retellings.
The Illumination Studies (1924–1927)
The first and most famous phase studied how lighting levels affected output in three departments: relay assembly, coil winding, and inspection. In the later rounds, workers were divided into a test group whose illumination was systematically varied, and a control group whose illumination was held constant. The researchers expected output to track illumination upward — the question was how steeply.
The story as usually told is that output rose in both groups, across nearly every illumination level the experimenters tried. In one informal follow-up, two volunteers kept working while the light was cut to roughly the level of a moonlit night, and reportedly kept up their output.
Here is the catch. Those descriptions come from secondhand summaries, not from an analysis of the data. When Levitt and List finally ran the numbers, they concluded that the remarkable patterns in the standard retelling were fiction.
After the experiments stopped, output came down from its peak but stayed above baseline, which they put down to seasonality.
The illumination data are now generally treated as the source of the Hawthorne legend — but the National Research Council (which sponsored the work) and Western Electric never published a detailed report of these specific experiments. The only contemporary account is a short 1927 trade-journal article.
Levitt and List’s 2011 analysis of the recovered data found that lighting was changed on Sundays, the day off, so every new lighting level began on a Monday. Output was high on Mondays whether or not the lights had changed.
The Relay Assembly Test Room (1927–1932)
This is the experiment that the textbooks should be quoting, but rarely are. Five women were selected from the broader assembly floor and moved to a separate test room where they assembled telephone relays under continuously varying conditions: rest pauses of different lengths, shorter workdays, free snacks, a Saturday off, then back to the original schedule. Output rose through nearly every condition, including when the experimenters reverted to the original schedule and benefits.
The detail the legend usually omits: in January 1928, two of the original five (Adeline Bogatowicz and Irene Rybacki) were removed, officially for talking too much and for an uncooperative attitude toward requests for more output. Their replacements were Mary Volango and Jennie Sirchio. Sirchio became the fastest worker in the room and was effectively the team’s pacesetter. Group composition shifted. A piecework pay system was introduced specifically for the test-room group, while the broader floor stayed on a different incentive scheme. Supervision was different — friendlier, more consultative, less disciplinary.
The headline finding, as Roethlisberger and Dickson reported it in Management and the Worker (1939), was that the social and supervisory changes inside the test room mattered more than the formal experimental manipulations. They concluded that workplace productivity was a function of “human relations” — supervisor behavior, group cohesion, and the perceived attention of management — not just physical conditions and pay.
The Mass Interviewing Program (1928–1930)
Roethlisberger’s team interviewed roughly 21,000 Hawthorne employees about their work, supervisors, and personal lives. The program shifted from structured to unstructured (“non-directive”) interviewing partway through, anticipating Carl Rogers’ later client-centered method. The substantive finding here was that workers’ grievances about specific conditions often masked deeper concerns about supervision style, social position in the work group, and recognition. This is the part of the Hawthorne corpus that most directly anticipates modern engagement research and the CD5 (Social Influence & Relatedness) literature.
The Bank Wiring Observation Room (1931–1932)
Fourteen men were placed in a separate room to wire bank telephone equipment under direct observation by an investigator who sat at a desk in the room. Unlike the Relay Assembly Test Room, this group received no special treatment, no pay-system change, no supervisor swap. The result: the group set its own informal output norm — roughly two equipments per day per worker — and enforced it with social pressure (“binging,” verbal teasing, ostracism) against any worker who exceeded the norm or fell below it.
The Bank Wiring data are almost the inverse of the Relay Assembly story. Workers who were observed without other changes did not increase output. They held it constant at a group-determined level that protected the slowest worker and concealed the productive capacity of the fastest. Supervision-by-observation alone, when no positive social changes accompanied it, produced compliance and concealment, not lift.
This is the part of the corpus that most behavioral designers have never read and that I suspect is the most important. If you take the four phases together, the Western Electric studies do not show “observation makes people more productive.” They show something more nuanced: observation combined with positive supervisor relationships, novel attention, and revised pay schemes raised output, while observation alone, embedded in a normal supervision regime, produced rate-buster norm enforcement and the deliberate suppression of output.
Both findings are enormously useful. Neither is what the textbook Hawthorne Effect actually claims.
What Mayo, Roethlisberger & Dickson Got Right
Three contributions from the Hawthorne corpus survive the modern critiques and continue to repay close reading.
Workplaces are social systems before they are productive systems
Mayo’s central argument — that human beings at work are responding to a web of social relationships, status hierarchies, and emotional needs that cannot be designed away by engineering the physical conditions of labor — landed during the high-water mark of Frederick Taylor’s scientific management and helped open the door to the entire human-relations movement, organizational behavior as a field, and modern engagement research. Whatever you think of the specific Hawthorne effect estimates, the framing was correct and durable.
For an Octalysis designer, this is the framing under Core Drive 5 (Social Influence & Relatedness): your “feature” is never landing in a vacuum. It is landing inside a social system that has its own informal norms, its own status games, and its own rate-busting protections. The Bank Wiring finding — that an observed group without the supervisor changes self-organized to suppress output — is the canonical warning label.
Recognition is a more reliable lever than physical comfort
Across the four phases, the changes that produced lasting output gains were not the ones that altered the physical conditions of work. They were the ones that altered the social conditions: friendlier supervision, being consulted about changes, being singled out as a research subject, getting a separate work area, getting a different pay system, being interviewed at length. The Hawthorne studies did not “prove” recognition matters — but they were the moment that idea entered the management literature with empirical anchors, and the subsequent ninety years of research has largely confirmed the framing.
This is the bridge to Core Drive 2 (Development & Accomplishment) inside Octalysis: visible recognition is a CD2 amplifier, but recognition delivered by a person inside a relationship is a much stronger lever than the same recognition delivered by an interface element with no social context attached. A leaderboard alone is a much weaker mechanic than a leaderboard plus a supervisor who occasionally calls out top performers by name in front of the group.
Group norms protect the bottom and ceiling-cap the top
The Bank Wiring finding — that group output norms emerge spontaneously and are enforced through social pressure — has aged extraordinarily well. It anticipated the formal social-loafing literature (Ringelmann, Latané), the literature on production norms in factories, the literature on rate-busting in unionized workplaces, and the broader social-comparison theory work that Festinger crystallized in 1954.
For Octalysis design, this is the warning that any team mechanic — guild challenges, departmental leaderboards, group quests — will silently produce output norms that the design has not specified and may not approve of. The norm-emergence is not a bug. It is what social humans do when you put them in groups with shared visible metrics. The design question is whether you want the norm to emerge implicitly or to scaffold it explicitly with the levers you actually want active.
Where the Hawthorne Effect Falls Apart
If you have only read about the Hawthorne Effect in management textbooks, you have missed the part where, somewhere between 1974 and 2014, the empirical floor under the headline effect basically gave way. There are at least three independent strands of critique, each of which would be enough to put the standard textbook claim into hospice care. Together they make a strong case that the popular version of the Hawthorne Effect is, at best, wildly oversold, and at worst, an artifact of selective storytelling that has survived because it makes a satisfying parable.
This is the section a behavioral designer cannot afford to skip. If you intend to use “the Hawthorne Effect” as part of a design rationale or a research-design caveat, you need to know which version of the effect you are actually invoking, because the version that has survived modern scrutiny is much narrower — and much more useful — than the textbook one.
Critique 1: The original effect estimates do not survive reanalysis
Steven Levitt and John List’s 2011 paper in the American Economic Journal: Applied Economics analysed the original illumination study output records. The data had never been formally analysed and were thought to have been destroyed. Levitt and List tracked them down themselves, in archives at the University of Wisconsin–Milwaukee and Harvard Business School’s Baker Library.
Their verdict on the standard retelling was blunt: the supposedly remarkable data patterns were fiction. Lighting changes were made on Sundays, so each new level started on a Monday, and output was high on Mondays whether the lights were brighter, dimmer, or unchanged.
They did find subtler hints of a real effect, which they called weak evidence. Output was higher while experimentation was active, and workers responded more to experimenter-made lighting changes than to natural ones.
Stephen R. G. Jones ran a statistical analysis of the Relay Assembly Test Room data in 1992 and found slender or no evidence of a Hawthorne effect. His conclusion was that the effect is largely a construction of later interpreters.
Two earlier critiques explain the output gains without any observation effect at all. H. M. Parsons argued in Science in 1974 that the workers could see their own output counts and were paid on output, which is feedback plus reinforcement. Franke and Kaul’s 1978 regression attributed about 90% of the variance in output to managerial discipline, the economic adversity of the Depression, and raw-material quality.
Calling any of that “the Hawthorne Effect” is a category error.
The Levitt-List paper is worth reading not because it conclusively kills the effect but because it shows how robust a finding has to be to survive a hundred-year-old data archive that was never analysed with the controls modern econometrics would now insist on. The polite summary in the field is that the Hawthorne illumination data underdetermines the effect — there are at least three plausible explanations for the recorded output patterns, and the experimenter-attention story is not even the leading candidate when you actually look at the records.
Critique 2: The modern Hawthorne Effect has inconsistent effect sizes nobody can pin down
The serious modern home of the Hawthorne Effect is in clinical trials methodology, where it has been used for decades to argue that being enrolled in a trial — being measured, observed, and questioned — is itself a non-specific intervention that should be controlled for. The best attempt to pin the effect down is McCambridge, Witton and Elbourne’s 2014 systematic review in the Journal of Clinical Epidemiology. They found 19 purposively designed studies that tested whether taking part in research changes the behavior being studied.
The aggregate finding: real, heterogeneous, and impossible to size with confidence. Twelve of the 19 studies reported at least some significant evidence of an effect. Across the 14 studies with binary outcomes, the pooled odds ratio was 1.17 (95% CI 1.06–1.30), with very high heterogeneity.
The authors’ conclusion was that participation effects exist, but little can be securely known about the conditions they operate under, their mechanisms, or their magnitudes.
The best-known single trial shows how messy this gets. McCarney and colleagues (2007) randomised 176 people in a dementia trial to intensive or minimal follow-up. The intensively followed group did better on the cognitive measure, and rated their own quality of life worse. More observation moved outcomes in both directions.
A 2022 meta-analysis in primary care by Berkhout and colleagues landed in the same place: a pooled odds ratio of 1.41 across 15 studies, and an effect that lost significance in the well-designed ones.
The 2017 Paradis and Sutkin review in Medical Education went further. They argued that the term is used so loosely in health professions education research that it works as a good story more than as an explanation. The authors recommended the phrase “participant reactivity” instead, and treating altered behavior as a window into the social world of the study site rather than as noise.
For a behavioral designer the practical implication is simple: do not budget for an observation lift of any particular size. No review supports a standard number. The range runs from nothing in well-controlled studies to large in specific settings, and the appearance is conditional on the kind of measurement and the kind of social relationship inside which the measurement is happening.
Hospital hand hygiene is where the effect is biggest and best measured. Srigley and colleagues (2014) used electronic dispensers to count hand-hygiene events when auditors were visible and when they were not: 3.75 events per dispenser per hour in sight of an auditor, against 1.48 out of sight.
A 2020 systematic review by Purssell and colleagues put the median inflation from direct observation at 35.6%, with a range of 4.2% to 65.3%. A specific behavior, a visible human observer, and a clear norm: that is where observation bites.
Critique 3: The “five women” sample is laughable as a basis for a universal effect
The Relay Assembly Test Room had five workers. Five. And two of them were swapped out partway through. The Bank Wiring Observation Room had fourteen. The illumination studies had larger N’s but the recorded data are fragmentary. These are not the sample sizes you build universal psychological laws from — and yet the textbook treatment of the Hawthorne Effect routinely cites the studies as if they had the methodological standing of, say, the Asch line-judgment series or Milgram’s obedience program.
Worse, the published reports have known issues that any modern reviewer would flag. There is no pre-registration. There is no clean control of supervisor behavior across phases. The pay-system change inside the Relay Assembly Test Room confounds the supervision and observation manipulations. The qualitative narrative in Management and the Worker mixes the investigators’ theoretical interpretations with the data in ways that make it nearly impossible to separate observation from inference.
Add to this the historical context — the Western Electric researchers had a strong institutional interest in finding that “human relations” mattered, because that conclusion was congenial to a managerial reform agenda Mayo and his sponsors were already committed to. Confirmation bias is not a modern invention. The most scrupulous reading of the Hawthorne corpus today is that it is a useful set of historical case studies whose findings inspired several productive research programs but do not, on their own, establish the effect that bears their name.
This is also where the contested-construct lean-in matters most. The honest framing is: something at Hawthorne raised output during the experimental phases. We don’t know what it was, the original investigators didn’t fully know, the modern reanalysts can isolate at least three candidate explanations none of which require a “Hawthorne Effect” as conventionally described, and the modern clinical-trials literature has found a participation signal that is real but that nobody can size with confidence. That is the version a designer should carry, not the cartoon.
The Brain on Observation
The Hawthorne Effect is loose enough as a behavioral construct that there is no single neural circuit you can point at. But the underlying psychological mechanisms — the ones that survive when you strip away the misnamed parts — do have neural correlates that have been mapped reasonably well over the last twenty years.
The “being watched” signal has been imaged directly. Izuma, Saito and Sadato (2010) scanned people making decisions with and without observers present. Medial prefrontal cortex activity was higher under observation, and the striatum responded strongly when subjects answered in front of observers.
Somerville and colleagues (2013) found that simply believing a peer was watching through a camera was enough to produce self-conscious emotion and medial prefrontal engagement.
The medial prefrontal cortex is also a core node of the mentalizing network Frith and Frith (2006) describe, the system we use to model what other people think. My reading, and it is an inference rather than a finding: being observed puts you to work modeling the observer, which is one reason sustained surveillance feels draining.
Demand characteristics, the inferred-purpose layer Orne identified, are best described at the cognitive level rather than the neural one. The subject holds a guess about the experimenter’s goal and adjusts behavior against it. That is deliberate goal-tracking work, which is why I treat it as the most effortful of the four sub-effects.
Evaluation apprehension overlaps with the threat-response circuitry, particularly when subjects expect negative judgement. Müller-Pinzler and colleagues (2015) found that failing in public engaged the ventral anterior insula and the amygdala. This is the part of the construct that links to Core Drive 8 (Loss & Avoidance) inside Octalysis: observation that is read as evaluative threat will produce avoidance-driven compliance, not engaged performance. It is the same family of response the Trier Social Stress Test exploits. Dickerson and Kemeny’s 2004 meta-analysis of 208 laboratory studies found cortisol responses were largest when a task combined uncontrollability with social-evaluative threat.
Novelty effects, finally, ride on the dopaminergic midbrain. Bunzeck and Düzel (2006) showed in two fMRI studies that the human substantia nigra/ventral tegmental area codes stimulus novelty.
Novelty pulls behavior toward exploration and engagement, and it fades as the situation becomes familiar. That is the likeliest reason many observation effects attenuate: the novelty response decays, and what remains is the slower social component plus whatever the underlying behavior actually is.
The take-home for a designer is that the four sub-effects have different neural signatures and therefore different decay curves, different intervention points, and different design implications. Lumping them all together as “the Hawthorne Effect” loses every one of those distinctions.
Hawthorne Effect vs Other Theories
The Hawthorne Effect overlaps with at least five other behavioral constructs in ways that matter for design. Knowing which one you are actually invoking is the difference between a coherent rationale and a vague gesture at “people change when watched.”
vs Demand Characteristics (Orne, 1962). Demand characteristics are the deeper construct. The Hawthorne Effect, in its survives-modern-critique form, is largely a special case of demand characteristics in which the demand signal is “the experimenter / supervisor / measurement system wants me to perform well.” Orne’s framing has the advantage of being mechanism-specific: it tells you that the intervention is the inferred-goal layer, and therefore that altering what the subject infers about your purpose alters the effect.
vs Placebo Effect. Placebo effects are mediated by expectancy and conditioning; they require the subject to believe a specific intervention is happening. Hawthorne-style observation effects do not require any treatment belief — only the awareness of being measured. The two constructs are dissociable in well-designed clinical trials, but they are routinely conflated in casual discussion. A designer should treat them as additive: a launched feature in a measured product surface gets some of each, and they do not cancel out.
vs Pygmalion Effect (Rosenthal & Jacobson, 1968). The Pygmalion Effect — that observers’ expectations of subjects shape subjects’ actual performance — is the inverse-direction sibling. Hawthorne is “subject knows they’re observed and changes behavior.” Pygmalion is “observer holds expectations that, through subtle behavior cues, change the subject’s behavior.” The two combine in classroom and workplace settings, which is why teacher-expectation studies and supervisor-attention studies both report similar productivity-style effects: the underlying mechanism is partly the same social attention loop running in opposite directions.
vs Social Facilitation (Triplett, 1898; Zajonc, 1965). Social facilitation is the older finding that the mere presence of another person — not necessarily an observer with evaluative intent — accelerates well-learned tasks and impairs novel ones. It is mechanistically distinct from Hawthorne because it does not require the awareness of measurement, only co-presence. The two effects layer: a measured surface where other users are visible (a leaderboard, a guild dashboard) is recruiting both Hawthorne and social-facilitation channels simultaneously.
vs Self-Determination Theory‘s autonomy concern. The most important theoretical tension. Self-Determination Theory (Deci & Ryan) argues that surveillance is an autonomy-undermining frame that crowds out intrinsic motivation. Hawthorne-style observation effects, in their crude form, look like a productivity lever you can pull. But Lepper and Greene (1975) found that children placed under adult surveillance showed less later interest in the activity than children who were not monitored. Enzle and Anderson (1993) sharpened it: surveillance undermined intrinsic motivation when the watcher’s intent was read as controlling, and not when it was read as non-controlling. This is the heart of the Black-Hat-vs-White-Hat distinction inside Octalysis design: the same telemetry, framed differently, will be received as care or as surveillance, with opposite long-run effects.
The Hawthorne Effect in the Real World
Strip away the management-textbook caricature and you find the surviving Hawthorne-adjacent mechanisms (observation, novelty, demand characteristics, evaluation apprehension) running quietly through nearly every measured human system. Four domains where the design implications are most urgent:
Workplace gamification and performance management
Every dashboard, leaderboard, and OKR tracker in a modern workplace is an observation surface. The standard design assumption is that these tools “make performance visible” and therefore raise it. The honest finding from the Hawthorne corpus and the modern surveillance research is that visible measurement raises performance only when it is paired with the supervision style and social context the Relay Assembly Test Room had — friendly, consultative, attentive, paired with a recognition system. When it is paired with the supervision style the Bank Wiring Observation Room had — distant, evaluative, no social warmth — visible measurement produces output-restriction norms that hold performance at a level the group sets for itself.
For Octalysis design this maps to the observation that CD5 (Social Influence & Relatedness) and CD2 (Development & Accomplishment) are required co-conditions. A measured surface without social warmth recruits CD8 (Loss & Avoidance) instead, which is why so many gamified-performance dashboards produce short-term lifts followed by gaming, sandbagging, and disengagement. The design correction is rarely “remove the dashboard.” It is “fix the supervision regime around the dashboard.”
Clinical trials and behavioral health interventions
This is the domain where Hawthorne-style controls are most institutionally embedded. Modern RCT design routinely includes “attention controls” — non-treatment groups that receive equivalent measurement attention and contact time — to separate the treatment signal from the observation signal. McCambridge’s 2014 systematic review and later work have made clear that the participation signal in trials is real but inconsistent in size, and is not a justification for inflating treatment effect claims.
The design implication for behavior-change apps and digital therapeutics is that the engagement lift you see in your first three weeks of usage is partly novelty, partly observation, and partly the actual intervention. Honest product science requires that you measure all three separately. The standard pattern — running a within-subject pre/post design with no attention control — will overstate your intervention effect by some unknown but non-trivial fraction.
Education and classroom research
Classroom-research designs are notoriously susceptible to Hawthorne-style effects because the unit of randomization is rarely the student. When you assign a new teaching method to a few classrooms and a control method to others, you have changed simultaneously: the lesson plan, the teacher’s attention to the experiment, the students’ awareness of being part of a study, and very often the school administration’s attention to the participating teachers. Pulling apart which of those is producing the effect is a methodological nightmare.
For learning-product designers, the relevant move is to assume that any positive lift in a pilot will be subject to the same confounding, and to design longer-horizon evaluations that allow novelty effects to decay before drawing conclusions. The 2017 Paradis & Sutkin review in medical education made this case forcefully, and it applies with equal force to consumer education products.
Marketing, UX, and consumer product analytics
Quantified-self products, dashboards in B2B SaaS, “your weekly report” emails, and any feature whose primary mechanic is showing the user a metric about themselves are all observation-effect-amplifying surfaces. The best evidence here is on self-monitoring. Harkin and colleagues’ 2016 meta-analysis of 138 studies found that prompting people to monitor their progress promoted goal attainment (d+ = 0.40). The effect was larger when progress was reported or made public, and when it was physically recorded.
That is the mechanism under Strava’s pace charts and under the spending charts Mint popularized, a pattern its successors kept after Intuit shut Mint down in March 2024 (Monarch Money, Rocket Money, Copilot, Quicken Simplifi all ship a version of the same visible-spending-chart surface). These are real effects, and they are part of why visible measurement is a legitimate design tool.
The honest caveat is the same as in clinical trials: novelty decays, the early lift attenuates, and the long-run effect is usually smaller than the launch-week metric suggests. Designers who build product roadmaps around six-week pilot data are routinely shipping disappointment.
The Elephant in the Room
The Hawthorne Effect is in a strange historical position. It is one of the most-cited findings in industrial-organizational psychology, the canonical example in nearly every research-methods textbook of why field studies need attention controls, and the term gets dropped into casual product conversations as if it were a settled physical law. And yet — and this is the elephant — the empirical foundation under the headline effect is, by modern standards, weak; the original studies do not cleanly establish the effect they are credited with; the modern reanalyses suggest the headline number was an artifact; and even the surviving evidence in clinical trials produces effect sizes that are small and inconsistent.
I think the field has not retired the term for two reasons that are both worth naming.
First, the cartoon Hawthorne Effect is a useful pedagogical fiction. It teaches a real lesson — that observation is never neutral inside human systems — even if the original studies do not cleanly establish the magnitude of that lesson. As a heuristic for “remember to control for the act of measuring,” it is hard to beat. It is much easier to tell a designer or a researcher “watch out for the Hawthorne Effect” than to lecture them on the four sub-mechanisms and their respective effect sizes.
Second, the term has become a portable label for a real cluster of phenomena even if the original referent is shaky. The cluster includes novelty, demand characteristics, evaluation apprehension, and observation effects per se, and that cluster is worth having a name for. Telling a designer “you might be seeing demand characteristics combined with novelty effects” is technically more accurate than “you might be seeing the Hawthorne Effect,” but the second is what the conversation already speaks, and language is sticky.
The honest position for a behavioral designer is to use the term as a flag for the cluster, not as a citation of a specific empirical finding. When someone says “we got a 40% lift in week one,” the right response is not “ah, the Hawthorne Effect” but “let’s separate novelty, attention from leadership, recruitment self-selection, and the actual feature effect, and run the pilot for long enough to see which ones are still active in week six.” The Hawthorne flag is what tells you to run that decomposition. The decomposition itself is the actual work.
How to Apply the Hawthorne Effect with the Octalysis Framework
Applying the surviving signal from the Hawthorne corpus to Octalysis design is exactly as simple as it is uncomfortable: you have to accept that telemetry is a Core Drive lever you are pulling whether you wanted to or not, and that the lever is amplifying or attenuating depending on the social context you wrap around it.

The primary Core Drive recruitment
The strongest signal in the modern, post-reanalysis Hawthorne literature lives on Core Drive 5 (Social Influence & Relatedness). When users perceive that another human is paying attention to a measurement, the social-attention channel activates and produces a fraction of the productivity lift the legend over-claims. The design implication is that the most efficient observation interventions are the ones that visibly attach a person — a coach, a manager, a mentor, a teammate — to the measurement, rather than presenting the metric as a disembodied dashboard. Mentorship (#61), Social Treasure (#63), and Group Quest (#22) are the Game Techniques that most cleanly amplify the surviving Hawthorne signal because each one explicitly attaches social presence to the measurement frame.
The Core Drive 2 amplification
Observation amplifies Core Drive 2 (Development & Accomplishment) only when the measurement is paired with progress feedback the user reads as informative rather than evaluative. The Relay Assembly Test Room raised output partly because the workers were given continuous, friendly feedback about their performance and were treated as collaborators in the experiment. The Bank Wiring Observation Room did not raise output because the observation was framed as supervisor evaluation. The design lever is the framing: a leaderboard with a coaching narrative attached lifts CD2; the same leaderboard presented as a ranking judgment activates CD8 instead and produces gaming, sandbagging, and rate-busting norms.
The Black-Hat slip into Core Drive 8
Every observation surface is one bad framing decision away from sliding into Core Drive 8 (Loss & Avoidance) territory. When measurement is read as surveillance, the dominant subjective experience is anticipated loss — the fear that a metric will go down, that the manager will notice, that the team will judge. The neural signature lines up with social-evaluation threat. The behavioral signature is the Bank Wiring rate-bust: workers will optimize for the hidden goal of “not getting in trouble” rather than the visible goal of “doing the work well.” This is the most common failure mode in workplace gamification rollouts, and the cure is rarely a feature change. It is almost always a supervision-style change — which is, of course, the exact lesson Mayo and Roethlisberger drew from the original studies, even if the magnitudes they claimed for it have not survived modern scrutiny.
The deliberate suppression in the change surface
One thing observation should not recruit, if the design wants long-run engagement, is the Core Drive 6 (Scarcity & Impatience) urgency channel. Time pressure layered onto an observation surface is a reliable Black-Hat compound: it produces short-term compliance and long-term reactance. The design pattern is to keep the urgency triggers off the measurement frame and on separate, voluntary surfaces — Countdown Timer #65 and Status Points #1 belong on opt-in challenge content, not on the user’s primary self-observation dashboard.
Recommended Game Techniques for the Hawthorne lever
The Game Technique inventory inside Octalysis includes several mechanics that ride the surviving Hawthorne signal cleanly when paired with social context, and several that recruit it badly when used alone. The cleanest amplifiers are Mentorship (#61), Social Treasure (#63), Friending, and Group Quest (#22) — each attaches social presence to the measurement frame. The riskiest, when used without social warmth, are Leaderboards (#3) and Status Points (#1) presented as evaluative rankings rather than collaborative progression. Glowing Choice (#28) and Step-by-Step Tutorial (#6) are the safest defaults for early-stage users because they make the observation visible to the user about themselves rather than to a third party, which dampens the evaluation-apprehension channel.
Practical Steps to Apply the Hawthorne Effect
If you are a designer trying to actually do something with the surviving signal in the Hawthorne corpus, the following sequence is the one I recommend. None of these steps are exotic. The discipline is in actually doing them rather than waving at them.
First, when you launch a measured feature, instrument both a primary metric and a “novelty decay” metric. The novelty decay metric is something orthogonal to the feature — usage of an unrelated section of the product, time on a different surface — that you would expect to also be affected by general engagement uplift. If both metrics rise together in week one and the decay metric falls back to baseline by week six, you have caught the novelty component. The component of your primary metric that is still elevated in week six is closer to the actual feature effect.
Second, build at least one social-warmth touchpoint into any observation-rich surface before you launch it, not after. The Hawthorne corpus is not subtle on this point: observation that is paired with friendly supervision raises performance and observation that is paired with distant evaluation suppresses it. If you cannot afford a real coaching layer, automated coaching copy that frames the metric as “your progress, here is what to try next” instead of “your ranking, here is who is beating you” gets you most of the way there at much lower operational cost.
Third, separate evaluation from observation in the surface itself. The simplest move is to have the primary self-observation surface be visible only to the user and their explicit collaborators (coach, mentor, team), with the cross-team or cross-user comparison surface as an opt-in second view. This preserves the CD2 lift from observation while suppressing the CD8 sliding into surveillance-as-threat. Strava’s per-activity visibility setting (Everyone, Followers, or Only You) is the canonical consumer-product version of this pattern. B2B SaaS products can do the same by shipping a “your dashboard” view first and a “team dashboard” view second.
Fourth, run any pilot of an observation-rich feature for at least eight weeks before drawing engagement conclusions. Novelty fades on its own schedule, and there is no published number you can trust for your product. Eight weeks is my rule of thumb, not a finding. Any conclusion drawn from the first six weeks of post-launch data will overstate the long-run effect by some non-trivial amount, and the magnitude of that overstatement is exactly the Hawthorne flag the corpus is good for.
Fifth, decompose the effect when you can. If you have engineering resources, an attention-control arm — a group that receives equivalent measurement frequency and contact intensity but not the actual feature — is the gold-standard way to separate Hawthorne-adjacent observation lift from feature lift. Most product teams cannot afford this, and the reasonable substitute is a phased-rollout design where the late-rollout cohort serves as a quasi-control for the early cohort during the first few weeks. The decomposition is not perfect but it is far better than the standard “before vs after” comparison most product post-mortems run.
Sixth, write down what you would predict the metric to do under each of the four sub-mechanisms (novelty, demand, evaluation apprehension, observation per se) before you see the data. The exercise is uncomfortable because most product teams have only one mechanism they are willing to defend in public, and forcing the four-way decomposition pre-launch reveals which ones the team has been quietly assuming are not in play. This is the most useful Hawthorne-related design exercise I know. Try it once and the conversation about “the data” changes shape permanently.
Closing Thoughts
The Hawthorne Effect, as the textbooks have it, is mostly a fairy tale about five women in a relay assembly room who taught us that human attention is a productivity multiplier. The actual studies are more interesting than the fairy tale, the modern reanalyses are still more interesting than the original studies, and the surviving effect is smaller, narrower, and more conditional than the legend ever was. None of which makes the underlying lesson less useful for a behavioral designer. It makes the lesson more precise.
The lesson, stripped to its working form: every measurement you put inside a human system is a Core Drive lever you are pulling. The lever’s gain depends on whether you wrapped social warmth around it (CD5 amplification, CD2 lift) or left it exposed as an evaluation surface (CD8 slide, rate-busting, gaming). The lever’s direction depends on whether your supervision regime treats the measurement as supportive attention or as surveillance. The lever’s decay curve depends on whether the underlying experience is novel, observed, demand-cued, or actually intrinsically motivating, and these decay at different rates that are worth distinguishing.
None of this is exotic to behavioral designers. All of it is routinely waved at and rarely actually decomposed. The single most valuable thing you can do with the Hawthorne corpus is treat it as a permanent reminder to do the decomposition. Write down the four sub-mechanisms before you launch. Build the social warmth in before the dashboard ships. Run the pilot long enough that the novelty decay has worked through. Look at week eight, not week one.
And whenever a teammate says “the Hawthorne Effect” with the certainty of someone quoting a physical law, gently remind them that five women in 1927 are doing more work in that sentence than five women in 1927 should reasonably be asked to do. Then run the four-way decomposition together. The resulting design rationale will be better than whatever the room was about to produce.
Frequently Asked Questions
Is the Hawthorne Effect real?
The textbook version — that being observed produces large productivity gains — does not survive modern reanalysis. The Levitt and List 2011 analysis of the original illumination data found the famous patterns were a Monday artifact, with only weak hints of a real effect. What survives empirically is a cluster of effects (novelty, demand characteristics, evaluation apprehension, observation per se) that reviews confirm exist but cannot size with confidence. So: a real cluster of phenomena exists, but the term as commonly used overstates them.
Who actually coined the term “Hawthorne Effect”?
John R. P. French. He first used the term in 1950 and popularized it in a 1953 chapter on field experiments. Henry A. Landsberger’s 1958 book Hawthorne Revisited often gets the credit, but the phrase does not appear in it. Neither Mayo, Roethlisberger, nor Dickson — the original investigators — used the phrase in their own reports. The label was applied retrospectively, which is part of why it has been used so loosely ever since.
What is the difference between the Hawthorne Effect and demand characteristics?
Demand characteristics, identified by Martin Orne in 1962, refer specifically to subjects’ inferences about what an experimenter wants and their attempts to deliver it. The Hawthorne Effect, in its modern surviving form, is largely a special case of demand characteristics where the inferred demand is “perform well because someone is measuring.” Orne’s framing is more precise and has the advantage of pointing to a clear intervention (alter what subjects infer about the purpose).
Did the original Hawthorne illumination studies prove anything?
They proved that productivity in a measured factory setting did not behave the way the National Research Council’s commissioning hypothesis predicted. They did not cleanly demonstrate an “experimenter attention” effect — Levitt and List’s analysis found the recorded patterns track day-of-week cycles more reliably than they track illumination changes. The studies are best understood as historically important inspiration for the human-relations movement, not as empirical proof of a specific effect.
How big is the Hawthorne Effect in clinical trials?
Nobody can say with confidence. McCambridge, Witton and Elbourne’s 2014 systematic review found 19 studies, 12 of which reported at least some significant evidence of an effect, with a pooled odds ratio of 1.17 across the 14 studies with binary outcomes. Their conclusion was that participation effects exist but that little can be securely known about their magnitudes. A 2022 primary-care meta-analysis by Berkhout and colleagues found a pooled odds ratio of 1.41 that lost significance in well-designed studies. The 2017 Paradis & Sutkin review recommended the phrase “participant reactivity” instead.
Does the Hawthorne Effect happen on digital products?
Yes — observation, novelty, and demand-characteristic effects all run on measured product surfaces. The best evidence is on self-monitoring: Harkin and colleagues’ 2016 meta-analysis of 138 studies found that monitoring progress promotes goal attainment (d+ = 0.40), more so when progress is made public. Strava’s pace charts and the spending charts Mint popularized (carried on by Monarch Money and Rocket Money after Intuit shut Mint down in March 2024) run on that mechanism, alongside the typical week-one launch lift on any dashboard feature. The honest framing is that these effects are real but usually smaller than the launch-week data suggests, fade as novelty wears off, and are partly distinguishable from the actual feature effect with phased-rollout or attention-control designs.
How do you control for the Hawthorne Effect in product research?
The cleanest method is an attention-control arm — a comparison group that receives equivalent measurement frequency and contact but not the feature. Most product teams cannot afford this. The reasonable substitute is a phased-rollout design where the late-rollout cohort acts as a quasi-control for the early cohort, plus an explicit novelty-decay metric (something orthogonal to the feature you would expect to be lifted by general engagement) that you can watch fall back to baseline. Run pilots for at least eight weeks (my rule of thumb) so the novelty has had time to wear off.
Is “Hawthorne Effect” a real thing or just a buzzword?
It is closer to a useful umbrella term for a real cluster of phenomena than to a single empirical finding. The cluster — novelty, demand characteristics, evaluation apprehension, observation effects — is real and well-documented. The single-construct version of the Hawthorne Effect, as cited in management textbooks, is largely a pedagogical fiction whose original empirical foundation has been substantially undermined by modern reanalysis. Treat the term as a flag that prompts decomposition, not as a citation of a specific magnitude.
How does the Hawthorne Effect relate to the Pygmalion Effect?
The two are inverse-direction siblings. Hawthorne is “subject knows they’re being observed and adjusts their behavior.” Pygmalion (Rosenthal & Jacobson, 1968) is “observer holds an expectation that, through subtle behavioral cues, shapes the subject’s behavior.” Both run through social attention between observer and observed. They combine in classroom and workplace settings — teacher-expectation studies recruit both — which is one reason field studies often find effects larger than either mechanism alone would predict.
What should designers actually take from the Hawthorne studies?
Three things. First, every measurement surface inside a human system is a Core Drive lever, so design the observation surface deliberately rather than treating it as neutral. Second, observation paired with social warmth amplifies the surviving signal (CD5 + CD2 lift); observation paired with distant evaluation suppresses it (CD8 slide, rate-busting). Third, decompose every launch lift into novelty, observation, and feature components — the Levitt-List reanalysis is the cautionary tale for what happens when you don’t.
References
- Roethlisberger, F. J., & Dickson, W. J. (1939). Management and the Worker: An Account of a Research Program Conducted by the Western Electric Company, Hawthorne Works, Chicago. Cambridge, MA: Harvard University Press.
- Mayo, E. (1933). The Human Problems of an Industrial Civilization. New York: Macmillan.
- French, J. R. P. (1953). Experiments in field settings. In L. Festinger & D. Katz (Eds.), Research Methods in the Behavioral Sciences (pp. 98–135). New York: Holt.
- Landsberger, H. A. (1958). Hawthorne Revisited: Management and the Worker, Its Critics, and Developments in Human Relations in Industry. Ithaca, NY: Cornell University Press.
- Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783.
- Rosenberg, M. J. (1965). When dissonance fails: On eliminating evaluation apprehension from attitude measurement. Journal of Personality and Social Psychology, 1(1), 28–42.
- Parsons, H. M. (1974). What happened at Hawthorne? Science, 183(4128), 922–932.
- Bramel, D., & Friend, R. (1981). Hawthorne, the myth of the docile worker, and class bias in psychology. American Psychologist, 36(8), 867–878.
- Jones, S. R. G. (1992). Was there a Hawthorne effect? American Journal of Sociology, 98(3), 451–468.
- McCarney, R., Warner, J., Iliffe, S., van Haselen, R., Griffin, M., & Fisher, P. (2007). The Hawthorne Effect: A randomised, controlled trial. BMC Medical Research Methodology, 7, 30.
- Levitt, S. D., & List, J. A. (2011). Was there really a Hawthorne effect at the Hawthorne plant? An analysis of the original illumination experiments. American Economic Journal: Applied Economics, 3(1), 224–238.
- Paradis, E., & Sutkin, G. (2017). Beyond a good story: From Hawthorne Effect to reactivity in health professions education research. Medical Education, 51(1), 31–39.
- Frith, C. D., & Frith, U. (2006). The neural basis of mentalizing. Neuron, 50(4), 531–534.
- Zajonc, R. B. (1965). Social facilitation. Science, 149(3681), 269–274.
- Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the Classroom: Teacher Expectation and Pupils’ Intellectual Development. New York: Holt, Rinehart & Winston.
- Adair, J. G. (1984). The Hawthorne effect: A reconsideration of the methodological artifact. Journal of Applied Psychology, 69(2), 334–345.
- Franke, R. H., & Kaul, J. D. (1978). The Hawthorne experiments: First statistical interpretation. American Sociological Review, 43(5), 623–643.
- McCambridge, J., Witton, J., & Elbourne, D. R. (2014). Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. Journal of Clinical Epidemiology, 67(3), 267–277. doi:10.1016/j.jclinepi.2013.08.015
- Berkhout, C., Berbra, O., Favre, J., Collins, C., Calafiore, M., Peremans, L., & Van Royen, P. (2022). Defining and evaluating the Hawthorne effect in primary care, a systematic review and meta-analysis. Frontiers in Medicine, 9, 1033486. doi:10.3389/fmed.2022.1033486
- Srigley, J. A., Furness, C. D., Baker, G. R., & Gardam, M. (2014). Quantification of the Hawthorne effect in hand hygiene compliance monitoring using an electronic monitoring system: A retrospective cohort study. BMJ Quality & Safety, 23(12), 974–980. doi:10.1136/bmjqs-2014-003080
- Purssell, E., Drey, N., Chudleigh, J., Creedon, S., & Gould, D. J. (2020). The Hawthorne effect on adherence to hand hygiene in patient care: A systematic review. Journal of Hospital Infection, 106(2), 311–317. doi:10.1016/j.jhin.2020.07.028
- Izuma, K., Saito, D. N., & Sadato, N. (2010). The roles of the medial prefrontal cortex and striatum in reputation processing. Social Neuroscience, 5(2), 133–147.
- Somerville, L. H., Jones, R. M., Ruberry, E. J., Dyke, J. P., Glover, G., & Casey, B. J. (2013). The medial prefrontal cortex and the emergence of self-conscious emotion in adolescence. Psychological Science, 24(8), 1554–1562.
- Müller-Pinzler, L., Gazzola, V., Keysers, C., Sommer, J., Jansen, A., Frässle, S., Einhäuser, W., Paulus, F. M., & Krach, S. (2015). Neural pathways of embarrassment and their modulation by social anxiety. NeuroImage, 119, 252–261.
- Bunzeck, N., & Düzel, E. (2006). Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron, 51(3), 369–379.
- Dickerson, S. S., & Kemeny, M. E. (2004). Acute stressors and cortisol responses: A theoretical integration and synthesis of laboratory research. Psychological Bulletin, 130(3), 355–391.
- Lepper, M. R., & Greene, D. (1975). Turning play into work: Effects of adult surveillance and extrinsic rewards on children’s intrinsic motivation. Journal of Personality and Social Psychology, 31(3), 479–486. doi:10.1037/h0076484
- Enzle, M. E., & Anderson, S. C. (1993). Surveillant intentions and intrinsic motivation. Journal of Personality and Social Psychology, 64(2), 257–266. doi:10.1037/0022-3514.64.2.257
- Harkin, B., Webb, T. L., Chang, B. P. I., Prestwich, A., Conner, M., Kellar, I., Benn, Y., & Sheeran, P. (2016). Does monitoring goal progress promote goal attainment? A meta-analysis of the experimental evidence. Psychological Bulletin, 142(2), 198–229.
Related Reading
- The Complete Octalysis Framework — the master reference for the eight Core Drives the Hawthorne signal sits inside.
- Cognitive Dissonance — Festinger’s contemporary in the social-psychology tradition; the CD4 ownership companion piece to Hawthorne’s CD5 observation channel.
- The Asch Conformity Experiment — the classical-experiments sibling that pins down the normative-pressure mechanism Bank Wiring Observation Room workers were running on each other.
- Social Cognitive Theory — Bandura’s account of observational learning, the other half of the “what observation does to humans” story.
- Groupthink — the mid-century sequel to Bank Wiring’s group-norms finding; what happens when the cohesion that protects a group also suppresses dissent.
- The Behavioral Framework Library — the master index of every framework in this series.


