CHAPTER ONE
Gathering Evidence of Evidence
Aggregation as Second-Order Newswork
Itâs shortly after 8 a.m. when Samantha1 receives a story assignment from her editor at VidNews: a new British study has found that half of people in the UK will get cancer at some point in their lives. Or perhaps two-thirds. Samanthaâs editor, Luke, has found a BBC article on the study citing the one in two statistic and a web article by the British newspaper the Telegraph citing the figure as two out of three. He sends a message to Samantha on Googleâs Gchat messenger system noting the discrepancy and asking her to determine the cause: Is one of the organizations misreporting the number, or is there some other difference, like a geographical one?2
âinterestingggggggg,â types Samantha before pulling up the stories on her computer at a workspace she shares with other producers and editors in VidNewsâ small, sunlit newsroom, a converted radiology office. Sheâs in her early twenties, two years out of college, having come to VidNews from a stint at a local TV news station. Sheâs in TV-style on-camera makeup today, ready for the âanchorâ intros and standups sheâll record for several VidNews videos throughout the day. For this assignment, sheâll be required to write the script for a ninety-second video on the study with graphics and stock photos and video, then hand it off to a producer to create the graphics and stitch together the visual elements. In this case, Samantha will add the voiceover and on-camera read for her own video.
Samantha reads through both stories and finds generally the same informationâa description of the study, background information on cancer rates, quotes from an interview with one of the researchers. She probably needs the original study to adjudicate the factual dispute, so she searches for it on Google News. She finds an article on the tech site Mashable, which links to a press release by the research group that conducted the study. That press release links to a blog post by the group, which has a link to the study as well as a slick graphical explanatory video similar to the one sheâs been assigned to create. The reason for the high cancer rate, the video explains, is largely because people are living longer.
Samantha watches the video and quickly starts on her own script. Without having read the original study yet, she goes with âhalfâ as the number in her lead because the Telegraph used âmore than halfâ in addition to two out of three in its article, and Luke has suggested via Gchat that he thinks the discrepancy might simply be a rounding difference. Most of the other information she needs for her storyâthe reasons for the rise, the background on survival rateâcomes from the research groupâs press release and blog post. She breezes through a draft and adds links to the press release, the Telegraph article, the original study, and U.S. Social Security data she has used to refer to Americansâ life expectancy.
As she waits to see if VidNewsâ graphics editor will be able to create graphics for her video, she decides to finally wade into the study itself to check on the Telegraphâs two-thirds figure. She finds the number, 53.5 percent, and keeps âhalfâ in her lead. âI mean, itâs 53.5,â she says. âThatâs pretty much half.â This raises questions about why the Telegraph is using two-thirds and whether the story should now be that the Telegraph is misreporting cancer statistics. âI donât really just want to call out the Telegraph,â she says. Weâre both scouring the Telegraphâs article for the origin of its two-thirds claim when I find it: the 53.5 percent figure in the study is for people born in 1960, and the two-thirds number comes from an interview with the researcher, who estimates that two-thirds of children born today will get cancer. Samanthaâs concerns are immediately assuaged. She adds a quote from the Telegraphâs interview and moves on toward the editing process, where sheâll add background and links to Mayo Clinic and the World Health Organization based on Google searches for cancer survival rates and early detection.
Samantha produced a brief, explanatory report on an important new scientific study by comparing sources, evaluating them, and following a trail of evidence back to the original source to resolve differences between them. But many journalists wouldnât consider her work reportingâshe didnât contact anyone, she didnât do anything to check the veracity of the Telegraphâs quotes from the researcher, and her sources were largely the published reports of other journalists, as well as a press release. Much about her newsgathering process is quite similar to reporting, but those subtle differences are telling. The processes of aggregation and reportingâand the work that other aggregators do to find and validate information and present it as newsânot only shape the veracity and credibility of the information we receive as news consumers each day, but they also form very different foundations for journalismâs authority to present news as valid. For all their overlap in practices, aggregationâs shift to gathering news secondhand from othersâ reporting undermines aggregatorsâ authority, as well as their own confidence in the reliability of their accounts. It is in this respect that aggregationâs difference from reporting is pivotal in determining its value for journalism.
HOW REPORTING AND AGGREGATION TURN INFORMATION INTO âTHE NEWSâ
If aggregation has a competing form against which it is measured in the journalistic world, it is reporting. Aggregation and reporting are certainly not the only forms of work that go into producing news: thereâs also editing, design, and distribution. But aggregation and reporting are often set in opposition as the two primary means of gathering and organizing the information that becomes news reports. Scholars have described them as the two dominant forms of newswork in the digital age, and they have noted the shift from reporting as a means of newsgathering toward, as one researcher put it, âthe filtration, selection, and gatekeeping of already existing content.â3 Journalists are keen to set them against each other as well, often drawing a sharp boundary between aggregation and the work of creating original news, often valorized as âshoe-leather reporting,â âboots-on-the-ground reporting,â âoriginal reporting,â or simply âreal journalism.â4 In the discourse and mythology of professional journalism, reporting involves going to the scene of major events, knocking on doors, cornering public officials, unearthing hard-to-find documents, and uncovering scoops that drive public discussion and official action.5 In actuality, of course, reporting is often much less adventurous: getting a press release and making a couple of phone calls to flesh it out or making a quick call to an organizationâs spokesperson to confirm details of a competitorâs story.
Aggregation and reporting are tangled both in practice and in history. As we have seen in the introduction, aggregation predates reporting throughout U.S. and UK journalism history and has existed alongside it for more than a century through news organizationsâ digests of news and opinion and their interweaving of staff-written and wire copy. For decades reporters have done only minimal rewriting and information-gathering to produce their own reports from press releases or competitorsâ accounts.6 Even when reporting is at its most ambitious, it is a process of pulling together information from disparate sources, both published and unpublished, and compressing it into a summary for busy audiencesâwhich is essentially what aggregation does, too. And in todayâs digital news environment, many journalists are doing aggregation and reporting within the same job. Itâs important, then, not to conceive of aggregation and reporting as cleanly divided binaries. Still, there are important general distinctions between the two practices, which begin to emerge as we examine them as forms of journalistic knowledge production.
The fundamental difference is that aggregation is a step further removed from the evidence on which both practices rely. It is, as journalism scholar C. W. Anderson has described, second-order newsworkâa process of piecing together bits of firsthand (and secondhand) information that have been published already, often gathered by journalists through reportingâand repackaging them into new forms.7 This derivative, second-hand relationship to reporting colors virtually everything else about aggregation. At the narrowest level, it indelibly shapes aggregatorsâ techniques of gathering and verifying information. But more broadly, itâs a key to the fundamental dynamics examined in this book: because aggregation is a knockoff of reporting, it has difficulty serving as a foundation for journalistic authority the way that reporting can. The ripple effects are dramatic. The relative lack of journalistic authority makes it more difficult to build a sustained audience around aggregation. It makes aggregation less economically valuable to advertisers and subscribers than reported work.8 And it undermines many aggregatorsâ sense of their own value and identity as professionals, which in turn can erode their commitment to doing aggregation for long enough to make substantial improvements to their work. To understand the magnitude of this difference, though, it helps to start with reporting and aggregationâs shared epistemological roots.
The core commonality between reporting and aggregation is their orientation around gathering evidence to build claims of knowledge regarding news eventsâoften through what journalists conceive of as factsâand authoritatively presenting those claims to the public. This is a process that is fundamentally epistemologicalâthat is, itâs a process of producing and publicly justifying knowledge. Media scholar Mats Ekström distinguishes between philosophical epistemology (theories of the nature of knowledge and possibility of scientific truth) and sociological epistemology (the routines and procedures that determine how knowledge is produced, expressed, and justified).9 The latter is the main object Iâm concerned with here. Journalists are hardly philosophers (to say the least), but they do spend their days analyzing information in order to produce knowledge. They evaluate sources of evidence, weigh competing pieces of information, organize that information, and then present it to the public in ways that appear justified enough to be considered news facts. Thatâs epistemological workâthe work of knowledge production. Those knowledge-oriented routines and procedures are what provide us the news and determine whether itâs trustworthy.
Journalistsâ main claim to cultural authority is their ability to provide reliable information on current events. That claim rests on the publicâs acceptance that the information is factual and the means of its production validate that factuality.10 If journalismâs democratic function is to provide people with the information they need to effectively self-govern, then the epistemological questions of how that information is produced, and whether the public accepts those production methods as valid, are crucial to journalismâs democratic value as well.11 Public acceptance has withered in recent decades, as trust in the media has dropped to some of its lowest levels in numerous countries around the world.12 This mistrust has political roots, of course; itâs shot through with ideology and tribalism. But itâs also deeply epistemological. One 2016 poll of Americans found that one of the top two reasons they cited for losing trust in a news sourceârunning neck-and-neck with perceptions of biasâwas that they âfound facts that were wrong.â13 At a deeper level, the news media have faced increased skepticism of whether they can find facts at allâa shift in which âthe notion that journalists or anyone else can arrive at a truthful account of things or follow an objective method of verification has been eroded in the public mind,â as former journalists Bill Kovach and Tom Rosenstiel lamented in their 2007 classic, The Elements of Journalism.14 Journalismâs knowledge-producing practices, then, are particularly important and imperiled. Aggregationâs derivative nature provides a further challenge to the legitimacy of those practices, but aggregation also represents a possible avenue for those practices to adapt to the digital information age.
Modern American reportingâs knowledge-producing process starts with the belief that there is a reality âout thereâ that reporters should strive to depict, and that they can do so using a set of methods meant to gather information with minimal subjective interference.15 This approach to knowledge has much in common with science. Indeed, many journalists of the early 1900s, led by the political commentator Walter Lippmann, expressed an admiration for science and invoked scientific language as a rationale for their own reporting methods. Lippmann advocated a form of âobjectiveâ reporting based on scientific methods of evidence-gathering, and even through the 1960s, several strands of journalism, both mainstream and niche, explicitly emulated scienceâs techniques of knowledge production.16 In practice, of course, journalism does not engage in anything resembling a formal scientific method. Journalistsâ hypotheses take the form of hunches and common-sense assumptions rather than theoretically grounded propositions, and their evidence-gathering techniques are born much more out of organizational and time constraints than out of systematic attempts to measure reality. Journalists have long acknowledged these shortcomings: even Lippmann famously declared that ânews and truth are not the same thing, and must be clearly distinguished.â Objectivity was seen as an unattainable myth by many journalists as early as the 1930s and became a term of abuse within much of professional journalism by the 1960s.17 In practice, todayâs journalists tend to be circumspect about the extent to which they can claim to have captured the truth in news accounts and operate from a more pragmatic mindset that, in the words of Watergate reporting legend Carl Bernstein, strives for âthe best obtainable version of the truth.â18
One of the main constraints limiting reportersâ efforts to gather and validate reliable information is time. With the exception of extensive (and expensive) investigative reporting projects that constitute a very small portion of journalistic work, reporting takes place on extremely tight time schedules, typically on the scale of hours or days. These constraints mean that journalists donât have time to rigorously confirm all of the knowledge they produce, so theyâre forced to rely on âan established network of sources who deliver information that is assumed, a priori, to be justified,â as Mats Ekström has put it.19 When the mayor says that five city employees have been laid off to help resolve a $300,000 funding shortfall in the city public works department, reporters donât typically have the time to independently verify that the layoffs have occurred or to conduct their own audit of the cityâs books to confirm the shortfall amount; they simply present the information as factual and attribute it to the mayor. Instead of fully gathering and presenting the kind of direct and rigorous empirical evidence needed to support the factual claim, the reporter allows the mayorâs statement to stand alone as sufficient evidence. As the sociologist Mark Fishman wrote several decades ago, the mayorâs claim is bureaucratically verifiedâthe source is in a position to know, so sheâs assumed to know what she assertsâwhich means the claim doesnât have to be meticulously verified.20
This kind of evidence may not be rigorously verified, but the reporting process, such as it is, revolves around gathering it. At bottom, the evidence that reporters use to constitute their information and justify their knowledge claims comes down to three basic forms, which C. W. Anderson refers to as âthe holy trinity of news objectsâ: observation, interviews, and documents.21 Each object plays a complementary role in establishing the factuality of news reports, and together they form the raw material that constitutes the knowledge produced by reporting. Observation is often positioned at the top of reportersâ hierarchy of evidence, regarded as the most reliable and authentic. It is validated by the journalistâs physical proximity to the events she recounts, as well as her firsthand testimony without havi...