Abstract
There is a growing expectation for academics to go public, that is, to actively engage with the media and supply policy advice for decision-makers. Data showing these interactions are scarce. By linking data from FRIS, BelgaPress, and Overton, this study reveals a first snapshot of academics’ media mentions and policy citations for all active academics from Dutch-speaking universities in Belgium. Exploratory analysis reveals distinct sector differences, with academics from Social sciences, Medical, and Health sciences being most visible. A small minority of mostly male academics featured very often in media as media figures, contrasted by much more discrete policy pillars whose publications were cited often but hardly featured in traditional media.
PEER REVIEW
1. INTRODUCTION
Scholars, research institutes and universities are now expected to create more than just scientific insights. Apart from producing and circulating knowledge, scientific actors must increasingly pursue societal impacts too. Requests like these express an ongoing need to disseminate scientific knowledge or make it more accessible (Joubert & Weingart, 2019). Simultaneously, there is an expectation of context-specific and feasible policy advice and practitioner recommendations wherever possible (Bandola-Gill, 2019; Boswell & Smith, 2017). Nowadays, the responsibility of the research sector extends beyond creating sound knowledge to also include its popularization and its application. The increase in the number of assessment instruments aiming to capture these extraacademic benefits of research—such as the United Kingdom’s Research Excellence Framework (REF), Excellence in Research Australia (ERA), and the Dutch Standard Evaluation Protocol (SEP)—demonstrates how past decades have witnessed institutionalizations of these formerly facultative demands (Kassab, 2019; Smit & Hessels, 2021). Regardless of whether the underlying idea is to legitimize or scrutinize public spending on research activities (Watermeyer & Chubb, 2018), growing numbers of academics must now consistently document and describe proofs of societal impact that their work generates (Kassab, 2019; Smit & Hessels, 2021). Obviously, this is never a neutral process of objectively showing beneficial effects. As most assessment instruments rely on self-reporting, impact is more often postulated than proved (Niederkrotenthaler, Dorner, & Maier, 2011; Watermeyer & Chubb, 2018). And while constructing impact cases is clearly a team effort, one exceptional scientist often spearheads the narrative (Dunlop, 2018). Hence, current systems encourage universities to prioritize stories of heroic scientists—usually male professors—transcending the confines of academia (Dunlop, 2018). Therefore, existing operationalizations of societal impact in research evaluation are often premised on individualistic conceptions of science’s extra-academic benefits.
Additionally, existing studies highlight assumptions about certain impact pathways’ efficacy that remain unsupported by empirical data. Periodical evaluations by national research administrations (e.g., REF and SEP—see Kassab, 2019; Smit & Hessels, 2021) and studies into academics’ perceptions of their extrascientific impact (e.g., Fecher & Hebing, 2021; Valinciute, 2020) testify to the scientific communities’ widespread conviction that the capacity to influence policymakers and governance actors relies on a sufficient degree of visibility in nonacademic media. That is to say, there appears to be an assumption that the ongoing expectation to publicly share research findings is not just commensurable with the demand to weigh on policy, but also deems popularization as a prerequisite for effectively translating science into governance. However, this is not to suggest that popularization would automatically result in successful translation. The idea that popular recognition is a condition for policy attention was already central to Rae Goodell’s (1977) conception of the visible scientists that emerged in the late 1970s. Nevertheless, the expectation to somehow influence policymakers is not the only reason scientists would lend their expertise to the public debate either, as there are intrinsic and institutional motivations for academics to seek interactions with journalists and other gatekeepers of popular attention (Dunwoody, Brossard, & Dudo, 2009). When academics engage with popular media, their motivations include enhancing public scientific knowledge (Miller, 2001), providing context and nuance to news stories (Weigold, 2001) or seeking recognition as an individual (Dunwoody et al., 2009). The idea of eventual policy impact has clearly become a key narrative in science communication and popularization in the context of societal impact evaluation in research governance.
Nevertheless, empirical evidence of this presumed relation continues to be lacking (Fahy, 2017). As Weingart (2022, p. 292) points out: “Hardly anything is known about the intended effects of this [media] attention on the decisions of policymakers and administrators in government bureaucracies except for the plausible assumption that attention is also the standard currency in the political arena.” To no small degree, this relates to the limited data available about scientists’ mark on nonscholarly media and policy documents. Indeed, studies have long surveyed academics about their interaction with journalists (Dunwoody et al., 2009; Fecher & Hebing, 2021; Valinciute, 2020), without being able to complement those reports with large-scale data on the actual presence of scientists in news media. However, advances in data collection and availability allow experiments with alternative indicators to explore science popularization and policy impacts, and their interlinkages. As traditional proxies for science performance are being evaluated, new objects outside science in the strict sense are being explored, from which the impact of science on society could appear (Bornmann, 2013). Such heterogenous couplings (Costas, de Rijcke, & Marres, 2021) document interactions between science and society, but require investigations to explore their characteristics, uses, and potential biases. The foregoing discussion raises prominent questions about how academics are mentioned in nonscholarly media and cited by policy. Approaching them as heterogenous couplings (Costas et al., 2021) can produce a first snapshot of the heterogeneity in the societal dissemination and institutional application of academic knowledge. This allows an exploration of academic profiles (e.g., seniority, discipline, and gender) present in media and policy documents, revealing potential interlinkages between them.
In the first place this requires a dependable overview of scientists. The case of Flanders is interesting because data on academics are freely available via the FRIS portal (https://www.researchportal.be/en). Additionally, it needs an extensive and navigable news media database. Here, the Belgian database BelgaPress (https://belga.press/) provides detailed data on the visibility of these academics in the media. Popular media exceed the written press of course, but we chose to focus on news media articles because it allows substantial amounts of data to be analyzed relatively easily. And since 2019, the Overton database offers the possibility to investigate which academics worldwide can be found in policy documents, including those found in FRIS. The aim in this paper is therefore to explore the characteristics of Flemish academics in media and policy documents. The extent to which academics do or do not appear in popular media has not been explicitly examined to date, including its reliance on sectors and disciplines, as well as the role of individual researchers’ characteristics. Moreover, it is far from certain that this form of visibility necessarily translates into policy impact.
2. METHODS
2.1. Data Collection
We scraped the regional open source data portal FRIS for all researchers active at one of five Dutch-speaking universities in Belgium in 2019, and logged their current (research group, departmental or faculty) affiliation(s), their starting year and total number of scientific publications (https://www.researchportal.be/en). Research-performing organizations must periodically transfer information from their CRIS systems to this regional database (Neyens & Vancauwenbergh, 2021), ensuring dependable data quality. To focus primarily on research profiles, academics working for administrative units were omitted. This produced a database of 30,226 individuals. Based on current affiliation, data were enriched with codes on sector and discipline, using the Flemish Research Discipline Standard (Vancauwenbergh & Poelmans, 2019) as a guideline. Next, data were gender-coded manually (reduced to female, male, undefined). Gender-neutral names were coded after individual validation. Finally, seniority levels were added manually, based on publicly available information on institutional websites or social media profiles.
For data on news media mentions, we used the online BelgaPress database. The Belgian news agency Belga collects all articles published in Belgian newspapers and magazines daily, and its database allows exact search functions over a selected time frame. As our data set consisted of Dutch-speaking academics in Belgium, we only selected newspapers and magazines published in Dutch. More details and methodological arguments for this approach, alongside partial results from a pilot study, have been reported elsewhere (Jonker, Vanlee, & Ysebaert, 2022). A strength of BelgaPress is its accurate search functions over a selected timeframe; a weakness is that specialized science magazines such as EOS or Wetenschap in Beeld are omitted. Data were gathered from January 1, 2019 to December 31, 2019, as 2020 and further years would likely be atypical due to the Covid-19 pandemic, which is beyond the scope of the present study. We queried all full names of researchers and noted the amount of written press attention for each individual, excluding namesakes and removing duplicates. We chose to exclude researchers who appeared in nonacademic capacities, such as those with a political mandate (n = 47), those in a full-time function of a nonacademic organization, institution, or company (n = 22), and a rest category of journalists, lawyers, athletes, or celebrities (n = 12). Rectors1 (n = 5) were also excluded because of their special mandate.
For data on policy document citations, we used the data portal Overton.io (https://www.overton.io/). A strength is its global, comprehensive coverage of policy documents in a broad sense, including (government) reports, clinical guidelines, legal documents, white papers, and parliamentary transcripts. Overton's main weakness is its tendency to disproportionately focus on relatively recent policy documents in English, primarily sourced from the United States, Canada, the United Kingdom, Japan, Germany, France, and Australia (Szomszor & Adie, 2022). Additionally, a substantial portion of the database consists of policy documents from international governmental organizations (IGOs) such as the World Health Organization (WHO), the United Nations Educational, Scientific and Cultural Organization (UNESCO), the World Bank, and the European Union (Szomszor & Adie, 2022).
In June 2021 we downloaded lists of all affiliated authors and their citations in worldwide policy-related documents for each Dutch-speaking university (and affiliated university hospital) in Belgium. We then deleted and merged duplicates, and removed wrong affiliations and namesakes. The documented citation delay in policy-related documents in Overton (Fang, Dudek et al., 2020; Szomszor & Adie, 2022) motivated our choice to compare a total number of policy citations in 2021 to media mentions in 2019, so as to leave sufficient time for accumulation of policy document citations to occur.
2.2. Descriptives
The data set used for this study had the following characteristics (see Table 1). Regarding media, 2,451 of 30,226 (8.1%) of active academics appeared once or more in the written press of 2019. Those academics who did appear in the media in 2019 did so with 5.6 (SD = 16.8) mentions on average. Compared to sector proportions at Flemish universities, academics from Social sciences (22.6% of university personnel vs. 31.5% in the media) and Humanities and the Arts (10.2% vs. 14.1%) were overrepresented in the written press of 2019, whereas academics working in Engineering and Technology (18.9% vs. 9.7%) and Natural sciences (14.5% vs. 10.3%) were underrepresented. Male academics (6.6 mentions (SD = 19.6)) appeared on average twice as often in the written press as their female colleagues (3.3 mentions, SD = 5.2). Almost two-thirds (66.5%) of academics mentioned in the media were professors or emeriti. Predocs received slightly more media attention than postdocs in absolute numbers, but slightly less on average (2.6 mentions, SD = 4.0 vs. 3.4 mentions, SD = 7.9). Almost half (47.5%) of academics mentioned in the media had produced 51 publications or more. More than half (57.6%) of academics mentioned in the media had 11 or more years of experience in the academic system.
Descriptive characteristics of active academics from FRIS, with sample mentioned in media (>0) and sample cited in policy (>0)
Variables . | NFRIS2019 . | nmedia . | npolicy . | |||||||
---|---|---|---|---|---|---|---|---|---|---|
N . | % . | n . | % . | M . | SD . | n . | % . | M . | SD . | |
Sectora | ||||||||||
NATU | 4,369 | 14.5 | 252 | 10.3 | 3.4 | 4.8 | 677 | 12.4 | 13.7 | 28.7 |
ENGI | 5,723 | 18.9 | 238 | 9.7 | 3.6 | 7.5 | 662 | 12.1 | 7.9 | 14.6 |
MEDI | 7,991 | 26.4 | 660 | 26.9 | 5.4 | 14.2 | 2,230 | 40.9 | 13.0 | 32.3 |
AGRI | 1,231 | 4.1 | 70 | 2.9 | 2.9 | 2.5 | 241 | 4.4 | 20.7 | 38.1 |
SOCI | 6,829 | 22.6 | 772 | 31.5 | 7.4 | 20.9 | 1,483 | 27.2 | 13.6 | 38.2 |
HUMA | 3,096 | 10.2 | 345 | 14.1 | 6.3 | 23.7 | 116 | 2.1 | 4.4 | 6.8 |
Other | 987 | 3.3 | 114 | 4.7 | 3.3 | 4.4 | 43 | 0.8 | 3.1 | 4.6 |
Academic age | ||||||||||
<1 | – | – | 37 | 1.5 | 2.6 | 4.2 | 34 | 0.6 | 3.2 | 3.7 |
1–5 | – | – | 446 | 18.2 | 2.8 | 4.4 | 795 | 17.6 | 3.9 | 6.3 |
6–10 | – | – | 558 | 22.8 | 3.4 | 5.1 | 1,282 | 23.5 | 6.5 | 12.2 |
11–20 | – | – | 830 | 33.9 | 6.0 | 17.0 | 2,209 | 40.5 | 13.5 | 29.8 |
21–50 | – | – | 575 | 23.5 | 9.6 | 26.7 | 1,122 | 20.6 | 24.4 | 52.1 |
51+ | – | – | 5 | 0.2 | 9.8 | 14.9 | 10 | 0.2 | 45.9 | 90.4 |
Gender | ||||||||||
Female | 12,404 | 41.0 | 729 | 29.7 | 3.3 | 5.2 | 2,040 | 37.4 | 8.7 | 19.4 |
Male | 16,415 | 54.3 | 1,722 | 70.3 | 6.6 | 19.6 | 3,412 | 62.6 | 15.1 | 37.4 |
Undefined | 1,406 | 4.7 | 0 | – | – | – | 0 | – | – | – |
Seniority | ||||||||||
Predocb | – | – | 474 | 19.3 | 2.6 | 4.0 | 821 | 15.1 | 3.2 | 5.1 |
Postdoc | – | – | 344 | 14.0 | 3.4 | 7.9 | 1,167 | 21.4 | 6.0 | 10.1 |
Professorc | – | – | 1,496 | 61.0 | 6.9 | 20.3 | 3,088 | 56.6 | 16.4 | 37.4 |
Emeritus | – | – | 134 | 5.5 | 7.8 | 15.6 | 354 | 6.5 | 25.4 | 50.7 |
Undefined | – | – | 3 | 0.1 | 2.7 | 2.1 | 22 | 0.4 | 4.9 | 6.8 |
Total publications (FRIS) | ||||||||||
0 | 9,532 | 31.5 | 110 | 4.5 | – | – | 0 | – | – | – |
1–5 | 7,798 | 25.8 | 253 | 10.3 | – | – | 390 | 7.2 | – | – |
6–10 | 2,927 | 9.7 | 168 | 6.9 | – | – | 403 | 7.4 | – | – |
11–20 | 2,759 | 9.1 | 263 | 10.7 | – | – | 651 | 11.9 | – | – |
21–50 | 3,277 | 10.8 | 493 | 20.1 | – | – | 1,330 | 24.4 | – | – |
51–100 | 1,969 | 6.5 | 486 | 19.8 | – | – | 1,173 | 21.5 | – | – |
100+ | 1,964 | 6.5 | 678 | 27.7 | – | – | 1,505 | 27.6 | – | – |
Total | ||||||||||
Total | 30,226 | 100 | 2,451 | 100 | 5.6 | 16.8 | 5,452 | 100 | 12.7 | 32.0 |
Variables . | NFRIS2019 . | nmedia . | npolicy . | |||||||
---|---|---|---|---|---|---|---|---|---|---|
N . | % . | n . | % . | M . | SD . | n . | % . | M . | SD . | |
Sectora | ||||||||||
NATU | 4,369 | 14.5 | 252 | 10.3 | 3.4 | 4.8 | 677 | 12.4 | 13.7 | 28.7 |
ENGI | 5,723 | 18.9 | 238 | 9.7 | 3.6 | 7.5 | 662 | 12.1 | 7.9 | 14.6 |
MEDI | 7,991 | 26.4 | 660 | 26.9 | 5.4 | 14.2 | 2,230 | 40.9 | 13.0 | 32.3 |
AGRI | 1,231 | 4.1 | 70 | 2.9 | 2.9 | 2.5 | 241 | 4.4 | 20.7 | 38.1 |
SOCI | 6,829 | 22.6 | 772 | 31.5 | 7.4 | 20.9 | 1,483 | 27.2 | 13.6 | 38.2 |
HUMA | 3,096 | 10.2 | 345 | 14.1 | 6.3 | 23.7 | 116 | 2.1 | 4.4 | 6.8 |
Other | 987 | 3.3 | 114 | 4.7 | 3.3 | 4.4 | 43 | 0.8 | 3.1 | 4.6 |
Academic age | ||||||||||
<1 | – | – | 37 | 1.5 | 2.6 | 4.2 | 34 | 0.6 | 3.2 | 3.7 |
1–5 | – | – | 446 | 18.2 | 2.8 | 4.4 | 795 | 17.6 | 3.9 | 6.3 |
6–10 | – | – | 558 | 22.8 | 3.4 | 5.1 | 1,282 | 23.5 | 6.5 | 12.2 |
11–20 | – | – | 830 | 33.9 | 6.0 | 17.0 | 2,209 | 40.5 | 13.5 | 29.8 |
21–50 | – | – | 575 | 23.5 | 9.6 | 26.7 | 1,122 | 20.6 | 24.4 | 52.1 |
51+ | – | – | 5 | 0.2 | 9.8 | 14.9 | 10 | 0.2 | 45.9 | 90.4 |
Gender | ||||||||||
Female | 12,404 | 41.0 | 729 | 29.7 | 3.3 | 5.2 | 2,040 | 37.4 | 8.7 | 19.4 |
Male | 16,415 | 54.3 | 1,722 | 70.3 | 6.6 | 19.6 | 3,412 | 62.6 | 15.1 | 37.4 |
Undefined | 1,406 | 4.7 | 0 | – | – | – | 0 | – | – | – |
Seniority | ||||||||||
Predocb | – | – | 474 | 19.3 | 2.6 | 4.0 | 821 | 15.1 | 3.2 | 5.1 |
Postdoc | – | – | 344 | 14.0 | 3.4 | 7.9 | 1,167 | 21.4 | 6.0 | 10.1 |
Professorc | – | – | 1,496 | 61.0 | 6.9 | 20.3 | 3,088 | 56.6 | 16.4 | 37.4 |
Emeritus | – | – | 134 | 5.5 | 7.8 | 15.6 | 354 | 6.5 | 25.4 | 50.7 |
Undefined | – | – | 3 | 0.1 | 2.7 | 2.1 | 22 | 0.4 | 4.9 | 6.8 |
Total publications (FRIS) | ||||||||||
0 | 9,532 | 31.5 | 110 | 4.5 | – | – | 0 | – | – | – |
1–5 | 7,798 | 25.8 | 253 | 10.3 | – | – | 390 | 7.2 | – | – |
6–10 | 2,927 | 9.7 | 168 | 6.9 | – | – | 403 | 7.4 | – | – |
11–20 | 2,759 | 9.1 | 263 | 10.7 | – | – | 651 | 11.9 | – | – |
21–50 | 3,277 | 10.8 | 493 | 20.1 | – | – | 1,330 | 24.4 | – | – |
51–100 | 1,969 | 6.5 | 486 | 19.8 | – | – | 1,173 | 21.5 | – | – |
100+ | 1,964 | 6.5 | 678 | 27.7 | – | – | 1,505 | 27.6 | – | – |
Total | ||||||||||
Total | 30,226 | 100 | 2,451 | 100 | 5.6 | 16.8 | 5,452 | 100 | 12.7 | 32.0 |
Natural sciences (NATU), Engineering and Technology (ENGI), Medical and Health sciences (MEDI), Agricultural and Veterinary sciences (AGRI), Social sciences (SOCI), Humanities and the Arts (HUMA); based on Vancauwenbergh and Poelmans (2019).
Includes medical doctors (MD).
Includes guest professors.
Regarding policy documents, 5,452 of 30,226 (18.0%) academics’ publications were cited at least once according to Overton, with 12.7 (SD = 32.0) citations on average. Compared to sector proportions at Flemish universities, academics from Medical and Health sciences (26.4% of university personnel vs. 40.9% in cited in policy) and Social sciences (22.6% vs. 27.2%) were overrepresented in policy documents. Academics from Engineering and Technology (18.9% vs. 12.1%) and Humanities and the Arts (10.2% vs. 2.1%) were underrepresented in policy documents. Publications of male academics (15.1 citations (SD = 37.4)) were cited on average almost twice as often in policy-related documents as publications of their female colleagues (8.7 citations, SD = 19.4). Almost two-thirds (63.1%) of academics cited in policy documents were professors or emeriti. As seniority increases to professorship, the proportion of academics cited in policy documents increases. Almost half (49.1%) of academics had produced 51 publications or more. Almost two-thirds (61.3%) of academics cited in policy documents had 11 or more years of experience in the academic system.
To find factors determining media visibility (n = 2,451) and cited research in policy documents (n = 5,452), two negative binomial regressions were run. We chose to work with these models even though both media and policy counts were characterized by major yet meaningful outliers, as incrementally removing the outliers would almost completely erode both variables. Both predictions were based on data on research sector, gender (0 = male; 1 = female), academic age, and total number of scientific publications, as provided by FRIS.
3. RESULTS
The first negative binomial regression for media (see Table 2) was found to be significant (likelihood ratio chi2 = 704.327(12), p < .001). For every extra scientific publication published, the probability of getting mentioned once a year in the media is 0.04% (p = .078). For every added year of experience in the academic system, the probability of getting mentioned once a year in the media is 0.3% (p < .001). Professors’ probability of being mentioned once a year in the written press is 71.7% (p < .001) with emeriti as a reference group, significantly more compared to postdocs (1.276 (p = .069)) and predocs (1.133 (p = .368)). For male academics, there is a predicted increase of 59.2% (p < .001) in yearly media mentions with female academics as a reference category. Compared to academics from HUMA, academics from other sectors appeared significantly less in the media, apart from academics from SOCI (1.103; p = .171).
Negative binomial regression model for media mentions (dependent), sectors, gender, experience, and publications (n = 2,451)
. | Exp(β) . | 95% CI . | |
---|---|---|---|
Lower . | Upper . | ||
Intercept | 1.724*** | 1.274 | 2.333 |
Sector | |||
Other | .710** | .557 | .907 |
NATU | .552*** | .459 | .666 |
ENGI | .506*** | .417 | .613 |
MEDI | .780** | .672 | .906 |
AGRI | .457*** | .336 | .621 |
SOCI | 1.103 | .959 | 1.270 |
HUMA | 1 | – | – |
Experience | |||
Academic age | 1.032*** | 1.026 | 1.038 |
Gender | |||
Male | 1.592*** | 1.436 | 1.766 |
Female | 1 | – | – |
Publications | |||
Total publications | 1.000 | 1.000 | 1.001 |
Seniority | |||
Predoc | 1.133 | .861 | 1.486 |
Postdoc | 1.276 | .966 | 1.659 |
Professor | 1.717*** | 1.376 | 2.127 |
Emeritus | 1 | – | – |
. | Exp(β) . | 95% CI . | |
---|---|---|---|
Lower . | Upper . | ||
Intercept | 1.724*** | 1.274 | 2.333 |
Sector | |||
Other | .710** | .557 | .907 |
NATU | .552*** | .459 | .666 |
ENGI | .506*** | .417 | .613 |
MEDI | .780** | .672 | .906 |
AGRI | .457*** | .336 | .621 |
SOCI | 1.103 | .959 | 1.270 |
HUMA | 1 | – | – |
Experience | |||
Academic age | 1.032*** | 1.026 | 1.038 |
Gender | |||
Male | 1.592*** | 1.436 | 1.766 |
Female | 1 | – | – |
Publications | |||
Total publications | 1.000 | 1.000 | 1.001 |
Seniority | |||
Predoc | 1.133 | .861 | 1.486 |
Postdoc | 1.276 | .966 | 1.659 |
Professor | 1.717*** | 1.376 | 2.127 |
Emeritus | 1 | – | – |
p < .05.
p < .01.
p < .001.
Deviance = 2,632.728. df = 2,435. AIC = 13,087.940.
The second negative binomial regression for policy (see Table 3) was found to be significant (likelihood ratio chi2 = 3,436.974(12), p < .001). For every extra scientific publication published, the probability of getting cited once in policy documents is 0.5% (p < .001). For every added year of experience in the academic system, the probability of getting cited once in policy documents is 3.1% (p < .001). Professors’ predicted policy citations are decreased with 7.0% (p = .242) with emeriti as a reference group, but more compared to postdocs (.716 (p < .001)) and predocs (.456 (p < .001)). For male academics, there is a predicted increase of 12.1% (p < .001) in policy citations compared to female academics. Compared to academics from HUMA, academics from other sectors were cited significantly more in policy documents, especially academics from AGRI (3.329; p < .001) and SOCI (3.332; p < .001).
Negative binomial regression model for policy citations (dependent), sectors, gender, experience, and publications (n = 5,452)
. | Exp(β) . | 95% CI . | |
---|---|---|---|
Lower . | Upper . | ||
Intercept | 1.866*** | 1.438 | 2.422 |
Sector | |||
Other | .895 | .600 | 1.335 |
NATU | 2.662*** | 2.132 | 3.323 |
ENGI | 1.414** | 1.130 | 1.769 |
MEDI | 2.378*** | 1.924 | 2.940 |
AGRI | 3.329*** | 2.604 | 4.257 |
SOCI | 3.332*** | 2.693 | 4.124 |
HUMA | 1 | – | – |
Experience | |||
Academic age | 1.031*** | 1.027 | 1.035 |
Gender | |||
Male | 1.121*** | 1.054 | 1.194 |
Female | 1 | – | – |
Publications | |||
Total publications | 1.005*** | 1.004 | 1.005 |
Seniority | |||
Predoc | .456*** | .391 | .533 |
Postdoc | .716*** | .621 | .826 |
Professor | .930 | .824 | 1.050 |
Emeritus | 1 | – | – |
. | Exp(β) . | 95% CI . | |
---|---|---|---|
Lower . | Upper . | ||
Intercept | 1.866*** | 1.438 | 2.422 |
Sector | |||
Other | .895 | .600 | 1.335 |
NATU | 2.662*** | 2.132 | 3.323 |
ENGI | 1.414** | 1.130 | 1.769 |
MEDI | 2.378*** | 1.924 | 2.940 |
AGRI | 3.329*** | 2.604 | 4.257 |
SOCI | 3.332*** | 2.693 | 4.124 |
HUMA | 1 | – | – |
Experience | |||
Academic age | 1.031*** | 1.027 | 1.035 |
Gender | |||
Male | 1.121*** | 1.054 | 1.194 |
Female | 1 | – | – |
Publications | |||
Total publications | 1.005*** | 1.004 | 1.005 |
Seniority | |||
Predoc | .456*** | .391 | .533 |
Postdoc | .716*** | .621 | .826 |
Professor | .930 | .824 | 1.050 |
Emeritus | 1 | – | – |
p < .05.
p < .01.
p < .001.
Deviance = 6,393.632. df = 5,416. AIC = 35,494.582.
The results show highly skewed distributions for both media mentions and policy citations (see Figure 1), with the outliers being predominantly male academics in SOCI and MEDI (and HUMA for media). Only a handful of male academics from SOCI and MEDI accomplished both high media mentions and policy citations. The data show that most academics either appeared more frequently in the media and were less cited in policy documents, or were cited more in policy documents and appeared less in the media.
Flemish academics’ media mentions and policy citations by academic sector (logarithmic scale), colored by gender. One dot stands for one academic visible in at least media or policy (n = 6,605). Dot size stands for total publications. Chart created with Flourish (https://flourish.studio/).
Flemish academics’ media mentions and policy citations by academic sector (logarithmic scale), colored by gender. One dot stands for one academic visible in at least media or policy (n = 6,605). Dot size stands for total publications. Chart created with Flourish (https://flourish.studio/).
The results also reveal that media mentions and policy citations vary by academic sector. This is clearly illustrated by academics from AGRI, who were frequently cited in policy documents but barely attracted media attention. Moreover, the policy citations model predicts a strong significant effect (3.320; p < .001) for academics active in this relatively small sector (4.1% in Flanders; Table 1). In contrast, HUMA academics were visible mainly in the media, but their publications were scarcely cited in policy documents. Academics active in ENGI and NATU sectors were present in media and policy, but to a much lesser extent compared to other sectors.
As visibility clearly varies by academic sector, Spearman’s correlations were calculated between total scientific publications, media mentions, and policy citations per sector (Table 4). Positive correlations between publications and policy citations seem significantly stronger compared to publications and media mentions (see Figure S2 in the Supplementary material). Academics who had published more saw their research being moderately more cited in policy documents, with the relatively strongest correlations for academics from MEDI (ρ = .548(2,412), p < .001) and AGRI (ρ = .561(257), p < .001). The relationship between publishing more and receiving popular media attention appears to be positive as well for academics in different sectors (see Figure S1 in the Supplementary material), but much weaker. The weaker and nonsignificant correlations for academics working in NATU (ρ = .087(781), p = .014), ENGI (ρ = .040(773), p = .269), and HUMA (ρ = .090(413), p = .067) show no overall tendency to either increase or decrease for the total amount of publications. Finally, the relationship between media mentions and policy citations is shown to be rather negative for most sectors. Hence, media mentions (policy citations) tend to decrease as policy citations (media mentions) rise.
Spearman’s correlations between publications, media mentions, and policy citations per sector
Sector . | ρ Publications media . | ρ Publications policy . | ρ Media policy . |
---|---|---|---|
NATU (n = 783) | .087 | .355*** | −.146*** |
ENGI (n = 775) | .040 | .432*** | −.212*** |
MEDI (n = 2,415) | .120*** | .548*** | −.057** |
AGRI (n = 259) | .190** | .561*** | .009 |
SOCI (n = 1,806) | .159*** | .405*** | −.180*** |
HUMA (n = 415) | .090 | .263*** | −.340*** |
Other (n = 152) | −.216** | .532*** | −.640*** |
Total (n = 6,605) | .042*** | .455*** | −.237*** |
Sector . | ρ Publications media . | ρ Publications policy . | ρ Media policy . |
---|---|---|---|
NATU (n = 783) | .087 | .355*** | −.146*** |
ENGI (n = 775) | .040 | .432*** | −.212*** |
MEDI (n = 2,415) | .120*** | .548*** | −.057** |
AGRI (n = 259) | .190** | .561*** | .009 |
SOCI (n = 1,806) | .159*** | .405*** | −.180*** |
HUMA (n = 415) | .090 | .263*** | −.340*** |
Other (n = 152) | −.216** | .532*** | −.640*** |
Total (n = 6,605) | .042*** | .455*** | −.237*** |
p < .05.
p < .01.
p < .001.
4. DISCUSSION
This study provides a first snapshot of academics’ media presence and policy impact in the case of Flemish academics, based on FRIS data. It is a first attempt to collect media mentions and policy citations for academics at the scale of universities. The question here is who appears in the written press, who gets cited in policy documents, and to what extent media attention leads to policy impact. Several factors at micro and macro level interact here that explain the variance in both proxies for visibility. This study points to the importance of the following results for discussion:
the limited presence of researchers in both proxies of visibility;
how both proxies are characterized by outliers with hardly any overlap;
the embeddedness of visibility in distinct sectors; and
the role of individual researchers.
4.1. Going Public: Breaking a Norm of Invisibility?
While there is a widespread emphasis on science communication to the public by universities, research institutes, and policymakers (Joubert & Weingart, 2019), the data presented in this study show that only a minority of researchers go public. Less than one-fifth (18.0%; cf. Table 1) of academics’ publications were cited in policy documents, and only a small minority (8.1%; cf. Table 1) of researchers appear in domestic written news media. As even fewer academics succeed in solidifying a habitual presence in newspaper reporting, the results of this study seemingly confirm previous observations regarding the preference given to heroic scientists (Cairney & Oliver, 2018; Dunlop, 2018); an excellent scientist + demonstrable impact = good PR for the institution, increasing the public understanding of science in the process. This study highlights not a widespread practice of visibility, but rather a widespread phenomenon of invisibility. At first glance, these results might suggest that the invisibility of many reinforces the heroism of a few—at the expense of the invisibility of many others—indicating winners and losers in the context of an attention economy (Franck, 1999). However, this assumes that everyone aims to gain visibility. An alternative explanation is that many scientists simply do not want to go public, and thus exclude themselves from this practice. Both explanations involve different considerations: If scientists go public, the whereabouts of the Matthew effect (Merton, 1968) come into question; and in a scenario where invisibility is common, the reason behind scientists not actively pursuing visibility becomes apparent.
Perhaps not every academic is eager to seek publicity with new findings and insights, regardless of the policy efforts to encourage them to do so. Indeed, popular science communication to a wide, lay audience deviates from an implicit norm in the scientific community, as Weingart (2022) argues. Communicating science in the narrow sense—where reporting to peers forms the bedrock of the system—differs from science communication in the broad sense, where scientists (should) address the public directly. In the first case, a degree of due process and peer review is involved, whereas this mechanism is skipped when science communication is practiced in the broader sense (Bucchi, 1996). Hence, not all scientists feel equipped to participate in this fundamentally different form of communication (Weingart, 2022). In a general sense, the results of this exploratory analysis give empirical credibility to the suggestion that hesitancy among scientists to seek publicity outside of the scholarly environment is more widespread than often assumed. This, in turn, negatively affects the considerable emphasis policymakers and research administrators have continued to place on science communication and popularization since the turn of the century (Miller, 2001). On an institutional level, the expansion of science’s publics is fueled by the logic of PR, where “the task is no longer to merely inform the public via press releases about new advances in research but to forge a brand of the university, to create an institutional identity through PR in order to convince policymakers of its unique value” (Weingart, 2022, p. 292). This medialization of science highlights a conflict, Weingart (2022) argues: Because of its paradoxical nature, a meticulous logic of organized skepticism to produce solid knowledge (truth) meets a more flashing logic of looks good (news) to gain trust of stakeholders (Gioia & Corley, 2002). The clash of media logic with scientific logic (see Grafström, Brechensbauer, and Jonsson (2022, pp. 4–5) for a detailed overview) is important to explain resistance or skepticism among researchers to engage with the media (Peters, 2012); this is illustrated in this study by a small minority of only 8.1% of active researchers who actively engage with the media, while a majority of 91.9% remain silent in the written press.
Regarding policy citations, the results show a higher prevalence compared to the written press; with almost one-fifth (18.0%) of researchers getting cited at least once in policy documents. With the relationship being quite weak between prominence in popular media and policy citations, it seems that gaining media visibility works under a distinct set of principles from achieving policy impact. When it comes to policy impact, citations to scientific publications are a passive and bibliometric pursuit. On the other hand, obtaining media attention necessitates a more active and deliberate approach towards engaging with journalists, and a willingness to answer ad hoc questions not necessarily related to one’s own expertise.
4.2. From Media Visibility to Policy Use: Media Stars or Policy Pillars?
The results from this study show that coupling high media prominence with high policy impact is very exceptional: Only a few academics (out of 30,226 active ones) were able to combine a relatively high media visibility with a relatively high number of publications cited by policymakers. One medical professor for instance, was appointed by the government as chairperson of scientific committees responsible for several disease outbreaks in the past. He gained public visibility due to his (controversial) opinion pieces and tweets on a wide variety of topics. Another case is a professor in the social sciences, who writes two-weekly columns about economic issues. A third case is a mediagenic professor in the social sciences with a specific communication talent of turning things that everyone already knows into refreshing new insights.
This study highlights that it is more common for researchers to distinguish themselves either in terms of their media presence or in terms of their policy recognition. On the media side, the results of this study point to the well-known figure of the public intellectual or celebrity scientist. Previous studies demonstrated that these are most likely older (Greenwood & Riordan, 2001) male academics (Fahy & Lewenstein, 2021) who often rank among a scientific elite (Boltanski & Maldidier, 1970; Dudo, 2013; Jensen, Rouquier et al., 2008; Peters, 2013). They have an accessible communication style (Goodell, 1977) and habitually comment on topics beyond their area of expertise in the strict sense (Bucchi & Trench, 2016). This can attract criticism from their peers (Fahy & Lewenstein, 2021), breaking a technocratic norm of “stick to what you know.” Of course, a highly visible scientist is not necessarily a celebrity (Bucchi, 2015). Some highly visible scientists (temporarily) rise to prominence because their expertise matches a hot topic, but do not choose to become celebrities. These should be distinguished from those who have a capacity to use (or exploit) media logic to draw media attention to themselves (van Krieken, 2018), engage in self-promotional activities on social media (Duffy & Pooley, 2017; Hall, 2014), blur their professional and private lives (Fahy & Lewenstein, 2021), and manage media attention for strategic purposes (Bucchi, 2015; Fahy & Lewenstein, 2021; Olesk, 2021; Peters, 2013). Closer investigation of these media stars in this study shows that these high media mentions were anchored in columns, where academics were given the space to produce opinions on a weekly basis on potentially any topic. Although it is noteworthy to mention that the results of this study do not point to public intellectuals active in NATU, ENGI, and AGRI, it would be misleading to assume that public intellectuals are restricted by disciplinary boundaries, as they by definition transcend these boundaries and are able to translate their expertise to potentially any topic (Jensen et al., 2008).
On the policy side, a much more discreet policy expert reveals itself. These policy pillars, mostly from MEDI, are highly cited in policy documents, with two economics professors—both in the top 5% of economists worldwide (RePEc, 2024)—forming distinct outliers. These academics may not leak intimate details about their private life into the press but influence policies behind the scenes. One of them, for example, founded a research institute on policy-oriented research and socioeconomic development of regions, while the other has been an advisor for many international institutions and governments. This is one possible explanation, though it remains unclear what strategies, practices, or policies have fostered closer links between these academics and policymaking. Concluding, researchers’ characteristics—especially regarding those who are featured in the media frequently—are important, but there are also other factors that determine the extent to which researchers receive or do not receive the attention of media and policy, not the least in sector and disciplinary differences.
4.3. Sector Differences: Some Sectors Offer Easier Pathways to Visibility
Although going public might not be embedded in the scientific community (Weingart, 2022), this study highlights how certain sectors offer easier pathways to visibility. More dominant sectors can be distinguished for more discrete disciplines here: While academics from SOCI, MEDI, and HUMA appear relatively more in the media, this appears to be much less clear for academics from AGRI and ENGI. In turn, academics’ publications from AGRI, SOCI, and MEDI are relatively more reflected in policy, while publications from HUMA are hardly cited in policy documents. An explanation may lie in the existence of distinct logics, where the science–media interface has different norms and rules than the science–policy interface. Researchers whose studies focus on certain themes that often appear in news cycles (like economics or politics) or are core competences of certain policy domains (such as agricultural sciences or medical sciences (Fang et al., 2020; Szomszor & Adie, 2022) are by definition more likely to gain visibility in one of the two domains. This illustrates that there is great variation in policy sensitivity across sectors and institutions (Li, Mao et al., 2022). Overlap is certainly possible but nevertheless seems rare. In addition, there are other elements that may or may not give certain individuals a structural advantage compared to other colleagues.
4.4. The Role of the Researcher: Who Are the Established Experts?
Apart from the disciplinary discrepancies that characterize media attention and policy citations, this study also highlights how individual characteristics can decide whether academics can step out of anonymity. Experience (seniority) plays a crucial role in this (Boltanski & Maldidier, 1970; Greenwood & Riordan, 2001; Jensen et al., 2008). The relatively low explanatory power of publications—especially in the case of media mentions—lies in the fact that this study compares all academics, more specifically across academic ages and experiences. Hence, the fact that only a minority of academics in Flanders are visible in media and policy is largely explained by the relatively large presence of academics who have barely published, as more than half (57.5% cf. Table 1) of academics in the data set have published five publications or fewer. At the very beginning of their career, academics will hardly have any output and will obviously be less visible to journalists and policymakers, while established experts are clearly favored in the media and are naturally more citable in policy documents, as there is more expertise to call on and more material to cite. As experience and expertise grows, an increase in publications will most probably have the strongest effect on visibility in the beginning of the career, while the effect flattens out at astronomical numbers of publications.
However, it is not those who have published the most in the academic system who emerge from this study as impact heroes (Dunlop, 2018). Publishing more scientific output has a slightly stronger effect on citation counts in policy documents (see Table 3) than getting media attention (Table 2). The link between publishing more and getting more cited in policy documents is evidently much more direct, while media interactions are likely explained by other factors, such as personality characteristics (Fahy, 2017; Goodell, 1977), time availability (Peters, 2008; Valinciute, 2020), willingness (Besley, O’Hara, & Dudo, 2019), and topicality, controversy, and successful interactions with journalists in the past (Bond & Hubner, 2022; Jensen et al., 2008). It is therefore not strange to assume that journalists are not that interested in the latest publication rather than the opinion of a seasoned academic with known expertise on current affairs topics.
Furthermore, the fact that fewer women were found in both media and policy documents and female public intellectuals are absent in these results could have several explanations. A recent study of German professors (Püttmann, Ruhose, & Thomsen, 2023) has highlighted how the risk of publicity is perceived to be higher for female academics, where (online) hostility may be more severe. Moreover, Püttmann et al. (2023) found a similar result for younger researchers. If women are younger than men in the same segment of their academic careers and are less present in certain academic sectors (most notably STEM) due to gender expectations, their share declines as academic hierarchy rises (cf. the leaky pipeline (Clark Blickenstaff, 2005)). As the media seem to favor well-known established experts and men are profiled as experts more frequently (Niemi & Pitkanen, 2017), structural factors then cause fewer female academics to be covered in the media. Here another a case of the Matthew effect (Bucchi, 2015) emerges, where the unknown (female) experts remain unknown with journalists, while already visible (male) experts become more popular with the wider public every year.
Regardless of gender, a junior effect can be noticed: With almost a fifth (19.0%; cf. Table 1) media coverage of junior researchers, they clearly stand out to journalists even though they have little experience. This raises questions about distinctive approaches in the supervision of research: Do supervisors function as a gatekeeper and opt to attend to queries by journalists themselves (as coordinator of the research) or pass it on to the junior researchers in question with the hands-on research expertise appropriate for the topic at hand.
These findings are also relevant in the context of research evaluation. At least part of the push away from traditional bibliometric indicators is driven by the need for a more holistic view of scientific excellence (Sivertsen & Meijer, 2020; Smit & Hessels, 2021), where science communication through mainstream media is habitually suggested as a proxy for societal impact (Fecher & Hebing, 2021; Kassab, 2019). If the growing belief that science should be open, public, and impactful is to be rewarded in some way, it raises the question of how to deal with these structural effects when certain subjects, disciplines, and sectors structurally offer easier pathways to visibility. If the promise of alternative indicators is increased inclusion in research evaluation, then simply counting media mentions and policy citations is not a desirable strategy, as this broadening of indicators will be biased and would paradoxically replicate existing inequalities in academia.
4.5. Limitations
This paper has several limitations. First, the information in FRIS depends on universities supplying their data in current research information systems (CRIS). This means that the list of active researchers in 2019 is likely not exhaustive. In 49 cases, no scientific publications were supplied, even though this was expected due to the existence of policy citations. These cases were queried in Web of Science to supply the total number of scientific publications. The question also arises as to what extent FRIS publications are consistent with large databases, such as Web of Science or Scopus. In 736 cases, the start date had to be corrected as it was earlier than expected. These cases were corrected with date of first publication.
Second, due to the relative high media concentration in Flanders (Hendrickx & Ranaivoson, 2021), some newspaper articles had the exact same content even though the newspaper was different. Because of the duopoly in the newspaper market in Flanders, content within the same press house is often recycled. Therefore, not every media mention is an equally substantial mention (Jonker et al., 2022); this means that high media profiles are likely to be slightly inflated. Additionally, 2019 was an election year, with increased demand for social science expertise.
Third, Overton states in its search engine that its underlying database OpenAlex is missing around 20% of author affiliations, especially for researchers that do not use persistent identifiers, and research before 2009 becomes harder to find. Another important implication of this is how Overton tends to index policy documents, and which documents it entails in terms of publication year, source type, and source region (see Szomszor and Adie (2022) for a detailed analysis of various aspects of the database). We used name matching to link FRIS academics to authors cited, where small errors cannot be avoided entirely. These factors mean that the proportion of Flemish academics cited in Overton is likely to be slightly higher. A more general limitation is that a policy document citing a publication is only one aspect of the broader concept of attention of policymakers for scientific studies. Lastly, further research can look at how policy documents cite (which) academic publications, as this might differ from academic citing behavior. Further research could also look at the content of media and policy documents.
ACKNOWLEDGMENTS
This paper is a substantially extended version of a conference paper submitted to the STI 2023 conference (Jonker & Vanlee, 2023). The authors thank Euan Adie for access to Overton and the helpful correspondence.
AUTHOR CONTRIBUTIONS
Hans Jonker: Conceptualization, Formal analysis, Investigation, Methodology, Visualization, Writing—original draft, Writing—review & editing. Florian Vanlee: Conceptualization, Supervision, Writing—original draft, Writing—review & editing.
COMPETING INTERESTS
The authors have no competing interests.
FUNDING INFORMATION
This research received no external funding.
DATA AVAILABILITY
Data from FRIS is open-sourced and can be found at https://www.researchportal.be/en. An anonymized and limited data set is available at https://zenodo.org/doi/10.5281/zenodo.10610197 (Jonker & Derom, 2024). BelgaPress (https://www.belga.press/) and Overton (https://www.overton.io/) are commercial databases that provided access to their platforms. The authors did not use unaggregated BelgaPress and Overton data. Enquiries about the raw unaggregated data should be directed to the owners of BelgaPress and Overton.
Note
Head of a university.
REFERENCES
Author notes
Handling Editor: Vincent Larivière