Number of institutions per country—the total number of institutions sampled relative to the number of institutions listed per country in WUR
Country . | # of institutions in WUR (2020) . | # of institutions in sample . | % of sampled institutions . | # of policies analyzed . |
---|---|---|---|---|
Austria | 11 | 6 | 54.5 | 13 |
Brazil | 46 | 12 | 26.1 | 15 |
Germany | 48 | 12 | 25.0 | 13 |
India | 56 | 12 | 21.4 | 12 |
Portugal | 13 | 6 | 46.2 | 7 |
UK | 100 | 24 | 24.0 | 47 |
USA | 172 | 35 | 20.3 | 36 |
Total | 446 | 107 | 24.0 | 143 |
Country . | # of institutions in WUR (2020) . | # of institutions in sample . | % of sampled institutions . | # of policies analyzed . |
---|---|---|---|---|
Austria | 11 | 6 | 54.5 | 13 |
Brazil | 46 | 12 | 26.1 | 15 |
Germany | 48 | 12 | 25.0 | 13 |
India | 56 | 12 | 21.4 | 12 |
Portugal | 13 | 6 | 46.2 | 7 |
UK | 100 | 24 | 24.0 | 47 |
USA | 172 | 35 | 20.3 | 36 |
Total | 446 | 107 | 24.0 | 143 |
Although selection of institutions based on university rankings is an often-used strategy (e.g., Rice et al. (2020) use the Leiden Ranking in a similar approach), it is not without flaws. First, university rankings have been criticized for their reliance on biased and unreliable reputational survey data (Waltman, Calero-Medina et al., 2012) and issues of gaming and selective reporting (Gadd, 2021). Second, rankings such as the WUR only include the most prominent institutions and leave out many institutions based on partly arbitrary criteria (e.g., how many yearly publications they need to be included). The reported groups of “high,” “medium,” and “low”-ranked universities are only relative to the set of institutions included in the ranking, and not academia as a whole. We see our use of the WUR as a pragmatic approach to reproducibly sampling universities. This does not negate their deficiencies for guiding prospective students to choose institutions or informing policy decisions.