w10dq
https://doi.org/10.1177/17470161221125097
Research Ethics 2022, Vol. 18(4) 329–338
© The Author(s) 2022 Article reuse guidelines:
sagepub.com/journals-permissions DOI: 10.1177/17470161221125097
journals.sagepub.com/home/rea
Creative Commons Non Commercial CC BY-NC: This article is distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 License (https://creativecommons.org/licenses/by-nc/4.0/) which
permits non-commercial use, reproduction and distribution of the work without further permission provided the original work is attributed as specified on the SAGE and Open Access pages (https://us.sagepub.com/en-us/nam/open-access-at-sage).
Perceived publication pressure and research misconduct: should we be too bothered with a causal relationship?
Nicole Shu Ling Yeo-Teh National University of Singapore, Singapore
Bor Luen Tang National University Health System, National University of Singapore, Singapore
Abstract Publication pressure has been touted to promote questionable research practices (QRP) and scientific or research misconduct (RM). However, logically attractively as it is, there is no unequivocal evidence for this notion, and empirical studies have produced conflicting results. Other than difficulties in obtaining unbiased empirical data, a direct causal relationship between perceived publication pressure (PPP) and QRP/RM is inherently difficult to establish, because the former is a complex biopsychosocial construct that is variedly influenced by multiple personal and environmental factors. To effectively address QRP/RM by tackling the sources of PPP would also be difficult because of the competitive nature of the reward and merit system of contemporary science. We might do better with efforts in enhancing knowledge in research ethics and integrity among the practitioners, as well as institutional infrastructures and mechanisms to fairly and efficiently adjudicate cases of QRP/RM.
Corresponding authors: Nicole Shu Ling Yeo-Teh, Research Compliance and Integrity Office, National University of Singapore, Lee Kong Chian Wing, #05-02, 21 Lower Kent Ridge Road, Singapore 119077, Singapore. Email: dprysln@nus.edu.sg
Bor Luen Tang, Department of Biochemistry, Yong Loo Lin School of Medicine, National University Health System, National University of Singapore, 8 Medical Dr, Singapore 117596, Singapore. Email: bchtbl@nus.edu.sg
1125097 REA0010.1177/17470161221125097Research in EducationYeo-The and Tang research-article2022
Topic Piece
330 Research Ethics 18(4)
Keywords Publication pressure, research misconduct, questionable research practice, publications, research climate
Introduction Research output, measured in terms of publications, is typically a major and criti- cal component of performance assessment for scientists and researchers in the academia. Contemporary scientific research is inherently and declaratively com- petitive, both in general terms (such as grant funding), as well as from more per- sonal perspectives (such as gainful employment and tenure). The pragmatic mandate and obligation to publish well to ensure career advancement, reinforced by a “publish or perish” culture (Neill 2008; Van Dalen and Henkens 2012), con- stitutes a psychological stress that has been termed perceived publication pressure (PPP) (Haven et al. 2019), on scientists and researchers.
The reproducibility crisis in research (Baker 2016) and the continuous rise in retractions (Brainard and You 2018; Steen et al. 2013) are worrisome and under- mines the credibility of science and scientists. The above have been varyingly attributed (Brainard and You 2018; Fang et al. 2012; Wang et al. 2019) to acts of scientific or research misconduct (RM) (Gross 2016) and questionable research practices (QRP) (Andrade 2021). The prevalence of misbehavior in science has also been estimated (Fanelli 2009; Godecharle et al. 2018; Martinson et al. 2005), with a recent meta-analysis indicating a self-confessed commitment rate of 2.9% for RM and 12.5% for QRP, as well as astute awareness of commitment by others (15.5% for RM and 39.7% for QRP) (Xie et al. 2021).
Explanations for RM have indicated the involvement of both personal and sys- temic risk factors. In particular, a classical notion of RM being committed by flawed characters or errant individuals, or the “bad apples” notion, has been broad- ened to include systemic factors that are conducive for misconduct (Redman 2013; Sovacool 2008). The latter includes institutional factors such as a lack of clear scientific misconduct policies, research integrity training and/or peer/institutional oversight, as well as more general factors, such as unhealthy competition for resources, particularly research funding (Harvey 2020) and publication pressure (Gandevia 2018; Moreels 2018; Qiu 2010; Tijdink et al. 2016b).
That PPP could be a risk or predictive factor in QRP/RM is a popular and argu- ably logical notion (Haven et al. 2021; Johann 2022; Tijdink et al. 2013), but evi- dence obtained from empirical analyses with different strategies are conflicting (Fanelli et al. 2015, 2017, 2019; Gopalakrishna et al. 2022; Heuritsch 2021; Maggio et al. 2019; Paruzel-Czachura et al. 2021; Tijdink et al. 2014). In the para- graphs below, we briefly summarize these empirical findings and discuss why conclusions drawn from these would be persistently confounded by a lack of
Yeo-The and Tang 331
unbiased data and the complexity of PPP as a biopsychosocial construct. We posit that it would also be difficult to effectively tackle the sources of PPP, and that we would do better in attenuating QRP and RM by focusing on the other systemic factors.
Empirical assessments of a relationship between perceived publication pressure and scientific misconduct Many different empirical analyses have been reported in the past years on the cor- relation between PPP and QRP/RM. Tijdink and colleagues noted a strong asso- ciation between publication pressure and a composite scientific misconduct severity score based on self-reporting with a survey of Flemish biomedical scien- tists (Tijdink et al. 2014b). A cross-sectional survey of health researchers by Maggio and colleagues indicated that publication pressure is the strongest indi- vidual predictor of misconduct (Maggio et al. 2019). More recently, two studies by Paruzel-Czachura and colleagues on researchers, as well as those at the manage- ment level in a Polish university, showed a positive correlation between PPP and self-reported QRP/RM, as well as observed QRP/RM by those at the management level of the researchers (Paruzel-Czachura et al. 2021). A comprehensive survey of astronomers worldwide by Heuritsch found that perceived pressure to publish explains 10% of the variance in occurrence of misconduct (Heuritsch 2021). A large, nationwide survey of researchers in the Netherlands by Gopalakrishna and colleagues showed that publication pressure is associated with a higher engage- ment with QRPs (Gopalakrishna et al. 2022).
On the other hand, in performing comparative analyses of bibliographic and per- sonal information of authors of retracted papers between 2010 and 2011 with authors of “control” papers matched by journal and issue, Fanelli and colleagues found a contradiction to the hypothesis that pressure to publish drives misconduct. The authors noted that “. . .high-impact and productive researchers, and those working in countries in which pressures to publish are believed to be higher, are less-likely to produce retracted papers, and more likely to correct them” (Fanelli et al. 2015). In another report by Fanelli and colleagues on bias-related patterns and risk factors with a large random sample of meta-analyses taken from different dis- ciplines, they showed that highly published authors with many citations were not at greater risk of bias (Fanelli et al. 2017). Furthermore, conditional logistic regres- sion analysis of a set of variables from papers containing problematic image dupli- cations and those that do not (obtained from a previous screening of 8138 papers published in PLoS One in 2013–2014) also did not support pressure to publish as a hypothetical driver for misconduct (Fanelli et al. 2019). A more recent report by Fanelli and colleagues has also demonstrated the importance of a “country-level”
332 Research Ethics 18(4)
effect (Fanelli et al. 2022). The authors found that for some countries where publi- cations are rewarded with misaligned institutional incentives, such as cash rewards for papers published, the risk of problematic image duplication was indeed higher for more productive, more frequently cited, earlier-career researchers working in lower-ranking institutions. It is notable that the data analyzed by the authors who have reported a positive correlation between PPP and QRP/RM are fundamentally different from those used by Fanelli and colleagues. The former authors used mainly self-reported survey data, in that participants recorded their own role in QRP/RM and their own perceived intensity of publication pressure. In surveys like such, there is no running away from a preexisting bias, in that the participants’ responses are guided by how the survey is framed and worded by the investigators. Conceivably, those admitting to committing QRP/RM are also likely to be more intensely per- ceptive of publication pressure. On the other hand, analyses of Fanelli and col- leagues of publication data appear to be relatively free of such a bias. However, the conclusion of Fanelli and colleagues are based on an intrinsic assumption that authors with higher number of publications and who are more highly cited would have a higher PPP. This assumption may be an oversimplification and may not be valid. It is entirely conceivable that the better published authors, being better endowed in terms of capabilities and resources, may instead have a lower PPP. Conversely, authors with higher PPP might be those that have low or marginal number of publications and are thus struggling for survival in academia. In any case, the assumption has not been independently verified, and is thus also a poten- tial source of bias. The most recent report by Fanelli and colleagues also illustrated that PPP could indeed be made more complex by other individual risk factors such as perverted publication incentives, leading to a high incidence of QRP/RM.
It is not difficult to see why attempts to obtain unequivocal evidence for a causal link between PPP and QRP/RM may ultimately be futile because of the difficulty in getting unbiased data. More importantly, as discussed below, PPP is a complex and multivariate biopsychosocial construct that is variedly influenced by both per- sonal and systemic factors and might not be accurately gauged in surveys.
Perceived publication pressure as a complex psychological construct influenced by multiple individual and systemic factors Paruzel-Czachura and colleagues have defined PPP as a “Subjectively perceived psychological tension that is related to the requirement for a particular number of publications in a specified timeframe, which attests to one’s academic develop- ment, and is a condition of maintaining one’s position or even retaining one’s job”(Paruzel-Czachura et al. 2021). This subjective perception could nonetheless be qualitatively assessed by psychometric analysis methodologies. The Publication
Yeo-The and Tang 333
Pressure Questionnaire (PPQ) (Tijdink et al. 2014a) and the revised PPQr (Haven et al. 2019), with content and structural validity that provide sufficient psychologi- cal component coverage, represent such approaches. The use of the PPQ in a sur- vey of medical scientists did indicate a strong association between publication pressure and scientific misconduct (Tijdink et al. 2014b). However, other surveys that attempted to examine explanatory or risk factors for QRP/RM may not have questions constructed with the same psychometric strength and depth of the PPQ or PPQr.
The issue though, is whether even survey questions with sufficient psychomet- ric strength and depth could truly reflect PPP, particularly in a way that could relate, but not bias it toward a tendency for QRP/RM. Notably, there is no objec- tive measure for PPP, and responses to PPP are conceivably influenced by a mul- titude of personal and environmental factors. In the first instance, personality traits could be an important determinant of one’s response to a given level of PPP, or conversely a determinant of the intensity of one’s PPP. Conceivably, the same intensity of PPP may result in varying degrees of tendency to moral transgression in individuals with differing moral virtues. Machiavellianism (but not narcissism, psychopathy and self-esteem) has been shown to be positively associated with self-reported research misbehavior (Tijdink et al. 2016a). Given an otherwise sim- ilar research climate and PPP, an unscrupulous machiavellian may have a dispro- portionate tendency to moral transgression. It is also likely that individuals with different cultural backgrounds (Davis 2003) may act differently given the same level of PPP. PPP intensity may also differ for scientists at different stages of their careers, and the ability to handle a given degree of PPP would presumably increase with age and experience (or conversely, apathy toward moral stringency may grow with age).
Wikström’s situational action theory in criminology posits that crimes are com- mitted when people “. . .fail to act in accordance with their own personal morals (i.e., fail to exercise self-control) in circumstances when externally pressurized to act otherwise”, or “. . .find them viable and acceptable in the circumstance (and there is no relevant and strong enough deterrent). . .” (Wikström 2019). Analogously, it is not difficult to see that given the same PPP intensity, an indi- vidual with adequate training in responsible conduct of research, or one working in an environment where research integrity is prominently emphasized and that has in place efficient misconduct management infrastructure, might be less likely to err compared to another who is uninitiated and unguided. Likewise, researchers in a topic or field with heightened propensity for peer scrutiny or post-publication peer-review would be more careful with potential violations in terms of QRP/RM given the same intensity of PPP.
The above considerations suggest that there could be a good degree of decou- pling between self-reported PPP and how this may relate to tendencies to commit
334 Research Ethics 18(4)
acts of QRP/RM, and that multiple mechanisms exists whereby the former might not be empirically predictive of the latter.
Difficulties in effectively eliminating the sources of perceived publication pressure PPP in the academia could arise from multiple sources, most commonly those associated with employment opportunity, career advancement (such as promotion and tenure) and research funding. The credential of practitioners in science and research are too often judged by their publication track records in an over-simplis- tic manner using bibliometric measures, such as one’s papers in journals with high impact factors. In the latter regard, in many fields, it is often difficult to publish negative or null results in such journals, rendering the often sizeable amount of effort and resources moot (Aczel et al. 2018). This understandably could prove to be very frustrating for researchers. In many research grant proposal evaluations, there is a demand for and bias toward productive researchers with a good track record. Often, the necessary support for project feasibility would be nothing less than a number of published papers. Indeed, funding opportunities could be made more inclusive, but given a fixed budget allocation, it would be a zero-sum game. The stiff competitions for faculty positions worldwide means that only those with an exceptional publication record would ever be shortlisted. Even for those who are merely looking to continue in research, a lag in one’s publication record within a contract may be detrimental to chances of securing their next employment. Criteria for promotion and tenure are almost never categorically spelled out for any universities and institutions, but it is common knowledge that these are criti- cally dependent on publication output.
There are important movements for changes in evaluation of publications (Hatch and Curry 2020) beyond the traditional bibliometric assessment (Joshi 2014), such as the San Francisco Declaration on Research Assessment (DORA) (https://sfdora.org/read) and the Leiden manifesto for research metrics (http:// www.leidenmanifesto.org/). There are also attempts to alleviate pressure to pub- lish for junior investigators, such as the pilot schemes by the European Molecular Biology Organization (EMBO) to remove the requirement of a first-authored paper for fellowship consideration, or that a first-author refereed preprint will be considered as an equivalent (Lemberger et al. 2022). For the evaluation of eligi- bility for grants, positions, promotions or tenure there could be efforts made to emphasize on the quality rather than quantity of a smaller number of one’s repre- sentative publications. Examples of such include the Australian National Health and Medical Research Council (NHMRC)’s requirement of listing only up to 10 of one’s top publications in the past 10 years (https://www.nhmrc.gov.au/about- us/news-centre/changes-publication-assessment), and the Swiss National Science
Yeo-The and Tang 335
Foundation’s “narrative” curriculum vitae template (Sing Chawla 2022). The Hong Kong Principles for assessing researchers, formulated in 2019 at the 6th World Conference on Research Integrity (WCRI) in 2019, also proposed recogni- tion of researchers in much broader terms than one’s publication list (https:// wcrif.org/guidance/hong-kong-principles).
However, given the stiff competition for limited resources and positions, PPP shall continue to be exerted. It would be difficult to make wholesale changes to the reward and merit systems of modern science such that PPP could be effectively diminished. In this regard, it may be equally difficult, if not ultimately misplaced, to focus efforts in reducing PPP, just as in attempts to determine whether there is a direct causal role for PPP in QRP/RM.
Promoting knowledge and systemic improvements in research ethics and integrity We posit that instead of struggling to decipher any causal relationships between PPP and QRP/RM with an intention of upstream intervention of the former, we might do better by simply focusing on more downstream remedies for the latter. Despite its negative connotations, PPP could in fact be a driving force for honest hard work. What would be needed is for any stress it induces to be handled with the right mindset and in the light of clear guidelines, as well for its negative con- sequences to be adequately and efficiently dealt with.
Perhaps from a haughtily stringent and uncompromising perspective, blaming QRP/RM on PPP is a show of weakness or even an attempt at moral disengage- ment (Moore 2015). In this regard, instilling essential moral values and virtues in science and research (Pennock 2015) among its practitioners with education and training would be a path forward. We should therefore put efforts in enhancing knowledge of research ethics and integrity among scientists and researchers (Shamoo and Resnik 2015; Yeo-Teh and Tang 2021), as well as closely associated managers and administrators. Zoloth has recently argued for the cultivation of “. . .classic values of veracity, courage, humility, and fidelity. . .” by researches to “. . .allow science to proceed ethically under conditions of deep uncer- tainty. . .”(Zoloth 2021). We think this would also be aptly applicable to dealing with pressure and stress in contemporary research settings.
To be fully prepared to tackle QRP/RM regardless of its cause, we should have in place institutional infrastructures and mechanisms to fairly and efficiently investigate and adjudicate suspicions, allegations and cases. These would include clear and well-disseminated research integrity guidelines or code, an authoritative protocol and trained personnel to handle whistleblowing and to investigate and adjudicate QRP/RM. These measures, we argue, would facilitate more effectively the productive output of reproducible research without laboring on poorly defined and potentially futile attempts to preempt any misconduct-inducing effects of PPP.
336 Research Ethics 18(4)
Declaration of Conflicting Interests The author(s) declared no potential conflicts of interest with respect to the research, author- ship, and/or publication of this article.
Funding All articles in Research Ethics are published as open access. There are no submission charges and no Article Processing Charges as these are fully funded by institutions through Knowledge Unlatched, resulting in no direct charge to authors. For more information about Knowledge Unlatched please see here: http://www.knowledgeunlatched.org
Ethical approval Not applicable.
ORCID iDs Nicole Shu Ling Yeo-Teh https://orcid.org/0000-0002-9153-9663
Bor Luen Tang https://orcid.org/0000-0002-1925-636X
References Aczel B, Palfi B, Szollosi A, et al. (2018) Quantifying support for the null hypothesis in psy-
chology: An empirical investigation. Advances in Methods and Practices in Psychological Science 1(3): 357–366.
Andrade C (2021) HARKing, Cherry-Picking, P-Hacking, fishing expeditions, and data dredging and mining as questionable research practices. The Journal of Clinical Psychiatry 82(1): 20f13804.
Baker M (2016) 1500 Scientists lift the lid on reproducibility. Nature 533(7604): 452–454. Brainard J and You J (2018) What a Massive Database of Retracted Papers Reveals About
Science Publishing’s ‘Death Penalty’. Available at: https://www.science.org/content/arti- cle/what-massive-database-retracted-papers-reveals-about-science-publishing-s-death- penalty (accessed June 2022).
Davis MS (2003) The role of culture in research misconduct. Accountability in Research 10(3): 189–201.
Fanelli D (2009) How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS One 4(5): e5738.
Fanelli D, Costas R, Fang FC, et al. (2019) Testing hypotheses on risk factors for scientific misconduct via matched-control analysis of papers containing problematic image duplica- tions. Science and Engineering Ethics 25(3): 771–789.
Fanelli D, Costas R and Ioannidis JPA (2017) Meta-assessment of bias in science. Proceedings of the National Academy of Sciences of the United States of America 114(14): 3714–3719.
Fanelli D, Costas R and Larivière V (2015) Misconduct policies, academic culture and career stage, not gender or pressures to publish, affect scientific integrity. PLoS One 10(6): e0127556.
Fanelli D, Schleicher M, Fang FC, et al. (2022) Do individual and institutional predictors of misconduct vary by country? Results of a matched-control analysis of problematic image duplications. PLoS One 17(3): e0255334.
Yeo-The and Tang 337
Fang FC, Steen RG and Casadevall A (2012) Misconduct accounts for the majority of retracted scientific publications. Proceedings of the National Academy of Sciences of the United States of America 109(42): 17028–17033.
Gandevia S (2018) Publication pressure and scientific misconduct: Why we need more open governance. Spinal Cord 56(9): 821–822.
Godecharle S, Fieuws S, Nemery B, et al. (2018) Scientists still behaving badly? A survey within industry and universities. Science and Engineering Ethics 24(6): 1697–1717.
Gopalakrishna G, Ter Riet G, Vink G, et al. (2022) Prevalence of questionable research prac- tices, research misconduct and their potential explanatory factors: A survey among aca- demic researchers in The Netherlands. PLoS One 17(2): e0263023.
Gross C (2016) Scientific misconduct. Annual Review of Psychology 6: 7693–7711. Harvey L (2020) Research fraud: A long-term problem exacerbated by the clamour for
research grants. Quality in Higher Education 26(3): 243–261. Hatch A and Curry S (2020) Changing how we evaluate research is difficult, but not impos-
sible. eLife 9: e58654. Haven TL, de Goede MEE, Tijdink JK, et al. (2019) Personally perceived publication pres-
sure: Revising the Publication Pressure Questionnaire (PPQ) by using work stress models. Research Integrity and Peer Review 4(1): 7.
Haven T, Tijdink J, Martinson B, et al. (2021) Explaining variance in perceived research misbehavior: Results from a survey among academic researchers in Amsterdam. Research Integrity and Peer Review 6: 7.
Heuritsch J (2021) Reflexive Behaviour: How Publication Pressure Affects Research Quality in Astronomy Publications 9:52.
Johann D (2022) Perceptions of scientific authorship revisited: Country differences and the impact of perceived publication pressure. Science and Engineering Ethics 28(2): 10.
Joshi MA (2014) Bibliometric indicators for evaluating the quality of scientifc publications. The Journal of Contemporary Dental Practice 15(2): 258–262.
Lemberger T, Pulverer B, Sheehan-Rooney K, et al. (2022) Funding: End ‘Publish or Perish’ for Postdocs. Available at: https://www.nature.com/articles/d41586-022-01541-1 (accessed June 2022).
Maggio L, Dong T, Driessen E, et al. (2019) Factors associated with scientific misconduct and questionable research practices in health professions education. Perspectives on Medical Education 8(2): 74–82.
Martinson BC, Anderson MS and de Vries R (2005) Scientists behaving badly. Nature 435(7043): 737–738.
Moore C (2015) Moral disengagement. Current Opinion in Psychology 6: 199–204. Moreels TG (2018) Ethical aspects in medical publishing in Belgium. Acta Gastro-enterologica
Belgica 81(1): 45–48. Neill US (2008) Publish or perish, but at what cost? The Journal of Clinical Investigation
118(7): 2368. Paruzel-Czachura M, Baran L and Spendel Z (2021) Publish or be ethical? Publishing pres-
sure and scientific misconduct in research. Research Ethics 17: 375–397. Pennock R (2015) Fostering a culture of scientific integrity: Legalistic vs. scientific virtue-
based approaches. Professional Ethics Report 28(2): 1–3. Qiu J (2010) Publish or perish in China. Nature 463(7278): 142–143. Redman B (2013) Research Misconduct Policy in Biomedicine: Beyond the Bad-Apple
Approach. USA: Oxford University Press.
338 Research Ethics 18(4)
Shamoo AE and Resnik DB (2015) Responsible Conduct of Research. Oxford: Oxford University Press.
Sing Chawla D (2022) Swiss Funder Unveils New CV Format to Make Grant Evaluation Fairer. Available at: https://www.nature.com/articles/d41586-022-01599-x?utm_source= Nature+Briefing&utm_campaign=98dfbae519-briefing-dy-202200609&utm_ medium=email&utm_term=0_c9dfd39373-98dfbae519-42226863 (accessed June 2022).
Sovacool B (2008) Exploring scientific misconduct: Isolated individuals, impure institutions, or an inevitable idiom of modern science? Journal of Bioethical Inquiry 5: 271–282.
Steen RG, Casadevall A and Fang FC (2013) Why has the number of scientific retractions increased? PLoS One 8(7): e68397.
Tijdink JK, Bouter LM, Veldkamp CLS, et al. (2016a) Personality traits are associated with research misbehavior in dutch scientists: A cross-sectional study. PLoS One 11(9): e0163251.
Tijdink JK, Schipper K, Bouter LM, et al. (2016b) How do scientists perceive the current publication culture? A qualitative focus group interview study among Dutch biomedical researchers. BMJ open 6(2): e008681.
Tijdink JK, Smulders YM, Vergouwen ACM, et al. (2014a) The assessment of publication pressure in medical science; validity and reliability of a Publication Pressure Questionnaire (PPQ). Quality of Life Research 23(7): 2055–2062.
Tijdink JK, Verbeke R and Smulders YM (2014b) Publication pressure and scientific miscon- duct in medical scientists. J Empir Res Hum Res Ethics 9(5): 64–71.
Tijdink JK, Vergouwen ACM and Smulders YM (2013) Publication pressure and burn out among Dutch medical professors: A nationwide survey. PLoS One 8(9): e73381.
Van Dalen H and Henkens K (2012) Intended and unintended consequences of a publish- or-perish culture: A worldwide survey. Journal of the American Society for Information Science and Technology 63(7): 1282–1293.
Wang T, Xing QR, Wang H, et al. (2019) Retracted publications in the biomedical literature from open access journals. Science and Engineering Ethics 25(3): 855–868.
Wikström P (2019) Situational action theory: A general, dynamic and mechanism-based the- ory of crime and its causes. In: Krohn M, Hendrix N, Penly Hall G, et al. (ed) Handbook on Crime and Deviance. Handbooks of Sociology and Social Research, Cham: Springer.
Xie Y, Wang K and Kong Y (2021) Prevalence of research misconduct and questionable research practices: A systematic review and meta-analysis. Science and Engineering Ethics 27(4): 41.
Yeo-Teh N and Tang B (2021) Research ethics courses as a vaccination against a toxic research environment or culture. Research Ethics 17(1): 55–65.
Zoloth L (2021) The ethical scientist in a time of uncertainty. Cell 184(6): 1430–1439.