Between frightening reports of fraud and other scientific misconducts, psychology risks losing face as a science. A main concern is that the hypotheses and explanations provided by psychologists are worthless, as they were obtained through questionable if not outright wrong methods. To remedy this, innovate projects such as the Open Science Framework and Preregistration are now emerging, aimed to improve the system; to impose rules and regulations that create scientific environment wherein researchers’ practices can be monitored more closely, so that dodgy research behaviors like fraud and QRP’s cannot exist, or at least can be detected more easily. One might wonder though, if this will be enough. After all, it was not the system but the researcher that chose to employ faulty research methods, and it may be optimistic to think that the current state of affairs can be improved without changing the researcher as well. For one, having the system make it harder for some faulty research practices to occur may just lead to an increase in others, that can slip past the system (for example, making up data). With this in mind, this paper will focus on improving psychology as a science by educating its researchers. The goal of this education will be to: 1) provide them with the knowledge to make responsible, well-informed research decisions, and 2) stimulate attitudes that will intrinsically motivate researchers to make responsible, well-informed research decisions. This is expected to reduce the use of questionable research practices and fraudulent behaviors in psychology. This blog will go into explaining: why researchers need to change, what aspects need to change and in what manner, and end in suggestions on how to realize these changes.
Why do researchers need to change? As was said before, changing the system may not be enough. Certain faulty research practices, such as altering or making up data (aka fraud) can still occur. Besides which, inhibiting some malpractices may simply lead to an increase in others; after all, researchers who were motivated to obtain certain results before system changes, will still be motivated to do so after. Making it harder to do wrong will not always lead to less wrongdoing. As long as external motivators (for example, publication pressure and publication bias) are still pushing researchers to obtain certain results, researchers will strive for these results, by any means necessary. Educating researchers may however provide researchers with the intrinsic motivation and means to fight these extrinsic motivators; to prioritize the quality of research over personal gain.
What needs to change then, and in what way? As was said before, the goal of this advice plan is to improve the researcher’s knowledge concerning research practices, and change their attitude towards research. The plan is to provide researchers with knowledge concerning research practices, both accepted and faulty research practices, in terms of research methods, designs, analyses and inferences. The focus will not only be bad research practices, and why they should not be used, but also good research practices, and when they can and cannot be used, why, and how to use them. For example, one can address that deleting data points that don’t support one’s hypothesis is considered a questionable research practice, and why, and what is the proper way to handle if the data does not support the research hypothesis. This will provide researchers with sufficient knowledge to make well-informed, responsible decisions when involved in research. Furthermore, the plan is to change researcher’s attitude towards research, or more specifically, to: stimulate a critical attitude, a willing to face one’s own shortcomings, and an (active) open to change. For example, the focus can be a critical attitude towards research, why this is considered productive, and how to assume this critical mindset. This will arm researchers with an intrinsic motivation to conduct good research, aka research using only acceptable, healthy research practices.
How will this be accomplished? The changes in both knowledge and research will be implemented through education, in the form of lectures with corresponding workshops, and seminars. The lectures will discuss one or more good research practices, one or more faulty research practices, or a research attitude. These initiatives will be organized by the UvA, and are intended for UvA employees working in research or research-related practices (though people from outside the UvA are not excluded from partaking). A certain amount of attendance will be required for doing research-related work at the UvA. Finally, a small entrance fee will be charged to help finance these innitiatives.
This is how educating researchers is expected to help reduce faulty research practices, such as questionable research practices and fraudulent behaviors, in psychology. It should be clear that this solution does not pose the previously discussed changes to the system are bad, or indeed unnecessary, but rather that changing the system would not be very effective unless the researcher is guided through some changes as well. Hopefully, these changes will not only mend the reputation of psychology as a science, but also restore its scientific value and integrity.