Aiming for quality: the scientific peer review process

June 15, 2013

file

The European Food Information Council, Brussels, Belgium

“When research is submitted for publication in a peer-reviewed journal, the journal invites several (usually two or more) independent experts to assess the credibility of the research. These experts consider the scientific methods, results and conclusions presented by the authors, asking themselves, if the science is technically sound, if the interpretation is consistent with the data, and if it is new, important or ground-breaking (1). Reviewers usually remain anonymous, are not paid for their assess-ment, and should not have any conflicts of interest in relation to the research. If a paper does not meet the requirements based on the peer reviews, the editor can either reject it or deem it acceptable if subjected to adequate changes, allowing authors to react and revise their paper.

The peer review process checks that a paper explains clearly how the research was carried out, so that it can be reproduced by others. It also verifies that the methodology is appropriate for the specific field and set of objectives. Another crucial part of the review process is assessing the originality of new research and the accurate referencing of related published research, particularly if these contrast with the research at hand. The review is also useful for those whose work is being scrutinized; it allows them to fine-tune their manuscript before public release. A manu-script is seldom accepted for publication without at least a minor revision. The review process essentially strives to separate fact from speculation and personal opinion. Peer-reviewed research is never beyond criticism however, and any conclusions drawn must be considered in the context of other studies. Ideally, experiments should be repeated to assess whether results can be reproduced; this is how findings are truly substantiated. The real validation, therefore, comes after publication.

Unfortunately, research results often find their way into the public domain without being peer reviewed – spread via newspapers, magazines, the internet, television and radio. They may be unpublished findings presented at press conferences, or published findings from a journal that does not use peer review. Even journals that do use peer review contain some non-peer-reviewed content, such as editorials and letters to the editor. Both scientists and journalists should understand the meaning and importance of peer review and clarify whether or not research they discuss has been peer reviewed. There are potentially enormous costs to both science and society from the promotion of scientifically weak or flawed research findings.

The peer review process does not protect against misconduct. It can identify mistakes, but relies on honesty and, as a result, can fail to recognize deliberately fraudulent research. Various organizations have produced integrity guide-lines on good research practice aiming to reduce such occurrences (2). On the other side, financial or personal concerns may bias a reviewer’s professional judgment and objectivity. It is vital to consider in advance any factors, which could lead to bias. According to the European Science Foundation, preventing and managing such conflicts of interest is crucial in ensuring equity and integrity.

Sometimes concerns are raised about the influence of the funding body on the design of the study, or the interpre-tation or reporting of the research outcomes. The peer review process gives credence to research, because the paper has been independently checked and critically evaluated, including the correct scientific interpretation of the results on the basis of other existing evidence – no matter who funded the research (1). Inevitably, there are variations in standards between journals. A journal’s ‘impact factor’ reflects how often its papers are cited in other peer-reviewed journals, and gives some indication of importance of the journal in its field – the higher the number, the greater the impact or influence.

The process and culture of checking each other’s work is ongoing in the scientific world. Once a paper has been published, further criticism can be made by the scientific community via letters to the journal editor, discussions at conferences, or direct exchange with the research team behind the study in question. Authors can justify their findings and flaws uncovered can be corrected or retracted. This is the nature of science; all work is open to critique by other scientists.”

Based on: The European Food Information Council. In search of quality: the scientific peer review process. FOOD TODAY 04/2013.

References

  1. Sense About Science. Peer Review and the acceptance of new scientific ideas. London, 2004
  2. European Science Foundation. European peer review guide integrating policies and practices into coherent procedures. Strasbourg, 2011.