AVS Survey on Data Reproducibility

A survey of 1576 scientists reported in Nature in 2016 indicated that 90% of those interviewed indicated that there was at least some level of reproducibility crisis in the scientific literature. Responding to a congressional mandate, the National Science Foundation has asked the National Academies to explore the issues of reproducibility and replication in scientific and engineering research and four workshops have examined the issue. In the fall of 2017 NPR's Richard Harris wrote a guest editorial in Chemical and Engineering News on 'Reproducibility issues', observing that although discussion about a 'reproducibility crisis' often focused on pre-clinical medical research and social psychology studies, there were many indications that the issue extends to the "hard" sciences as well.

Because of the significance of reproducibility (or non-reproducibility) in many areas of importance to AVS members (and to those who support our research), we are conducting a simple survey to gather information about the experiences of AVS members, perceived causes and how the AVS might help address this challenge.

The survey starting on the next page focuses what appear to be systemic reasons for reproducibility issues including the need to use a wide variety of instruments beyond the expertise of many research teams, unknowns or hidden algorithms within analysis or modeling programs, unrecognized or unreported details in procedures, and incomplete detailed records and/or reporting rather than relatively uncommon (but real) issues such as fraud. 

Thank you for your time and feedback. Please click continue to begin the survey and submit by 11/5/18.
Online Surveys  by