Building a
Better Science Fair

The Problem with Judging by
"The" Scientific Method

Most of us learned the steps of the scientific method before we entered high school. We learned that doing SCIENCE (implying all science) starts with a question that is answered with a hypothesis. That hypothesis is tested in an experiment where one variable is changed intentionally, one variable may change as a result, and all other variables must be held constant. The experimental data can then be analyzed and a clear result then stated that either confirms or refutes the original hypothesis.

But this is not reflective of science as a whole.

What is described above is single-variable hypothesis testing. But there are many methods used in science, and they don't all follow that prescriptive method. (See Methods of Inquiry in Science for more on methods of science beyond "the" scientific method.) Yet the way we expect students to go about inquiry for a science fair requires them to force any project into this narrow set of steps. If we want students to understand what it means to engage in science, we have to have science fairs allow students to engage in a variety of science methods.

A Massachusetts Case Study

The Current Massachusetts State Science Fair Scoring Sheet

Click on image above for a larger version.

The Massachusetts State Science Fair uses the same scoring sheet for judges year after year. Updates are infrequent intentionally. One of the more recent updates was to change the score sheet to make more sense for engineering projects. However, the science project side of the scoring sheet still focuses on "the scientific method" of single-variable hypothesis testing. Yet real science, even at the high school science fair level, does not always follow this particular, prescriptive method. The science fair scoring sheet needs to be updated to reflect and allow for the variety of methods used in real science.

Issues with the Current MA Science Fair Scoring Sheet

Click on image above for a larger version.

Particular score criteria are phrased in ways that either focus on single-variable hypothesis testing as the only allowable methodology or focus on creativity without regard for the appropriateness of the chosen method of inquiry.

  • "Clearly Stated Hypothesis"

      • Not all research starts with a specific hypothesis. Some is simply investigating an interesting phenomenon.

  • "Logical Experiment with Control"

      • Excludes research in all observational sciences, where you can make observations but cannot (sometimes due to ethical considerations) actively change aspects of the system. Some examples include research in astronomy, ecology, geology, paleontology, and the social sciences.

  • "Application & Understanding of Scientific Method or Design Process"

      • The Design Process, at least as taught in MA, has a very specific set of steps. Placing the singular phrase Scientific Method next to Design Process here implies that the Scientific Method also consists of a specific set of steps rather than an approach to investigation.

  • "Use of Unique Methods, Designs or Materials"

      • Creativity is an important part of science, but should be mitigated by the need to use valid methods for what you want to investigate.

  • "Creative Approach to Problem-Solving"

      • Again, creativity is important but should include checks for reasonableness of choice of methods.

Suggested Revisions to the MA Science Fair Scoring Sheet

Click on image above for a larger version.

Strategic rephrasing of these problematic scoring criteria keeps the spirit and intent of each while allowing for methodologies beyond "the" scientific method and focuses on the appropriate use of a wider variety of scientific methodologies.

  • "Clearly Stated Hypothesis" to "Clearly Stated Purpose"

      • While not all research starts with a specific hypothesis, all research has a stated purpose for being done.

  • "Logical Experiment with Control" to "Logical Investigation"

      • Certain methodologies, especially those in the observational sciences, do not have "control" variables. However, the methods used should still be sensible for the inquiry being conducted.

  • "Application & Understanding of Scientific Method or Design Process" to "Appropriate Application & Understanding of Scientific Methodologies or Design Process"

      • Not all science is done using "the" scientific method of single-variable hypothesis testing, but whatever scientific methods are used should be appropriate for the inquiry and well understood by the student.

  • "Use of Unique Methods, Designs or Materials" to "Unique Use of Appropriate Methods, Designs or Materials"

      • Creativity of methods in science must be tempered with checks that those methods are appropriate to the purpose of the research.

  • "Creative Approach to Problem-Solving" to "Creative Approach to the Inquiry or Problem"

      • Much research does not necessarily try to fix some problem, but seeks to explore and further understand some phenomenon.