• HOME
  • GETTING STARTED
    • Quick Start Guide
    • Evaluation Software
    • Webinars 2025
    • Demo Videos
  • OUR PRODUCTS
    • All SimBio Modules
    • Textbook Replacements
      • SimBio Ecology
      • Intro Bio
    • Intro Bio
    • Ecology
    • Evolution
    • Cell Biology
    • Molecular Biology
  • DELIVERY SYSTEM
    • What is SimUText?
  • PRICING & ORDERING
  • ABOUT
    • Overview
    • Employee Ownership
    • Research & Publications
    • Blog
    • Testimonials
    • Jobs
    • Accessibility
  • TECH SUPPORT
    • Knowledge Base
    • Help for Students
    • FAQ – Instructors
    • Accessibility

Mobile Menu

  • Menu
  • Skip to right header navigation
  • Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

SimBio logo

Simulated Biology. Real Learning.

  • Evaluation Software
  • Contact
  • Blog
  • HOME
  • GETTING STARTED
    • Quick Start Guide
    • Evaluation Software
    • Webinars 2025
    • Demo Videos
  • OUR PRODUCTS
    • All SimBio Modules
    • Textbook Replacements
      • SimBio Ecology
      • Intro Bio
    • Intro Bio
    • Ecology
    • Evolution
    • Cell Biology
    • Molecular Biology
  • DELIVERY SYSTEM
    • What is SimUText?
  • PRICING & ORDERING
  • ABOUT
    • Overview
    • Employee Ownership
    • Research & Publications
    • Blog
    • Testimonials
    • Jobs
    • Accessibility
  • TECH SUPPORT
    • Knowledge Base
    • Help for Students
    • FAQ – Instructors
    • Accessibility

Study Confirms the Importance of Feedback

Home » All Things SimBio » Study Confirms the Importance of Feedback

January 15, 2024 //  by Eli Meir

Eleven years ago, SimBio received a grant from the National Science Foundation to “develop techniques for automatically providing immediate formative assessment as students are conducting simulation-based experiments and reasoning about their results”. As I wrote at the time, it was supposed to be a four-year project with partners from the Scheller Teacher Education Program at MIT and  California State University, Fullerton. During those years we had a number of interesting results including a surprising finding about how certain question formats can promote learning. And now, as these things go, eleven years later we recently published the last major piece of the project.

The paper, Designing Activities to Teach Higher-Order Skills: How Feedback and Constraint Affect Learning of Experimental Design, tested whether feedback and the manipulation of constraint helps students learn complex skills like experimental design. The short answer is yes, in a big way. The details are interesting for groups like SimBio who develop teaching tools in biology.

The research was based on early versions of SimBio’s Understanding Experimental Design (UED), a tutorial that helps students design experiments and summarize and interpret results (and has since become a customer favorite). Our first result proved that Understanding Experimental Design is effective – using an independent test, students showed learning gains of Cohen’s D = 1.0 after using the tutorial which, if you are not familiar with the measure, is considered well into the “large effect” range. Anecdotally, instructors relate that using the tutorial helps students design better independent projects later in the term.

But why does it work so well?
We thought it might be due to either the immediate feedback students receive as they design experiments in the tutorial, or to the way we constrained aspects of what students are able to design to help guide them. It turned out that our automated feedback to students, within an open-ended simulation, improved learning gains. On the other hand, when we changed how open-ended the activity was – the constraint on what students could do when designing experiments – it made little difference to learning gains. It did, however, make a difference in our ability to provide feedback. The conclusion, spelled out both in the CBE LSE paper and a related book chapter, is that it’s ok to manipulate constraint on an open-ended activity in order to make sure one can provide students with quick, specific feedback.

It’s a lesson SimBio is carrying forward as we tackle other complex skills needed by biology students, such as our current project, GraphSmarts Assessments, which analyzes the graph construction and interpretation skills of biology undergraduates.

Author

  • Eli Meir
    Eli Meir

    SimBio founder Eli Meir brings together a PhD in biology, a long history of developing sophisticated software for both biology research and education markets, and over 20 years of experience running software companies. He has a passion for using these skills to improve education in both college and secondary schools through innovative products that let students learn by doing and playing.

    View all posts

Category: Biology Education, Research & CollaborationsTag: Active Learning, Student Assessment, Virtual Labs

Related Posts

Jaz Donkoh

In-class learning or homework?

John Roach

SimBio Ecology – Comprehensive ecology education

John Roach

Risk, Insurance, & Climate Policy

John Roach

The hidden benefits of Ecology courses

John Roach

Climate Change & Disease

John Roach

Icky Stories as Teachable Moments

Jaz Donkoh

Highlights from SABER

John Roach

Urban Ecology – Beyond Rock & Ice

John Roach

Tackling Climate Change

John Roach

Mysteries of the Sargasso Sea

John Roach

The Vaccine Debate

John Roach

Making Climate Change Real While Giving Students Hope

Previous Post: «John Roach Climate Change & Disease
Next Post: The hidden benefits of Ecology courses John Roach»

Footer

Testimonials

“[SimBio’s modules] provide a powerful environment for hands-on, active learning in Ecology and Evolution. The depth, design, and pedagogical effectiveness of these packages is unequaled. They have greatly enriched student interest and understanding in all of my courses, from Introductory Biology to Advanced Population Biology”

— Dr. Brad Lister
Rensselaer Polytechnic Institute

“The lab simulations have been very helpful to reinforce the lecture content and encourage students to use critical thinking skills to solve problems.”

— Patti Fallest-Strobl
Neumann University

“I was amazed how quickly and effortlessly the simulation taught them a dynamic system.”

— Paula Philbrick
University of Connecticut

“The students like [it] so much that they are working ahead of what I have assigned. They just think it’s fun. And from the quiz results I have so far, they’re really getting it. You guys are geniuses.”

— Paulette Bierzychudek
Lewis & Clark College

“Since we began using Simbio’s Ecology chapters our students consistently come to class better prepared. This is a key to the success of our hybrid flipped classroom approach.”

— Dr. Peter Curtis
Ohio State University

“That was the most fun I’ve had teaching ecology and, I would venture to guess, the most fun my students have had taking ecology from me.”

— Matt Orr
Oregon State University, Cascades

“Our students are more prepared and our class discussions are more sophisticated because SimUText is such a great out of class “instructor”. Since our students have SimUText preparation we can spend class time applying concepts and evaluating new information.”

— Emily Bernhardt
Duke University

“I LOVE that every lab is based on a real study. I LOVE that all of the labs offer an open-ended inquiry. I LOVE that the labs gradually teach the concepts and build up a repertoire of data collection techniques. Thank you, for creating them.”

— Jeanette Williams
Community College of Vermont

“I just wanted to say how great simutext has been. I could have memorized facts about the electron transport chain and passed the test, but would not have had any solid concept of what was happening inside. I hope that we continue to use it often even when things return to normal.”

— Student
Rochester Community and Technical College

“Congratulations for developing such a high quality chapter. I was very impressed by its comprehensiveness, accuracy, and thoughtful design. It really is superb.”

— Richard Boone
Humboldt State University

“I recommend your modules to anyone I can, because of all the online materials I’ve found, SimBio is really the best in content and best managed. I am definitely a SimBio fan!”

— Valerie Anderson
Marymount California University

All Things SimBio

  • Jaz DonkohIn-class learning or homework?
    By Jaz Donkoh
    September 18, 2024
  • John RoachSimBio Ecology – Comprehensive ecology education
    By John Roach
    July 18, 2024
  • John RoachRisk, Insurance, & Climate Policy
    By John Roach
    June 21, 2024
More Blog Posts →

Contact

Shipping: 1280 S. Third St W., Missoula, MT 59801
Billing: P.O. Box 7158, Missoula, MT 59807
Phone: (833) 314-7701
Fax: (617) 279-0055
Questions?

SimBio Order Form
VPAT / Accessibility Statement

Site Footer

  • Facebook

Copyright © 2025 SimBio. All Rights Reserved. Trademarks.