• HOME
  • GETTING STARTED
    • Quick Start Guide
    • Evaluation Software
    • Webinars 2023
    • Demo Videos
  • OUR PRODUCTS
    • Browse All Content
    • Molecular Biology Series
    • Introductory Biology
    • SimUText Ecology
    • Get Evaluation Software
  • DELIVERY SYSTEM
    • What is SimUText?
    • Accessibility
  • PRICING & ORDERING
  • ABOUT
    • Overview
    • Research & Publications
    • Testimonials
    • Jobs
    • Accessibility
  • TECH SUPPORT
    • Knowledge Base
    • Help for Students
    • FAQ – Instructors
  • CONTACT
  • BLOG

Mobile Menu

  • Menu
  • Skip to right header navigation
  • Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

SimBio logo

Simulated Biology. Real Learning.

  • Evaluation Software
  • Contact
  • Blog
  • HOME
  • GETTING STARTED
    • Quick Start Guide
    • Evaluation Software
    • Webinars 2023
    • Demo Videos
  • OUR PRODUCTS
    • Browse All Content
    • Molecular Biology Series
    • Introductory Biology
    • SimUText Ecology
    • Get Evaluation Software
  • DELIVERY SYSTEM
    • What is SimUText?
    • Accessibility
  • PRICING & ORDERING
  • ABOUT
    • Overview
    • Employee Ownership
    • Research & Publications
    • Blog
    • News & Events
    • Testimonials
    • Jobs
    • Accessibility
  • TECH SUPPORT
    • Knowledge Base
    • Help for Students
    • FAQ – Instructors

Beyond Multiple Choice

Home » All Things SimBio » Beyond Multiple Choice

July 2, 2021 //  by Eli Meir

Eli Meir

The Answers are in the Questions!

One of the reasons I enjoy working at SimBio (after three decades of building biology education software) is that we have always maintained a strong research emphasis behind our learning tools. Rather than focusing solely on producing new virtual labs, we spend a year or more on each new teaching tool, scouring the literature for learning objectives, identifying common student confusions via student testing and instructor reviews, and using the results of our own published research or others’ to validate and improve our content. Having evidence that our content is effective feels good, and it keeps life interesting to be doing both fundamental and applied biology education research. Indeed, we’re always looking for opportunities to continue the research side of our work.

Three years ago, at the SABER annual meeting, I heard a talk from the Automated Analysis of Constructed Response (AACR) group headquartered at Michigan State University. This multi-institution team was inspired by research showing that instructors remain unaware of important nuances regarding their students’ comprehension of complex topics when they pose questions in highly constrained formats like multiple choice. SimBio has a long-running research program inspired by the same body of research. We’ve investigated how to use question formats with less constraint than multiple choice, but more than an essay question – what have been termed “intermediate constraint” formats. In a recent paper in Computers & Education, we showed that using intermediate constraint question formats in learning tools can help students learn more than they would with high constraint (multiple choice) or lower constraint (essay) questions.

Essay questions are hard to auto-score, making them less effective for teaching and assessment. AACR is successfully tackling this challenge – postdoc Kamali Sripathi gave a talk focusing on the development of new short-answer questions to assess student understanding of cellular respiration. Coincidentally, SimBio has a popular lab called Cellular Respiration Explored that teaches the same ideas AACR is attempting to measure. While we had good anecdotal feedback on the lab’s effectiveness, we lacked a formal measure of student learning. On the flip side, AACR’s student test population was rather narrow, consisting mostly of students in large 4-year research universities. As Cellular Respiration Explored is used in a broad range of classes, we realized there was a unique opportunity to collaborate to test and improve both our tools.

The result was a satisfying study recently published in CBE Life Sciences Education, led by another AACR postdoc, Juli Uhl, under the direction of Kevin Haudek. We incorporated several AACR short-answer questions as a pre/post-test around our Cellular Respiration lab. Two of the questions targeted concepts important to cellular respiration. The third was unrelated and served as a control. For us, it was satisfying to see that there were large improvements in student understanding of cellular respiration as measured by the AACR questions after using Cellular Respiration Explored (and little change on the control, as expected). The AACR team was able to investigate differences in understanding and types of confusions among a more diverse student body than they had previously tested, which will help improve their scoring algorithms among other learnings.

For those looking to assess students – either to determine whether learning tools like SimBio’s labs are helpful, to determine where your students need help, or to measure the effectiveness of your course as a whole – I definitely recommend checking out AACR’s website. Instructors are free to teach using their questions and then can upload the answers to a web-based interface to return an automated analysis. It’s a great service to take advantage of – we’re certainly happy to have discovered this new means of testing our own learning tools!

– Eli Meir, SimBio founder and author

Author

  • Eli Meir
    Eli Meir

    SimBio founder Eli Meir brings together a PhD in biology, a long history of developing sophisticated software for both biology research and education markets, and over 20 years of experience running software companies. He has a passion for using these skills to improve education in both college and secondary schools through innovative products that let students learn by doing and playing.

    View all posts

Category: Biology Education, Cellular Biology, Research & CollaborationsTag: Student Assessment, Virtual Labs

Related Posts

John Roach

The Vaccine Debate

John Roach

Making Climate Change Real While Giving Students Hope

CC Carson

A Systems Thinking Framework for Biology Classes

John Roach

Six Degrees of Biology

John Roach

San Francisco’s Algal Bloom

Eli Meir

Big Ideas from SABER

SimBio ant

Mentors Honored

Olga Helmy

What’s The Buzz?

Eli Meir

Using Simulations to Teach Cell Biology

Eli Meir

Helping Students Become Better Graphers

Virtual Labs vs. Wet Labs?

Beyond Curriculum

Previous Post: « Virtual Labs vs. Wet Labs?
Next Post: Helping Students Become Better Graphers Eli Meir»

Footer

Testimonials

“[SimBio’s modules] provide a powerful environment for hands-on, active learning in Ecology and Evolution. The depth, design, and pedagogical effectiveness of these packages is unequaled. They have greatly enriched student interest and understanding in all of my courses, from Introductory Biology to Advanced Population Biology”

— Dr. Brad Lister
Rensselaer Polytechnic Institute

“The lab simulations have been very helpful to reinforce the lecture content and encourage students to use critical thinking skills to solve problems.”

— Patti Fallest-Strobl
Neumann University

“I was amazed how quickly and effortlessly the simulation taught them a dynamic system.”

— Paula Philbrick
University of Connecticut

“The students like [it] so much that they are working ahead of what I have assigned. They just think it’s fun. And from the quiz results I have so far, they’re really getting it. You guys are geniuses.”

— Paulette Bierzychudek
Lewis & Clark College

“Since we began using Simbio’s Ecology chapters our students consistently come to class better prepared. This is a key to the success of our hybrid flipped classroom approach.”

— Dr. Peter Curtis
Ohio State University

“That was the most fun I’ve had teaching ecology and, I would venture to guess, the most fun my students have had taking ecology from me.”

— Matt Orr
Oregon State University, Cascades

“Our students are more prepared and our class discussions are more sophisticated because SimUText is such a great out of class “instructor”. Since our students have SimUText preparation we can spend class time applying concepts and evaluating new information.”

— Emily Bernhardt
Duke University

“I LOVE that every lab is based on a real study. I LOVE that all of the labs offer an open-ended inquiry. I LOVE that the labs gradually teach the concepts and build up a repertoire of data collection techniques. Thank you, for creating them.”

— Jeanette Williams
Community College of Vermont

“I just wanted to say how great simutext has been. I could have memorized facts about the electron transport chain and passed the test, but would not have had any solid concept of what was happening inside. I hope that we continue to use it often even when things return to normal.”

— Student
Rochester Community and Technical College

“Congratulations for developing such a high quality chapter. I was very impressed by its comprehensiveness, accuracy, and thoughtful design. It really is superb.”

— Richard Boone
Humboldt State University

“I recommend your modules to anyone I can, because of all the online materials I’ve found, SimBio is really the best in content and best managed. I am definitely a SimBio fan!”

— Valerie Anderson
Marymount California University

All Things SimBio

  • John RoachThe Vaccine Debate
    By John Roach
    February 8, 2023
  • John RoachMaking Climate Change Real While Giving Students Hope
    By John Roach
    January 19, 2023
  • CC CarsonA Systems Thinking Framework for Biology Classes
    By CC Carson
    November 29, 2022
More Blog Posts →

Contact

Shipping: 1280 S. Third St W., Missoula, MT 59801
Billing: P.O. Box 7158, Missoula, MT 59807
Phone: (833) 314-7701
Fax: (617) 279-0055
Questions?

SimBio Order Form
VPAT / Accessibility Statement

Site Footer

  • Facebook

Copyright © 2023 SimBio. All Rights Reserved. Trademarks.