##plugins.themes.bootstrap3.article.main##

##plugins.themes.bootstrap3.article.sidebar##

Published Aug 29, 2024

Güntay Taşçi  

Abstract

The present study has aimed to develop and validate a protein concept inventory (PCI) consisting of 25 multiple-choice (MC) questions to assess students’ understanding of protein, which is a fundamental concept across different biology disciplines. The development process of the PCI involved a literature review to identify protein-related content, validation interviews to iteratively validate and refine the created items (n = 26), and data collection from a large sample (n = 291) for statistical analysis. An expert interview was held with two different field experts regarding the content validity of the draft PCI tool, the suitability of the options, and the clarity of the items. Free choice format (multiple marking) was used to answer the developed MC items. In scoring these items, positive points were given to correct options, and negative points were given to incorrect options. Evidence regarding the psychometric properties of the PCI trial form was collected through factor analysis, group differentiation, internal consistency, and item analysis using quantitative data. The evidence collected demonstrates that the validity and reliability of the PCI as a measurement tool have been confirmed. PCI’s scoring approach and the use of response patterns created by multiple markings in teaching are discussed.

Downloads

Download data is not yet available.

##plugins.themes.bootstrap3.article.details##

Keywords

Protein, Conceptual Understanding, History and Development

References
Adams, W. K., & Wieman, C. E. (2011). Development and Validation of Instruments to Measure Learning of Expert-Like Thinking. International Journal of Science Education, 33(9):1289-1312. DOI: https://doi.org/10.1080/09500693.2010.512369

Anderson, D. L., Fisher, K. M., & Norman, G. J. (2002). Development and evaluation of the conceptual inventory of natural selection. Journal of Research in Science Teaching, 39(10):952-978. DOI: https://doi.org/10.1002/tea.10053

Briggs, A. G., Hughes, L. E., Brennan, R. E., Buchner, J., Horak, R. E. A., Amburn, D. S. K., McDonald, A. H., Primm, T. P., Smith, A. C., Stevens, A. M., Yung, S. B., & Paustian, T. D. (2017). Concept Inventory Development Reveals Common Student Misconceptions about Microbiology. Journal of Microbiology & Biology Education, 18(3). DOI: https://doi.org/10.1128/jmbe.v18i3.1319

Bühner, M. (2006). Einführung in die Test- und Fragebogenkonstruktion (2nd ed.). Pearson Studium.

Bybee, R. W. (2012). The Next Generation of Science Standards : Implications for Biology Education. The American Biology Teacher, 74(8):542-549. DOI: https://doi.org/10.1525/abt.2012.74.8.3

Cho, H. H, Kahle, J. B., & Nordland, F. H. (1985). An investigation of high school biology textbooks as sources of misconceptions and difficulties in genetics and some suggestions for teaching genetics. Science Education, 69(5):707-719. DOI: https://doi.org/10.1002/sce.3730690512

Couch, B. A., Wood, W. B., & Knight, J. K. (2015). The Molecular Biology Capstone Assessment : A Concept Assessment for Upper-Division Molecular Biology Students. CBE-Life Sciences Education, 14:1-11. DOI: https://doi.org/10.1187/cbe.14-04-0071

Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Wadsworth Group- Thomson Learning.

D’Avanzo, C. (2008). Biology concept inventories: Overview, status, and next steps. BioScience, 58(11):1079-1085. DOI: https://doi.org/10.1641/b581111

Dikmenli, M., Çardak, O., & Öztaş, F. (2009). Conceptual problems in biology-related topics in primary science and technology textbooks in Turkey. International Journal of Environmental and Science Education, 4(4):429-440.

Fisher, K. M. (1985). A misconception in biology: Amino acids and translation. Journal of Research in Science Teaching, 22(1):53-62. DOI: https://doi.org/10.1002/tea.3660220105

Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the aevelopment and refinement of clinical assessment instruments. Psychological Assessment, 7(3):286-299. DOI: https://doi.org/10.1037/1040-3590.7.3.286

Frary, R. B. (1980). The effect of misinformation, partial information, and guessing on expected multiple-choice test item scores. Applied Psychological Measurement, 4(1):79-90. DOI: https://doi.org/10.1177/014662168000400109

Frary, R. B. (1989). Partial-Credit scoring methods for Multiple-Choice tests. Applied Measurement in Education, 2(1):79-96. DOI: https://doi.org/10.1207/s15324818ame0201

Garvin-Doxas, K., Klymkowsky, M., & Susan, E. (2007). Building, using, and maximizing the impact of concept inventories in the biological sciences: Report on a national science foundation-sponsored conference on the construction of concept inventories in the biological sciences. CBE Life Sciences Education, 6:297-306. DOI: https://doi.org/10.1187/cbe.07

Gericke, N., & Wahlberg, S. (2013). Clusters of concepts in molecular genetics: A study of Swedish upper secondary science students understanding. Journal of Biological Education, 47(2):73-83. DOI: https://doi.org/10.1080/00219266.2012.716785

Guzman, K., & Bartlett, J. (2012). Using simple manipulatives to improve student comprehension of a complex biological process: Protein synthesis. Biochemistry and Molecular Biology Education, 40(5):320-327. DOI: https://doi.org/10.1002/bmb.20638

Haladyna, T. M., & Downing, S. M. (1989). A taxonomy of multiple-choice item-writing rules. Applied Measurement in Education, 2(1):37-50. DOI: https://doi.org/10.1207/s15324818ame0201

Haladyna, T. M., & Steven, M. (1989). Validity of a taxonomy of multiple-choice item- writing rules. Applied Measurement in Education, 2(1):51-78. DOI: https://doi.org/10.1207/s15324818ame0201

Harle, M., & Towns, M. H. (2013). Students’ understanding of primary and secondary protein structure: Drawing secondary protein structure reveals student understanding better than simple recognition of structures. Biochemistry and Molecular Biology Education, 41(6):369-376. DOI: https://doi.org/10.1002/bmb.20719

Herrmann-Abell, C. F., & DeBoer, G. E. (2011). Using distracter-driven standards-based multiple-choice assessments and Rasch modeling to investigate hierarchies of chemistry misconceptions and detect structural problems with individual items. Chemistry Education Research and Practice, 12(2):184-192.DOI: https://doi.org/10.1039/c1rp90023d

Herrmann-Abell, C. F., Koppal, M., & Roseman, J. E. (2016). Toward high school biology: Helping middle school students understand chemical reactions and conservation of mass in nonliving and living systems. Cell Biology Education, 15(4).DOI: https://doi.org/10.1187/cbe.16-03-0112

Hershey, D. R. (2004). Avoid misconceptions when teaching about plants. Available at: http://Www.Actionbioscience.Org/Education/Hershey.Html?Print. & https://files.eric.ed.gov/fulltext/ED501356.pdf

Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30(3):141-158. DOI: https://doi.org/10.1119/1.2343497

Hsu, Tse-Chi, M., Moss, P. A., & Khampalikit, C. (1984). The merits of multiple-answer items as evaluated by using six scoring formulas. The Journal of Experimental Education, 52(3):152-158. Available at: http://www.jstor.org/stable/20151542

Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 6(1):1-55. DOI: http://www.tandfonline.com/doi/abs/10.1080/10705519909540118

Jarrett, L., Ferry, B., & Takacs, G. (2012). Development and validation of a concept inventory for introductory-level climate change science. International Journal of Innovation in Science and Mathematics Education, 20(2). Available at: https://openjournals.library.sydney.edu.au/CAL/article/view/5814

JASP Team (2022). JASP (Version 0.16.4) [Computer software].

Jorion, N., & Gane, B. D., & DiBello, L. V., & Pellegrino, J. W. (2015, June): Developing and Validating a Concept Inventory [Paper presentation]. ASEE Annual Conference & Exposition, Seattle, Washington. DOI: https://doi.org/10.18260/p.23836

Kalas, P., O’Neill, A., Pollock, C., & Birol, G. (2013). Development of a meiosis concept inventory. CBE Life Sciences Education, 12(4):655-664. DOI: https://doi.org/10.1187/cbe.12-10-0174

Kasapoglu, E. (2011). The effect of teaching protein synthesis using concept maps on the academic achievement and attitudes of 12th grade high school students. Master thesis. Selçuk University.

Kline, P. (1994). An easy guide to factor analysis. Routledge.

Kline, R. B. (2005). Principles and practice of structural equation modeling (Second). The Guilford Press.

Klymkowsky, M. W., & Garvin-Doxas, K. (2008). Recognizing student misconceptions through Ed’s tools and the biology concept inventory. PLoS Biology, 6(1):0014-0017. DOI: https://doi.org/10.1371/journal.pbio.0060003

Kummer, T. A., Whipple, C. J., Bybee, S. M., Adams, B. J., & Jensen, J. L. (2019). Development of an evolutionary tree concept inventory. Journal of Microbiology & Biology Education, 20(2). DOI: https://doi.org/10.1128/jmbe.v20i2.1700

Kurz, T. B. (1999). A review of scoring algorithms for multiple-choice tests. Annual Meeting of the Southwest Educational Research Association (San Antonio, TX, January 21-23, 1999, 1:1-21. Available at: https://files.eric.ed.gov/fulltext/ED428076.pdf

Lewis, J., Leach, J., & Wood-Robinson, C. (2000). All in the genes? Young people’s understanding of the nature of genes. Journal of Biological Education, 34(2):74-79. DOI: https://doi.org/10.1080/00219266.2000.9655689

Libarkin, J. (2008). Concept inventories in higher education science. STEM Education Workshop 2. Available at: https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072624.pdf

Lindell, R. S., Peak, E., & Foster, T. M. (2007). Are they all created equal? A comparison of different concept inventory development methodologies. AIP Conference Proceedings, 883:14-17. https://doi.org/10.1063/1.2508680

Linenberger, K. J., & Bretz, S. L. (2014). Biochemistry students’ ideas about shape and charge in enzyme-substrate interactions. Biochemistry and Molecular Biology Education, 42(3):203-212. DOI: https://doi.org/10.1002/bmb.20776

Mak, S. Y., Yip, D. Y., & Chung, C. M. (1999). Alternative conceptions in biology-related topics of integrated science teachers and implications for teacher education. Journal of Science Education and Technology, 8(2):161-170. DOI: http://www.jstor.org/stable/40188526

Marbach-Ad, G. (2001). Attempting to break the code in student comprehension of genetic concepts. Journal of Biological Education, 35(4):183-189. DOI: https://doi.org/10.1080/00219266.2001.9655775

Mayring, P. (2002). Einführung in die qualitative sozialforschung (5. edition). Beltz Verlag.

McFarland, J. L., Price, R. M., Wenderoth, M. P., Martinková, P., Cliff, W., Michael, J., Modell, H., & Wright, A. (2017). Development and validation of the homeostasis concept inventory. CBE Life Sciences Education, 16(2):1-13. DOI: https://doi.org/10.1187/cbe.16-10-0305

Naah, B. (2015). Enhancing preservice teachers’ understanding of students’ misconceptions in learning chemistry. Journal of College Science Teaching, 45(2):41-47. DOI: https://doi.org/10.2505/4/jcst15_045_02_41

Nelson, D. L., & Cox, M. M. (2016). Lehninger Principles of Biochemistry(Y. M. Elçin (ed.); 5th ed.). Palme Publshing.

Newman, D. L., Snyder, C. W., Fisk, J. N., & Wright, L. K. (2016). Development of the central dogma concept inventory (CDCI) assessment tool. CBE Life Sciences Education, 15(2). DOI: https://doi.org/10.1187/cbe.15-06-0124

Nolen, S. B., Haladyna, T. M., & Haas, N. S. (1992). Uses and abuses of achievement test scores. Educational Measurement: Issues and Practice, 1992:9-15. DOI: https://doi.org/10.1111/j.1745-3992.1992.tb00234.x

Paustian, T. D., Briggs, A. G., Brennan, R. E., Boury, N., Buchner, J., Harris, S., Horak, R. E. A., Hughes, L. E., Katz-Amburn, D. S., Massimelli, M. J., McDonald, A. H., Primm, T. P., Smith, A. C., Stevens, A. M., & Yung, S. B. (2017). Development, validation, and application of the microbiology concept inventory. Journal of Microbiology & Biology Education, 18(3). DOI: https://doi.org/10.1128/jmbe.v18i3.1320

Queloz, A. C., Klymkowsky, M. W., Stern, E., Hafen, E., & Köhler, K. (2017). Diagnostic of students’ misconceptions using the Biological Concepts Instrument (BCI): A method for conducting an educational needs assessment. PLoS ONE, 12(5):1-18. DOI: https://doi.org/10.1371/journal.pone.0176906

Ramlo, S. (2002). The Force and Motion Conceptual Evaluation. Annual Meeting of the Mid-Western Educational Research Association. Available at: https://files.eric.ed.gov/fulltext/ED471542.pdf

Ramlo, S. (2008). Validity and reliability of the force and motion conceptual evaluation. American Journal of Physics, 76(9):882-886. DOI: https://doi.org/10.1119/1.2952440

Revelle, W., & Zinbarg, R. E. (2009). Coefficients alpha, beta, omega, and the glb: Comments on sijtsma. Psychometrika, 74(1):145-154. DOI: https://doi.org/10.1007/s11336-008-9102-z

Robic, S. (2010). Mathematics, thermodynamics, and modeling to address ten common misconceptions about protein structure, folding, and stability. Cell Biology Education, 9:323-332. DOI: https://doi.org/10.1187/cbe.10

Sadava, D., Hillis, D. M., Heller, H. C., & Berenbaum, M. R. (2011). Life: The Science of Biology (E. Gündüz & İ. Türkan (eds.); 9th ed.). Palme Publishing.

Selvi, M., & Yakışan, M. (2004). Misconceptions about enzymes in university students. Gazi Eğitim Fakültesi Dergisi, 24(2):173-182. DOI: https://doi.org/10.17152/GEFD.02048

Shin, J., Guo, Q., & Gierl, M. J. (2019). Multiple-choice item distracter development using topic modeling approaches. Frontiers in Psychology, 10:1-14. DOI: https://doi.org/10.3389/fpsyg.2019.00825

Simon, E., Dickey, J., Reece, J., & Hogan, K. (2016). Campbell Essential Biology With Physiology (E. Gündüz & İ. Türkan (eds.); 5th ed.). Palme Publishing.

Smith, L. A., & Williams, J. M. (2007). “It’s the X and Y thing”: Cross-sectional and longitudinal changes in children’s understanding of genes. Research in Science Education, 37(4):407-422. DOI: https://doi.org/10.1007/s11165-006-9033-6

Smith, M. K., & Knight, J. K. (2012). Using the genetics concept assessment to document persistent conceptual difficulties in undergraduate genetics courses. Genetics, 191(1):21-32. DOI: https://doi.org/10.1534/genetics.111.137810

Tan, Ş. (2016). Measurement and Evaluation in Teaching (12th ed.). Pegem Akademi.

Tekkaya, C., Çapa, Y., & Yılmaz, Ö. (2000). Biology teacher candidates’ misconceptions about biology. HU Journal of Faculty of Education, 18:140-147. Available at: https://dergipark.org.tr/tr/pub/hunefd/issue/7818/102721#article_cite

Temelli, A. (2006). Determination of misconceptions concerning genetic subjects of high school students’. Kastamonu Education Journal, 14(1):73-82. Available at: https://dergipark.org.tr/tr/download/article-file/819169

Villafañe, S. M., Loertscher, J., Minderhout, V., & Lewis, J. E. (2011). Uncovering students’ incorrect ideas about foundational concepts for biochemistry. Chemistry Education Research and Practice, 12(2):1-6. DOI: https://doi.org/10.1038/nn.2744
Vogel, S. (2000). Mythology in introductory biology. Resonance, 2000:86-95.

White, B. T., & Bolker, E. D. (2008). Interactive computer simulations of genetics, biochemistry, and molecular biology. Biochemistry and Molecular Biology Education, 36(1):77-84. DOI: https://doi.org/10.1002/bmb.20152

Wynn, A. N., Pan, I. L., Rueschhoff, E. E., Herman, M. A. B., & Archer, E. K. (2017). Student Misconceptions about Plants - A First Step in Building a Teaching Resource. Journal of Microbiology & Biology Education, 18(1):0-13. DOI: https://doi.org/10.1128/jmbe.v18i1.1253

Yilmaz, M., Ertunç, G., Hatun Diken, E., & Çimen, O. (2017). The analysis of biology topics in the 8th grade science textbook in terms of scientific content. Erzincan University Journal Faculty of Education, 19(3):17-35. DOI: https://doi.org/10.17556/erziefd.330600

Yip, D. Y. (1998a). Identification of misconceptions in novice biology teachers and remedial strategies for improving biology learning. International Journal of Science Education, 20(4):461-477. DOI: https://doi.org/10.1080/0950069980200406

Yip, D. Y. (1998b). Teachers’ misconceptions of the circulatory system. Journal of Biological Education, 32(3):207-215. DOI: https://doi.org/10.1080/00219266.1998.9655622

Yurdugul, H. (2005). The comparison of reliability coefficients in parallel, tau-equivalent, and congeneric measurements. Ankara University Journal of Faculty of Educational Sciences, 39(1):15-37. DOI: https://doi.org/10.1501/egifak_0000000127
How to Cite
Taşçi, G. (2024). Development of a Protein Concept Inventory: A Proposal for Item Scoring and Responding. Science Insights Education Frontiers, 23(2), 3755–3777. https://doi.org/10.15354/sief.24.or617
Section
Original Article