Development of a Protein Concept Inventory: A Proposal for Item Scoring and Responding
##plugins.themes.bootstrap3.article.main##
##plugins.themes.bootstrap3.article.sidebar##
Abstract
The present study has aimed to develop and validate a protein concept inventory (PCI) consisting of 25 multiple-choice (MC) questions to assess students’ understanding of protein, which is a fundamental concept across different biology disciplines. The development process of the PCI involved a literature review to identify protein-related content, validation interviews to iteratively validate and refine the created items (n = 26), and data collection from a large sample (n = 291) for statistical analysis. An expert interview was held with two different field experts regarding the content validity of the draft PCI tool, the suitability of the options, and the clarity of the items. Free choice format (multiple marking) was used to answer the developed MC items. In scoring these items, positive points were given to correct options, and negative points were given to incorrect options. Evidence regarding the psychometric properties of the PCI trial form was collected through factor analysis, group differentiation, internal consistency, and item analysis using quantitative data. The evidence collected demonstrates that the validity and reliability of the PCI as a measurement tool have been confirmed. PCI’s scoring approach and the use of response patterns created by multiple markings in teaching are discussed.
Downloads
##plugins.themes.bootstrap3.article.details##
Protein, Conceptual Understanding, History and Development
Anderson, D. L., Fisher, K. M., & Norman, G. J. (2002). Development and evaluation of the conceptual inventory of natural selection. Journal of Research in Science Teaching, 39(10):952-978. DOI: https://doi.org/10.1002/tea.10053
Briggs, A. G., Hughes, L. E., Brennan, R. E., Buchner, J., Horak, R. E. A., Amburn, D. S. K., McDonald, A. H., Primm, T. P., Smith, A. C., Stevens, A. M., Yung, S. B., & Paustian, T. D. (2017). Concept Inventory Development Reveals Common Student Misconceptions about Microbiology. Journal of Microbiology & Biology Education, 18(3). DOI: https://doi.org/10.1128/jmbe.v18i3.1319
Bühner, M. (2006). Einführung in die Test- und Fragebogenkonstruktion (2nd ed.). Pearson Studium.
Bybee, R. W. (2012). The Next Generation of Science Standards : Implications for Biology Education. The American Biology Teacher, 74(8):542-549. DOI: https://doi.org/10.1525/abt.2012.74.8.3
Cho, H. H, Kahle, J. B., & Nordland, F. H. (1985). An investigation of high school biology textbooks as sources of misconceptions and difficulties in genetics and some suggestions for teaching genetics. Science Education, 69(5):707-719. DOI: https://doi.org/10.1002/sce.3730690512
Couch, B. A., Wood, W. B., & Knight, J. K. (2015). The Molecular Biology Capstone Assessment : A Concept Assessment for Upper-Division Molecular Biology Students. CBE-Life Sciences Education, 14:1-11. DOI: https://doi.org/10.1187/cbe.14-04-0071
Crocker, L., & Algina, J. (1986). Introduction to Classical and Modern Test Theory. Wadsworth Group- Thomson Learning.
D’Avanzo, C. (2008). Biology concept inventories: Overview, status, and next steps. BioScience, 58(11):1079-1085. DOI: https://doi.org/10.1641/b581111
Dikmenli, M., Çardak, O., & Öztaş, F. (2009). Conceptual problems in biology-related topics in primary science and technology textbooks in Turkey. International Journal of Environmental and Science Education, 4(4):429-440.
Fisher, K. M. (1985). A misconception in biology: Amino acids and translation. Journal of Research in Science Teaching, 22(1):53-62. DOI: https://doi.org/10.1002/tea.3660220105
Floyd, F. J., & Widaman, K. F. (1995). Factor analysis in the aevelopment and refinement of clinical assessment instruments. Psychological Assessment, 7(3):286-299. DOI: https://doi.org/10.1037/1040-3590.7.3.286
Frary, R. B. (1980). The effect of misinformation, partial information, and guessing on expected multiple-choice test item scores. Applied Psychological Measurement, 4(1):79-90. DOI: https://doi.org/10.1177/014662168000400109
Frary, R. B. (1989). Partial-Credit scoring methods for Multiple-Choice tests. Applied Measurement in Education, 2(1):79-96. DOI: https://doi.org/10.1207/s15324818ame0201
Garvin-Doxas, K., Klymkowsky, M., & Susan, E. (2007). Building, using, and maximizing the impact of concept inventories in the biological sciences: Report on a national science foundation-sponsored conference on the construction of concept inventories in the biological sciences. CBE Life Sciences Education, 6:297-306. DOI: https://doi.org/10.1187/cbe.07
Gericke, N., & Wahlberg, S. (2013). Clusters of concepts in molecular genetics: A study of Swedish upper secondary science students understanding. Journal of Biological Education, 47(2):73-83. DOI: https://doi.org/10.1080/00219266.2012.716785
Guzman, K., & Bartlett, J. (2012). Using simple manipulatives to improve student comprehension of a complex biological process: Protein synthesis. Biochemistry and Molecular Biology Education, 40(5):320-327. DOI: https://doi.org/10.1002/bmb.20638
Haladyna, T. M., & Downing, S. M. (1989). A taxonomy of multiple-choice item-writing rules. Applied Measurement in Education, 2(1):37-50. DOI: https://doi.org/10.1207/s15324818ame0201
Haladyna, T. M., & Steven, M. (1989). Validity of a taxonomy of multiple-choice item- writing rules. Applied Measurement in Education, 2(1):51-78. DOI: https://doi.org/10.1207/s15324818ame0201
Harle, M., & Towns, M. H. (2013). Students’ understanding of primary and secondary protein structure: Drawing secondary protein structure reveals student understanding better than simple recognition of structures. Biochemistry and Molecular Biology Education, 41(6):369-376. DOI: https://doi.org/10.1002/bmb.20719
Herrmann-Abell, C. F., & DeBoer, G. E. (2011). Using distracter-driven standards-based multiple-choice assessments and Rasch modeling to investigate hierarchies of chemistry misconceptions and detect structural problems with individual items. Chemistry Education Research and Practice, 12(2):184-192.DOI: https://doi.org/10.1039/c1rp90023d
Herrmann-Abell, C. F., Koppal, M., & Roseman, J. E. (2016). Toward high school biology: Helping middle school students understand chemical reactions and conservation of mass in nonliving and living systems. Cell Biology Education, 15(4).DOI: https://doi.org/10.1187/cbe.16-03-0112
Hershey, D. R. (2004). Avoid misconceptions when teaching about plants. Available at: http://Www.Actionbioscience.Org/Education/Hershey.Html?Print. & https://files.eric.ed.gov/fulltext/ED501356.pdf
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. The Physics Teacher, 30(3):141-158. DOI: https://doi.org/10.1119/1.2343497
Hsu, Tse-Chi, M., Moss, P. A., & Khampalikit, C. (1984). The merits of multiple-answer items as evaluated by using six scoring formulas. The Journal of Experimental Education, 52(3):152-158. Available at: http://www.jstor.org/stable/20151542
Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 6(1):1-55. DOI: http://www.tandfonline.com/doi/abs/10.1080/10705519909540118
Jarrett, L., Ferry, B., & Takacs, G. (2012). Development and validation of a concept inventory for introductory-level climate change science. International Journal of Innovation in Science and Mathematics Education, 20(2). Available at: https://openjournals.library.sydney.edu.au/CAL/article/view/5814
JASP Team (2022). JASP (Version 0.16.4) [Computer software].
Jorion, N., & Gane, B. D., & DiBello, L. V., & Pellegrino, J. W. (2015, June): Developing and Validating a Concept Inventory [Paper presentation]. ASEE Annual Conference & Exposition, Seattle, Washington. DOI: https://doi.org/10.18260/p.23836
Kalas, P., O’Neill, A., Pollock, C., & Birol, G. (2013). Development of a meiosis concept inventory. CBE Life Sciences Education, 12(4):655-664. DOI: https://doi.org/10.1187/cbe.12-10-0174
Kasapoglu, E. (2011). The effect of teaching protein synthesis using concept maps on the academic achievement and attitudes of 12th grade high school students. Master thesis. Selçuk University.
Kline, P. (1994). An easy guide to factor analysis. Routledge.
Kline, R. B. (2005). Principles and practice of structural equation modeling (Second). The Guilford Press.
Klymkowsky, M. W., & Garvin-Doxas, K. (2008). Recognizing student misconceptions through Ed’s tools and the biology concept inventory. PLoS Biology, 6(1):0014-0017. DOI: https://doi.org/10.1371/journal.pbio.0060003
Kummer, T. A., Whipple, C. J., Bybee, S. M., Adams, B. J., & Jensen, J. L. (2019). Development of an evolutionary tree concept inventory. Journal of Microbiology & Biology Education, 20(2). DOI: https://doi.org/10.1128/jmbe.v20i2.1700
Kurz, T. B. (1999). A review of scoring algorithms for multiple-choice tests. Annual Meeting of the Southwest Educational Research Association (San Antonio, TX, January 21-23, 1999, 1:1-21. Available at: https://files.eric.ed.gov/fulltext/ED428076.pdf
Lewis, J., Leach, J., & Wood-Robinson, C. (2000). All in the genes? Young people’s understanding of the nature of genes. Journal of Biological Education, 34(2):74-79. DOI: https://doi.org/10.1080/00219266.2000.9655689
Libarkin, J. (2008). Concept inventories in higher education science. STEM Education Workshop 2. Available at: https://sites.nationalacademies.org/cs/groups/dbassesite/documents/webpage/dbasse_072624.pdf
Lindell, R. S., Peak, E., & Foster, T. M. (2007). Are they all created equal? A comparison of different concept inventory development methodologies. AIP Conference Proceedings, 883:14-17. https://doi.org/10.1063/1.2508680
Linenberger, K. J., & Bretz, S. L. (2014). Biochemistry students’ ideas about shape and charge in enzyme-substrate interactions. Biochemistry and Molecular Biology Education, 42(3):203-212. DOI: https://doi.org/10.1002/bmb.20776
Mak, S. Y., Yip, D. Y., & Chung, C. M. (1999). Alternative conceptions in biology-related topics of integrated science teachers and implications for teacher education. Journal of Science Education and Technology, 8(2):161-170. DOI: http://www.jstor.org/stable/40188526
Marbach-Ad, G. (2001). Attempting to break the code in student comprehension of genetic concepts. Journal of Biological Education, 35(4):183-189. DOI: https://doi.org/10.1080/00219266.2001.9655775
Mayring, P. (2002). Einführung in die qualitative sozialforschung (5. edition). Beltz Verlag.
McFarland, J. L., Price, R. M., Wenderoth, M. P., Martinková, P., Cliff, W., Michael, J., Modell, H., & Wright, A. (2017). Development and validation of the homeostasis concept inventory. CBE Life Sciences Education, 16(2):1-13. DOI: https://doi.org/10.1187/cbe.16-10-0305
Naah, B. (2015). Enhancing preservice teachers’ understanding of students’ misconceptions in learning chemistry. Journal of College Science Teaching, 45(2):41-47. DOI: https://doi.org/10.2505/4/jcst15_045_02_41
Nelson, D. L., & Cox, M. M. (2016). Lehninger Principles of Biochemistry(Y. M. Elçin (ed.); 5th ed.). Palme Publshing.
Newman, D. L., Snyder, C. W., Fisk, J. N., & Wright, L. K. (2016). Development of the central dogma concept inventory (CDCI) assessment tool. CBE Life Sciences Education, 15(2). DOI: https://doi.org/10.1187/cbe.15-06-0124
Nolen, S. B., Haladyna, T. M., & Haas, N. S. (1992). Uses and abuses of achievement test scores. Educational Measurement: Issues and Practice, 1992:9-15. DOI: https://doi.org/10.1111/j.1745-3992.1992.tb00234.x
Paustian, T. D., Briggs, A. G., Brennan, R. E., Boury, N., Buchner, J., Harris, S., Horak, R. E. A., Hughes, L. E., Katz-Amburn, D. S., Massimelli, M. J., McDonald, A. H., Primm, T. P., Smith, A. C., Stevens, A. M., & Yung, S. B. (2017). Development, validation, and application of the microbiology concept inventory. Journal of Microbiology & Biology Education, 18(3). DOI: https://doi.org/10.1128/jmbe.v18i3.1320
Queloz, A. C., Klymkowsky, M. W., Stern, E., Hafen, E., & Köhler, K. (2017). Diagnostic of students’ misconceptions using the Biological Concepts Instrument (BCI): A method for conducting an educational needs assessment. PLoS ONE, 12(5):1-18. DOI: https://doi.org/10.1371/journal.pone.0176906
Ramlo, S. (2002). The Force and Motion Conceptual Evaluation. Annual Meeting of the Mid-Western Educational Research Association. Available at: https://files.eric.ed.gov/fulltext/ED471542.pdf
Ramlo, S. (2008). Validity and reliability of the force and motion conceptual evaluation. American Journal of Physics, 76(9):882-886. DOI: https://doi.org/10.1119/1.2952440
Revelle, W., & Zinbarg, R. E. (2009). Coefficients alpha, beta, omega, and the glb: Comments on sijtsma. Psychometrika, 74(1):145-154. DOI: https://doi.org/10.1007/s11336-008-9102-z
Robic, S. (2010). Mathematics, thermodynamics, and modeling to address ten common misconceptions about protein structure, folding, and stability. Cell Biology Education, 9:323-332. DOI: https://doi.org/10.1187/cbe.10
Sadava, D., Hillis, D. M., Heller, H. C., & Berenbaum, M. R. (2011). Life: The Science of Biology (E. Gündüz & İ. Türkan (eds.); 9th ed.). Palme Publishing.
Selvi, M., & Yakışan, M. (2004). Misconceptions about enzymes in university students. Gazi Eğitim Fakültesi Dergisi, 24(2):173-182. DOI: https://doi.org/10.17152/GEFD.02048
Shin, J., Guo, Q., & Gierl, M. J. (2019). Multiple-choice item distracter development using topic modeling approaches. Frontiers in Psychology, 10:1-14. DOI: https://doi.org/10.3389/fpsyg.2019.00825
Simon, E., Dickey, J., Reece, J., & Hogan, K. (2016). Campbell Essential Biology With Physiology (E. Gündüz & İ. Türkan (eds.); 5th ed.). Palme Publishing.
Smith, L. A., & Williams, J. M. (2007). “It’s the X and Y thing”: Cross-sectional and longitudinal changes in children’s understanding of genes. Research in Science Education, 37(4):407-422. DOI: https://doi.org/10.1007/s11165-006-9033-6
Smith, M. K., & Knight, J. K. (2012). Using the genetics concept assessment to document persistent conceptual difficulties in undergraduate genetics courses. Genetics, 191(1):21-32. DOI: https://doi.org/10.1534/genetics.111.137810
Tan, Ş. (2016). Measurement and Evaluation in Teaching (12th ed.). Pegem Akademi.
Tekkaya, C., Çapa, Y., & Yılmaz, Ö. (2000). Biology teacher candidates’ misconceptions about biology. HU Journal of Faculty of Education, 18:140-147. Available at: https://dergipark.org.tr/tr/pub/hunefd/issue/7818/102721#article_cite
Temelli, A. (2006). Determination of misconceptions concerning genetic subjects of high school students’. Kastamonu Education Journal, 14(1):73-82. Available at: https://dergipark.org.tr/tr/download/article-file/819169
Villafañe, S. M., Loertscher, J., Minderhout, V., & Lewis, J. E. (2011). Uncovering students’ incorrect ideas about foundational concepts for biochemistry. Chemistry Education Research and Practice, 12(2):1-6. DOI: https://doi.org/10.1038/nn.2744
Vogel, S. (2000). Mythology in introductory biology. Resonance, 2000:86-95.
White, B. T., & Bolker, E. D. (2008). Interactive computer simulations of genetics, biochemistry, and molecular biology. Biochemistry and Molecular Biology Education, 36(1):77-84. DOI: https://doi.org/10.1002/bmb.20152
Wynn, A. N., Pan, I. L., Rueschhoff, E. E., Herman, M. A. B., & Archer, E. K. (2017). Student Misconceptions about Plants - A First Step in Building a Teaching Resource. Journal of Microbiology & Biology Education, 18(1):0-13. DOI: https://doi.org/10.1128/jmbe.v18i1.1253
Yilmaz, M., Ertunç, G., Hatun Diken, E., & Çimen, O. (2017). The analysis of biology topics in the 8th grade science textbook in terms of scientific content. Erzincan University Journal Faculty of Education, 19(3):17-35. DOI: https://doi.org/10.17556/erziefd.330600
Yip, D. Y. (1998a). Identification of misconceptions in novice biology teachers and remedial strategies for improving biology learning. International Journal of Science Education, 20(4):461-477. DOI: https://doi.org/10.1080/0950069980200406
Yip, D. Y. (1998b). Teachers’ misconceptions of the circulatory system. Journal of Biological Education, 32(3):207-215. DOI: https://doi.org/10.1080/00219266.1998.9655622
Yurdugul, H. (2005). The comparison of reliability coefficients in parallel, tau-equivalent, and congeneric measurements. Ankara University Journal of Faculty of Educational Sciences, 39(1):15-37. DOI: https://doi.org/10.1501/egifak_0000000127
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.