Email this article 
TOSLS: Development, Implementation, and Quality Analysis of an Instrument for Assessing Scientific Literacy
Abstract
The research aimed to develop an appropriate cognitive assessment for scientific literacy to measure science education students' abilities to identify learning strengths and weaknesses. This research used the R & D method. The normality test and a one-sample t-test was conducted. The specific topic covered in the research is fermented material. The study participants are science education students at a public university in Surabaya, Indonesia. The results indicated that the percentage of question difficulty levels, with 11.11% categorized as difficult and 44.44% categorized as easy. The analysis of test item discrimination reveals that 66.67% fall into the very good category, 11.11% into the good category, and 22.22% into the bad category. The one-sample t-test is conducted, yielding a significance value of 0.0314. Based on the obtained data, with 0.314 > 0.05, the null hypothesis (Ho) is accepted. This implies that the TOSLS instrument influences assessing students' level of scientific literacy ability. The findings of this study serve as a reference and best practice for tertiary institutions seeking to evaluate students' scientific literacy abilities.
Keywords
Full Text:
PDFReferences
Akdiş, C 2019, Detergents we use for Agustina, D. A., & Rahmawati, L, 2021, ‘Analysis of Student Science Literacy Skills with TOSLS. Elementary School’, Journal of Yogyakarta PGRI University, Vol.8, pp. 15–23.
Allum Nick, Besley John, Gomes Louis & Smith, 2018, ‘Disparities in science literacy’. Science. Vol 360 No.6391,pp.861-862.
Ardianto A,2016, ‘Comparison Of Students’ Scientific Literacy In Integrated Science Learning Through Model Of Guided Discovery And Problem Based Learning’, Jurnal Pendidikan IPA Indonesia. Vol.5, No.1, pp: 31-37.
Arifin, Z, 2009,Learning Evaluation. Bandung: Remaja Rosdakarya
Arikunto, S ,2019, Fundamentals of Educational Evaluation: Bumi Aksara
Cahyana, U., Supatmi, S., Erdawati, & Rahmawati, Y, 2019, ‘Influence of web-based learning and learning independence toward student’s scientific literacy in chemistry course’, International Journal of Instruction, Vol.12, No.44, pp:655–668.
David Fortus, Knut Neumann & Troy D.Sadler, 2022, ‘The role of affect in science literacy for all’, International Journal Of Science Education. Vol.4, No.44 pp.535-555.
Fitriatun, A., & Sukanti, 2016, Analysis of Validity, Reliability, and Practice Questions for the National Accounting Economics Exam at MAN Maguwoharjo. Jurnal Kajian Pendidikan Akuntansi Indonesia. Vol.8 : pp.1-11.
Gormally, C., Brickman, P., & Lut, M., 2012, Developing a test of scientific literacy skills (TOSLS): Measuring undergraduates’ evaluation of scientific information and arguments. In CBE Life Sciences Education, Vol.11, No.4, pp: 364–377. https://doi.org/10.1187/cbe.12- 03-0026.
Hawa, A.M., & Putra, L.V, 2018, PISA for Indonesian students. Janacitra, Vol.1, No.1, pp:1–8.
Ismail Hisyam, Salleh M.F & Aris Syed, 2017, ‘Malaysian Education Plan 2013-2025: Transformation on Science Classroom towards Student's Achievement in TIMMS and PISA’, Journal Social Sciences, Vol.12, No.1, pp.79-84.
Jackson, S. L, 2015, Research methods and statistics: A critical thinking approach. Cengage learning.
Jagger L Susan & Yore D Larry, 2017, ‘Mind the Gap: Looking for Evidence-Based Practice of Science Literacy for All in Science Teaching Journals’, Journal of Science Teacher Education. Vol.1, No.2,pp.559-577.
Jufrida, Basuki Rahmat, Kurniawan Wawan, Pangestu Danu & Fitaloka, 2019, ‘Scientific literacy and science learning achievement at junior high school’, International Journal of Evaluation and Research in Education (IJERE), Vol.8 No.4, pp.630-636.
Kayumova, S., & Tippins, D, 2016, ‘Toward re-thinking science education in terms of affective practices: Reflections from the field’, Cultural Studies of Science Education, Vol.11, No.3, pp.567–575.
Krapp, A., & Prenzel, M, 2011, ‘Research on interest in science: Theories, methods, and findings’, International Journal of Science Education, Vol.33 No.1, pp.27–50.
Ministry of Education of the People’s Republic of China. (2020). High school physics/chemistry/ biology/geography curriculum standards.http://www.moe.gov.cn/srcsite/A26/s8001/202006/t20200603_462199.html
Muhid, A, 2012, ‘Statistical Analysis 5 practical steps of statistical analysis with SPSS for Windows. Zifatama jawara.
Nani Hanifah, 2014, ‘Comparison of Difficulty Levels, Item Distinguishing Power, and Reliability of the Ordinary Multiple Choice and Multiple Choice Tests in the Association of Economics Subjects’, Jurnal SOSIO e-KONS, Vol.6, No.1
National Academies of Sciences, E., and Medicine, 2016, ‘Science literacy: Concepts, contexts, and consequences. National Academies Press.
National Science Board, 2018, Science and Engineering Indicators 2018. Alexandria, VA: National Science Foundation.
OECD, 2019, PISA 2018 result (volume I): what students know and can do. Paris: OECD Publishing.
OECD,2019, PISA 2018 insight and interpretations. Paris: OECD Publishing.
OECD. (2021). OECD Skills Outlook 2021
Pituch, K. A., & Stevens, J. P, 2015, Applied multivariate statistics for the social sciences: Analyses with SAS and IBM’s SPSS. Routledge
Putri R.T, Masriani & Rasmawan R, 2022, ‘Analysis of Science Literacy Ability of Chemistry Education Students at Tanjungpura University’, Jurnal IPA dan Pembelajaran IPA, Vol.6, No.2, pp:164-179.
Ratnawati, Nasir M & Nazar Muhammad, 2020, ‘Development of Scientific Literacy-Based Multiple Choice Questions on Mol’, chimica didactica acta. Vol.8, No.1, pp: 18-23.
Septiani A.D, Junaidi E & Purwoko A, 2019, ‘The Relationship Between Critical Thinking Skills and Scientific Literacy Skills In Chemistry Education Students At The University Of Mataram. Prosiding Seminar Nasional FKIP Universitas Mataram. pp.234-224.
Shepard, L. A., Penuel, W. R., & Pellegrino, J. W, 2018, ‘Using learning and motivation theories to coherently link formative assessment, grading practices, and large-scale assessment’, Educational Measurement: Issues and Practice, Vol.37, No.1, pp. 21–34.
Sjöström, J., Eilks, , 2020, ‘Correction to: Reconsidering Different Visions of Scientific Literacy and Science Education Based on the Concept of Bildung. In: Dori, Y.J., Mevarech, Z.R., Baker, D.R. (eds) Cognition, Metacognition, and Culture in STEM Education’, Innovations in Science Education and Technology, Vol.24.
Sudijono, A, 2015, ‘Introduction to educational evaluation. Raja Grafindo Persada.
Sugiyono, 2012, Introduction to educational evaluation. Bandung: Alfabeta.
Valladares Liliana, 2021. Scientific Literacy and Social Transformation: Critical Perspectives About Science Participation and Emancipation. Vol. 30, pp 557–587.
Widiyawati Y, Nurwaidah I & Sari S, 2022, ‘Development of an Integrated Science Test Instrument with Reasoned Multiple Choice Types to Measure Student Hots’, Jurnal Saintifika.Vol.21, No.2, pp: 1-14.
Zalfaghari Fatemeh & Ahmadi A, 2016, Assessment literacy components across subjectmatters. Educational Assessment & Evaluation. Vol. 3 pp:1-16.
Shaffer Justin, Ferguson Julie & Kamaryn denaro, 2019, ‘Use of the Test of Scientific Literacy Skills Reveals That Fundamental Literacy Is an Important Contributor to Scientific Literacy’, Life Science Education, Vol 18, No. 3 pp. 1-10.
Klucevsek M Kristin, 2017, ‘The Intersection of Information and Science Literacy’, Information Comunication Literacy, Vol.11 No.2, pp: 354-365.
Wysession E Michael, Nicole LaDue, & Budd David, 2012, ‘Developing and Applying a set earth science literacy principles’, Journal Of Geoscience education, Vol.60 No.2 pp. 95-99.
Fives Helenrose, Huebner Wendy, Birnbaum S & Nicolich Mark, 2014, ‘Developing a Measure of Scientific Literacy for Middle School Students’, science education, Vol. 98, No.4 pp:549-580.
Mantzicopoulus Panayota, Patrick Helen & Samarapungavan Ala, 2013, ‘Science Literacy in School and Home Contexts: Kindergarteners’ Science Achievement and Motivation’, Cognition and instruction, Vol. 31 No.1, pp62-119.
Avikasari, Rukayah & Mintasih, 2018, ‘The Influence of Science Literacy-Based Teaching Material towards Science Achievement’, International Journal of Evaluation and Research in Education. Vol.7. No.3.
Sorvik Ove Gard & Mork M Sonja, 2015,’ Scientific literacy as social practice: Implications for reading and writing in science classrooms’, Scientific literacy as social practice’, Vo.11, No.3, pp. 268-281.
Mantazicopoulus Panayota, Patrick Helen, & Samarapungavan, 2013,’ Science Literacy in School and Home Contexts:Kindergarteners’ Science Achievement and Motivation’, cognition and instruction, Vol.31, No.01, pp.62-119.
Falk H John, Dierking Lynn, Prendergast Sawanger & Satus Nancy, 2016,’ Correlating Science Center Use With Adult Science Literacy: An International, Cross-Institutional Study’, Science Education, Vol.100, No.5, pp. 849-876.
Mc Farlanane, 2013,’ Understanding the Challenges of Science Education in the 21st Century: New Opportunities for Scientific Literacy’, International Letters Of Social and Humanistic Sciences, Vol 1, No.4, pp.35-44.
Vieira Marques & Tenreiro Celina, 2014, Fostering Scientific Literacy and Critical Thinking in Elementary Science Education, Internasional Journal of Science and Math Education, Vol.1, No.14, pp.659-680.
Kilag Kit T, Lisao Y Charmaine, Lastimoso R Jovielyn, 2024, ‘ Bildung-Oriented Science Education: A Critical Review of Different Visions of Scientific Literacy’, International Multidisciplinary Journal of Research for Innovation, Sustainability and Excellence, Vol.1, No.2, pp 1-10.
Ødegaard Marianne, Haug Beritm Mork M Sonja & Sørvik Ove Gard, 2014, ‘Challenges and Support WhenTeaching Science Through anIntegrated Inquiry and LiteracyApproach’, International Journal of Science Education, Vol 36, No18, pp.2997-3020.
Jagger Susan L & Yore D Larry, 2017, ‘Mind the Gap: Looking for Evidence-Based Practice of Science Literacy for All in Science Teaching’, ‘Journal of Science Teacher Education’. Vol.23, No.6, pp.559-577.
Drummond Caitlin & Fischhoff, 2017, ‘Individuals with greater science literacy and education have more polarized beliefs on controversial science topics’, Psychological and cognitive science, Vol.36, No.114. pp.9587-9592.
Cervetii, N. Gina, Barber Jacqueline & Dorph Rena, 2012, ‘The impact of an integrated approach to science and literacy in elementary school classrooms’, Journal of Research in Science Teaching, Vol.49, No.5, pp.631-658.
Turiman Punia, Omar Jizah, Daud Mohd Adzliana & Osman Kamisah, 2012, ‘Fostering the 21th Century Skills Through Scientific Literacy Science Process Skills,’ Procedia Social and Behavior. Vol.59 pp.110-116.
Klein D Perry, 2016, ‘The Challenges of Scientific Literacy:From the viewpoint of second-generation cognitive science’, International Journal of Science Education, Vol 28, No.2, pp. 143-178.
Cavas Huyuguzel Pinar, Ozdem Yasemin, Cavas Bulent, Jale Cakiroglu & Ertepinar Hamide, 2013, Vol.24, No.4, pp.383-401.
Wysession E Michael, Ladue Nicole, & Budd A David, 2012, ‘Developing and Applying a Set of Earth Science Literacy Principles,’ Vol.60, No.2, pp.95-99.
Correia Miranda R.P, Valle di X.B, Dazzani Melissa & Malachias, 2010, ‘The importance of scientific literacy in fostering education for sustainability: Theoretical considerations and preliminary findings from a Brazilian experience’, Journal of Cleaner Production, Vol.18, No.7, pp. 678-685.
DOI: http://dx.doi.org/10.30870/jppi.v10i1.21828
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Jurnal Penelitian dan Pembelajaran IPA
This work is licensed under a Creative Commons Attribution 4.0 International License.
Jurnal Penelitian dan Pembelajaran IPA is licensed under a Creative Commons Attribution 4.0 International License
Copyright © 2024 Jurnal Penelitian dan Pembelajaran IPA. All rights reserved.