Peer-Assessment Academic Integrity Scale (PAAIS-24)

Jusuf Blegur; Herman Subarjah; Yusuf Hidayat; Amung Ma'amun; Agus Mahendra; I Made Sriundy Mahardika; Sefri Hardiansyah

doi:10.28991/ESJ-2024-08-02-09

Authors

Jusuf Blegur 1) Universitas Pendidikan Indonesia, Dr. Setiabudhi Street, No. 229, Bandung, 40154, Indonesia. 2) Universitas Kristen Artha Wacana, Adisucipto Street, No. 147, Kupang, 85228,, Indonesia
Herman Subarjah Universitas Pendidikan Indonesia, Dr. Setiabudhi Street, No. 229, Bandung, 40154,, Indonesia
Yusuf Hidayat
yusuf_h@upi.edu
Universitas Pendidikan Indonesia, Dr. Setiabudhi Street, No. 229, Bandung, 40154,, Indonesia
Amung Ma'amun Universitas Pendidikan Indonesia, Dr. Setiabudhi Street, No. 229, Bandung, 40154,, Indonesia
Agus Mahendra Universitas Pendidikan Indonesia, Dr. Setiabudhi Street, No. 229, Bandung, 40154,, Indonesia
I Made Sriundy Mahardika Universitas Negeri Surabaya, Lidah Wetan Street, Surabaya, 60213,, Indonesia
Sefri Hardiansyah Universitas Negeri Padang, Prof. Dr. Hamka Street, No. 1, Padang, 25173,, Indonesia

Vol. 8 No. 2 (2024): April

Research Articles

Downloads

PDF

Abstract
How to Cite
Metrics
References
License

This study aims to develop an academic integrity scale to help lecturers evaluate the academic integrity of university students with peer-assessment learning experiences using the ADDIE research and development method. Twenty-four items were designed using the concepts of academic integrity; honesty, trust, fairness, respect, responsibility, and courage validated by six raters and tested on 520 students from various universities in Indonesia. Testing content validity using the Aiken-V formula, construct validity testing using discriminant indexes, factor analysis (Exploratory and Confirmatory Factor Analysis), and concurrent validity testing by correlating PAAIS-24 with the developed Academic Integrity Scale. While the reliability test used Cronbach's alpha formula. The study results proved that each item of content validity meets with an Aiken value >0.80; on construct validity testing, the discriminant index value is >0.50, and the EFA and CFA loading factor values are >0.50. In addition, the model is appropriate because the theoretical model of PAAIS-24 is in accordance with empirical data. Whereas in reliability testing, Cronbach's alpha value is 0.95. Lastly, PAAIS-24 is one of the credible instruments. It contributes to developing knowledge that assists lecturers in measuring, assessing, and evaluating student academic integrity based on peer-assessment to promote increased academic performance.

Doi: 10.28991/ESJ-2024-08-02-09

Full Text: PDF

Blegur, J., Subarjah, H., Hidayat, Y., Ma’amun, A., Mahendra, A., Mahardika, I. M. S., & Hardiansyah, S. (2024). Peer-Assessment Academic Integrity Scale (PAAIS-24). Emerging Science Journal, 8(2), 513–526. https://doi.org/10.28991/ESJ-2024-08-02-09

Download Citation

Harp, J., & Taietz, P. (1966). Academic Integrity and Social Structure: A Study of Cheating among College Students. Social Problems, 13(4), 365–373. doi:10.2307/798585.

Bertram Gallant, T., & Rettinger, D. (2022). An Introduction to 30 Years of Research on Academic Integrity. Journal of College and Character, 23(1), 1–5. doi:10.1080/2194587x.2021.2017975.

Lancaster, T. (2021). Academic Dishonesty or Academic Integrity? Using Natural Language Processing (NLP) Techniques to Investigate Positive Integrity in Academic Integrity Research. Journal of Academic Ethics, 19(3), 363–383. doi:10.1007/s10805-021-09422-4.

Macfarlane, B., Zhang, J., & Pun, A. (2014). Academic integrity: a review of the literature. Studies in Higher Education, 39(2), 339–358. doi:10.1080/03075079.2012.709495.

Arna'out, A. (2016). Academic integrity issues: Benefits, challenges, initiatives and practices. International Journal of Social Sciences & Education, 6(1), 8–21.

Almutairi, Y. M. N. (2022). Effects of Academic Integrity of Faculty Members on Students' Ethical Behavior. Education Research International, 2022, 6806752. doi:10.1155/2022/6806752.

Bretag, T., & Mahmud, S. (2014). Embedding and extending exemplary academic integrity policy and support frameworks across the higher education sector. Department of Education, Skills and Employment, Australian Government, Canberra, Australia.

Cutri, J., Abraham, A., Karlina, Y., Patel, S. V., Moharami, M., Zeng, S., Manzari, E., & Pretorius, L. (2021). Academic integrity at doctoral level: the influence of the imposter phenomenon and cultural differences on academic writing. International Journal for Educational Integrity, 17(1), 8. doi:10.1007/s40979-021-00074-w.

Salamah, I. (2022). Factors Influencing Academic Dishonesty Among Sriwijaya State Polytechnic Students. International Journal of Science, Technology & Management, 3(2), 357–362. doi:10.46729/ijstm.v3i2.491.

McHaney, R., Cronan, T. P., & Douglas, D. E. (2016). Academic integrity: Information systems education perspective. Journal of Information Systems Education, 27(3), 153-158.

Morris, E. J. (2018). Academic integrity matters: Five considerations for addressing contract cheating. International Journal for Educational Integrity, 14(1), 15. doi:10.1007/s40979-018-0038-5.

Holden, O. L., Norris, M. E., & Kuhlmeier, V. A. (2021). Academic Integrity in Online Assessment: A Research Review. Frontiers in Education, 6, 639814. doi:10.3389/feduc.2021.639814.

Ayoub/Al-Salim, M. I., & Aladwan, K. (2021). The relationship between academic integrity of online university students and its effects on academic performance and learning quality. Journal of Ethics in Entrepreneurship and Technology, 1(1), 43–60. doi:10.1108/jeet-02-2021-0009.

Brown, T., Isbel, S., Logan, A., & Etherington, J. (2020). Predictors of academic integrity in undergraduate and graduate-entry masters occupational therapy students. Hong Kong Journal of Occupational Therapy, 33(2), 42–54. doi:10.1177/1569186120968035.

Stone, A. (2023). Student Perceptions of Academic Integrity: A Qualitative Study of Understanding, Consequences, and Impact. Journal of Academic Ethics, 21(3), 357–375. doi:10.1007/s10805-022-09461-5.

Bayaa Martin Saana, S. B., Ablordeppey, E., Mensah, N. J., & Karikari, T. K. (2016). Academic dishonesty in higher education: Students' perceptions and involvement in an African institution. BMC Research Notes, 9(1), 234. doi:10.1186/s13104-016-2044-0.

Zhao, L., Mao, H., Compton, B. J., Peng, J., Fu, G., Fang, F., Heyman, G. D., & Lee, K. (2022). Academic dishonesty and its relations to peer cheating and culture: A meta-analysis of the perceived peer cheating effect. Educational Research Review, 36, 100455. doi:10.1016/j.edurev.2022.100455.

Winardi, R. D., Mustikarini, A., & Anggraeni, M. A. (2017). Academic Dishonesty Among Accounting Students: Some Indonesian Evidence. Jurnal Akuntansi Dan Keuangan Indonesia, 14(2), 142–164. doi:10.21002/jaki.2017.08.

Musau, P. (2018). Academic Dishonesty in Medical Schools. Annals of African Surgery, 14(1), 19–21. doi:10.4314/aas.v14i1.4.

Henning, M., Alyami, M., Melyani, Z., Alyami, H., & Al Mansour, A. (2020). Development of the Cross-Cultural Academic Integrity Questionnaire - Version 3 (CCAIQ-3). Journal of Academic Ethics, 18(1), 35–53. doi:10.1007/s10805-019-09350-4.

Henning, M. A., Abaraogu, U. O., Ram, S., Malpas, P., & Hawken, S. J. (2016). Developing a Cross-Cultural Academic Integrity Questionnaire for Medical and Health Sciences Students. Medical Science Educator, 26(4), 581–586. doi:10.1007/s40670-016-0302-3.

Maryon, T., Dubre, V., Elliott, K., Escareno, J., Fagan, M. H., Standridge, E., & Lieneck, C. (2022). COVID-19 Academic Integrity Violations and Trends: A Rapid Review. Education Sciences, 12(12), 901. doi:10.3390/educsci12120901.

Bashir, H., & Bala, R. (2018). Development and validation of academic dishonesty scale (ADS): Presenting a multidimensional scale. International Journal of Instruction, 11(2), 57–74. doi:10.12973/iji.2018.1125a.

EmiÌ‡Noğlu Özmercan, E., Polat, B., & Nartgün, Z. (2022). Psychometric Properties of Academic Dishonesty Tendency Scale for Graduate Students and Investigating Academic Dishonesty Tendency Levels with CHAID Analysis. Journal of Measurement and Evaluation in Education and Psychology, 13(1), 86–104. doi:10.21031/EPOD.1022731.

Ramdani, Z. (2018). Construction of academic integrity scale. International Journal of Research Studies in Psychology, 7(1), 87–97. doi:10.5861/ijrsp.2018.3003.

Tauginienč—, L., Gaižauskaitč—, I., Razi, S., Glendinning, I., Sivasubramaniam, S., Marino, F., Cosentino, M., Anohina-Naumeca, A., & Kravjar, J. (2019). Enhancing the Taxonomies Relating to Academic Integrity and Misconduct. Journal of Academic Ethics, 17(4), 345–361. doi:10.1007/s10805-019-09342-4.

Jones, L. R. (2011). Academic integrity & academic dishonesty: A handbook about cheating & plagiarism. Florida Institute of Technology, Melbourne, United States.

San Jose, A. E. (2022). Academic Integrity of Students during the COVID-19 Pandemic: A Mixed Method Analysis. European Journal of Education and Pedagogy, 3(4), 97–103. doi:10.24018/ejedu.2022.3.4.400.

Yin, S., Chen, F., & Chang, H. (2022). Assessment as Learning: How Does Peer Assessment Function in Students' Learning? Frontiers in Psychology, 13, 912568. doi:10.3389/fpsyg.2022.912568.

Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2023). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 1–12. doi:10.1080/14703297.2023.2190148.

Ahangari, S., Rassekh-Alqol, B., & Hamed, L. A. A. (2013). The effect of peer assessment on oral presentation in an EFL context. International Journal of Applied Linguistics and English Literature, 2(3), 45–53. doi:10.7575/aiac.ijalel.v.2n.3p.45.

Daukšaitč—-Kolpakovienč—, A., & Mačianskienč—, N. (2023). Peer Assessment of Oral Presentations in EFL Classes: Assessors' View. Pedagogika, 150(2), 102–118. doi:10.15823/p.2023.150.6.

De Grez, Valcke, & Berings. (2010). Peer assessment of oral presentation skills. Procedia - Social and Behavioral Sciences, 2(2), 1776–1780. doi:10.1016/j.sbspro.2010.03.983.

Gillanders, R., Karazi, S., & O'Riordan, F. (2020). Loss aversion as a motivator for engagement with peer assessment. Innovations in Education and Teaching International, 57(4), 424–433. doi:10.1080/14703297.2020.1726203.

Chauhan, P. K., Wood, E., Plummer, T., & Forsyth, G. (2018). Peer-Based Interventions on Academic Integrity: Assessing Immediate and Long Term Learning. Journal of Academic Ethics, 16(2), 133–149. doi:10.1007/s10805-017-9296-8.

Tai, J., & Adachi, C. (2019). The transformative role of self- and peer-assessment in developing critical thinkers. Innovative Assessment in Higher Education, 64–73, Routledge, London, United Kingdom. doi:10.4324/9780429506857-6.

Zainal Abidin, N. A., Masek, A., Mohd Faiz, N. S., & Sahdan, S. (2018). Exploring the Elements of Integrity in Peer Assessment. MATEC Web of Conferences, 150, 5002. doi:10.1051/matecconf/201815005002.

Ilhan, O. (2023). A research on determining the performance properties of engineered wood products. Wood Industry and Engineering, 5(1), 1–6.

Iglesias Pérez, M. C., Vidal-Puga, J., & Pino Juste, M. R. (2022). The role of self and peer assessment in Higher Education. Studies in Higher Education, 47(3), 683–692. doi:10.1080/03075079.2020.1783526.

Thomas, G., Martin, D., & Pleasants, K. (2011). Using self- and peer-assessment to enhance students' future-learning in higher education. Journal of University Teaching and Learning Practice, 8(1), 52–69. doi:10.53761/1.8.1.5.

Fishman, T. (2014). The fundamental values of academic integrity. International Center for Academic Integrity, Clemson University, Clemson, United States.

Branch, R. M. (2009). Instructional Design: The ADDIE Approach. Springer, New York, United States. doi:10.1007/978-0-387-09506-6.

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. doi:10.1177/0013164485451012.

Bichi, A. A., & Embong, R. (2018). Evaluating the Quality of Islamic Civilization and Asian Civilizations Examination Questions. Asian People Journal (APJ), 1(1), 93–109.

Ebel, R. L., & Frisbie, D. A. (1972). Essentials of educational measurement. Prentice-Hall, Englewood Cliffs, United States.

Quaigrain, K., & Arhin, A. K. (2017). Using reliability and item analysis to evaluate a teacher-developed test in educational measurement and evaluation. Cogent Education, 4(1), 1301013. doi:10.1080/2331186X.2017.1301013.

Hair Jr, J. F., Black, W. C., Babin, B. J., Anderson, R. E., Black, W. C., & Anderson, R. E. (2019). Multivariate Data Analysis. Cengage Learning, Boston, United States.

Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2013). Using multivariate statistics. Pearson, Boston, United States.

Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3). doi:10.33151/ajp.8.3.93.

Hair, J. F., Page, M., & Brunsveld, N. (2019). Essentials of Business Research Methods. Routledge, New York, United States. doi:10.4324/9780429203374.

Pyrczak, F. (1973). Validity of the Discrimination Index as a Measure of Item Quality. Journal of Educational Measurement, 10(3), 227–231. doi:10.1111/j.1745-3984.1973.tb00801.x.

Blegur, J., Rajagukguk, C. P. M., Sjioen, A. E., & Souisa, M. (2023). Innovation of Analytical Thinking Skills Instrument for Throwing and Catching Game Activities for Elementary School Students. International Journal of Instruction, 16(1), 723–740. doi:10.29333/iji.2023.16140a.

Chiavaroli, N., & Familari, M. (2011). When Majority Doesn't Rule: The Use of Discrimination Indices to Improve the Quality of MCQs. Bioscience Education, 17(1), 1–7. doi:10.3108/beej.17.8.

Allen, N. J., & Meyer, J. P. (1990). The measurement and antecedents of affective, continuance and normative commitment to the organization. Journal of Occupational Psychology, 63(1), 1–18. doi:10.1111/j.2044-8325.1990.tb00506.x.

Hidayat, Y., Hambali, B., & Tresdani, D. (2022). Construct Validity of Emotional Intelligence Scale for Sports Students. Jurnal Pendidikan Jasmani Dan Olahraga, 7(2), 149–159. doi:10.17509/jpjo.v7i2.49836.

Guttman, L. (1954). Some necessary conditions for common-factor analysis. Psychometrika, 19(2), 149–161. doi:10.1007/BF02289162.

Kaiser, H. F. (1970). A second generation little jiffy. Psychometrika, 35(4), 401–415. doi:10.1007/BF02291817.

Kaiser, H. F. (1981). A revised measure of sampling adequacy for factor-analytic data matrices. Educational and Psychological Measurement, 41(2), 379–381. doi:10.1177/001316448104100216.

Abrahim, S., Mir, B. A., Suhara, H., Mohamed, F. A., & Sato, M. (2019). Structural equation modeling and confirmatory factor analysis of social media use and education. International Journal of Educational Technology in Higher Education, 16(1), 32. doi:10.1186/s41239-019-0157-y.

Hair, J. F., Sarstedt, M., Pieper, T. M., & Ringle, C. M. (2012). The Use of Partial Least Squares Structural Equation Modeling in Strategic Management Research: A Review of Past Practices and Recommendations for Future Applications. Long Range Planning, 45(5–6), 320–340. doi:10.1016/j.lrp.2012.09.008.

Jackson, D. L., Gillaspy, J. A., & Purc-Stephenson, R. (2009). Reporting Practices in Confirmatory Factor Analysis: An Overview and Some Recommendations. Psychological Methods, 14(1), 6–23. doi:10.1037/a0014694.

Shrestha, N. (2021). Factor Analysis as a Tool for Survey Analysis. American Journal of Applied Mathematics and Statistics, 9(1), 4–11. doi:10.12691/ajams-9-1-2.

Lee, H. suk, Ko, M., & Kim, H.-J. (2023). Concurrent Validity of Dual-Task Walking Speed With CERAD-NP Assessment Battery in Community-Dwelling Older Adults. Archives of Rehabilitation Research and Clinical Translation, 5(4), 100291. doi:10.1016/j.arrct.2023.100291.

Lin, WL., & Yao, G. (2014). Concurrent Validity. In: Michalos, A.C. (eds) Encyclopedia of Quality of Life and Well-Being Research. Springer, Dordrecht, Netherlands. doi:10.1007/978-94-007-0753-5_516.

Adams, H., Cervantes, P., Jang, J., & Dixon, D. (2014). Standardized Assessment. Evidence-Based Treatment for Children with Autism, 501–516, Academic Press, Cambridge, United States. doi:10.1016/b978-0-12-411603-0.00025-2.

Song, J., Howe, E., Oltmanns, J. R., & Fisher, A. J. (2023). Examining the Concurrent and Predictive Validity of Single Items in Ecological Momentary Assessments. Assessment, 30(5), 1662–1671. doi:10.1177/10731911221113563.

C. P. Dancey & J. Reidy. (2020). Statistics without maths for psychology (8th Ed.). Pearson Education, London, United Kingdom.

Schober, P., & Schwarte, L. A. (2018). Correlation coefficients: Appropriate use and interpretation. Anesthesia and Analgesia, 126(5), 1763–1768. doi:10.1213/ANE.0000000000002864.

Gündüz, A., Kumru Bayazit, R., Gündoğmuş, İ., Sertçelik, S., Gönül, H., Yaşar, A. B., Oğuz, G., & Sungur, M. Z. (2019). Turkish validity and reliability of the Sexual Complaints Screener for Women. Psychiatry and Clinical Psychopharmacology, 29(4), 632–639. doi:10.1080/24750573.2018.1525811.

Lohr, K. N. (2002). Assessing health status and quality-of-life instruments: Attributes and review criteria. Quality of Life Research, 11(3), 193–205. doi:10.1023/A:1015291021312.

Amrane-Cooper, L., Hatzipanagos, S., & Tait, A. (2022). Developing Student Behaviours that Support Academic Integrity in Distance Learning. Open Praxis, 13(4), 378–384. doi:10.55982/openpraxis.13.4.461.

Cardina, Y., & Bayu Sangka, K. (2022). Qualitative Survey of Academic Dishonesty on Higher Education: Identify the Factors and Solutions. Journal of Positive School Psychology, 2022(3), 8705–8719.

Fishman, T. (2014). The fundamental values of academic integrity. International Center for Academic Integrity, Clemson University, Clemson, United States.

Miron, J., Eaton, S. E., McBreairty, L., & Baig, H. (2021). Academic Integrity Education Across the Canadian Higher Education Landscape. Journal of Academic Ethics, 19(4), 441–454. doi:10.1007/s10805-021-09412-6.

Sanni-Anibire, H., Stoesz, B. M., Gervais, L., & Vogt, L. (2021). International students' knowledge and emotions related to academic integrity at Canadian postsecondary institutions. International Journal for Educational Integrity, 17(1), 21. doi:10.1007/s40979-021-00088-4.

Werner, J. M. (2022). Academic Integrity and Human Resource Development: Being and Doing. Human Resource Development Review, 21(2), 249–257. doi:10.1177/15344843221078505.

Guerrero-Dib, J. G., Portales, L., & Heredia-Escorza, Y. (2020). Impact of academic integrity on workplace ethical behaviour. International Journal for Educational Integrity, 16(1), 2. doi:10.1007/s40979-020-0051-3.

Ayalon, M., & Wilkie, K. J. (2021). Investigating peer-assessment strategies for mathematics pre-service teacher learning on formative assessment. Journal of Mathematics Teacher Education, 24(4), 399–426. doi:10.1007/s10857-020-09465-1.

Acceptance Rate:	21%
Review Speed:	74 days
Issue Per Year:	6
Number of Volumes:	7
Number of Issues:	44
Number of Articles:	493
Number of Reviewers:	1187
Number of Contributors:	1394
Contributing Countries:	83
No. of WoS Citations:	2609
No. of Scopus Citations:	2936
No. of Google Citations:	4161
Google h-index:	29
Google i10-index:	126
Abstract Views:	681,807
PDF Download:	492,524

Peer-Assessment Academic Integrity Scale (PAAIS-24)

Authors

Downloads

Downloads

Information

indexing

editors

submission