Development and Testing of a Patient Outcome Measure for Interprofessional Tuberculosis Care: A Delphi Study

Bau D. Ardyansyah, Reinie Cordier, Margo Brewer, Dave Parsons

Abstract


Background: A chronic medical condition such as tuberculosis can be physically and emotionally challenging for both health practitioners and patients and their families. Tuberculosis requires a team-based care model that provides resilience and coordinated work, such as the one offered by an interprofessional collaborative practice team. Despite the increasing interest in interprofessional-based care globally, there is a notable lack of measures to assess patient impact. We aimed to develop a patient outcome measure to quantify the functional impact of interprofessional care on tuberculosis patients. Methods: The study involved four phases: 1) developing a conceptual framework and creating items, 2) evaluating the construct through Delphi studies to obtain international consensus, 3) back-to-back translation into Indonesian, and 4) re-evaluating the construct with Delphi study to obtain Indonesian consensus. The consensus was reached if the Content Validity Index covers at least 70% agreement from experts, an interquartile range <1, and a median score of 4 or 5 on a 5-point Likert-type scale. The COnsensus-based Standards for the Selection of Health Measurement INstruments (COSMIN) guidelines were used to assess item relevance, comprehensibility, and comprehensiveness. Results: A total of 65 international and 61 Indonesian participants in the Delphi studies. The final instrument consists of 44 items organized into five domains. All items were relevant to the construct being measured and deemed understandable, and significant concerns related to TB care were comprehensively addressed in the instrument. Conclusion:The findings indicate that the instrument content validity was good, fulfilling COSMIN requirements for items' relevance, comprehensibility, and comprehensiveness.

 

Doi: 10.28991/ESJ-2025-09-01-08

Full Text: PDF


Keywords


Interprofessional Education; Interprofessional Practice; Content Validity; Tuberculosis Care; Patient Outcome Measure.

References


WHO. (2022). Global Tuberculosis Report. World Health Organization (WHO), Rome, Italy. Available online: https://apps.who.int/iris/rest/bitstreams/1474924/retrieve (accessed on December 2024).

Mahendradhata, Y., Trisnantoro, L., Listyadewi, S., Soewondo, P., Marthias, T., Harimurti, P., & Prawira, J. (2017). The Republic of Indonesia health system review. Health Systems in Transition, WHO Regional Office for South-East Asia, New Delhi, India.

Directorate General of Prevention and Disease Control. (2022). Factsheet-Country-Profile-Indonesia-2022. Ministry of Health Republic of Indonesia, Jakarta, Indonesia. Available online: https://tbindonesia.or.id/wp-content/uploads/2023/02/Factsheet-Country-Profile-Indonesia-2022.pdf (accessed on December 2024).

Hafez, R., Harimurti, P., & Martin-Hughes, R. (2020). Tuberculosis in Indonesia: Epidemic Projections and Opportunities to Accelerate Control. World Bank, Washington, United States.

Mustikawati, D., Mahendradhata, Y., & Voskens, J. (2017). Breakthrough strategy for TB control in Indonesia. Handbook of Global Tuberculosis Control: Practices and Challenges, 2017, 47–59. doi:10.1007/978-1-4939-6667-7_5.

WHO. (2010). Framework for action on interprofessional education and collaborative practice. No. WHO/HRH/HPN/10.3, World Health Organization (WHO), Rome, Italy.

Hammick, M., Freeth, D., Koppel, I., Reeves, S., & Barr, H. (2007). A best evidence systematic review of interprofessional education: BEME Guide no. 9. Medical Teacher, 29(8), 735–751. doi:10.1080/01421590701682576.

Reeves, S., Perrier, L., Goldman, J., Freeth, D., & Zwarenstein, M. (2013). Interprofessional education: effects on professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews, 3, CD002213. doi:10.1002/14651858.cd002213.pub3.

Oandasan, I., & Reeves, S. (2005). Key elements of interprofessional education. Part 2: Factors, processes and outcomes. Journal of Interprofessional Care, 19(Sup1), 39–48. doi:10.1080/13561820500081703.

Cox, M., Cuff, P., Brandt, B., Reeves, S., & Zierler, B. (2016). Measuring the impact of interprofessional education on collaborative practice and patient outcomes. Journal of Interprofessional Care, 30(1), 1–3. doi:10.3109/13561820.2015.1111052.

Oosterom, N., Floren, L. C., ten Cate, O., & Westerveld, H. E. (2019). A review of interprofessional training wards: Enhancing student learning and patient outcomes. Medical Teacher, 41(5), 547–554. doi:10.1080/0142159X.2018.1503410.

Reeves, S., Pelone, F., Harrison, R., Goldman, J., & Zwarenstein, M. (2017). Interprofessional collaboration to improve professional practice and healthcare outcomes. Cochrane Database of Systematic Reviews, 2017(6), CD000072. doi:10.1002/14651858.CD000072.pub3.

Shuyi, A. T., Zikki, L. Y. T., Mei Qi, A., & Koh Siew Lin, S. (2024). Effectiveness of interprofessional education for medical and nursing professionals and students on interprofessional educational outcomes: A systematic review. Nurse Education in Practice, 74, 103864. doi:10.1016/j.nepr.2023.103864.

Canadian Interprofessional Health Collaborative. (2012). An Inventory of Quantitative Tools Measuring Interprofessional Education and Collaborative Practice Outcomes. Canadian Interprofessional Health Collaborative, Ottawa, Canada. Available online: https://heller.brandeis.edu/relational-coordination/pdfs/canadian-interprofessional-health-collaborative-report.pdf (accessed in December 2024).

S Yasobant, S., Nazli Khatib, M., Syed, Z. Q., Gaidhane, A. M., Shah, H., Narkhede, K., Bhavsar, P., Patel, J., Sinha, A., Puwar, T., Saha, S., & Saxena, D. (2022). Health-Related Quality of Life (HRQoL) of Patients with Tuberculosis: A Review. Infectious Disease Reports, 14(4), 509–524. doi:10.3390/idr14040055.

Singh, C., Palladino, K. E., Karuza, J., Ampadu, L., & Fogarty, C. T. (2024). Opportunities and Challenges of Interprofessional Education: Postgraduate Nurse Practitioner and Physician Residency. Journal for Nurse Practitioners, 20(8). doi:10.1016/j.nurpra.2024.105086.

Cadet, T., Cusimano, J., McKearney, S., Honaker, J., O’Neal, C., Taheri, R., Uhley, V., Zhang, Y., Dreker, M., & Cohn, J. S. (2024). Describing the evidence linking interprofessional education interventions to improving the delivery of safe and effective patient care: a scoping review. Journal of Interprofessional Care, 38(3), 476–485. doi:10.1080/13561820.2023.2283119.

Aggarwal, A. (2010). Health-related quality of life: A neglected aspect of pulmonary tuberculosis. Lung India, 27(1), 1. doi:10.4103/0970-2113.59259.

Wong, Y. J., Noordin, N. M., Keshavjee, S., & Lee, S. W. H. (2021). Impact of latent tuberculosis infection on health and wellbeing: A systematic review and meta-analysis. European Respiratory Review, 30(159), 1–11. doi:10.1183/16000617.0260-2020.

IPEC. (2016). Core competencies for interprofessional collaborative practice: 2016 update. Interprofessional Education Collaborative (IPEC), Washington, United States. Available online: https://ipec.memberclicks.net/assets/2016-Update.pdf (accessed on December 2024).

Canadian Interprofessional Health Collaborative. (2010). A National Interprofessional Competency Framework. Canadian Interprofessional Health Collaborative, Ottawa, Canada.

Brewer, M. (2013). Interprofessional capability framework. Curtin University, Bentley, United Kingdom.

WHO. (2003). Adherence to long-term therapies: evidence for action. World Health Organization (WHO), Rome, Italy.

WHO. (2016). Patient engagement. World Health Organization (WHO), Rome, Italy.

WHO. (2009). WHO patient safety curriculum guide for medical schools. World Health Organization (WHO), Rome, Italy.

WHO. (2011). Patient safety curriculum guide: multi-professional. World Health Organization (WHO), Rome, Italy.

Schmitz, C., Atzeni, G., & Berchtold, P. (2017). Challenges in interprofessionalism in Swiss health care: the practice of successful interprofessional collaboration as experienced by professionals. Swiss Medical Weekly, 147(4344), w14525. doi:10.4414/smw.2017.14525.

Curran, V., Hollett, A., Casimiro, L. M., McCarthy, P., Banfield, V., Hall, P., Lackie, K., Oandasan, I., Simmons, B., & Wagner, S. (2011). Development and validation of the interprofessional collaborator assessment rubric (ICAR). Journal of Interprofessional Care, 25(5), 339–344. doi:10.3109/13561820.2011.589542.

Sigalet, E., Donnon, T., & Grant, V. (2012). Undergraduate students’ perceptions of and attitudes toward a simulation-based interprofessional curriculum: The kidSIM Attitudes questionnaire. Simulation in Healthcare, 7(6), 353–358. doi:10.1097/SIH.0b013e318264499e.

Stutsky, B. J., & Spence Laschinger, H. K. (2014). Development and Testing of a Conceptual Framework for Interprofessional Collaborative Practice. Health and Interprofessional Practice, 2(2). doi:10.7710/2159-1253.1066.

Schroder, C., Medves, J., Paterson, M., Byrnes, V., Chapman, C., O’Riordan, A., Pichora, D., & Kelly, C. (2011). Development and pilot testing of the collaborative practice assessment tool. Journal of Interprofessional Care, 25(3), 189–195. doi:10.3109/13561820.2010.532620.

Pollard, K. C., & Miers, M. E. (2008). From students to professionals: Results of a longitudinal study of attitudes to pre-qualifying collaborative learning and working in health and social care in the United Kingdom. Journal of Interprofessional Care, 22(4), 399–416. doi:10.1080/13561820802190483.

McFadyen, A. K., Webster, V., Strachan, K., Figgins, E., Brown, H., & McKechnie, J. (2005). The Readiness for Interprofessional Learning Scale: A possible more stable sub-scale model for the original version of RIPLS. Journal of Interprofessional Care, 19(6), 595–603. doi:10.1080/13561820500430157.

Almås, S. H., & Ødegård, A. (2010). Impact of Professional Cultures on Students' Perceptions of Interprofessionalism: Some Norwegian Experiences. Journal of Allied Health, 39(3), 143-149.

Luetsch, K., & Rowett, D. (2016). Developing interprofessional communication skills for pharmacists to improve their ability to collaborate with other professions. Journal of Interprofessional Care, 30(4), 458–465. doi:10.3109/13561820.2016.1154021.

Oates, M., & Davidson, M. (2015). A critical appraisal of instruments to measure outcomes of interprofessional education. Medical Education, 49(4), 386–398. doi:10.1111/medu.12681.

Ardyansyah, B. D., Cordier, R., Brewer, M., & Parsons, D. (2024). An evaluation of the psychometric properties of the Australian Collaborative Practice Assessment Tool. PLoS ONE, 19(5 May). doi:10.1371/journal.pone.0302834.

Jensen, C. B., Iversen, A., Dahlgren, M. A., & Norbye, B. (2024). “Everyone who wants to can practice on me”– a qualitative study of patients’ view on health profession students’ learning in an interprofessional clinical placement. BMC Medical Education, 24(1). doi:10.1186/s12909-024-05194-8.

Diamond, I. R., Grant, R. C., Feldman, B. M., Pencharz, P. B., Ling, S. C., Moore, A. M., & Wales, P. W. (2014). Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology, 67(4), 401–409. doi:10.1016/j.jclinepi.2013.12.002.

Mokkink, L. B., de Vet, H. C. W., Prinsen, C. A., & Terwee, C. B. (2023). COSMIN Methodology for Conducting Systematic Reviews of Patient-Reported Outcome Measures (PROMs). Encyclopedia of Quality of Life and Well-Being Research. Springer, Cham, Switzerland. doi:10.1007/978-3-319-69909-7_2972-2.

Mokkink, L. B., de Vet, H. C. W., Prinsen, C. A. C., Patrick, D. L., Alonso, J., Bouter, L. M., & Terwee, C. B. (2017). COSMIN Risk of Bias checklist for systematic reviews of Patient-Reported Outcome Measures. Quality of Life Research, 27(5), 1171–1179. doi:10.1007/s11136-017-1765-4.

Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. doi:10.1007/s11136-018-1798-3.

Qualtrics (2025). Qualtrics XM: The Leading Experience Management Software. Qualtrics XM, Washington, United States. Available online: https://www.qualtrics.com (accessed on December 2024).

Bradby, M. (1990). Status passage into nursing: another view of the process of socialization into nursing. Journal of Advanced Nursing, 15(10), 1220–1225. doi:10.1111/j.1365-2648.1990.tb01715.x.

WHO. (2012). WHODAS 2.0 translation package (version 1.0): Translation and linguistic evaluation protocol and sup-porting material. World Health Organization (WHO), Rome, Italy.

Pubcompare. (2023). SPSS Statistics for windows (version 26.0). Pubcompare, San Francisco, United States.

Belton, I., MacDonald, A., Wright, G., & Hamlin, I. (2019). Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process. Technological Forecasting and Social Change, 147, 72–82. doi:10.1016/j.techfore.2019.07.002.

Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398–405. doi:10.1111/nhs.12048.

Allen, M. S., Iliescu, D., & Greiff, S. (2022). Single Item Measures in Psychological Science. European Journal of Psychological Assessment, 38(1), 1–5. doi:10.1027/1015-5759/a000699.

Xyrichis, A., Reeves, S., & Zwarenstein, M. (2018). Examining the nature of interprofessional practice: An initial framework validation and creation of the InterProfessional Activity Classification Tool (InterPACT). Journal of Interprofessional Care, 32(4), 416–425. doi:10.1080/13561820.2017.1408576.

IPEC. (2016). Core competencies for interprofessional collaborative practice: 2016 update. Interprofessional Education Collaborative (IPEC), Washington, United States. Available online: https://ipec.memberclicks.net/assets/2016-Update.pdf (accessed on December 2024).

Morgan, K. H., Barroso, C. S., Bateman, S., Dixson, M., & Brown, K. C. (2020). Patients’ Experiences of Interprofessional Collaborative Practice in Primary Care: A Scoping Review of the Literature. Journal of Patient Experience, 7(6), 1466–1475. doi:10.1177/2374373520925725.

Aggarwal, A. N. (2019). Quality of life with tuberculosis. Journal of Clinical Tuberculosis and Other Mycobacterial Diseases, 17(100121). doi:10.1016/j.jctube.2019.100121.

OECD. (2023). OECD Health Statistics. Organisation for Economic Co-operation and Development (OECD), Paris, France.

Chad-Friedman, E., Coleman, S., Traeger, L. N., Pirl, W. F., Goldman, R., Atlas, S. J., & Park, E. R. (2017). Psychological distress associated with cancer screening: A systematic review. Cancer, 123(20), 3882–3894. doi:10.1002/cncr.30904.

Course-Choi, J., & Hammond, L. (2021). Social Media Use and Adolescent Well-Being: A Narrative Review of Longitudinal Studies. Cyberpsychology, Behavior, and Social Networking, 24(4), 223–236. doi:10.1089/cyber.2020.0020.

Halvorson, J. J., Winter, S. B., Teasdall, R. D., & Scott, A. T. (2013). Talar Neck Fractures: A Systematic Review of the Literature. Journal of Foot and Ankle Surgery, 52(1), 56–61. doi:10.1053/j.jfas.2012.10.008.

Yerrakalva, D., Mullis, R., & Mant, J. (2015). The associations of fatness, fitness, and physical activity with all-cause mortality in older adults: A systematic review. Obesity, 23(10), 1944–1956. doi:10.1002/oby.21181.

Zywiel, M. G., Mahomed, A., Gandhi, R., Perruccio, A. V., & Mahomed, N. N. (2013). Measuring expectations in orthopaedic surgery: A systematic review. Clinical Orthopaedics and Related Research, 471(11), 3446–3456. doi:10.1007/s11999-013-3013-8.

Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study. Quality of Life Research, 27(5), 1159–1170. doi:10.1007/s11136-018-1829-0.


Full Text: PDF

DOI: 10.28991/ESJ-2025-09-01-08

Refbacks

  • There are currently no refbacks.