A comparative analysis of models for assessing the effectiveness of agricultural training courses

Document Type : Review Article

Authors

Department of Socio-Economic and Agricultural Extension Research, Agricultural Research, Education & Extension Organization (AREEO), Tehran, I. R. Iran

10.22099/iar.2025.51602.1645

Abstract

Assessing the effectiveness of agricultural training courses has long been a crucial subject for planners and decision-makers. A significant gap in the literature exists due to the lack of recognized models and frameworks for evaluating the effectiveness of these courses. In this context, the present study aimed to conduct a scoping review and comparative analysis of existing models for assessing the effectiveness of agricultural training programs. The study identified 17 models used for evaluation and established eight criteria for comparing these frameworks. The scoring and ranking of these models revealed that the Phillips Return on Investment model is among the most optimal for assessing the effectiveness of agricultural training courses. Based on the criteria established in this study, the Phillips model offers a more realistic approach for evaluating the effectiveness of agricultural training courses. Notably, the findings indicate that, apart from the Phillips model, none of the other frameworks explicitly consider Return on Investment, while it is not possible to assess the effectiveness of agricultural training without calculating the Return on Investment.

Keywords

Main Subjects

Article Title [Persian]

تحلیل مقایسه ای الگوهای ارزیابی اثربخشی دوره های آموزشی کشاورزی

Authors [Persian]

  • خدیجه بذرافکن
  • حسن علیپور
سازمان تحقیقات، آموزش و ترویج کشاورزی، تهران، ج. ا. ایران
Abstract [Persian]

ارزیابی اثربخشی برنامه ها و دوره های آموزشی کشاورزی همیشه به عنوان یک معضل کلیدی برای بسیاری از برنامه ریزان و تصمیم گیران بوده است. عدم وجود شناخت از الگوها و چارچوب های مناسب برای ارزیابی اثربخشی این دوره ها به عنوان یک شکاف بحرانی در ادبیات ارزیابی و اثربخشی آموزشی بوده است. در این راستا، مرور نظام مند و مقایسه الگوها ارزیابی اثربخشی دوره های آموزشی کشاورزی به عنوان هدف اصلی این مطالعه انتخاب شد. نتایج مطالعه به شناسایی 17 مدل ارزیابی اثربخشی دوره های آموزشی و 8 معیار مقایسه این چارچوب ها ختم شد. همچنین، نتایج مطالعه نشان داد که الگوی بازگشت سرمایه فلیپس یکی از بهترین الگوها برای ارزیابی اثربخشی دوره های آموزشی ترویجی است. این الگو بر اساس معیارهای معرفی شده در مطالعه، می تواند به حصول نتایج واقع بینانه تری در مورد اثربخشی برنامه های آموزشی بهره برداران کشاورزی ختم شود. نتایج مطالعه حاضر نشان داد که هیچ کدام از مدل ها به جز مدل فلیپس به بازگشت سرمایه توجه نکرده اند، این در حالی است که ارزیابی اثربخشی آموزش های کشاورزی بدون محاسبه بازگشت سرمایه امکانپذیر نیست.

Keywords [Persian]

  • ارزیابی اثربخشی
  • بازگشت سرمایه
  • دوره های آموزشی کشاورزی
  • معیارهای مقایسه

References

Abao, E., Isidro, M. A., Bacus, R., Balo, V., Boholano, H., Bustamante, J., Mananay, J., & Navarro, T. M. (2022). CIRO model: A monitoring and evaluation framework in developing global Filipino teachers' program. Neuro Quantology, 20(16), 1502. https://doi.org/10.14704/NQ.2022.20.16.NQ880147
Abbasi Rostami, A., AhmadPour, A., & Sharifzadeh, M. S. (2016). Analysis of eeffectiveness of extension education activities on promoting tobacco growers' knowledge level in Mazandaran province with structural equation mmodelling. Iranian Journal of Agricultural Economics and Development Research, 47(3), 695-706. https://doi.org/10.22059/ijaedr.2016.60250
Abili, K., Gholamali lavasani, M., Gholami, K., & Hosseini, S. J. (2016) The study of effectiveness training courses supervisions and suggestions suitable solutions in order to its improvement (case study: National Iranian gas company). Strategic Studies in the Oil and Energy Industry, 7 (27), 51-74.
Edham Maleki, M., Khosravipour, B., & Soltani, F. (2021). Participatory management of groundwater resources in agriculture (case study: Inhibitory and promotional factors in (Murghab Plain, Khuzestan province). Geography and Human Relationships, 3(4), 419-423. https://doi.org/10.22034/gahr.2021.279993.1526
Ahn, E., & Kang, H. (2018). Introduction to systematic review and meta-analysis. Korean Journal of Anesthesiology, 71(2), 103-112. https://doi.org/10.4097/kjae.2018.71.2.103
Ayele, N. F., & Singh, M. (2024). Integrating sustainability with performance: Effect of social and environmental dimensions of the balanced scorecard on the performance of financial institutions in Ethiopia, moderated by management commitment. Business Strategy & Development, 7(3), e414. https://doi.org/10.1002/bsd2.414
Azizi-Khalkheili, T. (2017). Investigating the effectiveness of farmers occupational training the case of: Vermicompost production training in Pasargad township. Journal of Entrepreneurial Strategies in Agriculture, 4(7), 39-47. https://doi.org/10.29252/jea.4.7.39
Bagherabadi, G. H. (2013). Investigating the evaluation and effectiveness of training courses of the teacher training centre and technical and professional research based on the first and second level of the Kirkpatrick model. Tehran: Technical and Vocational Education Organization Press: Tehran, Iran. (In Persian).
Baldwin, T. T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel psychology, 41(1), 63-105. https://doi.org/10.1111/j.1744-6570.1988.tb00632.x
Brinkerhoff, R. O. (2005). The success case method: A strategic evaluation approach to increasing the value and effect of training. Advances in Developing Human Resources, 7(1), 86-101. https://doi.org/10.1177/1523422304272172
Brown, C. (2012). Application of the balanced scorecard in higher education: Opportunities and challenges. Planning for Higher Education, 40(4), 40-50.
Coffman, S., Doolen, J., & Llasus, L. (2015). Program development and evaluation of the concierge model of simulation. On-Line Journal of Nursing Informatics, 19(2), 8-27.
Crocetti, E. (2016). Systematic reviews with meta-analysis: Why, when, and how? Emerging Adulthood, 4(1), 3-18. https://doi.org/10.1177/2167696815617076
De Jesus Alvares Mendes Junior, I., & Alves, M. D. C. (2023). The balanced scorecard in the education sector: A literature review. Cogent Education, 10(1), 2160120. https://doi.org/10.1080/2331186X.2022.2160120
Elfiky, A., Arous, S., Ahmed, G., & Abouraia, M. (2021). Measuring the outcomes of training programs in the Egyptian hotels: An analytical study. Journal of the Faculty of Tourism and Hotels-University of Sadat City, 5(1), 138-155.
Enayati rad, M., Ajili, A., Rezaei Moghaddam, k., & Bijani, M. (2009) Factors influencing knowledge Corn growers in about sustainable agriculture in the West North of Khuzestan, Journal of Agricultural Extension and Education, 5(2), 68-59.
Fathi Vajargah, K., Dibavajari, T. (2016). Assessing the effectiveness of training courses. Tehran: Aeezh. (In Persian).
Fazeli, S., Forouzani, M., Yazdanpanah, M., & Abdeshahi, A. (2016). A quality evaluation of IPM/FFS training courses using QFD. Journal of Agricultural Extension and Education Research, 9(1), 69-75.
Gomez, A. K. (2003). An analysis of the evaluation practices of employer-sponsored training in the financial services industry (Doctoral Dissertation, Texas A&M University, Texas, The United States of America). Retrieved from: https://core.ac.uk/download/pdf/147123094.pdf
Grigal, M., Test, D. W., Beattie, J., & Wood, W. M. (1997). An evaluation of transition components of individualized education programs. Exceptional Children, 63(3), 357-372. https://doi.org/10.1177/001440299706300305
Gulu, K., Celik, O., Gulu, T., & Bayram, H. (2017). A research on internal marketing and motivation: Employee evaluation of training and development programmes in banking sector. Business & Management Studies: An International Journal, 5(1), 162-173. http://dx.doi.org/10.15295/bmij.v5i1.104
Hajimirrahimi, S. D. (2022). Evaluating the socio-economic impacts of training, extension, and research tours of progressive farmers in Alborz province; application of Kirkpatrick model. Iranian Agricultural Extension and Education Journal, 18(1), 143-159. https://doi.org/10.52547/jea.9.18.1
Hladchenko, M. (2015). Balanced scorecard-a strategic management system of the higher education institution. International Journal of Educational Management, 29(2), 167-176. https://doi.org/10.1108/IJEM-11-2013-0164
Iran Ministry of Agriculture Jihad. (2019). Disseminatable findings of the agriculture and natural resources sector in 2019 of the agricultural research, education and extension organization (Volume 2). Tehran: Agricultural Research, Education, and Extension Organization Press.
Khodaverdian, M. R. (2023). Principles and foundations of evaluating educational and promotional programs. Tehran: Agricultural Research, Education and Extension Organization Press.
Khorasani, A., & Rashtiani, B. (2012). Comprehensive approach to the effectiveness of education (a step-by-step guide to implementing the ROI model). Tehran: Iran Industrial Education and Research Publishing Center.
Kirkpatrick, D. L. (2013). Kirkpatrick four levels audio recordings study guide. Georgia: Kirkpatrick Partners. https://doi.org/10.1515/9781580468619
Linde, K., & Willich, S. N. (2003). How objective are systematic reviews? Differences between reviews on complementary medicine. Journal of the Royal Society of Medicine, 96(1), 17-22. https://doi.org/10.1177/014107680309600105
Mansikka, H., Harris, D., & Virtanen, K. (2017). An input-process-output model of pilot core competencies. Aviation Psychology and Applied Human Factors, 7, 78-85. https://doi.org/10.1027/2192-0923/a000120
Marshall, J., & Peters, M. (1985). Evaluation and education: The ideal learning community. Policy Sciences, 18(3), 263-288. https://doi.org/10.1007/BF00138912
Marshall, S. P. (2012). Assessing schema knowledge. In Test theory for a new generation of tests (pp. 155-180). Routledge.
McGrath, J. (1984). Groups: Interaction and performance (Vol. 14). NJ: Prentice-Hall, Englewood Cliffs.
Mirgohar, M., & Movahed Mohamady, H. (2008) study of extension and training needs assessment of agricultural with using of measure differences in the level of technical knowledge and its application Azrvykrd. Journal of Agricultural Extension and Education, 4(1), 72-61.
Molenda, M. (1996). Designing instructional systems. Training and development handbook (4th ed.). New York: Mcgraw-Hill.
Munn, Z., Peters, M. D., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18, 1-7.https://doi.org/10.1186/s12874-018-0611-x
Oreszczyn, S., Lane, A., & Carr, S. (2010). The role of networks of practice and webs of influencers on farmers' engagement with and learning about agricultural innovations. Journal of Rural Studies, 26(4), 404-417. https://doi.org/10.1016/j.jrurstud.2010.03.003
Pershing, J. A. (2000). Business impact ISD model: Indiana University. The Culture and Change Management Conference of the International Society for Performance Improvement, Washington DC, The United States of America.
Pershing, J. A. (2006). Human performance technology fundamentals. Handbook of human performance technology: Principles, practices, and potential (3rd Edition). John Wiley & Sons, Inc: Hoboken, New Jersey, The United States of America.
Pershing, J. A., & Lee, S. H. (2000). Transfer evaluation of knowledge and skill development: A case study of an instructional systems development training program. Performance Improvement Quarterly, 13(1), 7-29. https://doi.org/10.1111/j.1937-8327.2000.tb00154.x
Peter, K., John, V., George, G., Luke, H., Shawn, M., and Spencer, G. (2021). Impact of calf housing improvement and farmer training on finances, management and animal welfare perceptions of Kenyan smallholder dairy farmers. Journal of Development and Agricultural Economics, 13(2), 119-129. https://doi.org/10.5897/JDAE2021.1259
Phillips, J. J. (2012). Return on investment in training and performance improvement programs. UK: Routledge. https://doi.org/10.4324/9780080516257
Phillips, P. P., and Phillips, J. J. (2009). Return on investment, in Watkins, R. and Leigh, D. (Eds), Handbook of Improving Performance in the Workplace, (pp. 823-846). Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9780470592663.ch53
Rahayu, E. S., & Paerah, A. (2022). Learning transfer perceived from the Baldwin & Ford theory: An empirical study on the alumni of pre-service training in East Java. Enrichment: Journal of Management, 12(4), 3232-3241.
https://doi.org/10.35335/enrichment.v12i4.791
Saifi Hosseinabadi, M. (2015). Evaluating the effectiveness of the executive management training course at Iran National Gas Company based on the Kirkpatrick model. Training and Development of Human Resources, 2(4), 1-16.
Srivastava, V., & Walia, A. M. (2018). An analysis of various training evaluation models. International Journal of Advance and Innovative Research, 5(4), 276-282.
Stufflebeam, D. L. (1971). The relevance of the CIPP evaluation model for educational accountability. Journal of Research and Development in Education, 5, 19-25.
Stufflebeam, D. L., & Zhang, G. (2017). The CIPP evaluation model: How to evaluate for improvement and accountability. New York: Guilford Publications.
Suleiman, W., Dassanayake, M. S., & Othman, A. E. A. (2016). Roles of trainee characteristics and work environment in training transfer: A conceptual extension of Baldwin and Ford model with job attitude factors in Nigerian Context. Amity Journal of Training and Development, 1(1), 20-31.
Talukder, B., & Blay-Palmer, A. (2017). Comparison of methods to assess agricultural sustainability. Sustainable agriculture reviews, 25, 149-168. https://doi.org/10.1007/978-3-319-58679-3_5
Warr, P., Bird, M., & Rackham, N. (1970). Evaluation of management training: A practical framework, with cases, for evaluating training needs and results. Princeton: Gower Press.
Yanti, D., & Azhariyah, S. (2020). Development program evaluation on entrepreneurship course in vocational high school west Sumatra. In 1st Progress in Social Science, Humanities and Education Research Symposium (PSSHERS 2019), (pp. 19-22). Atlantis Press.
 
Iran Agricultural Research
Volume 43, Issue 2
December 2024
Pages 64-74

Files

Share

How to cite

Statistics