Pattern Recognition Tasks with Personalized Federated Learning
Downloads
Personalized Federated Learning (PFL) constitutes a novel paradigm that tailors Machine Learning (ML) models to individual clients, thereby furnishing personalized model updates whilst upholding stringent data privacy principles. Diverging from conventional standard Federated Learning (FL) approaches, PFL adapts models to distinct client data distributions, engendering heightened levels of accuracy, customization, and data security, all while minimizing communication overhead. This methodology proves particularly salient in contexts marked by pattern recognition tasks reliant upon heterogeneous data sources and underpinned by paramount privacy apprehensions. In the present research endeavor, this article undertake a comprehensive comparative analysis of seven distinct PFL algorithms deployed across three diverse datasets, namely MNIST, SignMNIST, and Digit5. The overarching objective entails ascertaining the preeminent PFL algorithm, within the framework of pattern recognition tasks, through a rigorous evaluation anchored in metrics encompassing Accuracy, Precision, Recall, and F1 Score. Concurrently, an in-depth scrutiny of these PFL algorithms is conducted, elucidating their operative workflows, advantages, and limitations. Through empirical investigation, the findings evince that APPLE, FedGC, and FedProto emerge as stalwart contenders, consistently furnishing superior performance across the spectrum of assessed datasets, while acknowledging the contextual specificity of alternative algorithms and the potential for iterative refinement to realize optimal outcomes.
Downloads
[1] Niknam, S., Dhillon, H. S., & Reed, J. H. (2020). Federated Learning for Wireless Communications: Motivation, Opportunities, and Challenges. IEEE Communications Magazine, 58(6), 46–51. doi:10.1109/MCOM.001.1900461.
[2] Hosain, M. T., & Morol, M. K. (2025). Can Multi-turn Self-refined Single Agent LMs with Retrieval Solve Hard Coding Problems? Proceedings of the Annual Meeting of the Association for Computational Linguistics, 4, 129–142. doi:10.18653/v1/2025.acl-srw.8.
[3] Voigt, P., & Von dem Bussche, A. (2017). The EU General Data Protection Regulation (GDPR): A Practical Guide. In The EU General Data Protection Regulation (GDPR): a Practical Guide. Springer International Publishing, Berlin, Germany. doi:10.1007/978-3-319-57959-7.
[4] Abir, M. R., Mridha, M. F., & Shin, J. Federated Smart Mirrored Personalized Fashion in IoT. ResearchGate, 1-5. doi:10.13140/RG.2.2.35779.52008.
[5] Brendan McMahan, H., Moore, E., Ramage, D., Hampson, S., & Agüera y Arcas, B. (2017). Communication-efficient learning of deep networks from decentralized data. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 54.
[6] Hosain, M. T., Morol, M. K., & Hossen, M. J. (2025). A hybrid self-attentive linearized phrase structured transformer based RNN for financial sentence analysis with sentence level explainability. Scientific Reports, 15(1), 23893. doi:10.1038/s41598-025-09265-8.
[7] Kairouz, P., & McMahan, H. B. (2021). Advances and open problems in federated learning. Foundations and trends in machine learning, 14(1-2), 1-210. doi:10.1561/2200000083.
[8] Arivazhagan, M. G., Aggarwal, V., Singh, A. K., & Choudhary, S. (2019). Federated learning with personalization layers. arXiv Preprint, arXiv:1912.00818. doi:10.48550/arXiv.1912.00818.
[9] Mushfiqur Rahman Abir, Asif Zaman, & Sawon Mursalin. (2024). Efficiency measurement of FL algorithms for image classification. GSC Advanced Research and Reviews, 18(3), 356–366. doi:10.30574/gscarr.2024.18.3.0110.
[10] Karimireddy, S. P., Kale, S., Mohri, M., Reddi, S. J., Stich, S. U., & Suresh, A. T. (2020). SCAFFOLD: Stochastic Controlled Averaging for Federated Learning. 37th International Conference on Machine Learning, ICML 2020, PartF168147-7, 5088–5099.
[11] Li, T., Sahu, A. K., Zaheer, M., Sanjabi, M., Talwalkar, A., & Smith, V. (2020). Federated Optimization in Heterogeneous Networks. Proceedings of Machine Learning and Systems, 2, 429–450.
[12] Gupta, R. Das, Hosain, M. T., Mridha, M. F., & Ahmed, S. U. (2025). Multimodal Programming in Computer Science with Interactive Assistance Powered by Large Language Model. Lecture Notes in Computer Science, 15770 LNCS, 59–69. doi:10.1007/978-3-031-93864-1_5.
[13] Hosain, M. T., Rahman, S., Morol, M. K., & Parvez, M. R. (2025). Xolver: Multi-agent reasoning with holistic experience learning just like an olympiad team. arXiv Preprint, arXiv:2506.14234. doi:10.48550/arXiv.2506.14234.
[14] Theodoridis, S., & Koutroumbas, K. (2006). Pattern recognition. Elsevier, Amsterdam, Netherlands.
[15] Saini, P., Kaur, J., & Lamba, S. (2021). A Review on Pattern Recognition Using Machine Learning. Lecture Notes in Mechanical Engineering, 619–627. doi:10.1007/978-981-16-0942-8_58.
[16] Hosain, M. T., Gupta, R. D., & Morol, M. K. (2025). Multilingual question answering in low-resource settings: A dzongkha-english benchmark for foundation models. arXiv Preprint, arXiv:2505.18638. doi:10.48550/arXiv.2505.18638.
[17] Woubie, A., Solomon, E., & Attieh, J. (2024). Maintaining privacy in face recognition using federated learning method. IEEE Access, 12, 39603-39613. doi:10.1109/ACCESS.2024.3373691.
[18] Hosain, M. T., Abir, M. R., Rahat, M. Y., Mridha, M. F., & Mukta, S. H. (2024). Privacy Preserving Machine Learning with Federated Personalized Learning in Artificially Generated Environment. IEEE Open Journal of the Computer Society, 5, 694–704. doi:10.1109/OJCS.2024.3466859.
[19] Hosain, M. T., Zaman, A., Sajid, M. S., Khan, S. S., & Akter, S. (2023). Privacy Preserving Machine Learning Model Personalization through Federated Personalized Learning. 2023 4th International Conference on Data Analytics for Business and Industry, ICDABI 2023, 536–545. doi:10.1109/ICDABI60145.2023.10629638.
[20] Luo, J., & Wu, S. (2022). Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning. IJCAI International Joint Conference on Artificial Intelligence, 2166–2173. doi:10.24963/ijcai.2022/301.
[21] Zhang, J., Hua, Y., Wang, H., Song, T., Xue, Z., Ma, R., & Guan, H. (2023). FedALA: Adaptive Local Aggregation for Personalized Federated Learning. Proceedings of the 37th AAAI Conference on Artificial Intelligence, AAAI 2023, 37, 11237–11244. doi:10.1609/aaai.v37i9.26330.
[22] Oh, J., Kim, S., & Yun, S. Y. (2021). Fedbabu: Towards enhanced representation for federated image classification. arXiv Preprint, arXiv:2106.06042. doi:10.48550/arXiv.2106.06042.
[23] Niu, Y., & Deng, W. (2022). Federated Learning for Face Recognition with Gradient Correction. Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022, 36, 1999–2007. doi:10.1609/aaai.v36i2.20095.
[24] Xu, J., Tong, X., & Huang, S. L. (2023). Personalized federated learning with feature alignment and classifier collaboration. arXiv preprint arXiv:2306.11867. doi:10.48550/arXiv.2306.11867.
[25] Tan, Y., Long, G., Ma, J., Liu, L., Zhou, T., & Jiang, J. (2022). Federated Learning from Pre-Trained Models: A Contrastive Learning Approach. Advances in Neural Information Processing Systems, 35, 19332–19344.
[26] Tan, Y., Long, G., Liu, L., Zhou, T., Lu, Q., Jiang, J., & Zhang, C. (2022). FedProto: Federated Prototype Learning across Heterogeneous Clients. Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022, 36, 8432–8440. doi:10.1609/aaai.v36i8.20819.
[27] Deng, L. (2012). The MNIST database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6), 141–142. doi:10.1109/MSP.2012.2211477.
[28] El-Marzouki, N., Lasri, I., Riadsolh, A., & Elbelkacemi, M. (2024). American Sign Language Recognition with Convolutional Neural Networks: A Gateway to Enhanced Inclusivity. Lecture Notes in Networks and Systems, 1100 LNNS, 24–33. doi:10.1007/978-3-031-68660-3_3.
[29] Zhou, K., Yang, Y., Hospedales, T., & Xiang, T. (2020). Learning to Generate Novel Domains for Domain Generalization. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12361 LNCS, 561–578. doi:10.1007/978-3-030-58517-4_33.
[30] Abir, M., Hosain, M. T., Jubair, M. A. A., & Mridha, M. F. (2024). Imvb7t: A multi-modal model for food preferences based on artificially produced traits. Proceedings of the 3rd International Conference on Computing Advancements, 882-888. doi:10.1145/3723178.3723295.
[31] Senekane, M. (2019). Differentially Private Image Classification Using Support Vector Machine and Differential Privacy. Machine Learning and Knowledge Extraction, 1(1), 483–491. doi:10.3390/make1010029.
[32] Nirmala, M. (2022). Sign Language Recognition Using Deep Learning. 2022 4th International Conference on Cognitive Computing and Information Processing, CCIP 2022, 12(5), 964–968. doi:10.1109/CCIP57447.2022.10058655.
[33] Sharma, A., Bhardwaj, H., Bhardwaj, A., Sakalle, A., Acharya, D., & Ibrahim, W. (2022). A Machine Learning and Deep Learning Approach for Recognizing Handwritten Digits. Computational Intelligence and Neuroscience, 2022. doi:10.1155/2022/9869948.
[34] Bhushan, S., Alshehri, M., Keshta, I., Chakraverti, A. K., Rajpurohit, J., & Abugabah, A. (2022). An Experimental Analysis of Various Machine Learning Algorithms for Hand Gesture Recognition. Electronics (Switzerland), 11(6), 968. doi:10.3390/electronics11060968.
[35] Gope, B., Pande, S., Karale, N., Dharmale, S., & Umekar, P. (2021). Handwritten digits identification using mnist database via machine learning models. IOP Conference Series: Materials Science and Engineering, 1022(1), 012108. doi:10.1088/1757-899X/1022/1/012108.
[36] Ruberto, S., Terragni, V., & Moore, J. H. (2020). Image feature learning with genetic programming. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 12270 LNCS, 63–78. doi:10.1007/978-3-030-58115-2_5.
[37] Xi, E. (2022). Image Classification and Recognition Based on Deep Learning and Random Forest Algorithm. Wireless Communications and Mobile Computing, 2022. doi:10.1155/2022/2013181.
[38] Durmus, A. E., Yue, Z., Ramon, M., Matthew, M., Paul, W., & Venkatesh, S. (2021). Federated learning based on dynamic regularization. International Conference on Learning Representations, 10280833.
[39] Li, Q., He, B., & Song, D. (2021). Model-contrastive federated learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 10713–10722.
[40] Zhu, Z., Hong, J., & Zhou, J. (2021). Data-Free Knowledge Distillation for Heterogeneous Federated Learning. Proceedings of Machine Learning Research, 139, 12878–12889.
- This work (including HTML and PDF Files) is licensed under a Creative Commons Attribution 4.0 International License.
