Privacy-preserving machine learning: a review of federated learning techniques and ‎applications

  • Authors

    • Nazik Saber Rashid AUAS
    • Hajar Maseeh Yasin Akre University for Applied Sciences, Technical College of Informatics

    Received date: January 10, 2025

    Accepted date: January 27, 2025

    Published date: February 7, 2025

    https://doi.org/10.14419/af03y111
  • Privacy-Preserving Machine Learning; Federated Learning; Decentralized AI Models; Differential Privacy; ‎Homomorphic Encryption; IoT and Smart City Applications.

  • Abstract

    Federated Learning (FL), which permits decentralized model training without sharing raw data, guarantees ‎adherence to privacy laws like GDPR and HIPAA. This study offers a thorough analysis of FL with an ‎emphasis on its exceptional capacity to strike a balance between data value and privacy in industries ‎including healthcare, the Internet of Things, and finance. In contrast to previous evaluations, this study ‎explores sophisticated privacy-preserving techniques, such as differential privacy and homomorphic ‎encryption, and assesses how well they work to handle issues like adversarial threats, non-IID data ‎distributions, and communication overhead. The study also discusses the practical uses of optimization ‎techniques like Federated Proximal (FedProx) and Federated Averaging (FedAvg). This paper provides ‎practical insights and future approaches to promote the use of FL in privacy-sensitive AI applications by ‎comparing and contrasting current methods and pointing out research gaps. FL is positioned as a ‎revolutionary method for privacy-conscious machine learning because to this fresh viewpoint.

    This update highlights the paper's distinctive features that set it apart from prior reviews, including the ‎thorough examination of privacy mechanisms, assessment of optimization techniques, and identification ‎of research needs‎.

  • References

    1. G. Nguyen et al., “Landscape of machine learning evolution: privacy-preserving federated ‎learning frameworks and tools,” Artif Intell Rev, vol. 58, no. 2, Feb. 2025, https://doi.org/10.1007/s10462-024-11036-2.
    2. ‎A. El Ouadrhiri and A. Abdelhadi, “Differential Privacy for Deep and Federated Learning: A ‎Survey,” IEEE Access, vol. 10, pp. 22359–22380, 2022, https://doi.org/10.1109/ACCESS.2022.3151670.
    3. K. Narmadha and P. Varalakshmi, “Federated Learning in Healthcare: A Privacy Preserving ‎Approach,” in Studies in Health Technolo-gy and Informatics, IOS Press BV, May 2022, pp. 194–‎‎198. https://doi.org/10.3233/SHTI220436.
    4. J. Feng, C. Rong, F. Sun, D. Guo, and Y. Li, “PMF: A privacy-preserving human mobility prediction ‎framework via federated learning,” Proc ACM Interact Mob Wearable Ubiquitous Technol, vol. 4, ‎no. 1, Mar. 2020, https://doi.org/10.1145/3381006.
    5. X. Gong et al., “Ensemble Attention Distillation for Privacy-Preserving Federated Learning.”‎
    6. M. Aledhari, R. Razzak, R. M. Parizi, and F. Saeed, “Federated Learning: A Survey on Enabling ‎Technologies, Protocols, and Applica-tions,” 2020, Institute of Electrical and Electronics Engineers ‎Inc. https://doi.org/10.1109/ACCESS.2020.3013541.
    7. P. Treleaven and M. Smietanka, “Federated Learning The pioneering distributed machine learning ‎and privacy-preserving data technol-ogy.”‎
    8. ‎J. Song, W. Wang, T. R. Gadekallu, J. Cao, and Y. Liu, “EPPDA: An Efficient Privacy-Preserving Data ‎Aggregation Federated Learning Scheme,” IEEE Trans Netw Sci Eng, vol. 10, no. 5, pp. 3047–‎‎3057, Sep. 2023, doi: 10.1109/TNSE.2022.3153519.‎
    9. ‎R. T. Potla, “Distributed Learning and Broad Applications in Scientific Research Privacy-Preserving ‎AI with Federated Learning: Revo-lutionizing Fraud Detection and Healthcare Diagnostics,” 2022.‎ https://doi.org/10.1109/TNSE.2022.3153519.
    10. T. Li, A. K. Sahu, A. Talwalkar, and V. Smith, “Federated Learning: Challenges, Methods, and ‎Future Directions,” IEEE Signal Process Mag, vol. 37, no. 3, pp. 50–60, May 2020, https://doi.org/10.1109/MSP.2020.2975749.
    11. I. Ergun, H. U. Sami, and B. Guler, “Sparsified Secure Aggregation for Privacy-Preserving ‎Federated Learning,” Dec. 2021, [Online]. Available: http://arxiv.org/abs/2112.12872‎.
    12. S. Kadhe, N. Rajaraman, O. O. Koyluoglu, and K. Ramchandran, “FastSecAgg: Scalable Secure ‎Aggregation for Privacy-Preserving Fed-erated Learning,” Sep. 2020, [Online]. Available: ‎http://arxiv.org/abs/2009.11248‎.
    13. M. Grama, M. Musat, L. Muñoz-González, J. Passerat-Palmbach, D. Rueckert, and A. Alansary, ‎‎“Robust Aggregation for Adaptive Pri-vacy Preserving Federated Learning in Healthcare,” Sep. ‎‎2020, [Online]. Available: http://arxiv.org/abs/2009.08294‎.
    14. S. Bharati, M. R. H. Mondal, P. Podder, and V. B. S. Prasath, “Federated learning: Applications, ‎challenges and future directions,” Int J Hybrid Intell Syst, vol. 18, no. 1–2, pp. 19–35, 2022, https://doi.org/10.3233/HIS-220006.
    15. ‎F. Zerka et al., “Systematic Review of Privacy-Preserving Distributed Machine Learning From ‎Federated Databases in Health Care,” 2020. [Online]. Available: https://doi.org/10.1200/CCI.19.00047.
    16. Q. Li et al., “A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy ‎and Protection,” Jul. 2019, doi: 10.1109/TKDE.2021.3124599.‎
    17. C. Thapa, M. A. P. Chamikara, and S. A. Camtepe, “Advancements of federated learning towards ‎privacy preservation: from federated learning to split learning,” Nov. 2020, [Online]. Available: ‎http://arxiv.org/abs/2011.14818‎. https://doi.org/10.1007/978-3-030-70604-3_4.
    18. S. K. Lo, Q. Lu, L. Zhu, H. Paik, X. Xu, and C. Wang, “Architectural Patterns for the Design of ‎Federated Learning Systems,” Jan. 2021, [Online]. Available: http://arxiv.org/abs/2101.02373‎.
    19. A. Fu, X. Zhang, N. Xiong, Y. Gao, and H. Wang, “VFL: A Verifiable Federated Learning with ‎Privacy-Preserving for Big Data in In-dustrial IoT,” Jul. 2020, [Online]. Available: ‎http://arxiv.org/abs/2007.13585‎.
    20. ‎J. Domingo-Ferrer, A. Blanco-Justicia, J. Manjón, and D. Sánchez, “Secure and Privacy-Preserving ‎Federated Learning via Co-Utility,” Aug. 2021, [Online]. Available: ‎http://arxiv.org/abs/2108.01913‎.
    21. ‎G. Feretzakis, K. Papaspyridis, A. Gkoulalas-Divanis, and V. S. Verykios, “Privacy-Preserving ‎Techniques in Generative AI and Large Language Models: A Narrative Review,” Nov. 01, 2024, ‎Multidisciplinary Digital Publishing Institute (MDPI). https://doi.org/10.3390/info15110697.
    22. J. Wen, Z. Zhang, Y. Lan, Z. Cui, J. Cai, and W. Zhang, “A survey on federated learning: challenges ‎and applications,” International Journal of Machine Learning and Cybernetics, vol. 14, no. 2, pp. ‎‎513–535, Feb. 2023, https://doi.org/10.1007/s13042-022-01647-y.
    23. ‎G. A. Kaissis, M. R. Makowski, D. Rückert, and R. F. Braren, “Secure, privacy-preserving and ‎federated machine learning in medical imaging,” Nat Mach Intell, vol. 2, no. 6, pp. 305–311, Jun. ‎‎2020, https://doi.org/10.1038/s42256-020-0186-1.
    24. H. Fang and Q. Qian, “Privacy preserving machine learning with homomorphic encryption and ‎federated learning,” Future Internet, vol. 13, no. 4, 2021, https://doi.org/10.3390/fi13040094.
    25. K. Narmadha and P. Varalakshmi, “Federated Learning in Healthcare: A Privacy Preserving ‎Approach,” in Studies in Health Technolo-gy and Informatics, IOS Press BV, May 2022, pp. 194–‎‎198. https://doi.org/10.3233/SHTI220436.
    26. ‎A. Vyas, P. C. Lin, R. H. Hwang, and M. Tripathi, “Privacy-Preserving Federated Learning for ‎Intrusion Detection in IoT Environments: A Survey,” IEEE Access, 2024, https://doi.org/10.1109/ACCESS.2024.3454211.
    27. ‎Z. Yang, M. Chen, K. K. Wong, H. V. Poor, and S. Cui, “Federated Learning for 6G: Applications, ‎Challenges, and Opportunities,” Jan. 01, 2022, Elsevier Ltd. https://doi.org/10.1016/j.eng.2021.12.002.
    28. Z. Qin, G. Y. Li, and H. Ye, “Federated Learning and Wireless Communications,” May 2020, ‎‎[Online]. Available: http://arxiv.org/abs/2005.05265‎.
    29. Z. Li, V. Sharma, and S. P. Mohanty, “Preserving Data Privacy via Federated Learning: Challenges ‎and Solutions,” IEEE Consumer Electronics Magazine, vol. 9, no. 3, pp. 8–16, May 2020, https://doi.org/10.1109/MCE.2019.2959108.
    30. ‎A. Rauniyar et al., “Federated Learning for Medical Applications: A Taxonomy, Current Trends, ‎Challenges, and Future Research Di-rections,” Aug. 2022, [Online]. Available: ‎http://arxiv.org/abs/2208.03392‎.
    31. ‎X. Yin, Y. Zhu, and J. Hu, “A Comprehensive Survey of Privacy-preserving Federated Learning: A ‎Taxonomy, Review, and Future Di-rections,” Jul. 31, 2021, Association for Computing Machinery. ‎ https://doi.org/10.1145/3460427.
    32. ‎Y. Mansour, M. Mohri, J. Ro, and A. T. Suresh, “Three Approaches for Personalization with ‎Applications to Federated Learning,” Feb. 2020, [Online]. Available: ‎http://arxiv.org/abs/2002.10619‎.
    33. ‎X. Li, Y. Gu, N. Dvornek, L. H. Staib, P. Ventola, and J. S. Duncan, “Multi-site fMRI analysis using ‎privacy-preserving federated learning and domain adaptation: ABIDE results,” Med Image Anal, ‎vol. 65, Oct. 2020, https://doi.org/10.1016/j.media.2020.101765.
    34. ‎Y. Liu, J. J. Q. Yu, J. Kang, D. Niyato, and S. Zhang, “Privacy-preserving Traffic Flow Prediction: A ‎Federated Learning Approach,” Mar. 2020, https://doi.org/10.1109/JIOT.2020.2991401.
    35. B. Jeon, S. M. Ferdous, M. R. Rahman, and A. Walid, “Privacy-preserving Decentralized ‎Aggregation for Federated Learning,” Dec. 2020, [Online]. Available: ‎http://arxiv.org/abs/2012.07183‎. https://doi.org/10.1109/INFOCOMWKSHPS51825.2021.9484437.
    36. R. Kerkouche, G. Ács, C. Castelluccia, and P. Genevès, “Privacy-preserving and bandwidth-‎efficient federated learning: An application to in-hospital mortality prediction,” in ACM CHIL 2021 ‎‎- Proceedings of the 2021 ACM Conference on Health, Inference, and Learn-ing, Association for ‎Computing Machinery, Inc, Apr. 2021, pp. 25–35. https://doi.org/10.1145/3450439.3451859.
    37. K. Wei et al., “User-Level Privacy-Preserving Federated Learning: Analysis and Performance ‎Optimization,” Feb. 2020, [Online]. Available: http://arxiv.org/abs/2003.00229‎.
    38. F. Mo, H. Haddadi, K. Katevas, E. Marin, D. Perino, and N. Kourtellis, “PPFL: Privacy-preserving ‎federated learning with trusted exe-cution environments,” in MobiSys 2021 - Proceedings of the ‎‎19th Annual International Conference on Mobile Systems, Applications, and Services, ‎Association for Computing Machinery, Inc, Jun. 2021, pp. 94–108. https://doi.org/10.1145/3458864.3466628.
    39. V. Venkataramanan, S. Kaza, and A. M. Annaswamy, “DER Forecast using Privacy Preserving ‎Federated Learning,” Jul. 2021, [Online]. Available: http://arxiv.org/abs/2107.03248‎.
    40. M. Biswal, A. S. M. Tayeen, and S. Misra, “AMI-FML: A Privacy-Preserving Federated Machine ‎Learning Framework for AMI,” Sep. 2021, [Online]. Available: http://arxiv.org/abs/2109.05666‎.
    41. H. Fang and Q. Qian, “Privacy preserving machine learning with homomorphic encryption and ‎federated learning,” Future Internet, vol. 13, no. 4, 2021, https://doi.org/10.3390/fi13040094.‎
    42. ‎J. D. Fernández, S. P. Menci, C. M. Lee, A. Rieger, and G. Fridgen, “Privacy-preserving federated ‎learning for residential short-term load forecasting,” Appl Energy, vol. 326, Nov. 2022, https://doi.org/10.1016/j.apenergy.2022.119915.
    43. ‎A. M. Elbir, B. Soner, S. Coleri, D. Gunduz, and M. Bennis, “Federated Learning in Vehicular ‎Networks,” Jun. 2020, [Online]. Availa-ble: http://arxiv.org/abs/2006.01412‎.
    44. ‎T. Zhang, L. Gao, C. He, M. Zhang, B. Krishnamachari, and S. Avestimehr, “Federated Learning for ‎Internet of Things: Applications, Challenges, and Opportunities,” Nov. 2021, [Online]. Available: ‎http://arxiv.org/abs/2111.07494‎.
    45. A. Peyvandi, B. Majidi, S. Peyvandi, and J. C. Patra, “Privacy-preserving federated learning for ‎scalable and high data quality computa-tional-intelligence-as-a-service in Society 5.0,” Multimed ‎Tools Appl, vol. 81, no. 18, pp. 25029–25050, Jul. 2022, https://doi.org/10.1007/s11042-022-12900-5.‎
    46. L. Zhang, J. Xu, P. Vijayakumar, P. K. Sharma, and U. Ghosh, “Homomorphic Encryption-Based ‎Privacy-Preserving Federated Learn-ing in IoT-Enabled Healthcare System,” IEEE Trans Netw Sci ‎Eng, vol. 10, no. 5, pp. 2864–2880, Sep. 2023, https://doi.org/10.1109/TNSE.2022.3185327.
    47. S. Pentyala, N. Neophytou, A. Nascimento, M. De Cock, and G. Farnadi, “PrivFairFL: Privacy-‎Preserving Group Fairness in Federated Learning,” May 2022, [online]. Available: ‎http://arxiv.org/abs/2205.11584‎.
    48. W. Liu, T. Zhou, L. Chen, H. Yang, J. Han, and X. Yang, “Round efficient privacy-preserving ‎federated learning based on MKFHE,” Comput Stand Interfaces, vol. 87, Jan. 2024, https://doi.org/10.1016/j.csi.2023.103773.
    49. T. U. Islam, N. M. Tanzir, and U. Islam, “Privacy-Preserving Federated Learning Model for ‎Healthcare Data Thesis advisor Author Privacy-Preserving Federated Learning Model for ‎Healthcare Data,” 2023.‎ https://doi.org/10.1109/CCWC54503.2022.9720752.
    50. ‎M. Butt et al., “A Fog-Based Privacy-Preserving Federated Learning System for Smart Healthcare ‎Applications,” Electronics (Switzer-land), vol. 12, no. 19, Oct. 2023, https://doi.org/10.3390/electronics12194074.
    51. V. Michalakopoulos, E. Sarantinopoulos, E. Sarmas, and V. Marinakis, “Empowering federated ‎learning techniques for privacy-preserving PV forecasting,” Energy Reports, vol. 12, pp. 2244–‎‎2256, Dec. 2024, https://doi.org/10.1016/j.egyr.2024.08.033.
    52. S. Jiang, H. Yang, Q. Xie, C. Ma, S. Wang, and G. Xing, “Lancelot: Towards Efficient and Privacy-‎Preserving Byzantine-Robust Feder-ated Learning within Fully Homomorphic Encryption,” Aug. ‎‎2024, [Online]. Available: http://arxiv.org/abs/2408.06197‎.
    53. Y. Zhang et al., “Privacy-Preserving and Fairness-Aware Federated Learning for Critical ‎Infrastructure Protection and Resilience,” in WWW 2024 - Proceedings of the ACM Web ‎Conference, Association for Computing Machinery, Inc, May 2024, pp. 2986–2997. https://doi.org/10.1145/3589334.3645545.
    54. ‎A. Munawar and M. Piantanakulchai, “A collaborative privacy-preserving approach for passenger ‎demand forecasting of autonomous taxis empowered by federated learning in smart cities,” Sci ‎Rep, vol. 14, no. 1, Jan. 2024, https://doi.org/10.1038/s41598-024-52181-6.
    55. Y. Wu, S. Cai, X. Xiao, G. Chen, and B. C. Ooi, “Privacy preserving vertical federated learning for ‎tree-based models,” Proceedings of the VLDB Endowment, vol. 13, no. 11, pp. 2090–2103, Jul. ‎‎2020, https://doi.org/10.14778/3407790.3407811.
    56. N. A. A.-A. Al-Marri, B. S. Ciftler, and M. Abdallah, “Federated Mimic Learning for Privacy ‎Preserving Intrusion Detection,” Dec. 2020, [Online]. Available: http://arxiv.org/abs/2012.06974‎. https://doi.org/10.1109/BlackSeaCom48709.2020.9234959.
    57. S. Dutta et al., “Federated Learning with Quantum Computing and Fully Homomorphic ‎Encryption: A Novel Computing Paradigm Shift in Privacy-Preserving ML,” Sep. 2024, [Online]. ‎Available: http://arxiv.org/abs/2409.11430‎.
    58. M. Abaoud, M. A. Almuqrin, and M. F. Khan, “Advancing Federated Learning Through Novel ‎Mechanism for Privacy Preservation in Healthcare Applications,” IEEE Access, vol. 11, pp. 83562–‎‎83579, 2023, https://doi.org/10.1109/ACCESS.2023.3301162.
    59. P. Ruzafa-Alcázar et al., “Intrusion Detection Based on Privacy-Preserving Federated Learning for ‎the Industrial IoT,” IEEE Trans In-dustr Inform, vol. 19, no. 2, p. 1145, 2023, https://doi.org/10.1109/TII.2021.3126728.
    60. X. Lu, Y. Liao, P. Lio, and P. Hui, “Privacy-preserving asynchronous federated learning mechanism ‎for edge network computing,” IEEE Access, vol. 8, pp. 48970–48981, 2020, https://doi.org/10.1109/ACCESS.2020.2978082.

  • Downloads

  • How to Cite

    Saber Rashid, N. ., & Maseeh Yasin , H. . (2025). Privacy-preserving machine learning: a review of federated learning techniques and ‎applications. International Journal of Scientific World, 11(1), 30-39. https://doi.org/10.14419/af03y111

    Received date: January 10, 2025

    Accepted date: January 27, 2025

    Published date: February 7, 2025