{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T13:10:39Z","timestamp":1775913039633,"version":"3.50.1"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T00:00:00Z","timestamp":1665619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62002369"],"award-info":[{"award-number":["62002369"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Scientific Research Project of National University of Defense Technology","award":["ZK19-03"],"award-info":[{"award-number":["ZK19-03"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2022,10,31]]},"abstract":"<jats:p>\n            With the development of smart devices, the computing capabilities of portable end devices such as mobile phones have been greatly enhanced. Meanwhile, traditional cloud computing faces great challenges caused by privacy-leakage and time-delay problems, there is a trend to push models down to edges and end devices. However, due to the limitation of computing resource, it is difficult for end devices to complete complex computing tasks alone. Therefore, this article divides the model into two parts and deploys them on multiple end devices and edges, respectively. Meanwhile, an early exit is set to reduce computing resource overhead, forming a hierarchical distributed architecture. In order to enable the distributed model to continuously evolve by using new data generated by end devices, we comprehensively consider various data distributions on end devices and edges, proposing a hierarchical federated learning framework\n            <jats:italic>FLEE<\/jats:italic>\n            , which can realize dynamical updates of models without redeploying them. Through image and sentence classification experiments, we verify that it can improve model performances under all kinds of data distributions, and prove that compared with other frameworks, the models trained by\n            <jats:italic>FLEE<\/jats:italic>\n            consume less global computing resource in the inference stage.\n          <\/jats:p>","DOI":"10.1145\/3514501","type":"journal-article","created":{"date-parts":[[2022,5,17]],"date-time":"2022-05-17T13:26:38Z","timestamp":1652793998000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["FLEE: A Hierarchical Federated Learning Framework for Distributed Deep Neural Network over Cloud, Edge, and End Device"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1515-4876","authenticated-orcid":false,"given":"Zhengyi","family":"Zhong","sequence":"first","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha, Hunan Province, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1867-3660","authenticated-orcid":false,"given":"Weidong","family":"Bao","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha, Hunan Province, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4199-2793","authenticated-orcid":false,"given":"Ji","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha, Hunan Province, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1301-7840","authenticated-orcid":false,"given":"Xiaomin","family":"Zhu","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha, Hunan Province, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8399-5175","authenticated-orcid":false,"given":"Xiongtao","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Systems Engineering, National University of Defense Technology, Changsha, Hunan Province, China"}]}],"member":"320","published-online":{"date-parts":[[2022,10,13]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9054634"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/MICRO.2016.7783725"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9207469"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/LifeTech52111.2021.9391874"},{"key":"e_1_3_2_6_2","unstructured":"Mingqing Chen Rajiv Mathews Tom Ouyang and Fran\u00e7oise Beaufays. 2019. Federated Learning Of Out-Of-Vocabulary Words. (2019). arXiv:cs.CL\/1903.10635. Retrieved from https:\/\/arxiv.org\/abs\/1903.10635."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2021.103421"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2021.01.052"},{"key":"e_1_3_2_9_2","unstructured":"Maha Elbayad Jiatao Gu Edouard Grave and Michael Auli. 2020. Depth-Adaptive Transformer. In International Conference on Learning Representations . https:\/\/openreview.net\/forum?id=SJg7KhVKPH"},{"key":"e_1_3_2_10_2","unstructured":"Dashan Gao Ce Ju Xiguang Wei Yang Liu Tianjian Chen and Qiang Yang. 2020. HHHFL: Hierarchical Heterogeneous Horizontal Federated Learning for Electroencephalography. (2020). arXiv:eess.SP\/1909.05784. Retrieved from https:\/\/arxiv.org\/abs\/1909.05784."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.001.2000410"},{"key":"e_1_3_2_12_2","unstructured":"Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand Marco Andreetto and Hartwig Adam. 2017. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. (2017). arXiv:cs.CV\/1704.04861. Retrieved from https:\/\/arxiv.org\/abs\/1704.04861."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2021.102602"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3093337.3037698"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. (2014). arXiv:cs.CL\/1408.5882. Retrieved from https:\/\/arxiv.org\/abs\/1408.5882.","DOI":"10.3115\/v1\/D14-1181"},{"key":"e_1_3_2_16_2","unstructured":"Jakub Kone\u010dn\u00fd H. Brendan McMahan Felix X. Yu Peter Richt\u00e1rik Ananda Theertha Suresh and Dave Bacon. 2017. Federated Learning: Strategies for Improving Communication Efficiency. (2017). arXiv:cs.LG\/1610.05492. Retrieved from https:\/\/arxiv.org\/abs\/1610.05492."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00198"},{"key":"e_1_3_2_19_2","unstructured":"Xiang Li Kaixuan Huang Wenhao Yang Shusen Wang and Zhihua Zhang. 2020. On the Convergence of FedAvg on Non-IID Data. In International Conference on Learning Representations . https:\/\/openreview.net\/forum?id=HJxNAnVtDS"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.162"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC40277.2020.9148862"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3426239"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.537"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.23919\/JCC.2020.02.010"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR48806.2021.9412388"},{"key":"e_1_3_2_26_2","first-page":"1273","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research)","volume":"54","author":"McMahan Brendan","year":"2017","unstructured":"Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.), Vol. 54. PMLR, 1273\u20131282. Retrieved from https:\/\/proceedings.mlr.press\/v54\/mcmahan17a.html."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/CIC.2018.00042"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3317572"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482252"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2021.3057082"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490181"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00144"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","unstructured":"Mohammad Rastegari Vicente Ordonez Joseph Redmon and Ali Farhadi. 2016. XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. In Computer Vision \u2013 ECCV 2016 Bastian Leibe Jiri Matas Nicu Sebe and Max Welling (Eds.). Springer International Publishing Cham 525\u2013542.","DOI":"10.1007\/978-3-319-46493-0_32"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2019.2944481"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/EDGE.2018.00013"},{"issue":"1","key":"e_1_3_2_36_2","first-page":"16","article-title":"Scalable distributed computing hierarchy: Cloud, fog and dew computing","volume":"2","author":"Skala Karolj","year":"2015","unstructured":"Karolj Skala, Davor Davidovic, Enis Afgan, Ivan Sovic, and Zorislav Sojat. 2015. Scalable distributed computing hierarchy: Cloud, fog and dew computing. Open Journal of Cloud Computing 2, 1 (2015), 16\u201324. Retrieved from http:\/\/nbn-resolving.de\/urn:nbn:de:101:1-201705194519.","journal-title":"Open Journal of Cloud Computing"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.504"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2016.7900006"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2017.226"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2019.8737464"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSPW51379.2020.00053"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2971524"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33011190"},{"key":"e_1_3_2_44_2","unstructured":"Jianyu Wang and Gauri Joshi. 2019. Adaptive Communication Strategies to Achieve the Best Error-Runtime Trade-off in Local-Update SGD. In Proceedings of Machine Learning and Systems A. Talwalkar V. Smith and M. Zaharia (Eds.) Vol. 1. 212\u2013229. https:\/\/proceedings.mlsys.org\/paper\/2019\/file\/c8ffe9a587b126f152ed3d89a146b445-Paper.pdf."},{"key":"e_1_3_2_45_2","unstructured":"Jianyu Wang and Gauri Joshi. 2021. Cooperative SGD: A Unified Framework for the Design and Analysis of Local Update SGD Algorithms. Journal of Machine Learning Research 22 213 (2021) 1\u201350. http:\/\/jmlr.org\/papers\/v22\/20-147.html."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2019.2904348"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2020.2970550"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.2979669"},{"key":"e_1_3_2_49_2","article-title":"Privacy-preserving federated depression detection from multi-source mobile health data","author":"Xu Xiaohang","year":"2021","unstructured":"Xiaohang Xu, Hao Peng, Md Zakirul Alam Bhuiyan, Zhifeng Hao, Lianzhong Liu, Lichao Sun, and Lifang He. 2021. Privacy-preserving federated depression detection from multi-source mobile health data. IEEE Transactions on Industrial Informatics 18, 7 (2021), 4788\u20134797.","journal-title":"IEEE Transactions on Industrial Informatics"},{"key":"e_1_3_2_50_2","unstructured":"Bishan Yang Scott Wen-tau Yih Xiaodong He Jianfeng Gao and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In Proceedings of the International Conference on Learning Representations (ICLR) 2015 . https:\/\/www.microsoft.com\/en-us\/research\/publication\/embedding-entities-and-relations-for-learning-and-inference-in-knowledge-bases\/."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00244"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298981"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/HotWeb.2015.22"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2020.05.137"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2018.2858384"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3274783.3275199"},{"key":"e_1_3_2_57_2","unstructured":"Wangchunshu Zhou Canwen Xu Tao Ge Julian McAuley Ke Xu and Furu Wei. 2020. BERT Loses Patience: Fast and Robust Inference with Early Exit. In Advances in Neural Information Processing Systems H. Larochelle M. Ranzato R. Hadsell M. F. Balcan and H. Lin (Eds.) Vol. 33. Curran Associates Inc. 18330\u201318341. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/d4dd111a4fd973394238aca5c05bebe3-Paper.pdf."},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13278-021-00731-5"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514501","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514501","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:21Z","timestamp":1750188621000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514501"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,13]]},"references-count":57,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,10,31]]}},"alternative-id":["10.1145\/3514501"],"URL":"https:\/\/doi.org\/10.1145\/3514501","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,13]]},"assertion":[{"value":"2021-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-01-30","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-10-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}