题 目:Neural Network Pruning in Federated Learning
内容简介:Neural network pruning is an essential technique for reducing the size and complexity of deep neural networks, enabling large-scale models on devices with limited resources. However, existing pruning approaches heavily rely on training data for guiding the pruning strategies, making them ineffective for federated learning over distributed and confidential datasets. Additionally, the memory- and computation-intensive pruning process becomes infeasible for recourse-constrained devices in federated learning. To address these challenges, we propose FedTiny, a distributed pruning framework for federated learning that generates specialized tiny models for memory- and computing-constrained devices. This talk presents the design of FedTiny and demonstrates the effectiveness of FedTiny.
报告人:Dapeng Oliver Wu
报告人简介:Dapeng Oliver Wu received Ph.D. in Electrical and Computer Engineering from Carnegie Mellon University, Pittsburgh, PA, in 2003. Currently, he is Yeung Kin Man Chair Professor of Network Science, at the Department of Computer Science, City University of Hong Kong. His research interests are in the areas of artificial intelligence, communications, image processing, computer vision, signal processing, and biomedical engineering. He received University of Florida Term Professorship Award in 2017, University of Florida Research Foundation Professorship Award in 2009, AFOSR Young Investigator Program (YIP) Award in 2009, ONR Young Investigator Program (YIP) Award in 2008, NSF CAREER award in 2007, the IEEE Circuits and Systems for Video Technology (CSVT) Transactions Best Paper Award for Year 2001, the Best Paper Award in GLOBECOM 2011, and the Best Paper Award in QShine 2006. He has served as Editor-in-Chief of IEEE Transactions on Network Science and Engineering, and Associate Editor of IEEE Transactions on Communications, IEEE Transactions on Signal and Information Processing over Networks, and IEEE Signal Processing Magazine. He was the founding Editor-in-Chief of Journal of Advances in Multimedia between 2006 and 2008, and an Associate Editor for IEEE Transactions on Circuits and Systems for Video Technology, IEEE Transactions on Wireless Communications and IEEE Transactions on Vehicular Technology. He has served as Technical Program Committee (TPC) Chair for IEEE INFOCOM 2012. He was elected as a Distinguished Lecturer by IEEE Vehicular Technology Society in 2016. He is an IEEE Fellow.
时 间:2024年3月9日(周六)下午14:30开始
地 点:番禺校区知识产权楼1420室
热烈欢迎广大师生参加!
信息科学技术学院
2024年3月7日