Jiaxi Li, Kiran Davuluri, Khairul Mottakin, Zheng Song, Fei Dou, Jin Lu
ACM MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking 2024
This paper proposes a privacy-preserving BMI monitoring system using proximal federated learning (PFL) and commodity WiFi devices, leveraging Channel State Information (CSI) to passively classify BMI without requiring active user participation. The approach, powered by the Adaptive Elastic Stochastic ADMM algorithm, addresses data heterogeneity and connectivity issues, achieving higher accuracy, lower communication costs, and better scalability than existing personalized FL methods.
Jiaxi Li, Kiran Davuluri, Khairul Mottakin, Zheng Song, Fei Dou, Jin Lu
ACM MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking 2024
This paper proposes a privacy-preserving BMI monitoring system using proximal federated learning (PFL) and commodity WiFi devices, leveraging Channel State Information (CSI) to passively classify BMI without requiring active user participation. The approach, powered by the Adaptive Elastic Stochastic ADMM algorithm, addresses data heterogeneity and connectivity issues, achieving higher accuracy, lower communication costs, and better scalability than existing personalized FL methods.
Huaqin Zhao*, Jiaxi Li*, Yi Pan, Shizhe Liang, Xiaofeng Yang, Wei Liu, Xiang Li, Fei Dou, Tianming Liu, Jin Lu (* equal contribution)
arXiv preprint arXiv:2411.10696 2024
This paper presents HELENE, a memory-efficient and scalable optimizer for fine-tuning large language models, addressing the slow convergence of zeroth-order methods like MeZO by incorporating annealed A-GNB gradients, diagonal Hessian estimation, and layer-wise clipping. HELENE achieves faster, more stable convergence with up to 20× speedup and improved accuracy, and it supports both full and parameter-efficient fine-tuning across large-scale models and tasks.
Huaqin Zhao*, Jiaxi Li*, Yi Pan, Shizhe Liang, Xiaofeng Yang, Wei Liu, Xiang Li, Fei Dou, Tianming Liu, Jin Lu (* equal contribution)
arXiv preprint arXiv:2411.10696 2024
This paper presents HELENE, a memory-efficient and scalable optimizer for fine-tuning large language models, addressing the slow convergence of zeroth-order methods like MeZO by incorporating annealed A-GNB gradients, diagonal Hessian estimation, and layer-wise clipping. HELENE achieves faster, more stable convergence with up to 20× speedup and improved accuracy, and it supports both full and parameter-efficient fine-tuning across large-scale models and tasks.
Fei Dou, Jin Lu, Tan Zhu, Jinbo Bi
arXiv 2024
This paper introduces Latent Orthonormal Contrastive Learning (LOCAL), a method for paired image classification that addresses limitations of Supervised Contrastive Learning (SCL) under small batch sizes and class imbalance. By mapping class representations to orthogonal planes and incorporating a feature correlation module, LOCAL improves efficiency and discriminative power, achieving superior performance on high-resolution, paired satellite image tasks.
Fei Dou, Jin Lu, Tan Zhu, Jinbo Bi
arXiv 2024
This paper introduces Latent Orthonormal Contrastive Learning (LOCAL), a method for paired image classification that addresses limitations of Supervised Contrastive Learning (SCL) under small batch sizes and class imbalance. By mapping class representations to orthogonal planes and incorporating a feature correlation module, LOCAL improves efficiency and discriminative power, achieving superior performance on high-resolution, paired satellite image tasks.
Ehsan Latif, Yifan Zhou, Shuchen Guo, Yizhu Gao, Lehong Shi, Matthew Nayaaba, Gyeonggeon Lee, Liang Zhang, Arne Bewersdorff, Luyang Fang, Xiantong Yang, Huaqin Zhao, Hanqi Jiang, Haoran Lu, Jiaxi Li, Jichao Yu, Weihang You, Zhengliang Liu, Vincent Shung Liu, Hui Wang, Zihao Wu, Jin Lu, Fei Dou, Ping Ma, Ninghao Liu, Tianming Liu, Xiaoming Zhai
arXiv preprint arXiv:2410.21287 2024
This study evaluates OpenAI's o1-preview model across 14 higher-order cognitive dimensions, finding it outperforms humans in areas like systems thinking, computational thinking, and creative thinking, while slightly underperforming in logical, critical, and quantitative reasoning. Despite its strengths, the model shows limitations in abstract reasoning, underscoring the need for human oversight and suggesting educational systems should adapt to emphasize uniquely human skills in an AI-enhanced world.
Ehsan Latif, Yifan Zhou, Shuchen Guo, Yizhu Gao, Lehong Shi, Matthew Nayaaba, Gyeonggeon Lee, Liang Zhang, Arne Bewersdorff, Luyang Fang, Xiantong Yang, Huaqin Zhao, Hanqi Jiang, Haoran Lu, Jiaxi Li, Jichao Yu, Weihang You, Zhengliang Liu, Vincent Shung Liu, Hui Wang, Zihao Wu, Jin Lu, Fei Dou, Ping Ma, Ninghao Liu, Tianming Liu, Xiaoming Zhai
arXiv preprint arXiv:2410.21287 2024
This study evaluates OpenAI's o1-preview model across 14 higher-order cognitive dimensions, finding it outperforms humans in areas like systems thinking, computational thinking, and creative thinking, while slightly underperforming in logical, critical, and quantitative reasoning. Despite its strengths, the model shows limitations in abstract reasoning, underscoring the need for human oversight and suggesting educational systems should adapt to emphasize uniquely human skills in an AI-enhanced world.
Rong Fan, Azzedine Boukerche, Pan Pan, Zhigang Jin, Yishan Su, Fei Dou
IEEE Transactions on Mobile Computing (TMC) 2024
This paper proposes a secure localization scheme for underwater wireless sensor networks using cooperative beamforming with mobile anchor nodes and TDOA-based self-localization, addressing privacy threats from eavesdroppers. By formulating a multi-objective optimization problem and solving it with a DRL-based MADDPG algorithm, the approach enhances both security and energy efficiency, as validated by simulations and field experiments.
Rong Fan, Azzedine Boukerche, Pan Pan, Zhigang Jin, Yishan Su, Fei Dou
IEEE Transactions on Mobile Computing (TMC) 2024
This paper proposes a secure localization scheme for underwater wireless sensor networks using cooperative beamforming with mobile anchor nodes and TDOA-based self-localization, addressing privacy threats from eavesdroppers. By formulating a multi-objective optimization problem and solving it with a DRL-based MADDPG algorithm, the approach enhances both security and energy efficiency, as validated by simulations and field experiments.
Yingjian Song, Zaid Farooq Pitafi, Fei Dou, Jin Sun, Xiang Zhang, Bradley G Phillips, WenZhan Song
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (UbiComp/IMWUT) 2024
This paper presents SeismoDot, a bed occupancy detection system that combines self-supervised learning and spectral-temporal feature fusion to improve generalization across diverse environments with limited data. Unlike traditional threshold-based methods, SeismoDot achieves high accuracy and F1 scores across 13 settings and remains effective even when trained on only 20% of the data, demonstrating strong adaptability and efficiency.
Yingjian Song, Zaid Farooq Pitafi, Fei Dou, Jin Sun, Xiang Zhang, Bradley G Phillips, WenZhan Song
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (UbiComp/IMWUT) 2024
This paper presents SeismoDot, a bed occupancy detection system that combines self-supervised learning and spectral-temporal feature fusion to improve generalization across diverse environments with limited data. Unlike traditional threshold-based methods, SeismoDot achieves high accuracy and F1 scores across 13 settings and remains effective even when trained on only 20% of the data, demonstrating strong adaptability and efficiency.
Rong Fan, Pan Pan, Zhigang Jin, Yishan Su, Fei Dou
IEEE International Conference on Communications (ICC) 2024
This paper proposes a secure underwater localization scheme for wireless sensor networks using cooperative beamforming among AUVs and TDOA-based self-localization, addressing the challenge of privacy leakage in acoustic environments. By formulating a multi-objective optimization problem and solving it with a DRL-based MADDPG algorithm, the method enhances both security and energy efficiency, with validation through simulations and sea experiments.
Rong Fan, Pan Pan, Zhigang Jin, Yishan Su, Fei Dou
IEEE International Conference on Communications (ICC) 2024
This paper proposes a secure underwater localization scheme for wireless sensor networks using cooperative beamforming among AUVs and TDOA-based self-localization, addressing the challenge of privacy leakage in acoustic environments. By formulating a multi-objective optimization problem and solving it with a DRL-based MADDPG algorithm, the method enhances both security and energy efficiency, with validation through simulations and sea experiments.
Yishan Su, Pan Pan, Rong Fan, Sidan Yang, Fei Dou
IEEE International Conference on Communications (ICC) 2024
This article proposes a secure key generation scheme for underwater acoustic communications that leverages the spatio-temporal dynamics of channel impulse responses (CIRs), using amplitude and time delay as raw key parameters. A synchronous probing protocol enhances channel reciprocity, and field experiments confirm the scheme’s effectiveness and improved performance in resource-constrained underwater environments.
Yishan Su, Pan Pan, Rong Fan, Sidan Yang, Fei Dou
IEEE International Conference on Communications (ICC) 2024
This article proposes a secure key generation scheme for underwater acoustic communications that leverages the spatio-temporal dynamics of channel impulse responses (CIRs), using amplitude and time delay as raw key parameters. A synchronous probing protocol enhances channel reciprocity, and field experiments confirm the scheme’s effectiveness and improved performance in resource-constrained underwater environments.
Ziba Parsons, Fei Dou, Houyi Du, Zheng Song, Jin Lu
Advances in Neural Information Processing Systems 36 (NeurIPS) 2023
This paper proposes RWSADMM, a novel federated learning algorithm designed for infrastructure-less environments with isolated, heterogeneous nodes connected via wireless links. By leveraging server mobility and enforcing hard constraints among adjacent clients, RWSADMM enables efficient, personalized learning with provable convergence, reduced communication costs, and improved accuracy and scalability over baseline methods.
Ziba Parsons, Fei Dou, Houyi Du, Zheng Song, Jin Lu
Advances in Neural Information Processing Systems 36 (NeurIPS) 2023
This paper proposes RWSADMM, a novel federated learning algorithm designed for infrastructure-less environments with isolated, heterogeneous nodes connected via wireless links. By leveraging server mobility and enforcing hard constraints among adjacent clients, RWSADMM enables efficient, personalized learning with provable convergence, reduced communication costs, and improved accuracy and scalability over baseline methods.
Tan Zhu, Fei Dou, Xinyu Wang, Jin Lu, Jinbo Bi
Advances in Neural Information Processing Systems 36 (NeurIPS) 2023
This paper introduces the Polyhedron Attention Module (PAM), which forms interpretable, piecewise polynomial models by adaptively learning feature interactions within polyhedrons in the input space. PAM outperforms ReLU-based networks in expressive power and achieves superior classification results on large-scale click-through rate datasets while uncovering meaningful interactions in medical applications.
Tan Zhu, Fei Dou, Xinyu Wang, Jin Lu, Jinbo Bi
Advances in Neural Information Processing Systems 36 (NeurIPS) 2023
This paper introduces the Polyhedron Attention Module (PAM), which forms interpretable, piecewise polynomial models by adaptively learning feature interactions within polyhedrons in the input space. PAM outperforms ReLU-based networks in expressive power and achieves superior classification results on large-scale click-through rate datasets while uncovering meaningful interactions in medical applications.
Fei Dou, Jin Ye, Geng Yuan, Qin Lu, Wei Niu, Haijian Sun, Le Guan, Guoyu Lu, Gengchen Mai, Ninghao Liu, Jin Lu, Zhengliang Liu, Zihao Wu, Chenjiao Tan, Shaochen Xu, Xianqiao Wang, Guoming Li, Lilong Chai, Sheng Li, Jin Sun, Hongyue Sun, Yunli Shao, Changying Li, Tianming Liu, Wenzhan Song
arXiv preprint arXiv:2309.07438 2023
This paper investigates the integration of Artificial General Intelligence (AGI) within the Internet of Things (IoT), proposing a conceptual framework that highlights AGI’s potential to enhance intelligent decision-making across diverse domains such as healthcare, agriculture, and smart infrastructure. It also examines key challenges, including limited computational resources, large-scale communication complexities, and security and privacy concerns, emphasizing the need for targeted research to adapt AGI for resource-constrained IoT environments.
Fei Dou, Jin Ye, Geng Yuan, Qin Lu, Wei Niu, Haijian Sun, Le Guan, Guoyu Lu, Gengchen Mai, Ninghao Liu, Jin Lu, Zhengliang Liu, Zihao Wu, Chenjiao Tan, Shaochen Xu, Xianqiao Wang, Guoming Li, Lilong Chai, Sheng Li, Jin Sun, Hongyue Sun, Yunli Shao, Changying Li, Tianming Liu, Wenzhan Song
arXiv preprint arXiv:2309.07438 2023
This paper investigates the integration of Artificial General Intelligence (AGI) within the Internet of Things (IoT), proposing a conceptual framework that highlights AGI’s potential to enhance intelligent decision-making across diverse domains such as healthcare, agriculture, and smart infrastructure. It also examines key challenges, including limited computational resources, large-scale communication complexities, and security and privacy concerns, emphasizing the need for targeted research to adapt AGI for resource-constrained IoT environments.
Qinqing Liu, Fei Dou, Meijian Yang, Ezana Amdework, Guiling Wang, Jinbo Bi
the International Joint Conference on Artificial Intelligence (IJCAI) 2023
This paper introduces a novel Transformer-based architecture for crop yield prediction that incorporates Customized Positional Encoding (CPE), adapting sequence encoding based on static variables like geographic location. By leveraging CPE and partially linearized attention, the model significantly improves prediction robustness under climate variability, reducing mean absolute error by up to 26% compared to baseline models during extreme drought years.
Qinqing Liu, Fei Dou, Meijian Yang, Ezana Amdework, Guiling Wang, Jinbo Bi
the International Joint Conference on Artificial Intelligence (IJCAI) 2023
This paper introduces a novel Transformer-based architecture for crop yield prediction that incorporates Customized Positional Encoding (CPE), adapting sequence encoding based on static variables like geographic location. By leveraging CPE and partially linearized attention, the model significantly improves prediction robustness under climate variability, reducing mean absolute error by up to 26% compared to baseline models during extreme drought years.
Fei Dou, Jin Lu, Tan Zhu, Jinbo Bi
IEEE Internet of Things Journal (IOT-J) 2023
This paper proposes a personalized federated reinforcement learning (RL) framework for indoor localization that enables mobile devices to train locally while preserving data privacy and coping with limited connectivity and data heterogeneity. By combining personalized on-device RL with a global model trained via sparse updates, the approach achieves improved localization accuracy and robustness, and is further extended to support few-shot learning for rapid adaptation to new users with minimal data.
Fei Dou, Jin Lu, Tan Zhu, Jinbo Bi
IEEE Internet of Things Journal (IOT-J) 2023
This paper proposes a personalized federated reinforcement learning (RL) framework for indoor localization that enables mobile devices to train locally while preserving data privacy and coping with limited connectivity and data heterogeneity. By combining personalized on-device RL with a global model trained via sparse updates, the approach achieves improved localization accuracy and robustness, and is further extended to support few-shot learning for rapid adaptation to new users with minimal data.
Fei Dou, Jin Lu, Tingyang Xu, Chun-Hsi Huang, Jinbo Bi
IEEE Internet of Things Journal (IOT-J) 2021
This article presents a deep reinforcement learning-based approach to 3-D indoor localization using Wi-Fi RSSI fingerprinting, addressing signal variability and environmental dynamics. By formulating localization as a Markov decision process and hierarchically bisecting the search space, the method achieves high accuracy and robustness while reducing time complexity from O(N3) to O(log N), outperforming traditional sequential localization methods.
Fei Dou, Jin Lu, Tingyang Xu, Chun-Hsi Huang, Jinbo Bi
IEEE Internet of Things Journal (IOT-J) 2021
This article presents a deep reinforcement learning-based approach to 3-D indoor localization using Wi-Fi RSSI fingerprinting, addressing signal variability and environmental dynamics. By formulating localization as a Markov decision process and hierarchically bisecting the search space, the method achieves high accuracy and robustness while reducing time complexity from O(N3) to O(log N), outperforming traditional sequential localization methods.
Fei Dou, Jin Lu, Xia Xiao, Zigeng Wang, Jinbo Bi, Chun-Hsi Huang
IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS) 2018
This paper proposes a deep reinforcement learning-based top-down searching method for indoor localization using Wi-Fi RSSI fingerprints, addressing signal fluctuations caused by environmental uncertainties. The model effectively navigates large indoor spaces, accurately localizing 75% of targets within 0.55 meters in a 25,000 m² area.
Fei Dou, Jin Lu, Xia Xiao, Zigeng Wang, Jinbo Bi, Chun-Hsi Huang
IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS) 2018
This paper proposes a deep reinforcement learning-based top-down searching method for indoor localization using Wi-Fi RSSI fingerprints, addressing signal fluctuations caused by environmental uncertainties. The model effectively navigates large indoor spaces, accurately localizing 75% of targets within 0.55 meters in a 25,000 m² area.
Jin Lu, Fei Dou
IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC) 2017
This paper introduces a bi-subspace bottom-up saliency detection model that separates background and salient objects through subspace analysis, incorporating group-sparse constraints to capture object structure. Experimental results demonstrate that the proposed approach achieves greater stability and accuracy compared to existing saliency detection methods.
Jin Lu, Fei Dou
IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC) 2017
This paper introduces a bi-subspace bottom-up saliency detection model that separates background and salient objects through subspace analysis, incorporating group-sparse constraints to capture object structure. Experimental results demonstrate that the proposed approach achieves greater stability and accuracy compared to existing saliency detection methods.
Fei Dou, Zheng Peng
Proceedings of the 10th International Conference on Underwater Networks & Systems (WUWNet) 2015
This paper proposes OPMAC, a new medium access control (MAC) protocol designed for time-critical applications in Underwater Wireless Sensor Networks (UWSNs). By establishing an on-demand data transmission pipeline and introducing a lightweight acknowledgment mechanism, OPMAC significantly reduces end-to-end delay and enhances energy efficiency, addressing the challenges of long propagation delays and high error rates in UWSNs.
Fei Dou, Zheng Peng
Proceedings of the 10th International Conference on Underwater Networks & Systems (WUWNet) 2015
This paper proposes OPMAC, a new medium access control (MAC) protocol designed for time-critical applications in Underwater Wireless Sensor Networks (UWSNs). By establishing an on-demand data transmission pipeline and introducing a lightweight acknowledgment mechanism, OPMAC significantly reduces end-to-end delay and enhances energy efficiency, addressing the challenges of long propagation delays and high error rates in UWSNs.
Robert Martin, Yibo Zhu, Lina Pu, Fei Dou, Zheng Peng, Jun-Hong Cui, Sanguthevar Rajasekaran
Proceedings of the 10th International Conference on Underwater Networks & Systems (WUWNet) 2015
This paper introduces Aqua-Sim: Next Generation, an improved underwater sensor network (UWSN) simulator built by transitioning Aqua-Sim 2.0 from NS-2 to NS-3 for better memory management and unified programming. The new version enhances performance, preserves existing protocol functionality, and adds features to more accurately model underwater environments and phenomena.
Robert Martin, Yibo Zhu, Lina Pu, Fei Dou, Zheng Peng, Jun-Hong Cui, Sanguthevar Rajasekaran
Proceedings of the 10th International Conference on Underwater Networks & Systems (WUWNet) 2015
This paper introduces Aqua-Sim: Next Generation, an improved underwater sensor network (UWSN) simulator built by transitioning Aqua-Sim 2.0 from NS-2 to NS-3 for better memory management and unified programming. The new version enhances performance, preserves existing protocol functionality, and adds features to more accurately model underwater environments and phenomena.
Yishan Su, Zhigang Jin, Fei Dou
Journal of Harbin Engineering University 36(7):987-991 2015
This paper introduces SFM-MAC, a multi-channel MAC protocol for underwater sensor networks that enhances spatial fairness and supports multi-channel communication using a single transducer. By incorporating location-aware RTS/CA/CL/CTS handshaking and a Markov-based reservation model, SFM-MAC improves fairness by 15% and achieves 60–70% and 12–15% higher throughput than slotted FAMA and UMMAC, respectively.
Yishan Su, Zhigang Jin, Fei Dou
Journal of Harbin Engineering University 36(7):987-991 2015
This paper introduces SFM-MAC, a multi-channel MAC protocol for underwater sensor networks that enhances spatial fairness and supports multi-channel communication using a single transducer. By incorporating location-aware RTS/CA/CL/CTS handshaking and a Markov-based reservation model, SFM-MAC improves fairness by 15% and achieves 60–70% and 12–15% higher throughput than slotted FAMA and UMMAC, respectively.
Zhigang Jin, Yishan Su, Zixin Liu, Fei Dou
Journal of Electronics & Information Technology 35(3):728-734 2013
This paper presents P-MAC, a contention-based MAC protocol designed for mobile Underwater Wireless Sensor Networks (UWSNs), addressing the challenges posed by node mobility and acoustic signal delays. By incorporating an autoregressive AR(5) mobility prediction algorithm to mitigate space-time uncertainty, P-MAC achieves up to 74.8% reduction in delay detection error and improves packet reception rate by 10–15% under wave-induced motion, as demonstrated in NS-2 simulations.
Zhigang Jin, Yishan Su, Zixin Liu, Fei Dou
Journal of Electronics & Information Technology 35(3):728-734 2013
This paper presents P-MAC, a contention-based MAC protocol designed for mobile Underwater Wireless Sensor Networks (UWSNs), addressing the challenges posed by node mobility and acoustic signal delays. By incorporating an autoregressive AR(5) mobility prediction algorithm to mitigate space-time uncertainty, P-MAC achieves up to 74.8% reduction in delay detection error and improves packet reception rate by 10–15% under wave-induced motion, as demonstrated in NS-2 simulations.
Fei Dou, Zhigang Jin, Yishan Su, Jia Liu
International Conference on Consumer Electronics, Communications and Networks (CECNet) 2012
This paper proposes WSF-MAC, a weight-based spatially fair MAC protocol for Underwater Sensor Networks (UWSNs) that addresses space-time uncertainty caused by high propagation delays. By using a silence duration and prioritizing transmissions based on UW-REQ packet timing and competition count, WSF-MAC improves spatial fairness by approximately 10%, as demonstrated in simulation results.
Fei Dou, Zhigang Jin, Yishan Su, Jia Liu
International Conference on Consumer Electronics, Communications and Networks (CECNet) 2012
This paper proposes WSF-MAC, a weight-based spatially fair MAC protocol for Underwater Sensor Networks (UWSNs) that addresses space-time uncertainty caused by high propagation delays. By using a silence duration and prioritizing transmissions based on UW-REQ packet timing and competition count, WSF-MAC improves spatial fairness by approximately 10%, as demonstrated in simulation results.