README.md

Generative AI-Powered Plugin for Robust Federated Learning in Heterogeneous IoT Networks

This is an official implementation of the following paper:

Youngjoon Lee, Jinu Gong, and Joonhyuk Kang. Generative AI-Powered Plugin for Robust Federated Learning in Heterogeneous IoT Networks
arXiv preprint arXiv:2410.23824.

Requirements

Please install the required packages as below

pip install tensorboard scipy tqdm pandas torch ollama transformers

Federated Learning Techniques

This paper considers the following federated learning techniques

• FedAvg (McMahan, Brendan, et al. AISTATS 2017)
• FedProx (Li, Tian, et al. MLSys 2020)
• FedRS (Li, X. C., & Zhan, D. C. SIGKDD 2021)

Edge AI Model

• google-bert/bert-base-uncased
• distilbert/distilbert-base-uncased
• dmis-lab/biobert-v1.1
• microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext

LLM

• Gemma 1.0:7B, Gemma 2.0:2B/9B
• Llama 3.1:8B, Llama 3.2:1B/3B
• Phi 2.0:3B, Phi 3.0:3B, Phi 3.5:3B

Dataset

• Medical-Abstracts-TC-Corpus (Schopf, T., Braun, D., & Matthes, F. NLPIR 2022)