Harnessing LLMs for IoT Malware Detection: A Comparative Analysis of BERT and GPT-2
Document Type
Conference Proceeding
Source of Publication
2024 8th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT)
Publication Date
11-9-2024
Abstract
In recent years, the proliferation of Internet of Things (IoT) devices has introduced significant vulnerabilities in cybersecurity, particularly with the rise of sophisticated malware targeting these systems. Traditional detection methods, often based on static signatures, struggle to keep pace with evolving threats, such as zero-day attacks. This paper explores the application of Large Language Models (LLMs), specifically BERT and GPT-2, in detecting IoT malware by analyzing network traffic and identifying anomalies. Using the contextual understanding and adaptability of LLM, our approach significantly enhances detection accuracy compared to conventional methods. We evaluated the models using the ToN-IoT dataset, demonstrating their capability to detect complex malware patterns with higher precision. The results indicate that BERT outperforms GPT-2 across multiple metrics, highlighting its effectiveness in generalizing to various attack types. Despite promising advancements, challenges such as computational resource demands and model interpretability persist. Future research should focus on optimizing LLMs for real-time detection in resource-constrained environments and improving transparency to enhance trust among cybersecurity professionals. Our study underscores the potential of LLMs as powerful tools in the ongoing battle against IoT malware, offering a robust framework for enhancing cybersecurity defenses.
DOI Link
ISBN
979-8-3503-5442-3
Publisher
IEEE
Volume
00
First Page
1
Last Page
6
Disciplines
Computer Sciences
Keywords
IoT security, malware detection, BERT, GPT-2, large language models
Recommended Citation
Omar, Marwan; Zangana, Hewa Majeed; Al-Karaki, Jamal N.; and Mohammed, Derek, "Harnessing LLMs for IoT Malware Detection: A Comparative Analysis of BERT and GPT-2" (2024). All Works. 7045.
https://zuscholars.zu.ac.ae/works/7045
Indexed in Scopus
no
Open Access
no