SLM with Swarm Intelligence for Efficient Representation of Medical Claims

Document Type

Article

Source of Publication

IEEE Access

Publication Date

1-1-2026

Abstract

Healthcare industry faces significant challenges due to fraudulent medical insurance claims, which result in substantial financial losses. We propose an automated system using domain-specific Small Language Models (SLMs) with a narrower scope and smaller parameter count than general-purpose Large Language Models (LLMs), combined with optimization algorithms to improve fraud detection. Our approach integrates numerical features, such as age and claim amount, with textual descriptions, including diagnoses and procedures, into a unified textual representation for each medical activity. This representation captures complex patterns, enhancing the model’s predictive ability. SLMs fine-tuned on medical corpora transform these textual inputs into fixed-dimensional numerical embeddings, capturing semantic and contextual information. Swarm-intelligence-based optimization algorithms then refine feature selection, identifying the most informative subset of features to reduce dimensionality and computational overhead. The system achieves up to 87% accuracy and 96% specificity in classifying medical activities, demonstrating that domain-specific SLMs deliver competitive performance with lower computational costs compared to larger general-purpose models, making the system scalable and efficient. To our knowledge, this is the first work to combine domain-specific SLMs with optimization algorithms for fraud detection in medical claims. This novel approach improves classification accuracy while reducing computational overhead, demonstrating the potential of domain-specific generative AI in healthcare applications.

ISSN

2169-3536

Publisher

Institute of Electrical and Electronics Engineers (IEEE)

Disciplines

Computer Sciences

Keywords

Fraud Detection, Medical Claims, Generative AI, Healthcare Analytics, Medical language model, swarm intelligence

Scopus ID

105030855722

Creative Commons License

Creative Commons Attribution 4.0 International License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Indexed in Scopus

yes

Open Access

yes

Open Access Type

Gold: This publication is openly available in an open access journal/series

This document is currently not available here.

Share

COinS