AnomalyAdapters: Parameter-Efficient Multi-Anomaly Task Detection

Loading...
Thumbnail Image

Date

2022

Authors

Dag, Hasan

Journal Title

Journal ISSN

Volume Title

Publisher

IEEE-Inst Electrical Electronics Engineers Inc

Open Access Color

OpenAIRE Downloads

OpenAIRE Views

Research Projects

Organizational Units

Journal Issue

Abstract

The emergence of technological innovations brings sophisticated threats. Cyberattacks are increasing day by day aligned with these innovations and entails rapid solutions for defense mechanisms. These attacks may hinder enterprise operations or more importantly, interrupt critical infrastructure systems, that are essential to safety, security, and well-being of a society. Anomaly detection, as a protection step, is significant for ensuring a system security. Logs, which are accepted sources universally, are utilized in system health monitoring and intrusion detection systems. Recent developments in Natural Language Processing (NLP) studies show that contextual information decreases false-positives yield in detecting anomalous behaviors. Transformers and their adaptations to various language understanding tasks exemplify the enhanced ability to extract this information. Deep network based anomaly detection solutions use generally feature-based transfer learning methods. This type of learning presents a new set of weights for each log type. It is unfeasible and a redundant way considering various log sources. Also, a vague representation of model decisions prevents learning from threat data and improving model capability. In this paper, we propose AnomalyAdapters (AAs) which is an extensible multi-anomaly task detection model. It uses pretrained transformers' variant to encode a log sequences and utilizes adapters to learn a log structure and anomaly types. Adapter-based approach collects contextual information, eliminates information loss in learning, and learns anomaly detection tasks from different log sources without overuse of parameters. Lastly, our work elucidates the decision making process of the proposed model on different log datasets to emphasize extraction of threat data via explainability experiments.

Description

Keywords

Task analysis, Anomaly detection, Adaptation models, Transformers, Security, Semantics, Monitoring, Anomaly detection, adapters, cyber threat intelligence, explainability, log, transfer learning

Turkish CoHE Thesis Center URL

Fields of Science

Citation

4

WoS Q

Q2

Scopus Q

Q1

Source

Ieee Access

Volume

10

Issue

Start Page

5635

End Page

5646