Website category classification using fine-tuned BERT language model

No Thumbnail Available
Date
2020
Authors
Çayır, Aykut
Ünal, Uğur
Dağ, Hasan
Journal Title
Journal ISSN
Volume Title
Publisher
Institute of Electrical and Electronics Engineers Inc.
Research Projects
Organizational Units
Journal Issue
Abstract
The contents on the Word Wide Web is expanding every second providing web users a rich content. However, this situation may cause web users harm rather than good due to its harmful or misleading information. The harmful contents can contain text, audio, video, or image that can be about violence, adult contents, or any other harmful information. Especially young people may readily be affected with these harmful information psychologically. To prevent youth from these harmful contents, various web filtering techniques, such as keyword filtering, Uniform Resource Locator (URL) based filtering, Intelligent analysis, and semantic analysis, are used. We propose an algorithm that can classify websites, which may contain adult contents, with 67.81% (BERT) accuracy among 32 unique categories. We also show that a BERT model gives higher accuracy than both the Sequential and Functional API models when used for text classification.
Description
Keywords
BERT, Functional API, Sequential API, Text classification, Web filtering
Turkish CoHE Thesis Center URL
Citation
3
WoS Q
N/A
Scopus Q
N/A
Source
Volume
Issue
Start Page
333
End Page
336