Website category classification using fine-tuned BERT language model

No Thumbnail Available

Date

2020

Authors

Çayır, Aykut
Ünal, Uğur
Dağ, Hasan

Journal Title

Journal ISSN

Volume Title

Publisher

Institute of Electrical and Electronics Engineers Inc.

Research Projects

Organizational Units

Journal Issue

Abstract

The contents on the Word Wide Web is expanding every second providing web users a rich content. However, this situation may cause web users harm rather than good due to its harmful or misleading information. The harmful contents can contain text, audio, video, or image that can be about violence, adult contents, or any other harmful information. Especially young people may readily be affected with these harmful information psychologically. To prevent youth from these harmful contents, various web filtering techniques, such as keyword filtering, Uniform Resource Locator (URL) based filtering, Intelligent analysis, and semantic analysis, are used. We propose an algorithm that can classify websites, which may contain adult contents, with 67.81% (BERT) accuracy among 32 unique categories. We also show that a BERT model gives higher accuracy than both the Sequential and Functional API models when used for text classification.

Description

Keywords

BERT, Functional API, Sequential API, Text classification, Web filtering

Turkish CoHE Thesis Center URL

Citation

3

WoS Q

N/A

Scopus Q

N/A

Source

Volume

Issue

Start Page

333

End Page

336