Multitype Learning via Multimodal Data Embedding
Özet
This paper creates a multimodal retrieval system for image and text data in a multi-type learning approach that enables text-to-image, image-to-text, text-to-text, and image-to-image retrievals. As a practical solution, a mobile application is developed in which the users can upload their images to search a description sentence for the images. The user system is created on the application, which is done with React Native, and crucial features like e-mail authentication and reset password options are added to the application. An essential database system is designed with PostgreSQL to store user information and search for the user. The multimodal embedding study is worked, and the model that recognizes multitype retrievals is formed. The image-to-text retrieval model, which is our application's idea, is applied to the mobile application. © 2021 IEEE.
Koleksiyonlar
İlgili Öğeler
Başlık, yazar, küratör ve konuya göre gösterilen ilgili öğeler.
-
Click prediction boosting via Bayesian hyperparameter optimization-based ensemble learning pipelines
Demirel, Ç.; Tokuç, A.A.; Tekin, A.T. (Elsevier B.V., 2023)Online travel agencies (OTA's) advertise their website offers on meta-search bidding engines. The problem of predicting the number of clicks a hotel would receive for a given bid amount is an important step in the management ... -
Benchmark Static API Call Datasets for Malware Family Classification
Gencaydin, B.; Kahya, C.N.; Demirkiran, F.; Duzgun, B.; Cayir, A.; Dag, H. (Institute of Electrical and Electronics Engineers Inc., 2022)Nowadays, malware and malware incidents are increasing daily, even with various antivirus systems and malware detection or classification methodologies. Machine learning techniques have been the main focus of the security ... -
MuscleNET: Smart Predictive Analysis for Muscular Activity Using Wearable Sensors
Gemici, M.; Korkmaz, K.; Ayhan, N.T.; Soylu, S.; Guc, F.; Ogrenci, A.S. (Institute of Electrical and Electronics Engineers Inc., 2022)Doing weightlifting training at home has become more popular during the pandemic. Unfortunately, exercising without professional help can lead to dangerous injuries such as muscle tearing. It is possible to create a smart ...