Dictionary-Based Sentiment Analysis at Subword Level

While deep learning can offer a promising approach to sentiment analysis, it often presents challenges in complexity and explainability. Alternatively, sentiment analysis based on dictionaries has been explored. In this paper, subword-Level dictionaries in English are considered to address performance degradation resulting from domain mismatches. To work at subword level, a framework based on naive bayes machine learning algorithm is exploited. Furthermore, stopwords at the subword level have been proposed to remove additional interference intrinsic to subword tokenization. Numerical experiments demonstrate that the proposed method achieves higher accuracy and F1 scores compared to the conventional dictionary-based method when there is a mismatch between the dictionary and the corpus of documents while performing marginally worse than state-of-the-art deep learning methods when applied to datasets from the same domain.

© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”