4.7 Review

Efficient utilization of pre-trained models: A review of sentiment analysis via prompt learning

Related references

Note: Only part of the references are listed.
Article Computer Science, Artificial Intelligence

Transfer-based adaptive tree for multimodal sentiment analysis based on user latent aspects

Sana Rahmani et al.

Summary: Multimodal sentiment analysis is useful for various applications and can infer user-based sentiments using modals enriched by empirical data. However, current approaches in this field often overlook user-specific aspects. To address this issue, we propose a novel method that utilizes cognitive cues for multimodal sentiment prediction. Our cognitive-aware framework constructs an adaptive tree for hierarchical user division and employs long short-term memory submodels with attention-based fusion to transfer cognitive-oriented knowledge within the tree. The framework then uses the agglomerative knowledge from the adaptive tree to predict final sentiments. Our empirical results show that our proposed model outperforms trending baselines in sentiment prediction. Additionally, compared to other ensemble approaches, our transfer-based algorithm better utilizes latent cues and improves prediction outcomes through multiple categorization strategies.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

CRF-GCN: An effective syntactic dependency model for aspect-level sentiment analysis

Bo Huang et al.

Summary: Attention-based models are widely used in aspect-level sentiment analysis due to their contextual semantic-alignment capabilities. However, these models lack the ability to incorporate syntactic tendencies, resulting in lower accuracy when dealing with complex syntactic relationships and long-span syntactically dependent utterances. To address this problem, a neural network model combining a conditional random field and a graph convolutional network is proposed. The proposed model integrates contextual information within the opinion span to global nodes and predicts aspect-specific sentiment polarity labels by computing vector expressions of the global nodes.

KNOWLEDGE-BASED SYSTEMS (2023)

Article Computer Science, Theory & Methods

Survey on Aspect Category Detection

Siva Uday Sampreeth Chebolu et al.

Summary: In recent years, aspect category detection has gained popularity due to the increase in customer reviews data on e-commerce and online platforms. This task involves categorizing reviews based on product features or entity aspects. Various methods, including supervised and unsupervised learning, have been proposed to tackle this problem. This article provides an overview of datasets, explores the methods used for aspect category detection, analyzes their strengths and weaknesses, and discusses challenges and future research directions.

ACM COMPUTING SURVEYS (2023)

Article Computer Science, Artificial Intelligence

Learn from structural scope: Improving aspect-level sentiment analysis with hybrid graph convolutional networks

Lvxiaowei Xu et al.

Summary: This study proposes a hybrid graph convolutional network (HGCN) that synthesizes information from constituency tree and dependency tree to learn structural text regions related to specific targets and predict sentiment polarity. Experimental results show that the proposed method outperforms current state-of-the-art baselines on five public datasets.

NEUROCOMPUTING (2023)

Review Computer Science, Artificial Intelligence

Beyond Sentiment Analysis: A Review of Recent Trends in Text Based Sentiment Analysis and Emotion Detection

Lai Po Hung et al.

Summary: Sentiment Analysis is a well-known area in text mining, but recently more areas of text classification, such as emotion detection, are being explored. Emotion detection is valuable for social behavior analysis and decision making. It can support tasks such as opinion mining and early depression detection. This review focuses on text-based sentiment analysis and emotion detection, summarizing methods and examining models of emotion classes.

JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS (2023)

Article Computer Science, Artificial Intelligence

Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

Ankita Gandhi et al.

Summary: This survey paper explores the importance and recent advancements in sentiment analysis and multimodal sentiment analysis in the fields of artificial intelligence and natural language processing. It compares various fusion architectures in terms of MSA categories and presents interdisciplinary applications and future research directions.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

Improving aspect-based sentiment analysis with Knowledge-aware Dependency Graph Network

Haiyan Wu et al.

Summary: Aspect-based sentiment analysis (ABSA) aims to extract sentiment-target pairs in review sentences. Previous methods based on recurrent neural networks (RNNs) struggle with accurately capturing sentiment pairs. Recent research incorporates dependency information into structured models, achieving better results, while ignoring domain knowledge related to entities in the comments. This paper proposes a Knowledge-aware Dependency Graph Network (KDGN) that incorporates domain knowledge, dependency labels, and syntax path, showing significant improvement on the ABSA task.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

AOBERT: All-modalities-in-One BERT for multimodal sentiment analysis

Kyeonghun Kim et al.

Summary: Multimodal sentiment analysis uses various modalities to predict sentiment, but traditional methods suffer from loss of intramodality and inter-modality. AOBERT, a single-stream transformer pre-trained on two tasks, achieves state-of-the-art results and addresses this problem effectively.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

Aspect-level sentiment analysis: A survey of graph convolutional network methods

Huyen Trang Phan et al.

Summary: Aspect-level sentiment analysis (ALSA) is crucial in social networks, especially in e-commerce. This study provides a comprehensive survey on GCN-based ALSA methods, proposing a novel taxonomy and discussing benchmark datasets and text representations commonly used. The study also highlights future research directions and challenges in this field.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

Emotion fusion for mental illness detection from social media: A survey

Tianlin Zhang et al.

Summary: Mental illnesses are a global public health problem that negatively impact people's lives and society's health. With the rise of social media, there has been increasing research interest in using user-generated posts to detect mental illness. This article provides a comprehensive survey of approaches that incorporate emotion fusion in the detection of mental illness in social media. It reviews different fusion strategies, discusses challenges faced by researchers in this area, and suggests potential directions for future research.

INFORMATION FUSION (2023)

Article Computer Science, Artificial Intelligence

The Biases of Pre-Trained Language Models: An Empirical Study on Prompt-Based Sentiment Analysis and Emotion Detection

Rui Mao et al.

Summary: With the breakthrough of large-scale pre-trained language model (PLM) technology, prompt-based classification tasks, such as sentiment analysis and emotion detection, have gained increasing attention. This study conducts a systematic empirical study on prompt-based sentiment analysis and emotion detection to investigate the biases of PLMs in affective computing.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2023)

Article Computer Science, Artificial Intelligence

The power of ensemble learning in sentiment analysis

Jacqueline Kazmaier et al.

Summary: This paper examines the use of ensemble models in sentiment classification, introducing several techniques for constructing heterogeneous ensembles and evaluating their performance. The results demonstrate significant performance improvements of several ensemble configurations compared to the best individual model across different data sets, identifying clear trends that may be valuable to other researchers in the field. Additionally, a novel ensemble selection approach is proposed to address storage and retraining challenges commonly associated with similar methods.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Review Computer Science, Interdisciplinary Applications

AMMU: A survey of transformer-based biomedical pretrained language models

Katikapalli Subramanyam Kalyan et al.

Summary: Transformer-based pretrained language models have revolutionized natural language processing in the biomedical research community. This survey comprehensively explores the core concepts, taxonomy, challenges, and possible solutions of these models, providing valuable insights for further advancements.

JOURNAL OF BIOMEDICAL INFORMATICS (2022)

Article Computer Science, Artificial Intelligence

Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks

Bin Liang et al.

Summary: This paper proposes a graph convolutional network model Sentic GCN based on SenticNet to enhance the affective dependencies of sentences for aspect-based sentiment analysis. By integrating emotional knowledge from SenticNet, the model effectively handles contextual affective information in sentences, improving the effectiveness of sentiment polarity detection towards specific aspects.

KNOWLEDGE-BASED SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis

Manju Venugopalan et al.

Summary: Aspect level sentiment analysis is a fine-grained task that extracts aspects and their sentiment polarity from opinionated text. This research proposes an unsupervised model that uses minimal aspect seed words to guide the extraction process and enhance the performance. The model incorporates guided inputs, multiple pruning strategies, and semantic filters to improve performance. Evaluation results show competitive and appreciable performance on restaurant domain datasets.

KNOWLEDGE-BASED SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Aspect-Based Sentiment Analysis with New Target Representation and Dependency Attention

Tao Yang et al.

Summary: In this study, a new approach for aspect-based sentiment analysis is proposed by considering contextual, lexical, and syntactic cues. Experimental results demonstrate the effectiveness of the proposed approach.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2022)

Article Computer Science, Artificial Intelligence

A reinforced active learning approach for optimal sampling in aspect term extraction for sentiment analysis

Manju Venugopalan et al.

Summary: Aspect level sentiment analysis is a fine-grained task that requires identifying product features and mapping sentiment towards each feature. This research proposes an active learning based sampling strategy for aspect term extraction, which automates the process and reduces annotation costs. Experimental results show a significant reduction in training data size and improved performance across different domains.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Article Computer Science, Artificial Intelligence

Aspect-based sentiment analysis with attention-assisted graph and variational sentence representation

Shi Feng et al.

Summary: Aspect-based sentiment analysis is a fine-grained task that detects the sentiment polarities of aspect words in a sentence. Current ABSA models primarily use graph-based methods but may rely excessively on the quality of dependency trees and overlook global sentence information. To address these issues, we propose a new ABSA model AG-VSR, which utilizes A2GR and VSR for final classification.

KNOWLEDGE-BASED SYSTEMS (2022)

Review Computer Science, Artificial Intelligence

Ontology based sentiment analysis for fake review detection

D. U. Vidanagama et al.

Summary: A majority of customers and manufacturers who engage in e-commerce rely on reviews for making purchasing decisions. However, fake reviews are problematic as they mislead decision-making. This research proposes a method for detecting fake reviews by integrating linguistic features, Part-of-Speech (POS) features, and sentiment analysis features. The detection is improved through the use of a rule-based classifier and a domain feature ontology. The performance measures of the classifier are enhanced by considering the features together rather than separately.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Article Computer Science, Information Systems

Fake news detection via knowledgeable prompt learning

Gongyao Jiang et al.

Summary: Researchers propose a knowledgeable prompt learning (KPL) method for fake news detection. By designing prompt templates and verbal words, and incorporating external knowledge, the KPL method outperforms traditional fine-tuning methods in fake news detection.

INFORMATION PROCESSING & MANAGEMENT (2022)

Article Computer Science, Information Systems

BioKnowPrompt: Incorporating imprecise knowledge into prompt-tuning verbalizer with biomedical text for relation extraction

Qing Li et al.

Summary: This paper presents BioKnowPrompt, a prompt-tuning pre-trained language model that incorporates imprecise knowledge into biomedical text relation extraction. By using task-specific prompts, BioKnowPrompt outperforms previous models and achieves state-of-the-art results on 5 datasets.

INFORMATION SCIENCES (2022)

Article Computer Science, Artificial Intelligence

Sentiment interaction and multi-graph perception with graph convolutional networks for aspect-based sentiment analysis

Qiang Lu et al.

Summary: This paper proposes a novel graph convolutional network with sentiment interaction and multi-graph perception for aspect-based sentiment analysis. The model considers the semantic correlations within aspect phrases and the sentiment interaction relations between different aspects of a sentence. It generates different types of adjacency graphs and uses graph convolutional neural networks and a multi-graph perception mechanism to enrich dependencies and enhance context-awareness. Experimental results show that the proposed model outperforms state-of-the-art methods in terms of accuracy and macro-F1 score.

KNOWLEDGE-BASED SYSTEMS (2022)

Article Computer Science, Information Systems

PromptEM: Prompt-tuning for Low-resource Generalized Entity Matching

Pengfei Wang et al.

Summary: Entity Matching (EM) is a fundamental problem in data management that aims to identify whether two entity records refer to the same real-world entity. Traditional EM methods assume homogeneous tables with aligned schemas, but in practice, entity records may have different formats. To support EM on format-different entity records, Generalized Entity Matching (GEM) has been proposed. This paper focuses on low-resource GEM and proposes a novel method called PromptEM, which addresses three challenging issues in low-resource GEM.

PROCEEDINGS OF THE VLDB ENDOWMENT (2022)

Article Computer Science, Software Engineering

Prompt-based system for personality and interpersonal reactivity prediction

Bin Li et al.

Summary: This paper presents our proposed method for the PER and IRI shared tasks at WASSA 2022. We utilize prompt-based learning with a pre-trained language model to enhance the models, and employ data augmentation and model ensemble for improved results. Additionally, we provide an online software demonstration and the corresponding code for further research.

SOFTWARE IMPACTS (2022)

Proceedings Paper Computer Science, Artificial Intelligence

Persistent Anti-Muslim Bias in Large Language Models

Abubakar Abid et al.

Summary: Research found that the GPT-3 model exhibits anti-Muslim bias, which is varied and severe, and can be partially alleviated with positive text prompts.

AIES '21: PROCEEDINGS OF THE 2021 AAAI/ACM CONFERENCE ON AI, ETHICS, AND SOCIETY (2021)

Review Computer Science, Artificial Intelligence

Sentiment analysis using deep learning architectures: a review

Ashima Yadav et al.

ARTIFICIAL INTELLIGENCE REVIEW (2020)

Article Computer Science, Artificial Intelligence

How Can We Know What Language Models Know?

Zhengbao Jiang et al.

TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (2020)

Article Automation & Control Systems

An effective Decision Support System for social media listening based on cross-source sentiment analysis models

Pietro Ducange et al.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2019)

Article Computer Science, Artificial Intelligence

Sentiment analysis based on rhetorical structure theory:Learning deep neural networks from discourse trees

Mathias Kraus et al.

EXPERT SYSTEMS WITH APPLICATIONS (2019)

Review Computer Science, Artificial Intelligence

Knowledge-enhanced neural networks for sentiment analysis of Chinese reviews

Fang Chen et al.

NEUROCOMPUTING (2019)

Article Computer Science, Artificial Intelligence

Sentiment analysis through critic learning for optimizing convolutional neural networks with rules

Bowen Zhang et al.

NEUROCOMPUTING (2019)

Article Automation & Control Systems

Sentiment analysis on stock social media for stock price movement prediction

Ali Derakhshan et al.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2019)

Article Computer Science, Artificial Intelligence

Fuzzy rule based unsupervised sentiment analysis from social media posts

Srishti Vashishtha et al.

EXPERT SYSTEMS WITH APPLICATIONS (2019)

Article Computer Science, Information Systems

A Survey of Sentiment Analysis Based on Transfer Learning

Ruijun Liu et al.

IEEE ACCESS (2019)

Article Computer Science, Artificial Intelligence

Multimodal Sentiment Analysis: Addressing Key Issues and Setting Up the Baselines

Soujanya Poria et al.

IEEE INTELLIGENT SYSTEMS (2018)

Article Computer Science, Information Systems

Approval network: a novel approach for sentiment analysis in social networks

E. Fersini et al.

WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS (2017)

Article Computer Science, Artificial Intelligence

Distantly Supervised Lifelong Learning for Large-Scale Social Media Sentiment Analysis

Rui Xia et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2017)

Article Computer Science, Artificial Intelligence

A Neural Word Embeddings Approach for Multi-Domain Sentiment Analysis

Mauro Dragoni et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2017)

Review Computer Science, Information Systems

Approaches to Cross-Domain Sentiment Analysis: A Systematic Literature Review

Tareq Al-Moslmi et al.

IEEE ACCESS (2017)

Article Computer Science, Artificial Intelligence

Chinese comments sentiment classification based on word2vec and SVMperf

Dongwen Zhang et al.

EXPERT SYSTEMS WITH APPLICATIONS (2015)

Proceedings Paper Computer Science, Theory & Methods

Topic and Sentiment Unification Maximum Entropy Model for Online Review Analysis

Changlin Ma et al.

WWW'15 COMPANION: PROCEEDINGS OF THE 24TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (2015)

Article Computer Science, Information Systems

Sentiment analysis in multiple languages: Feature selection for opinion classification in Web forums

Ahmed Abbasi et al.

ACM TRANSACTIONS ON INFORMATION SYSTEMS (2008)

Article Computer Science, Artificial Intelligence

An empirical study of sentiment analysis for chinese documents

Songbo Tan et al.

EXPERT SYSTEMS WITH APPLICATIONS (2008)

Article Computer Science, Artificial Intelligence

AVA: Adjective-verb-adverb combinations for sentiment analysis

V. S. Subrahmanian et al.

IEEE INTELLIGENT SYSTEMS (2008)