4.6 Article

Student engagement detection in online environment using computer vision and multi-dimensional feature fusion

Related references

Note: Only part of the references are listed.
Article Engineering, Multidisciplinary

Edge Computing Driven Low-Light Image Dynamic Enhancement for Object Detection

Yirui Wu et al.

Summary: This paper proposes an edge-computing driven framework for image enhancement and object detection in low-light conditions. By combining cloud computing and edge computing technologies, the framework achieves fast response and improved detection performance.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2023)

Article Computer Science, Information Systems

Multi-window Transformer parallel fusion feature pyramid network for pedestrian orientation detection

Xiao Li et al.

Summary: In complex traffic scenes, the orientation and location of pedestrians play a vital role in determining their intentions. Traditional object detection algorithms perform poorly in extracting features due to the variability in appearance and small differences among pedestrian orientations. To address this issue, this study proposes a novel framework for enhanced feature extraction using pedestrian orientation detection. The framework comprises two modules: the multi-window Transformer parallel fusion feature pyramid (MTPF) and the gated graph (GG). The MTPF module employs multi-layer feature fusion to improve the feature representation by extracting high-level semantic information and recovering missing contextual information. The GG module abstracts the region proposal into a graph with nodes representing body parts, enabling the learning of spatial dependencies and feature aggregation. The proposed method is evaluated using manually annotated pedestrian orientations on three public datasets and compared with state-of-the-art object detection methods, demonstrating its effectiveness.

MULTIMEDIA SYSTEMS (2023)

Article Computer Science, Information Systems

Digital Twin of Intelligent Small Surface Defect Detection with Cyber-manufacturing Systems

Yirui Wu et al.

Summary: This article aims to construct a cyber-manufacturing system to achieve a digital twin solution for small surface defect detection. By using an Edge Cloud architecture and a deep learning algorithm, data can be collected, processed, analyzed, and stored efficiently to achieve smart manufacturing.

ACM TRANSACTIONS ON INTERNET TECHNOLOGY (2023)

Article Education & Educational Research

This weird time we're in: How a sudden change to remote education impacted college students' self-regulated learning

Lauren C. Hensley et al.

Summary: The study found that college students faced challenges such as feeling disconnected, experiencing difficulty in concentration, and dealing with personal stressors and loss of autonomy during emergency remote learning. These issues impacted their willingness and ability to enact self-regulated learning behaviors and strategies.

JOURNAL OF RESEARCH ON TECHNOLOGY IN EDUCATION (2022)

Article Computer Science, Artificial Intelligence

An intelligent system for monitoring students' engagement in large classroom teaching through facial expression recognition

Chakradhar Pabba et al.

Summary: The problem of students' disengagement has become critical in modern scenarios due to distractions and lack of student-teacher interactions. This paper presents a real-time system for monitoring student group engagement by analyzing facial expressions and recognizing academic affective states, achieving promising results.

EXPERT SYSTEMS (2022)

Article Computer Science, Information Systems

Assessing learning engagement based on facial expression recognition in MOOC's scenario

Junge Shen et al.

Summary: Online learning is becoming increasingly important, but there is a need for supervisors to consistently keep learners motivated and focused. A new framework for assessing learning engagement introduces facial expression recognition to improve accuracy in assessing learners' engagement.

MULTIMEDIA SYSTEMS (2022)

Review Chemistry, Analytical

Wearables for Engagement Detection in Learning Environments: A Review

Maritza Bustos-Lopez et al.

Summary: Appropriate teaching strategies can increase student engagement, and modern technology allows for the measurement of engagement through analyzing physiological signals. This review explores current initiatives in detecting student engagement in educational settings, highlighting common physiological signals and key features of engagement.

BIOSENSORS-BASEL (2022)

Article Education & Educational Research

Online learner engagement: Conceptual definitions, research themes, and supportive practices

Florence Martin et al.

Summary: This article integrates scholarship from educational technology, educational psychology, and the learning sciences to propose a reconceptualization of online learner engagement. It introduces research themes and frameworks that have shaped understanding of learner engagement in online learning environments, and provides strategies for supporting online learner engagement.

EDUCATIONAL PSYCHOLOGIST (2022)

Proceedings Paper Computer Science, Interdisciplinary Applications

Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning

Prabin Sharma et al.

Summary: This paper presents a system for detecting the level of student engagement in e-learning using a laptop's built-in webcam. By analyzing eye and head movements, as well as facial expressions, the system generates a concentration index with three levels of engagement. The system was tested in a typical e-learning scenario and accurately identified periods of high, nominal, and low engagement. The results also showed a correlation between high concentration indexes and better student performance.

TECHNOLOGY AND INNOVATION IN LEARNING, TEACHING AND EDUCATION, TECH-EDU 2022 (2022)

Article Computer Science, Artificial Intelligence

Classifying Emotions and Engagement in Online Learning Based on a Single Facial Expression Recognition Neural Network

Andrey V. V. Savchenko et al.

Summary: This article analyzes the behavior of students in the e-learning environment and proposes a novel pipeline based on video facial processing. By applying face detection, tracking, and clustering techniques, sequences of faces of each student are extracted, and an efficient neural network is used to extract emotional features. The resulting facial features enable fast simultaneous prediction of students' engagement levels, individual emotions, and group-level affect. Additionally, the possibility of creating a summary of a lesson by saving short clips of different emotions and engagement is demonstrated.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2022)

Proceedings Paper Computer Science, Theory & Methods

Engagement Analysis of Students in Online Learning Environments

Sharanya Kamath et al.

Summary: In this paper, an ensemble approach is proposed to detect student engagement levels while watching an e-learning video. The model utilizes a deep convolutional neural network for facial expression recognition and a deep recurrent neural network for establishing a relationship between eye-gaze and engagement intensity.

MACHINE LEARNING AND BIG DATA ANALYTICS (PROCEEDINGS OF INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND BIG DATA ANALYTICS (ICMLBDA) 2021) (2022)

Proceedings Paper Computer Science, Theory & Methods

Transformer-based Multimodal Information Fusion for Facial Expression Analysis

Wei Zhang et al.

Summary: This paper introduces the author's submission to the CVPR 2022 Affective Behavior Analysis in-the-wild (ABAW) competition. The author proposes a multimodal Transformer-based framework for Action Unit detection and expression recognition, and achieves first place in the ABAW3 competition. Extensive quantitative evaluations and ablation studies on the Aff-Wild2 dataset demonstrate the effectiveness of the proposed method.

2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022 (2022)

Article Education & Educational Research

Online education action for defeating COVID-19 in China: An analysis of the system, mechanism and mode

Eryong Xue et al.

Summary: This study examines the efforts made in China to combat COVID-19 through online education, focusing on the system, mechanism, and mode. It explores the policy development, education system, and mechanisms implemented during the epidemic, as well as the various modes of online education and teaching used. The study also discusses the characteristics, trends, and issues surrounding online education in China during the epidemic.

EDUCATIONAL PHILOSOPHY AND THEORY (2022)

Article Psychology, Multidisciplinary

Online teaching and learning in higher education: Lessons learned in crisis situations

Sarah Hofer et al.

Summary: This article positions online teaching and learning in higher education within the broad framework of communities of practice (CoPs) and derives general insights on the topic from international research. It emphasizes the importance of scaffolding regulation processes and communication platforms as potential artifacts of an online teaching and learning community of practice.

COMPUTERS IN HUMAN BEHAVIOR (2021)

Article Computer Science, Artificial Intelligence

Deep facial spatiotemporal network for engagement prediction in online learning

Jiacheng Liao et al.

Summary: In this paper, a novel model called DFSTN was presented for engagement prediction, achieving good results on the DAiSEE dataset and outperforming many existing works. The model combines SENet for extracting facial spatial features and LSTM with GALN for generating an attentional hidden state.

APPLIED INTELLIGENCE (2021)

Article Computer Science, Interdisciplinary Applications

Linking self-report and process data to performance as measured by different assessment types

Teresa M. Ober et al.

Summary: This study examines the relationship between behavioral indicators of engagement from digital log data and student learning outcomes, finding that certain process data variables are significantly correlated with learning outcomes, particularly students' frequency of score report checking. The findings suggest that process data can enhance understanding of student behavior beyond self-report measures.

COMPUTERS & EDUCATION (2021)

Article Engineering, Electrical & Electronic

Student behavior analysis to measure engagement levels in online learning environments

Khawlah Altuwairqi et al.

Summary: The importance of smart online learning systems in education is widely acknowledged following the COVID-19 pandemic. Measuring student engagement based on emotions presents a challenge for researchers. To address this challenge, a new automatic multimodal approach has been proposed to measure student engagement levels in real time.

SIGNAL IMAGE AND VIDEO PROCESSING (2021)

Article Engineering, Electrical & Electronic

Multi-scale relation reasoning for multi-modal Visual Question Answering

Yirui Wu et al.

Summary: This paper proposes a method using a deep neural network for multi-modal relation reasoning, which successfully constructs a regional attention scheme and multi-scale property to accurately answer questions about images.

SIGNAL PROCESSING-IMAGE COMMUNICATION (2021)

Proceedings Paper Computer Science, Hardware & Architecture

Real-time Driver Drowsiness Detection based on Eye Movement and Yawning using Facial Landmark

Ali Mansour Al-madani et al.

Summary: The use of computer vision and image processing technology can detect and alert drivers about drowsiness, reducing the number of accidents. The developed real-time driver drowsiness detection system based on eye movement and yawning is cost-effective and minimizes resource requirements, monitoring drivers' facial landmarks without the need for sensors.

2021 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI) (2021)

Article Education & Educational Research

The positive relationship between flipped and blended learning and student engagement, performance and satisfaction

Rosemary Fisher et al.

Summary: The limited research so far does not definitively demonstrate the empirical link between flipped and blended learning pedagogies and student outcomes. However, the study found that flipped and blended learning do positively influence perceptions of engagement, performance, and satisfaction, with flipped learning mediating the effects of blended learning. Furthermore, the engagement stimulated by flipped learning pedagogy is inherently satisfying to students independent of their perceptions of performance.

ACTIVE LEARNING IN HIGHER EDUCATION (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Improving state-of-the-art in Detecting Student Engagement with Resnet and TCN Hybrid Network

Ali Abedi et al.

Summary: A novel hybrid neural network architecture, combining 2D ResNet and TCN, is proposed for detecting students' engagement levels in videos, outperforming other methods and setting a new baseline for future research.

2021 18TH CONFERENCE ON ROBOTS AND VISION (CRV 2021) (2021)

Article Education & Educational Research

High school students' experience of online learning during Covid-19: the influence of technology and pedagogy

Anne Yates et al.

Summary: The study explored New Zealand students' experiences of digital learning at home during Covid-19, highlighting the importance of authenticity, collaboration, and supportive pedagogies in facilitating learning outcomes.

TECHNOLOGY PEDAGOGY AND EDUCATION (2021)

Article Education & Educational Research

Machine learning for human learners: opportunities, issues, tensions and threats

Mary E. Webb et al.

Summary: The article discusses the impact of machine learning on human learning and education systems, emphasizing the importance of explainability and accountability in the design of machine learning systems. Students need to understand key aspects of machine learning systems and have opportunities to adapt and create such systems.

ETR&D-EDUCATIONAL TECHNOLOGY RESEARCH AND DEVELOPMENT (2021)

Review Psychology, Educational

Attentive or Not? Toward a Machine Learning Approach to Assessing Students' Visible Engagement in Classroom Instruction

Patricia Goldberg et al.

Summary: Teacher training and technological advances can help teachers improve their ability to monitor student behavior and evaluate student engagement in learning. Research has shown that both manual rating systems and machine vision methods are effective in predicting students' cognitive engagement and learning performance.

EDUCATIONAL PSYCHOLOGY REVIEW (2021)

Article Chemistry, Analytical

The Automatic Detection of Cognition Using EEG and Facial Expressions

Mohamed El Kerdawy et al.

SENSORS (2020)

Article Multidisciplinary Sciences

Learning recommendation with formal concept analysis for intelligent tutoring system

Jirapond Muangprathub et al.

HELIYON (2020)

Article Education & Educational Research

The Effects of Flow, Emotional Engagement, and Motivation on Success in a Gamified Online Learning Environment

Seyma Caglar Ozhan et al.

JOURNAL OF EDUCATIONAL COMPUTING RESEARCH (2020)

Article Education & Educational Research

Automatic detection of students' affective states in classroom environment using hybrid convolutional neural networks

T. S. Ashwin et al.

EDUCATION AND INFORMATION TECHNOLOGIES (2020)

Article Education & Educational Research

Self-regulated learning strategies in higher education: Fostering digital literacy for sustainable lifelong learning

Lilian Anthonysamy et al.

EDUCATION AND INFORMATION TECHNOLOGIES (2020)

Article Education & Educational Research

Data-driven Online Learning Engagement Detection via Facial Expression and Mouse Behavior Recognition Technology

Zhaoli Zhang et al.

JOURNAL OF EDUCATIONAL COMPUTING RESEARCH (2020)

Article Computer Science, Interdisciplinary Applications

Measuring motivation from the Virtual Learning Environment in secondary education

Tomas Aluja-Banet et al.

JOURNAL OF COMPUTATIONAL SCIENCE (2019)

Article Computer Science, Artificial Intelligence

Facial Landmark Detection: A Literature Survey

Yue Wu et al.

INTERNATIONAL JOURNAL OF COMPUTER VISION (2019)

Article Engineering, Electrical & Electronic

Deep feature based efficient regularised ensemble for engagement recognition

Y. -m. Park et al.

ELECTRONICS LETTERS (2019)

Review Education & Educational Research

Engagement detection in online learning: a review

M. Ali Akber Dewan et al.

SMART LEARNING ENVIRONMENTS (2019)

Proceedings Paper Computer Science, Information Systems

Fine-grained Engagement Recognition in Online Learning Environment

Tao Huang et al.

PROCEEDINGS OF 2019 IEEE 9TH INTERNATIONAL CONFERENCE ON ELECTRONICS INFORMATION AND EMERGENCY COMMUNICATION (ICEIEC 2019) (2019)

Article Mathematical & Computational Biology

Student Engagement Predictions in an e-Learning System and Their Impact on Student Course Assessment Scores

Mushtaq Hussain et al.

COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Fine-Grained Head Pose Estimation Without Keypoints

Nataniel Ruiz et al.

PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW) (2018)

Article Computer Science, Artificial Intelligence

Automated Detection of Engagement Using Video-Based Estimation of Facial Expressions and Heart Rate

Hamed Monkaresi et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2017)

Article Computer Science, Interdisciplinary Applications

Students' patterns of engagement and course performance in a Massive Open Online Course

Trang Phan et al.

COMPUTERS & EDUCATION (2016)

Article Computer Science, Interdisciplinary Applications

ToTCompute: A Novel EEG-Based TimeOnTask Threshold Computation Mechanism for Engagement Modelling and Monitoring

Ioana Ghergulescu et al.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2016)

Article Education & Educational Research

Measuring Cognitive Engagement With Self-Report Scales: Reflections From Over 20 Years of Research

Barbara A. Greene

EDUCATIONAL PSYCHOLOGIST (2015)

Article Computer Science, Artificial Intelligence

The Faces of Engagement: Automatic Recognition of Student Engagement from Facial Expressions

Jacob Whitehill et al.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2014)

Article Psychology, Educational

Measuring Engagement in Fourth to Twelfth Grade Classrooms: The Classroom Engagement Inventory

Ze Wang et al.

SCHOOL PSYCHOLOGY QUARTERLY (2014)

Article Computer Science, Information Systems

The Development and Evaluation of a Survey to Measure User Engagement

Heather L. O'Brien et al.

JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY (2010)

Article Social Sciences, Interdisciplinary

Benefits of 'observer effects': lessons from the field

Torin Monahan et al.

QUALITATIVE RESEARCH (2010)

Article Psychology, Multidisciplinary

Out of Mind, Out of Sight: Eye Blinking as Indicator and Embodiment of Mind Wandering

Daniel Smilek et al.

PSYCHOLOGICAL SCIENCE (2010)

Article Education & Educational Research

Facilitating Cognitive Presence in Online Learning: Interaction Is Not Enough

D. Randy Garrison et al.

AMERICAN JOURNAL OF DISTANCE EDUCATION (2005)

Review Education & Educational Research

School engagement: Potential of the concept, state of the evidence

JA Fredricks et al.

REVIEW OF EDUCATIONAL RESEARCH (2004)