4.4 Article

Interactionally Embedded Gestalt Principles of Multimodal Human Communication

相关参考文献

注意:仅列出部分参考文献,下载原文获取全部文献信息。
Article History & Philosophy Of Science

Direct perception in context: radical empiricist reflections on the medium

Ludger van Dijk et al.

Summary: The radical empiricists of the early 20th century described organisms experiencing their relations with the environment before any analytical separation. Gibson's ecological approach to perception was inspired by this perspective, although his inconsistent accounts of the medium posed challenges. By revisiting the concept of the medium and emphasizing the role of social factors in direct perception, a novel radical empiricist view is proposed in this study.

SYNTHESE (2021)

Article Psychology, Experimental

All Affordances Are Social: Foundations of a Gibsonian Social Ontology

Edward Baggs

Summary: Ecological psychology is based on a perception-oriented ontology, focusing on explaining the perception and action behavior of individual animals. To include social phenomena, the ontology needs to be expanded, but theorists are unsure how to do this. The paper argues against the term 'social affordance' and advocates for the claim that all affordances are social, while also highlighting the need for new tools to describe social meaning within an ecological social ontology.

ECOLOGICAL PSYCHOLOGY (2021)

Article Psychology, Experimental

Perception of the Potential for Interaction in Social Scenes

Roy S. Hessels et al.

Summary: Participants base their potential actions on the behavior depicted in the photograph, and believe that the likelihood of interaction depends not only on the behavior itself, but also on the distance between the actor and the camera.

I-PERCEPTION (2021)

Article Linguistics

Situated talking

Ludger van Dijk et al.

Summary: In ecological psychology, language use is seen as a practical process of adapting to the environment shared with others, rather than inferring pre-existing meaning in the mind of the speaker. Through the analysis of situated talking in the practice of making an architectural art installation, it is found that talking establishes practical continuity between past and present activities, contributing to determining affordances of different timescales. By running different threads of unfolding affordances together, talking can enable future activities to continue the process further.

LANGUAGE SCIENCES (2021)

Article Biology

More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension

Ye Zhang et al.

Summary: Two studies indicate that multimodal cues are crucial for comprehension, with brain responses to words being influenced by the informativeness of co-occurring cues.

PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2021)

Article Multidisciplinary Sciences

Kinematics and observer-animator kinematic similarity predict mental state attribution from Heider-Simmel style animations

Bianca A. Schuster et al.

Summary: The ability to attribute mental states to oneself and others is crucial for social interactions, and animations tasks have been used extensively to test this in clinical populations. Research suggests that movement similarity between observer and animator significantly influences the correct identification of animations. Other indices of movement similarity, such as acceleration- and rotation-based similarity, also predict performance in animation tasks.

SCIENTIFIC REPORTS (2021)

Article Neurosciences

Facial Signals and Social Actions in Multimodal Face-to-Face Interaction

Naomi Nota et al.

Summary: This study investigates the importance of facial signals in conversations, showing differences in the distribution and timing of facial signals between questioning and responding. Facial signals may critically contribute to the communication of social actions by providing social action-specific visual information.

BRAIN SCIENCES (2021)

Article Communication

Multimodal Gestalts and Their Change Over Time: Is Routinization Also Grammaticalization?

Anja Stukenbrock

Summary: The study discusses whether grammar emerges from embodied conduct and proposes two different kinds of multimodal gestalts, analyzing the relationship between demonstratives and embodied practices through self-defense training video data.

FRONTIERS IN COMMUNICATION (2021)

Article Linguistics

Language without representation: Gibson's first- and second-hand perception on a pragmatic continuum1

Julian Kiverstein et al.

Summary: This paper examines how ecological psychology can account for linguistic deeds, highlighting the reciprocal relationship between active perception and linguistic practices. The hierarchical view of first-hand perception based on natural laws versus second-hand perception enabled by social and cultural convention in ecological psychology is critiqued.

LANGUAGE SCIENCES (2021)

Article Neurosciences

Seeing the Unexpected: How Brains Read Communicative Intent through Kinematics

James P. Trujillo et al.

CEREBRAL CORTEX (2020)

Article Neurosciences

Informing, Coordinating, and Performing: A Perspective on Functions of Sensorimotor Communication

Cordula Vesper et al.

FRONTIERS IN HUMAN NEUROSCIENCE (2020)

Article Linguistics

Sequence organization: A universal infrastructure for social action

Kobin H. Kendrick et al.

JOURNAL OF PRAGMATICS (2020)

Article Education & Educational Research

How Referential Gestures Align With Speech: Evidence From Monolingual and Bilingual Speakers

Maria Graziano et al.

LANGUAGE LEARNING (2020)

Review Biology

The body talks: Sensorimotor communication and its brain and kinematic signatures

Giovanni Pezzulo et al.

PHYSICS OF LIFE REVIEWS (2019)

Article History & Philosophy Of Science

General ecological information supports engagement with affordances for 'higher' cognition

Jelle Bruineberg et al.

SYNTHESE (2019)

Review Behavioral Sciences

Multimodal Language Processing in Human Communication

Judith Holler et al.

TRENDS IN COGNITIVE SCIENCES (2019)

Article Psychology, Experimental

Statistical learning and Gestalt-like principles predict melodic expectations

Emily Morgan et al.

COGNITION (2019)

Article Psychology, Multidisciplinary

Ecological mechanisms in cognitive science

Sabrina Golonka et al.

THEORY & PSYCHOLOGY (2019)

Review Psychology, Multidisciplinary

The Role of Eye Gaze During Natural Social Interactions in Typical and Autistic People

Roser Canigueral et al.

FRONTIERS IN PSYCHOLOGY (2019)

Article Psychology

Distinct Kinematic Markers of Demonstration and Joint Action Coordination? Evidence From Virtual Xylophone Playing

Luke McEllin et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE (2018)

Review Behavioral Sciences

Audiovisual multisensory integration in individuals with autism spectrum disorder: A systematic review and meta-analysis

Jacob I. Feldman et al.

NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS (2018)

Article Psychology, Experimental

The Preference for Pointing With the Hand Is Not Universal

Kensy Cooperrider et al.

COGNITIVE SCIENCE (2018)

Article Linguistics

Some pragmatic functions of conversational facial gestures

Janet Bavelas et al.

GESTURE (2018)

Article Psychology, Biological

Modelling the N400 brain potential as change in a probabilistic representation of meaning

Milena Rabovsky et al.

NATURE HUMAN BEHAVIOUR (2018)

Article Psychology, Multidisciplinary

The History and Philosophy of Ecological Psychology

Lorena Lobo et al.

FRONTIERS IN PSYCHOLOGY (2018)

Article Psychology

Our Own Action Kinematics Predict the Perceived Affective States of Others

Rosanna Edey et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE (2017)

Article Psychology, Experimental

The Senses Considered as One Perceptual System

Thomas A. Stoffregen et al.

ECOLOGICAL PSYCHOLOGY (2017)

Article Psychology, Multidisciplinary

Inviting affordances and agency

Rob Withagen et al.

NEW IDEAS IN PSYCHOLOGY (2017)

Review Neurosciences

Multisensory Processes: A Balancing Act across the Lifespan

Micah M. Murray et al.

TRENDS IN NEUROSCIENCES (2016)

Article Linguistics

Challenges of multimodality: Language and the body in social interaction

Lorenza Mondada

JOURNAL OF SOCIOLINGUISTICS (2016)

Article Psychology, Experimental

The not face: A grammaticalization of facial expressions of emotion

C. Fabian Benitez-Quiroz et al.

COGNITION (2016)

Article Psychology, Multidisciplinary

Cultural Affordances: Scaffolding Local Worlds Through Shared Intentionally and Regimes of Attention

Maxwell J. D. Ramstead et al.

FRONTIERS IN PSYCHOLOGY (2016)

Article Psychology

Self-Organized Complementary Joint Action: Behavioral Dynamics of an Interpersonal Collision-Avoidance Task

Michael J. Richardson et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE (2015)

Article Multidisciplinary Sciences

Predicting Object Size from Hand Kinematics: A Temporal Perspective

Caterina Ansuini et al.

PLOS ONE (2015)

Article Neurosciences

Eye'm talking to you: speakers' gaze direction modulates co-speech gesture processing in the right MTG

Judith Holler et al.

SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE (2015)

Article Psychology, Experimental

Laws and Conventions in Language-Related Behaviors

Sabrina Golonka

ECOLOGICAL PSYCHOLOGY (2015)

Article Neurosciences

The dynamics of invariant object recognition in the human visual system

Leyla Isik et al.

JOURNAL OF NEUROPHYSIOLOGY (2014)

Editorial Material Biology

Language as a multimodal phenomenon: implications for language learning, processing and evolution

Gabriella Vigliocco et al.

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2014)

Review Biology

Hearing and seeing meaning in speech and gesture: insights from brain and behaviour

Asli Ozyurek

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2014)

Article Linguistics

The local constitution of multimodal resources for social interaction

Lorenza Mondada

JOURNAL OF PRAGMATICS (2014)

Article Linguistics

Righting language: a view from ecological psychology

Bert H. Hodges

LANGUAGE SCIENCES (2014)

Article Neurosciences

Goal or movement? Action representation within the primary motor cortex

Andrea Cavallo et al.

EUROPEAN JOURNAL OF NEUROSCIENCE (2013)

Article Ophthalmology

Representational dynamics of object vision: The first 1000 ms

Thomas Carlson et al.

JOURNAL OF VISION (2013)

Article Multidisciplinary Sciences

Human Sensorimotor Communication: A Theory of Signaling in Online Social Interactions

Giovanni Pezzulo et al.

PLOS ONE (2013)

Article Linguistics

A new approach to prosodic grouping

Gerrit Kentner et al.

LINGUISTIC REVIEW (2013)

Article Humanities, Multidisciplinary

Talking and driving: Multiactivity in the car

Lorenza Mondada

SEMIOTICA (2012)

Review Psychology, Experimental

Music and Language Perception: Expectations, Structural Integration, and Cognitive Sequencing

Barbara Tillmann

TOPICS IN COGNITIVE SCIENCE (2012)

Review Neurosciences

Temporal coherence and attention in auditory scene analysis

Shihab A. Shamma et al.

TRENDS IN NEUROSCIENCES (2011)

Article Neurosciences

Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing

Spencer D. Kelly et al.

JOURNAL OF COGNITIVE NEUROSCIENCE (2010)

Article Psychology, Experimental

Construction grammar

Adele Goldberg et al.

WILEY INTERDISCIPLINARY REVIEWS-COGNITIVE SCIENCE (2010)

Editorial Material Neurosciences

The Speed of Categorization in the Human Visual System

Simon J. Thorpe

NEURON (2009)

Article Biology

Role of facial expressions in social interactions

Chris Frith

PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES (2009)

Review Behavioral Sciences

The eye contact effect: mechanisms and development

Atsushi Senju et al.

TRENDS IN COGNITIVE SCIENCES (2009)

Review Behavioral Sciences

Natural pedagogy

Gergely Csibra et al.

TRENDS IN COGNITIVE SCIENCES (2009)

Article Psychology, Experimental

Joint Action, Interactive Alignment, and Dialog

Simon Garrod et al.

TOPICS IN COGNITIVE SCIENCE (2009)

Review Linguistics

Cross-cultural variation of speech-accompanying gesture: A review

Sotaro Kita

LANGUAGE AND COGNITIVE PROCESSES (2009)

Article Psychology, Experimental

Structural integration in language and music: Evidence for a shared system

Evelina Fedorenko et al.

MEMORY & COGNITION (2009)

Article Psychology, Experimental

Does the intention to communicate affect action kinematics?

Luisa Sartori et al.

CONSCIOUSNESS AND COGNITION (2009)

Article Psychology, Experimental

INSINCERE UTTERANCES AND GAZE: EYE CONTACT DURING SARCASTIC STATEMENTS

Jason A. Williams et al.

PERCEPTUAL AND MOTOR SKILLS (2009)

Review Neurosciences

A cortical network for semantics: (de)constructing the N400

Ellen F. Lau et al.

NATURE REVIEWS NEUROSCIENCE (2008)

Article Psychology, Experimental

Direct perception in the intersubjective context

Shaun Gallagher

CONSCIOUSNESS AND COGNITION (2008)

Article Neurosciences

Processing scene context: Fast categorization and object interference

Olivier R. Joubert et al.

VISION RESEARCH (2007)

Article Psychology

Judging and actualizing intrapersonal and interpersonal affordances

Michael J. Richardson et al.

JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE (2007)

Article Psychology, Biological

Early semantic context integration and lexical access as revealed by event-related brain potentials

Barbara Penolazzi et al.

BIOLOGICAL PSYCHOLOGY (2007)

Article Neurosciences

A model of biological motion perception from configural form cues

J Lange et al.

JOURNAL OF NEUROSCIENCE (2006)

Article Multidisciplinary Sciences

Parietal lobe: From action organization to intention understanding

L Fogassi et al.

SCIENCE (2005)

Article Acoustics

Integration and segregation in auditory scene analysis

ES Sussman

JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA (2005)

Article Psychology, Multidisciplinary

Visual recognition - As soon as you know it is there, you know what it is

K Grill-Spector et al.

PSYCHOLOGICAL SCIENCE (2005)

Review Neurosciences

Visual objects in context

M Bar

NATURE REVIEWS NEUROSCIENCE (2004)

Review Neurosciences

Language, music, syntax and the brain

AD Patel

NATURE NEUROSCIENCE (2003)

Article Neurosciences

An event-related potentials study of biological motion perception in humans

M Hirai et al.

NEUROSCIENCE LETTERS (2003)

Article History & Philosophy Of Science

Affordances explained

A Scarantino

PHILOSOPHY OF SCIENCE (2003)

Article Ophthalmology

Active versus passive processing of biological motion

IM Thornton et al.

PERCEPTION (2002)

Review Psychology, Biological

On specification and the senses

TA Stoffregen et al.

BEHAVIORAL AND BRAIN SCIENCES (2001)

Article Neurosciences

A limit to the speed of processing in ultra-rapid visual categorization of novel natural scenes

M Fabre-Thorpe et al.

JOURNAL OF COGNITIVE NEUROSCIENCE (2001)

Article Communication

Visible acts of meaning - An integrated message model of language in face-to-face dialogue

JB Bavelas et al.

JOURNAL OF LANGUAGE AND SOCIAL PSYCHOLOGY (2000)