Recent Perspectives on Gesture and Multimodality

Recent Perspectives on Gesture and Multimodality PDF Author: Anabela Cruz-Santos
Publisher: Cambridge Scholars Publishing
ISBN: 1527536874
Category : Language Arts & Disciplines
Languages : en
Pages : 184

Get Book

Book Description
What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.

Recent Perspectives on Gesture and Multimodality

Recent Perspectives on Gesture and Multimodality PDF Author: Anabela Cruz-Santos
Publisher: Cambridge Scholars Publishing
ISBN: 1527536874
Category : Language Arts & Disciplines
Languages : en
Pages : 184

Get Book

Book Description
What is gesture and what does it do? What is the meaning of multimodality? What do these concepts signify within the different theoretical approaches to interaction and communication among human beings? Why do we study gesture and multimodality? The thirteen chapters that make up this volume provide answers to these questions. They bring together an eclectic set of recent studies on visible bodily actions conducted by junior and senior researchers and are a testimony to the curiosity and vitality that have always distinguished gesture studies. This young yet rapidly growing field investigates the semiotic features of gesture in relation to speech as integral parts of utterances, the different uses of gestures with and without speech, such as gestures in language acquisition, gestures in the performing arts (music, dance, theatre) and gestures in Artificial Intelligence.

Gesture and Multimodal Development

Gesture and Multimodal Development PDF Author: Jean-Marc Colletta
Publisher: John Benjamins Publishing
ISBN: 9027202583
Category : Language Arts & Disciplines
Languages : en
Pages : 236

Get Book

Book Description
Brings together studies from language acquisition and developmental psychology. This title addresses topics such as: gesture use in prelinguistic infants with a focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics

New Perspectives on Narrative and Multimodality

New Perspectives on Narrative and Multimodality PDF Author: Ruth Page
Publisher: Routledge
ISBN: 1135254613
Category : Language Arts & Disciplines
Languages : en
Pages : 243

Get Book

Book Description
The contributors in this collection question what kinds of relationships hold between narrative studies and the recently established field of multimodality, evaluate how we might develop an analytical vocabulary which recognizes that stories do not consist of words alone, and demonstrate the ways in which multimodality brings into fresh focus the embodied nature of narrative production and processing. Engaging with a spectrum of multimodal storytelling, from ‘low tech’ examples encompassing face-to-face stories, comic books, printed literature, through to opera, film adaptation and television documentary, stretching beyond to narratives that employ new media such as hypertext, performance art, and interactive museum guides, this volume examines the interplay of semiotic codes (visual, oral, aural, haptic, physiological) within each case under scrutiny, thereby exposing both points of commonality and difference in the range of multimodal narrative experiences.

Perspectives on Multimodality

Perspectives on Multimodality PDF Author: Eija Ventola
Publisher: John Benjamins Publishing
ISBN: 9027232067
Category : Language Arts & Disciplines
Languages : en
Pages : 260

Get Book

Book Description
This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.

Dance Data, Cognition, and Multimodal Communication

Dance Data, Cognition, and Multimodal Communication PDF Author: Carla Fernandes
Publisher: Taylor & Francis
ISBN: 1000556190
Category : Performing Arts
Languages : en
Pages : 332

Get Book

Book Description
Dance Data, Cognition, and Multimodal Communication is the result of a collaborative and transdisciplinary effort towards a first definition of "dance data", with its complexities and contradictions, in a time where cognitive science is growing in parallel to the need of a renewed awareness of the body’s agency in our manyfold interactions with the world. It is a reflection on the observation of bodily movements in artistic settings, and one that views human social interactions, multimodal communication, and cognitive processes through a different lens—that of the close collaboration between performing artists, designers, and scholars. This collection focuses simultaneously on methods and technologies for creating, documenting, or representing dance data. The editors highlight works focusing on the dancers’ embodied minds, including research using neural, cognitive, behavioural, and linguistic data in the context of dance composition processes. Each chapter deals with dance data from an interdisciplinary perspective, presenting theoretical and methodological discussions emerging from empirical studies, as well as more experimental ones. The book, which includes digital Support Material on the volume's Routledge website, will be of great interest to students and scholars in contemporary dance, neuro-cognitive science, intangible cultural heritage, performing arts, cognitive linguistics, embodiment, design, new media, and creativity studies.

Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics

Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics PDF Author: Alan J. Cienki
Publisher: Distinguished Lectures in Cogn
ISBN: 9789004332096
Category : Language Arts & Disciplines
Languages : en
Pages : 198

Get Book

Book Description
"Cognitive linguistics is purported to be a usage-based approach, yet only recently has research in some of its subfields turned to spontaneous spoken (versus written) language data. The collection of Alan Cienki's 'Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics' considers what it means to apply different approaches from within this field to the dynamic, multimodal combination of speech and gesture. The lectures encompass such main paradigms as blending and mental space theory, conceptual metaphor and metonymy, construction and cognitive grammars, image schemas, and mental simulation in relation to semantics. Overall, Alan Cienki shows that taking the usage-based commitment seriously with audio-visual data raises new issues and questions for theoretical models in cognitive linguistics."--Cover page 4.

Repetitions in Gesture

Repetitions in Gesture PDF Author: Jana Bressem
Publisher: Walter de Gruyter GmbH & Co KG
ISBN: 3110697998
Category : Language Arts & Disciplines
Languages : en
Pages : 253

Get Book

Book Description
Repetitive sequences play a major role as a pattern-building device and are a basic syntagmatic linguistic means on all language levels in spoken and signed languages. Little attention has been paid to investigating them in multimodal language use. Do gestures exhibit different types of repetitive sequences? Do they build complex units based on these types and if so, how is the pattern building to be described? How is the interrelation of gestural and spoken units in such complex units? Is it possible to identify repetitive patterns that are comparable to spoken and signed languages and/or patterns specific to the gestural modality? Based on a corpus-analysis of multimodal usage-events, 7 chapters explore gestural repetitions with regard to their structure, semantic and syntactic relevance for multimodal utterances, and cognitive saliency. Fine-grained cognitive-linguistic analyses of multimodal usage events reveal that gestural repetitions are not only a basic principle of building patterns in spoken and signed languages, but also in gestures. By addressing questions of mediality and multimodality of language-in-use, the book contributes to the investigation of repetition as a fundamental means of sign and meaning construction (crosscutting modalities) and enhances the understanding of the multimodal character of language in use.

Gesture-Based Communication in Human-Computer Interaction

Gesture-Based Communication in Human-Computer Interaction PDF Author: Antonio Camurri
Publisher: Springer
ISBN: 3540245987
Category : Computers
Languages : en
Pages : 571

Get Book

Book Description
Research on the multifaceted aspects of modeling, analysis, and synthesis of - man gesture is receiving growing interest from both the academic and industrial communities. On one hand, recent scienti?c developments on cognition, on - fect/emotion, on multimodal interfaces, and on multimedia have opened new perspectives on the integration of more sophisticated models of gesture in c- putersystems.Ontheotherhand,theconsolidationofnewtechnologiesenabling “disappearing” computers and (multimodal) interfaces to be integrated into the natural environments of users are making it realistic to consider tackling the complex meaning and subtleties of human gesture in multimedia systems, - abling a deeper, user-centered, enhanced physical participation and experience in the human-machine interaction process. The research programs supported by the European Commission and s- eral national institutions and governments individuated in recent years strategic ?elds strictly concerned with gesture research. For example, the DG Infor- tion Society of the European Commission (www.cordis.lu/ist) supports several initiatives, such as the “Disappearing Computer” and “Presence” EU-IST FET (Future and Emerging Technologies), the IST program “Interfaces & Enhanced Audio-Visual Services” (see for example the project MEGA, Multisensory - pressive Gesture Applications, www.megaproject.org), and the IST strategic - jective “Multimodal Interfaces.” Several EC projects and other funded research are represented in the chapters of this book. Awiderangeofapplicationscanbene?tfromadvancesinresearchongesture, from consolidated areas such as surveillance to new or emerging ?elds such as therapy and rehabilitation, home consumer goods, entertainment, and aud- visual, cultural and artistic applications, just to mention only a few of them.

Point of View, Perspective, and Focalization

Point of View, Perspective, and Focalization PDF Author: Peter Hühn
Publisher: Walter de Gruyter
ISBN: 3110218909
Category : Language Arts & Disciplines
Languages : en
Pages : 312

Get Book

Book Description
Stories do not actually exist in the world but are created and structured- modeled- through the process of mediation, i.e. through the means and techniques by which they are represented. This is an important field, not only for narratology but a

Gesture and Multimodal Development

Gesture and Multimodal Development PDF Author: Jean-Marc Colletta
Publisher: John Benjamins Publishing
ISBN: 9027273928
Category : Language Arts & Disciplines
Languages : en
Pages : 237

Get Book

Book Description
We gesture while we talk and children use gestures prior to words to communicate during the first year. Later, as words become the preferred form of communication, children continue to gesture to reinforce or extend the spoken messages or even to replace them. This volume, originally published as a Special Issue of Gesture 10:2/3 (2010), brings together studies from language acquisition and developmental psychology. It provides a review of common theoretical, methodological and empirical themes, and the contributions address topics such as gesture use in prelinguistic infants with a special and new focus on pointing, the relationship between gestures and lexical development in typically developing and deaf children and even how gesture can help to learn mathematics. All in all, it brings additional evidence on how gestures are related to language, communication and mind development.