Perm, Perm, Russian Federation
VAK Russia 5.4.4
Time can be represented non-verbally in the spatial context of virtual reality. Time gestures remain understudied in a temporal contexts, despite the strong analytical potential of modern technologies, e.g., virtual reality. Time gestures are deictic means in multimodal communication; they are both universal and linguistically dependent. In this research, the focus shifted from traditional linguistic methods to immersive environments that made it possible to explore body patterns behind the spatial and temporal organization of gestures. The multimodal analysis involved 24 informants, whose gestures were observed in five modeled virtual scenes with various spatial orientation parameters. The time gestures revealed consistent trajectories and forms along the sagittal, lateral, and vertical axes. The movement direction correlated with the temporal reference, while the body pattern depended on the linguistic model. The gestures that accompanied time expressions formed an integrated spatial-temporal system anchored in bodily orientation. The meaning of time gestures became evident only within specific communicative contexts.
temporal deixis, temporal gestures, virtual reality, spatial deixis, embodied patterns, multimodal analysis
1. Bondarko A. V. Principles of functional grammar and issues of aspectology. 3rd ed. Moscow: URSS, 2003, 207. (In Russ.) https://elibrary.ru/qqpqbf
2. Grishina E. A. Zdes’ vs. tut "here": Corporal and gestural analysis of complete synonyms. Russian Language and Linguistic Theory, 2012, (1): 39–71. (In Russ.) https://elibrary.ru/qatonh
3. Grishina E. A. Time deictic gestures. Bulletin of the Russian Academy of Sciences: Studies in Literature and Language, 2013, 72(1): 3–31. (In Russ.) https://elibrary.ru/puypjv
4. Kreidlin G. E. Nonverbal semiotics: Body language and natural language. Moscow: Novoe literaturnoe obozrenie, 2002, 581. (In Russ.) https://elibrary.ru/stoobn
5. Litvinenko A. O., Nikolaeva Yu. V., Kibrik A. A. Annotation of Russian manual gestures: Theoretical and practical issues. Computational linguistics and intellectual technologies: Proc. Intern. Conf., Moscow, 31 May – 3 Jun 2017. Moscow: RSUH, 2017, vol. 2, iss. 16, 271–286. (In Russ.) https://elibrary.ru/prmztv
6. Popova Z. D., Sternin I. A. Cognitive linguistics. Moscow: AST; Vostok-Zapad, 2007, 314. (In Russ.) https://elibrary.ru/rufsvd
7. Ryabinin K. V., Baranov D. A., Belousov K. I. Integration of Semograph information system and SciVi visualizer for solving the tasks of lingual content expert analysis. Scientific Visualization, 2017, 9(4): 67–77. (In Russ.) http://doi.org/10.26583/sv.9.4.07 EDN: https://elibrary.ru/WNFNFF
8. Taleski A. Models of deictic and communicative behavior of a speaker in virtual reality. Moscow: Flinta, 2024, 220. (In Russ.) https://elibrary.ru/eoskyp
9. Alcaraz Carrión D., Valenzuela J. Distant time, distant gesture: Speech and gesture correlate to express temporal distance. Semiotica, 2021, (241): 159–183. https://doi.org/10.1515/sem-2019-0120 EDN: https://elibrary.ru/GOVVYJ
10. Belousov K., Erofeeva E., Leshchenko Yu., Baranov D. "Semograph" information system as a framework for network-based science and education. Smart Innovation, Systems and Technologies, 2017, 75: 263–272. https://doi.org/10.1007/978-3-319-59451-4_26 EDN: https://elibrary.ru/XMYMSW
11. Calbris G. Espace-temps: Expression gestuelle du temps. Semiotica, 1985, 55(1-2): 43–74. https://doi.org/10.1515/semi.1985.55.1-2.43
12. Calbris G. From left to right...: Coverbal gestures and their symbolic use of space. Metaphor and Gesture, 2008, 27–53. https://doi.org/10.1075/gs.3.05cal
13. Casasanto D., Jasmin K. The hands of time: Temporal gestures in English speakers. Cognitive Linguistics, 2012, 23(4): 643–674. https://doi.org/10.1515/cog-2012-0020
14. Efron D. Gesture and environment: A tentative study of some of the spatiotemporal and linguistic aspects of the gestural behavior of eastern Jews and southern Italians in New York City, living under similar as well as different environmental conditions. NY: King’s Crown Press, 1941, 184.
15. Gu Y., Zheng Y., Swerts M. Which is in front of Chinese people, past or future? The effect of language and culture on temporal gestures and spatial conceptions of time. Cognitive Science, 2019, 43(12). https://doi.org/10.1111/cogs.12804
16. Haspelmath M. From space to time: Temporal adverbials in the world’s languages. München-Newcastle: Lincom Europa, 1997, 181. https://doi.org/10.5281/zenodo.831421
17. Kendon A. Gesture: Visible action as utterance. Cambridge: Cambridge University, 2004, 412. https://doi.org/10.1017/CBO9780511807572
18. Knox D. Late medieval and renaissance ideas on gesture. Die Sprache der Zeichen und Bilder. Rhetorik und nonverbale Kommunikation in der frühen Neuzeit, ed. Kapp V. Marburg: Hitzeroth, 1990, 11–39.
19. Lakoff G., Johnson M. The metaphorical structure of the human conceptual system. Cognitive Science, 1980, 4(2): 195–208. https://doi.org/10.1207/s15516709cog0402_4
20. Levinson S. C. Space in language and cognition. Cambridge: Cambridge University, 2003, 389. https://doi.org/10.1017/CBO9780511613609
21. Li H. Time on hands: Deliberate and spontaneous temporal gestures by speakers of Mandarin. Gesture, 2017, 16(3): 396–415. https://doi.org/10.1075/gest.00002.li
22. McNeill D. Hand and mind: What gestures reveal about thought. Chicago: University of Chicago, 1992, 423.
23. Mortensen K., Hazel S. The temporal organisation of leaning in social interaction. Social Interaction. Video-Based Studies of Human Sociality, 2024, 7(4). https://doi.org/10.7146/si.v7i4.152386 EDN: https://elibrary.ru/PPHJFU
24. Pagán Cánovas C., Valenzuela J., Alcaraz Carrión D., Olza I., Ramscar M. Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions. PLoS ONE, 2020, 15(6). https://doi.org/10.1371/journal.pone.0233892 EDN: https://elibrary.ru/BKCVNZ
25. Patel K., Stotter J., Pali M. C., Giannopulu I. Imagine going left versus imagine going right: Whole-body motion on the lateral axis. Scientific Reports, 2024, 14. https://doi.org/10.1038/s41598-024-57220-w EDN: https://elibrary.ru/UMKSWI
26. Stolpe K., Falck M. J., Larsson A. Spatial constructions of time: Exploring co-speech gestures in lectures on programming. Cognitive Semiotics, 2025, 18(1). https://doi.org/10.1515/cogsem-2025-2002
27. The Institutio Oratoria of Quintilian with an English translation by H. E. Butler, M. A., professor of Latin in London University, ed. Carvalho D. London: William Heinemann; NY: G. P. Putnam’s Sons, 1922, vol. IV, book X, 3–154.
28. Yang Y., Sinha C., Filipovic L. Sequential time construal is primary in temporal uses of Mandarin Chinese qian "front" and hou "back". Language Sciences, 2022, 95. https://doi.org/10.1016/j.langsci.2022.101511 EDN: https://elibrary.ru/WEPGAU
