Imagine trying to capture the essence of a story by looking at the cover of a book. In a similar way, speakers rely on visual cues to identify features of verbs, such as tense and aspect morphology. To explore this phenomenon, researchers conducted experiments with Japanese speakers who were asked to describe computer-generated animations depicting simple actions. The results showed that participants were able to use visual information, specifically goal-related visuals, to select the appropriate verb forms. Additionally, they produced a wide variety of verb forms. To explain these findings, a deep-learning model was created that mimicked human-like verb production using visual input. This model successfully used visual cues to determine the correct tense/aspect morphology. Interestingly, the model also predicted that video duration would impact verb complexity and that past tense production would increase when the endpoint of an action was shown. These predictions were confirmed in a separate study with Japanese adults. Overall, this research suggests that verb production is closely linked to visual heuristics that aid in understanding events.
Abstract
Tense/aspect morphology on verbs is often thought to depend on event features like telicity, but it is not known how speakers identify these features in visual scenes. To examine this question, we asked Japanese speakers to describe computer-generated animations of simple actions with variation in visual features related to telicity. Experiments with adults and children found that they could use goal information in the animations to select appropriate past and progressive verb forms. They also produced a large number of different verb forms. To explain these findings, a deep-learning model of verb production from visual input was created that could produce a human-like distribution of verb forms. It was able to use visual cues to select appropriate tense/aspect morphology. The model predicted that video duration would be related to verb complexity, and past tense production would increase when it received the endpoint as input. These predictions were confirmed in a third study with Japanese adults. This work suggests that verb production could be tightly linked to visual heuristics that support the understanding of events.
Dr. David Lowemann, M.Sc, Ph.D., is a co-founder of the Institute for the Future of Human Potential, where he leads the charge in pioneering Self-Enhancement Science for the Success of Society. With a keen interest in exploring the untapped potential of the human mind, Dr. Lowemann has dedicated his career to pushing the boundaries of human capabilities and understanding.
Armed with a Master of Science degree and a Ph.D. in his field, Dr. Lowemann has consistently been at the forefront of research and innovation, delving into ways to optimize human performance, cognition, and overall well-being. His work at the Institute revolves around a profound commitment to harnessing cutting-edge science and technology to help individuals lead more fulfilling and intelligent lives.
Dr. Lowemann’s influence extends to the educational platform BetterSmarter.me, where he shares his insights, findings, and personal development strategies with a broader audience. His ongoing mission is shaping the way we perceive and leverage the vast capacities of the human mind, offering invaluable contributions to society’s overall success and collective well-being.