A05 Project for Developing Non-verbal Communication Availability using Body Functions and Gestures


Overview

When human beings communicate, the total message impression is 100%, where the percentage of the language content is 7%, the proportion of voice and sound quality is 38%, the ratio of facial expressions and gestures is the remaining 55%, according to Albert Melian. Based on this law, this project aims at a smooth meeting by visualizing not only conversations but also non-verbal communications in web conferences.


Background

When people communicate, facial expressions, glances, and gestures are more important than words. Albert Melian (1968) derived the law that the percentage of language content is 7% when the impression of the entire message is 100%, the ratio of voice and sound quality is 38%, and the ratio of expression and gesture is 55%. It is considered that non-verbal communication is more important than language communication.


Purpose

The purpose of this project is to improve non-verbal communication skills by reading voice, gaze, facial expressions,  and gestures.


Project Goal

The aim of a smooth meeting is to deepen the content understanding by adding the method of non-verbal communications assuming the use of VR at the conference.


System Configuration


Completed projection drawing


Development Language

Hardware

  • FOVE
  • Kinect v1
  • Web Camera
  • Microphone

Software

  • Unreal Engine 4
  • Blender

Development language

  • BluePrint
  • C++
  • Python

Member

  • Ryo Beppu   PM, Main Programmer
  • Yuki Suzuki   Programmer
  • Mao Saitou   Programmer
  • Yusuke Takeda    Programmer
  • Yuki Fukui      Programmer
  • Yukiko Cordova   Main Designer,  Modeler