Gesture interaction support explaining ideas

In the refined sketch, there will be a common transparent board between the speaker and audiences, the speaker can use gestures to make lists, create shapes, draw lines on that com-mon board during his speech. Besides that, the speaker can also use gesture to grab and move those elements he created. By making lists, the speaker can easily highlight the key points of the meeting, with those basic shapes and drawings, those spatial relationship and abstract thoughts can be explained clearly. Furthermore, the speaker can use gesture to change com-mon board or grab the old common board back, so he can easily jump between old and new top-ic.





If the speaker is sharing slides, he can use the pointing gesture to move his camera video to the place he’s pointing. In this way, we can simulate the situation of people point in real life, poten-tially direct the audiences’ attention better. Not only the presenter can point, but the audienc-es can also point and move their camera videos to the place they are pointing. Because of that, there will be more interaction between the speaker and audiences.

Except this refined sketch, the basic problems such as how people can interact with computer/machine through hands, what should we pay attention to when designing the gesture triggered function, how to design the gesture triggered function, have been discussed in this project as well.

Although there is a final refined sketch based on my insights and principles, as an exploratory project, the purpose of this diploma is not giving the final solution, but showing the different possibilities, along with the exploration of those basic problems, this project can be a founda-tion for people to go further in this area. 



Try the prototype? :  https://gesturemeeting.netlify.app/

---

Ziyue Wang / 96800906 / Wang.ziyue@stud.aho.no