This article presents a new algorithm of interpreting human gestures based on the 3D coordinates of one of the user’s hands. This way, certain decisions are made based on the rule set. The developed application allows the playback of a video file which is chosen from a list with the help of a certain hand gesture, like a series of functions presented in this article. In order for the user’s experience to be interactive, the human gestures’ acquisition must be carried on continuously and data processing must be conducted in real time. Furthermore, the algorithm evolves the rule set to be able to identify the human gesture acquired at a certain time.