news.volyx.in

Semaphore: A Full-Body Keyboard (github.com)

1362 points by kieto · 1236 days ago · 209 comments on HN

Article summary

The Semaphore project is a full-body keyboard that uses computer vision to detect body landmarks and translate them into keyboard inputs. The system uses OpenCV and MediaPipe's Pose detection to perform real-time detection of body landmarks from video input. The primary input is to 'type' letters, digits, and symbols via flag semaphore by extending both arms at various angles. The project also includes other modifier gestures, such as shift, backspace, and command, which are performed using different body movements.

Main themes

  • full-body keyboard
  • computer vision
  • gesture recognition
  • creative applications
  • gaming
  • music creation
  • humor and entertainment

What commenters say

  • The video demonstration of the Semaphore project is entertaining and showcases the creator's sense of humor.
  • Some viewers appreciate the creativity and potential of the project, suggesting it could be developed into a game or used for music creation.
  • The project's use of dance-like movements to input commands is reminiscent of earlier concepts, such as Google Motion and Dance Dance Authentication.
  • There are differing opinions on whether the project's creator made a joke at the expense of Claude Chappe, the inventor of Semaphore signaling.
  • The project's potential for creative applications, such as music or gaming, is being explored and discussed.
  • Some viewers are impressed by the project's technical aspects and the creator's ability to learn and perform the actions.
  • The idea of using the Semaphore project to play challenging games, such as Dark Souls, is being discussed and explored.