Turning a MacBook into a Touchscreen with $1 of Hardware (2018) (anishathalye.com)

Article summary

The article describes a proof-of-concept project called Project Sistine, which turns a MacBook into a touchscreen using $1 of hardware and computer vision. The system uses a small mirror positioned in front of the MacBook's built-in webcam to detect fingers hovering over or touching the screen. The video feed is then translated into touch events using classical computer vision techniques. The project's goal is to create a low-cost touchscreen system with minimal hardware requirements.

Main themes

• Touchscreen conversion
• Computer vision
• Latency reduction
• Hardware modification
• Software optimization

What commenters say

• Rewriting the code in a lower-level language like C or Rust could potentially reduce latency, but it may not be the primary cause of the issue.
• The webcam's hardware and post-processing are significant contributors to the latency, and optimizing these components could lead to better performance.
• Using a higher-resolution webcam and a curved mirror could improve the accuracy and responsiveness of the touchscreen system.
• The current implementation has limitations, including latency and portability issues, which need to be addressed to make the system more practical.
• Some commenters argue that using an eGPU with an NVIDIA GPU could improve performance, but this would add significant cost and complexity to the system.
• Others disagree, stating that the added cost and bulk of an eGPU would negate the benefits of the low-cost touchscreen conversion.
• The project's use of computer vision and machine learning algorithms is seen as a creative solution to the touchscreen conversion problem, but it also introduces new challenges and limitations.
• The discussion highlights the trade-offs between performance, cost, and portability in designing a touchscreen system, and the need for careful optimization and compromise to achieve a practical solution.