Open Access

Maximilian Maurer

• In recent years, smart mirrors have established themselves as a key technology within the Internet of Things (IoT), primarily serving as interactive information displays in everyday situations. While commercial solutions are widely available, a strong community of developers continues to create and refine customized smart mirror systems. Despite numerous projects in this domain, there is currentlyIn recent years, smart mirrors have established themselves as a key technology within the Internet of Things (IoT), primarily serving as interactive information displays in everyday situations. While commercial solutions are widely available, a strong community of developers continues to create and refine customized smart mirror systems. Despite numerous projects in this domain, there is currently no known solution that seamlessly integrates touchless gesture control with AI powered image recognition. This thesis focuses on the conceptualization and implementation of a gesture controlled smart mirror that functions not only as an interactive information display but also incorporates an AI-driven (Artificial Intelligence) drawing game. The study is guided by the central research question: "How can a gesture-controlled smart mirror, integrating both everyday information and an AI-based mini-game, be designed and implemented to ensure long-term usability in a university environment while offering a reliable, intuitive, and interactive user experience?" The development is based on a comprehensive system design, which considers key requirements such as the intended target audience, usability factors, and technical constraints. For implementation, MagicMirror² was used as the core software platform for information display, while MediaPipe and OpenCV handle gesture recognition. The AI-powered real-time image classification is facilitated by a convolutional neural network (CNN) trained specifically for this purpose. The results demonstrate that the integration of these technologies leads to an innovative and efficient smart mirror solution. The incorporation of touchless gesture control enables a modern and intuitive mode of interaction, while the AI-driven drawing game introduces a playful learning experience.…