Proto-OS is designed to be an 'operating system' for a Protogen suit head. It is designed to use computer vision and machine learning to track the user's eye position and facial expression and mimic them on the character's face display.
A Protogen is a type of cyborg character. They have a robotic face display that can be used to show their emotions and eye position.
For example:
3D models I am printing:
Proto-OS uses a Raspberry Pi 4B with a camera module to track the user's eye position and facial expression. These are mounted inside the suit head, with the camera facing the user. The Raspberry Pi is connected to the camera via a long ribbon cable and runs a Python script that uses OpenCV to track the user's eye position and Tensorflow Lite to track their facial expression. The script then sends the eye position and facial expression data to two Raspberry Pi Zeros via serial communication.
The Zeros then run my custom graphics library for the Pimoroni Unicorn HD Hat (An RGB LED Matrix) to display the eye position and facial expression on the character's face display.
Here is matrix, which would account for a single eye:
