Bracket Bot

Hooked the robot up to GPT-4 + function calling, eleven labs, and whisper to perform actions given voice commands. Used multithreading to execute physical commands while running inference or waiting for user input on a seperate thread.

Attatched arms to the robot designed and controlled by Kyum Lee. Used roboflow to fine-tune Yolov8 to recognize open vs closed elevator doors and navigate towards them.

Continued working on autonomous navigation using Yolov8. Wrote a simple homing script to continiously move towards a bottle. Also added a webfeed to display images from the camera in realtime.