Smart Car

The whole ecosystem around one small vehicle: a cross-platform control hub, wireless comms, natural-language understanding, and one reverse-engineered light stick.

CFLUTTEREMBEDDEDGEMINI API

90%

Zero-shot voice-command accuracy

The smart car on a workbench: foam chassis, exposed breadboard and sensor wiring, with a cat figure riding on top

PROBLEM

The hardware only accepts fixed-format protocol commands, and people do not speak in that format. Talking to the car directly needs a forgiving semantic layer in between.

APPROACH

A cross-platform control hub in Flutter (Dart) speaking wireless UART to the PIC18F firmware (C) over Bluetooth Serial, with the Gemini 2.0 Flash API parsing unstructured speech into standard vehicle protocol commands. The BLE protocol of a commercial light stick (IU-IKE) was reverse-engineered from its packet structure, with a custom driver syncing its LEDs to the vehicle state.

RESULT

Over 90% zero-shot accuracy on voice commands, with no per-command rules written by hand.

GitHub ↗