Radar-Optical Fusion

Developed a radar-optical fusion system integrating a FMCW radar data with real-time images.

Live camera frame with bounding boxes around two people and a bench, each labelled with radar range and radial velocity — A live frame: detected objects labelled with radar range and radial velocity.

This was done using Texas Instruments AWR1843BOOST evaluation board. I put this together really quickly in Python (with the help of LLM for UART parsing code), using OpenCV for image display and YOLO for object detection. It provides an intuitive way to visualize the processed data of the radar, which was the motivation. Please note that the radar was configured with a maximum distance of about ~8 m, and the velocity resolution is 0.43 m/s. It also does not do a good job discriminating the the detected objectsin the image versus the range estimates produced by the radar.

I found learning about FMCW radar interesting, but other than that not much can be said.

← Index