← Back to projects

Embedded ML · Radar sensing · Project Infineon-X

60 GHz Radar Gesture Recognition

A radar-based gesture input subsystem for Project Infineon-X, an assistive facial-recognition system. I adapted an Infineon PSoC 6 radar example, trained a custom swipe gesture, and exposed gesture detections to the rest of the system through GPIO and UART.

System context

One subsystem in a larger assistive platform.

The radar work was developed as part of Project Infineon-X, a team-built facial-recognition platform that combines model training and inference, a single-board-computer client, and a web control surface. The PSoC radar subsystem provided a hands-free gesture input path for controlling or triggering behavior elsewhere in that system.

Separating gesture recognition into its own embedded subsystem meant the rest of the platform did not need to receive or process raw radar data. Instead, it could react to simple event signals produced by the PSoC.

Problem

Turn radar inference into a useful system input.

The starting point was Infineon's DEEPCRAFT radar deployment example for the PSoC 6 AI Evaluation Kit. It demonstrated gesture classification using the XENSIV 60 GHz radar sensor, but the larger Infineon-X system needed a clean interface for reacting to those detections and a gesture set tailored to the intended interaction.

My contribution

Firmware integration and custom gesture training

  • Modified the application behavior around detected gestures.
  • Added a GPIO output that can act as a hardware trigger for another device.
  • Added UART output for communicating detected events digitally.
  • Configured the required PSoC GPIO resources.
  • Collected and labeled radar data for a new swipe gesture.
  • Trained and exported a DEEPCRAFT model containing the custom swipe class.
  • Integrated the new model into the PSoC firmware and tested it on the physical radar hardware.
  • Integrated the radar gesture stage into the broader Infineon-X system concept.

Architecture

Gesture signal flow

XENSIV BGT60TR13C 60 GHz Radar │ SPI ▼ PSoC 6 AI Evaluation Kit │ ▼ Radar sampling / preprocessing │ ▼ Custom DEEPCRAFT ML model │ ▼ Gesture classification │ ├────────► GPIO trigger ───────┐ │ │ └────────► UART event ─────────┤ ▼ Infineon-X system

Embedded ML

Training a custom swipe gesture

The stock example included gestures such as push and circle. Rather than limiting the interaction design to the vendor-provided classes, I collected application-specific radar samples for a swipe motion and labeled them alongside contrasting gesture and non-gesture examples.

I used the expanded dataset to train a new classifier in DEEPCRAFT Studio, exported the embedded model, replaced the model files in the ModusToolbox project, and flashed the result to the PSoC 6 for real-time testing. This created an end-to-end workflow from physical motion and radar data collection through model training, embedded deployment, and hardware validation.

Perform swipe gestures │ ▼ Capture + label radar samples │ ▼ Train DEEPCRAFT classifier │ ▼ Export embedded model │ ▼ Integrate into PSoC firmware │ ▼ Flash + validate on hardware

Why this architecture

Keep radar-specific work at the edge.

Running acquisition and classification on the PSoC keeps raw radar processing local to the sensor subsystem. The larger project only needs to understand a simple GPIO trigger or UART event rather than the radar data format, preprocessing pipeline, or ML implementation.

Tools

Hardware & software

  • PSoC 6
  • Infineon XENSIV 60 GHz Radar
  • C
  • ModusToolbox
  • DEEPCRAFT Studio
  • Embedded ML
  • UART
  • GPIO

Related work

Project Infineon-X

The complete team project includes the facial-recognition backend and model-training stack, SBC client software, and web interface. The radar repository documents the PSoC-side gesture subsystem in more detail, while the Infineon-X repository shows the wider system it was designed to support.

Next revision

What I’d improve

I would add quantitative per-gesture accuracy and false-trigger measurements, characterize detection latency, expand the swipe dataset across users and gesture conditions, and document the full gesture-event path from the PSoC through the downstream Infineon-X hardware and software.