ESP-WIFI-CSI detects humans with WiFi signals only, no sensor needed

Espressif ESP-WIFI-CSI software relies on the disturbance in the force WiFi signals between one or more ESP32 boards and a router to detect whether humans are present in a room, or even indoor positioning, providing a cost-effective solution since no sensors are needed.

Channel state information (CSI) leverages carrier signal strength, amplitude, phase, and signal delay indicators to reveal the signal scattering, reflection, and power attenuation phenomena that occur with the carrier as the transmission distance changes. This is typically used to measure the channel status of the wireless network in Wi-Fi communication, but it’s also possible to analyze and study the changes in CSI to detect movements such as walking and running of people or animals, and Espressif claims it can also capture subtle movements caused by small movements such as breathing and chewing of people or animals in a static environment.

ESP-WiFi-CSI

ESP-WIFI-CSI implementation works with all ESP32 series microcontrollers including ESP32, ESP32-S2, and ESP32-C3, and does not require any changes to the hardware, although an external IPEX antenna is better than a PCB antenna which has directivity. The company also explains Bluetooth LE can also be leveraged for presence detection by scanning surrounding devices to assist with the detection.

ESP32 WIFI CSI indoor positioning
ESP-WIFI-CSI with multiple ESP32 lightbulbs

Typical CSI applications include intruder detection, positioning and ranging, as well as human activity detection and gesture recognition. You’ll find more details on Github with the source code, sample, and a more detailed explanation showing how this all works. More details on ESP32 WiFI CSI indicators can be found on the documentation website. The video below from 2021 also shows a demo of ESP-WIFI-CSI for human detection only (no indoor location).

YouTube video player

I could not find details about indoor location range, accuracy, and features like breathing detection when multiple ESP32 boards are in use, so it’s unclear whether ESP-WIFI-CSI will be able to provide the same type of solutions such as ToF sensors, for example, the VL53L5CP used in laptops for human detection and gesture recognition, as well as UWB sensors like Novelda UWB x4 which can detect submillimeter movements for applications such as heating or air conditioner control in a hotel room, where human detection must work even if the guest sleeps.

Share this:
FacebookTwitterHacker NewsSlashdotRedditLinkedInPinterestFlipboardMeWeLineEmailShare

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

ROCK 5 ITX RK3588 mini-ITX motherboard

16 Replies to “ESP-WIFI-CSI detects humans with WiFi signals only, no sensor needed”

  1. Espressif ESP-WIFI-CSI software relies on the disturbance in the force WiFi signals between one or more ESP32 boards ” Almost a Jedi, Luke.

  2. A friend asked me about investing in a ToF sensor startup that wanted to give smart TV presence detection so they’d be able to turn off their screens when people leave the room.

    I told them it will never sell since smart TV manufacturers make revenues off advertisement and user tracking even when people leave the screens on while leaving the room…

    That was over 5 years ago…

    1. I remember the very first patent I worked on when I joined a cable company was occupancy sensing from the STB. We ended up citing a handful of patents and its been cited over a thousand times. Targeted advertising is fat more valuable than playing a random ad to a potentially unoccupied room so there’s hope for a ToF or camera over the 500 cheaper ways of doing it

  3. Looks good for “presense detection” in smart home applications. I try to find somethin useful for my Homeassistant setup recently.
    For now, mmWave FMCW radars on 24/60 GHz with human pulse detection looks promising but price is x10 to ESP32.

  4. Very interesting, thanks for sharing! I think I’ll give this a try, just out of curiosity, I like the almost non-intrusive approach.

  5. This kind of works and it is free assuming you already needed the ESPs in the room. Sure the other technologies are better but they are also way more expensive. They’ve had this for a couple years now. Consider it more of a presence hint than reliable presence detection.

    If you want to detect gross motion nothing beats a PIR motion detector. If you want to detect a person who is staying still you need a radar. Radars are not cheap.

    The newer ESPs support 801.11mc for distance measurement.

    1. Radars are extremely cheap on Ali. Starting for pennies. Obviously not for pennies but 40gz and up radars are also available.

      Which are those newer esps that support 801.11mc?

      1. The S2, S3, C3 maybe more
        It is 802.11mc

        Thus, within 95% of the time, the positioning accuracy in the check point is less than 1 m and within 50% of the time, the accuracy figures are kept within the limits of 30 cm.

  6. I find this a little disturbing from a privacy standpoint, if the tech is really as good as advertised.

    1. This doesn’t gather any personal identifying information. All it detects is signal disturbances. If I were to characterize it, it has the same effect as a PIR.

    2. This is like trying to track a person by following their shadow on the ground. Sometimes you have a clear shadow, sometimes multiple shadows, sometimes no shadow at all. Shadows are very indistinct, you aren’t going to identify some one by their shadow in most cases. It is nothing like a radar which can detect the heart pulse of people in a room.

Leave a Reply

Your email address will not be published. Required fields are marked *

Khadas VIM4 SBC
Khadas VIM4 SBC