TRACEPaw sensorized paw helps legged robots “feel the floor” with Arduino Nicla Vision

TRACEPaw

Our four-legged friends don’t walk on tarmac the same way as they do on ice or sand as they can see and feel the floor with their eyes and nerve endings and adapt accordingly. The TRACEPaw open-source project, which stands for “Terrain Recognition And Contact force Estimation through Sensorized Legged Robot Paw“, aims to bring the same capabilities to legged robots. Autonomous Robots Lab achieves this through the Arduino Nicla Vision board leveraging its camera and microphone to run machine learning models on the STM32H7 Cortex-M7 microcontroller in order to determine the type of terrain and estimate the force exercized on the leg. But the camera is apparently not used to look at the terrain, but instead, at the deformation of the silicone hemisphere – made of “Dragon Skin” – at the end of the leg to estimate 3D force vectors, while the microphone is used to recognize terrain types […]

Arduino Nicla Vision – A tiny STM32H7 board with 2MP camera, WiFi & Bluetooth LE, sensors

Arduino Nicla Vision

Arduino Nicla Vision is an ultra-compact (~2.3×2.3 cm) board powered by an STMicro STM32H7 dual-core Cortex-M7/M4 microcontroller, and equipped with a 2MP camera, a WiFi & Bluetooth LE module, and a few sensors. Those features make the board suitable for machine vision and edge computing applications such as asset tracking, image detection, object recognition, and predictive maintenance. For instance, image detection, facial recognition, automated optical inspection, vehicle plate reading, or gesture recognition can be added to projects, either using Nicla Vision as a standalone board or in combination with Portenta or MKR boards. Arduino Nicla Vision specifications: Microcontrollers – STMicro STM32H757AII6 dual-core MCU with Arm Cortex M7 @ 480MHz, Cortex-M4 @ 240MHz, 2 MB flash, 1MB RAM Storage – 16MB QSPI flash Connectivity – 2.4GHz WiFi 802.11b/g/n up to 65 Mbps and Bluetooth 5.1 BR/EDR/LE via Murata 1DX module Camera – 2MP GC2145 color camera. USB – Micro USB port […]

Exit mobile version
Memfault IoT and embedded debugging platform