Based on Prophese Metavision ® The advantages of event vision sensors and AI algorithms in performance, power consumption, and speed enable developers to create a new generation of edge AI machine vision applications that support AMD platforms.

On May 30, 2024, Shanghai, China – Prophesee, a leading neuromimetic visual sensing company, announced its Metavision ® HD event visual sensors and AI algorithms now support AMD Kria ™ KV260 Visual AI Beginner Kit (AMD Kria ™ KV260 Vision AI Starter Kit）， The strong combination of the two will accelerate the development of advanced edge machine vision applications. At the same time, this collaboration also marks the launch of the industry’s first event visual development kit that is compatible with the AMD platform. This suite will provide customers with an efficient platform to quickly evaluate industrial grade solutions in areas such as smart cities, machine vision, security cameras, retail analytics, and put them into production.

The KV260 Visual AI Beginner Kit is AMD Kria ™ The development platform for K26 System Module (SOM) is specifically designed for advanced visual application development, without the need for developers to have complex hardware design knowledge or FPGA programming skills. The AMD Kria SOM is suitable for edge AI applications, production ready, equipped with a wide range of I/O interfaces, high energy efficiency, and cost-effectiveness, accelerating visual and robotic tasks. By combining Prophese’s groundbreaking event vision technology, machine vision system developers can leverage the low latency and low power advantages of the Metavision platform to create more efficient applications that traditional frame based vision solutions cannot achieve.

Figure 1: Prophesee Metavision starter kit – AMD Kria KV260 and Active Marker LED board

This kit includes a groundbreaking Active Markers Tracking application that supports 3D pose estimation at>1000Hz, completely eliminating background interference at the pixel level, while providing extremely high robustness in complex lighting conditions. This application showcases the unique features of Prophese Metavision event vision technology, providing assistance in implementing a series of new ultra high speed tracking use cases, such as game controller tracking, construction site safety, and overload anti sway systems.

In addition, more ready to use application algorithms will be launched in the coming months.

The Prophese Beginner Kit is an out of the box development solution that allows developers to quickly launch and run the Prophese Metavision SDK, as well as the IMX636 HD event visual sensor jointly developed by Prophese and Sony. This enables the algorithm to be easily ported to AMD commercial and industrial grade SOMs (these modules are customized by Zynq) ™ The UltraScale+? Multi processor System on Chip (MPSoC) driver greatly improves development efficiency and system performance.

Chetan Khona, Senior Director of Industrial, Visual, Medical, and Scientific Markets at AMD, said, “The Kria ecosystem is thriving, greatly promoting innovative development among robotics experts and developers in motion capture, connectivity technology, and edge AI applications. Prophesee event vision sensing technology provides unique advantages for machine vision applications.”. The amount of data generated by event visual sensing is relatively small, which not only ensures the high-energy efficiency of the system, but also significantly reduces the computational burden and memory requirements, thereby achieving faster system response

Luca Verre, co-founder and CEO of Prophesee, stated, “By collaborating with AMD, we have created an efficient development assistance tool that makes developing event based edge applications easier. To fully experience the unique advantages of low power consumption and low latency of event vision technology, we provide comprehensive resource support and create a flexible development environment that allows developers to customize specific KPIs for applications and use cases based on customers, optimizing machine vision systems. This will further accelerate the popularization of event vision technology in key niche markets, and Metavision’s unique advantages will also drive innovative development in these niche markets.”.

350092-136180-01