The robot “super brain” driven by multi-modal large models has a new landing case.

Ruoyu Technology, which was incubated from the Institute of Computing and Intelligence of Harbin Institute of Technology (Shenzhen), announced the launch of Ruoyu · Jiutian Robot Brain, in which the realization of multi-modal large model driven group intelligence is a major breakthrough of Ruoyu · Jiutian robot brain.

Swarm intelligence, or “one brain, many bodies,” allows you to centrally control multiple robots (including robotic arms and AGVs). “Multiple robots work together to perform complex tasks efficiently, and there are complex dependencies between these different tasks. For example, two robots are frying food while another robot is fetching dishes. If the cooking time is extended due to temporary changes in the cooking process, the other robot can decide to continue picking the next ingredient after picking up the dish. The robot brain will autonomously plan the task logic, keeping all robots as uninterrupted as possible while ensuring the safety of collaboration. This is difficult to achieve with traditional rule-based teaching methods.” If Yu technology chief product officer Deng Yuping said.

TPM810 According to titanium media App, at present, Ruoyu Jiutian robot brain has been verified by the technical solution of the unmanned kitchen environment, driving multiple agents to cook the unmanned kitchen. Through human natural language interaction with multiple robots to complete the whole process from ordering to serving food, the long sequence of “cooking” tasks are independently planned.

Different from the common embodied intelligence technology on the market today, Joyu · Jiuten robot brain can realize functions such as human intention understanding, high-frequency human-computer interaction and complex task planning.

Long sequence task planning (quickly generate complex task planning)

When the human puts forward the demand of “a fried lettuce”, the robot can independently understand the human intention and plan the task, which is broken down into multiple steps such as “picking up vegetables in the food area”, “weighing in the preparation area”, “frying vegetables in the production area”, and “serving vegetables in the consumption area”.

The Royu Jiutian robot brain also has a certain generalization ability of “drawing inferences from one another”. For example, when the model was trained, it was only told to add garlic, but it was not trained to add chili. But later, if the robot is asked to add chili, it can automatically understand that garlic and chili belong to the ingredients, and know that the garlic should be replaced with chili.

TPM810

Large model-driven swarm intelligence (giving multiple agents the ability to work autonomously)

Joyu Jiutian Machine Brain is also technically optimized in terms of controlling the cerebellum at the executive level of the robot. For example, in response to the challenge of difficult perception of diverse environments, Ruoyu Technology has developed a large model 3D supply perception technology, which can sense the functional supply area of the object, and can grasp a variety of objects without registration, anti-complex light, and anti-stacking.

TPM810 In response to the difficult challenges of executing complex actions such as “the robot pours garlic paste from the ingredient box” and “pours finished dishes from the pot with a shovel”, Ruoyu Technology proposed a diffusion model-driven imitation learning technology to achieve accurate execution of complex skills and actions. At the same time, combined with the multi-modal large-model driven robot multi-arm cooperation technology, the cooperation ability and execution efficiency of target tasks are greatly improved.

Complex action execution driven by diffusion model (accurate execution without on-site instruction)

Shenzhen Ruoyu Technology Co., LTD., founded in 2023, completed more than 50 million angel round financing in March this year. At present, it has reached cooperation with the international corrugated packaging intelligent equipment leader and water power equipment head enterprise East Seiko Group to improve the intelligence level of the core products of East Seiko.

Dr. Teng Sun, co-founder and CEO of Ruoyu Technology, said: “The technological breakthrough of Ruoyu Technology’s nine-day robot brain and robot cerebellum can be further applied to complex processes in the industrial field, such as welding, grinding, dispensing, sorting and mixed palletizing in the logistics field, unmanned retail, unmanned pharmacy, three-dimensional cleaning in the commercial field, and can be further extended to the consumer field in the future.” At present, Ruoyu Technology has also been in some special areas, with industry partners for specific scenarios, to jointly build more intelligent robots, to liberate people from dangerous, heavy and repetitive labor, to improve the quality and efficiency of the industry, to create new quality productivity.”