Evolution 6.0: Robot Evolution through Generative Design

TL;DR

Evolution 6.0 introduces an autonomous robotic system that uses generative AI to design tools and learn actions for accomplishing human tasks, significantly advancing adaptive robot capabilities.

Contribution

The paper presents a novel autonomous system integrating Vision-Language Models and generative tools for real-time tool creation and task execution in robotics.

Findings

90% success rate in tool generation with 10-second inference

83.5% success in action generalization across environments

70% success in motion generalization

Abstract

We propose a new concept, Evolution 6.0, which represents the evolution of robotics driven by Generative AI. When a robot lacks the necessary tools to accomplish a task requested by a human, it autonomously designs the required instruments and learns how to use them to achieve the goal. Evolution 6.0 is an autonomous robotic system powered by Vision-Language Models (VLMs), Vision-Language Action (VLA) models, and Text-to-3D generative models for tool design and task execution. The system comprises two key modules: the Tool Generation Module, which fabricates task-specific tools from visual and textual data, and the Action Generation Module, which converts natural language instructions into robotic actions. It integrates QwenVLM for environmental understanding, OpenVLA for task execution, and Llama-Mesh for 3D tool generation. Evaluation results demonstrate a 90% success rate for tool generation with a 10-second inference time, and action generation achieving 83.5% in physical and visual generalization, 70% in motion generalization, and 37% in semantic generalization. Future improvements will focus on bimanual manipulation, expanded task capabilities, and enhanced environmental interpretation to improve real-world adaptability.