Capstone Project - The Autonomous Humanoid
Complete VLA pipeline demonstration showing how a simulated humanoid robot receives voice commands, plans paths, navigates obstacles, identifies objects, and manipulates them.
Complete VLA pipeline demonstration showing how a simulated humanoid robot receives voice commands, plans paths, navigates obstacles, identifies objects, and manipulates them.
Understanding how LLMs perform cognitive planning by translating natural language commands into ROS 2 action sequences.
Key terminology definitions for Module 4: Vision-Language-Action (VLA), including VLA, voice-to-action, cognitive planning, and related concepts.
Introduction to Vision-Language-Action (VLA) systems, learning objectives, prerequisites, and module structure for Module 4.
Understanding how Large Language Models (LLMs) converge with robotics to enable natural language interaction with humanoid robots.
Introduction to Vision-Language-Action (VLA) systems, covering LLM-robotics convergence, voice-to-action, cognitive planning, and complete VLA pipeline integration.
Understanding how VLA concepts connect to and build upon concepts from Modules 1, 2, and 3, including ROS 2 integration, simulation support, and perception integration.
Understanding how LLM-generated action plans are validated and executed safely, including plan verification and constraint checking.
Understanding how OpenAI Whisper enables voice-to-action capabilities for humanoid robots, including the complete pipeline from audio capture to action generation.