Video2STL: Grounding VLM-Generated Temporal Specifications for Robot Learning
From the abstract
Video-based policy learning is particularly promising, as it illustrates target behaviors without requiring action annotations or embodiment-matched demonstrations. A central challenge is deciding what information should be transferred from the video to the robot.
From the abstract. Our summary is in progress.