Smart Grocery Bot

An AI-driven robotic packing system using LLaMA and Hello Robot Stretch leverages vision and language planning to dynamically sequence items for optimal bag utilization—adapting in real time to any object to maximize packing efficiency and safety.

The Smart Grocery Bot is an AI-driven robotic packing system designed to optimize grocery bagging. Powered by LLaMA and the Hello Robot Stretch platform, it uses advanced vision and language planning to dynamically arrange items for maximum efficiency and safety. The system adapts in real time to various objects, ensuring optimal space utilization. Key features include real-time visual servoing and natural-language task planning, supported by tools like YOLOv8 for object detection and Meta’s Segment Anything Model for precise segmentation. The LLaMA-based reasoning engine guides high-level instructions, while depth sensing and velocity control enable smooth, accurate manipulation. Built with modular networking, the system decouples sensing, perception, and action, ensuring seamless operation. This proof-of-concept demonstrates the potential for intelligent, adaptable robotic assistants in everyday tasks.