Online and Offline Learning for Embodied AI in Autonomous Systems