Collaborative Perception and Planning for Multi-View and Multi-Robot Systems