When Do Discrete Actions Make Good Continuous Controllers?
From the abstract
Though modern AI models like LLMs predict discrete tokens, today's robotic foundation models represent actions as continuous vectors. In this paper, we challenge this common consensus by asking if continuous action parametrizations are superior to their discrete counterparts.
From the abstract. Our summary is in progress.