In the limit, there is zero alpha for multiple agents over one agent, on any task, ever. So the Bitter Lesson applies in full to your clever multi-agent framework; it's just you awkwardly trying to hardcode stuff that SGD can better bake into a single agent.