I had a inkling that was Kaidou's plan.
From a personal opinion, I always found it weird Oda is trying to include the Momotarou story into his own but missing one of the most crucial pieces.
We do have Momo, we do have Onigashima, we do have a Treasure to be found, we have Kaidou as the Oni...