Hello.
Your project sounds quite ambitious. We have heard of others doing something similar to what you described using the Zumo robot for Arduino instead of the Zumo 32U4 robot (like this one), but I do not see a why reason you would not be able to do the same thing using the Zumo 32U4. However, we do not have any experience or good advice on how to go about doing that.
- Amanda