There is simply no way that VCE is as enjoyable with an infant as without.
As @moish said, from what I recall Italy is bigger than VCE but even there was more than fine.
By infant I mean infant, not toddler.
But I do disagree with that. I have been there with and without numerous times and enjoyed it all the same.
Throw on a comfortable baby carrier and you are good to go. If you are in the properties on the other side of the island and have a combined 3 hr mandatory walking in extremely hot and humid weather over shabbos to do, that may be a different story, but I never recommend staying there either way.
Not being able to do a particular activity doesn't make the trip/vacation/getaway any less enjoyable. In Thailand they wouldn't allow me to go on the Zipline with a 3 month old strapped to my back no matter how much I begged and pleaded

but I guarantee I had the same enjoyable Thailand experience as the next guy.