Of course massive empires come and go from Hashem.
The question is though that the בעל ההגדה seems certain that without the supernatural יציאת מצרים with all its accompanying miracles, we would still be there. How does he know that? Other nations were enslaved and liberated without this whole shebang in a much more על פי דרך הטבע way
וירא ישראל והנה מצריים רודפים אחריהם..
It's referring to the שר.
Perhaps us being enslaved to mitzrayim physically was simply a manifestation of the שליטה that the שר had over us, that's why it says "אני ולא מלאך " meaning there was no other angel that had the strength to take מצריים down, so had God not "personally" knocked מצריים out, there wud not have been another way for us to become free from it's clutches.
So perhaps we wud not be in the land of Egypt per se' but us as kllal yisroel wud still be enslaved under those powerful forces for eternity.