When the Brass Tower was born and walked, the Dwemer succeeded and failed at the same time do to the resulting dragon break. Because the success and failure could not both be true in linear time, only un-time, the dweller were ejected from Aurbis when the linear time resumed, with the dwemer civilization traveling tangentially away from the wheel in their own time line. Dwemer time could not exist until the perfect Numidium existed, however the perfect Numidium could not exist while the brass tower maintained supported mundus. Only when the brass tower was destroyed was the final one way link of causality severed, allowing the perfect Numidium to exist, allowing the Dwemer to experience time and causality again. The paradox of the Dwemer both existing by experiencing time while not existing do to being outside reality is resolved tropically by them randomly materializing withing a reality which is comparable to their existence.
Thus soem unsuspecting universe has the Dwemer civilization inflicted upon it.