^ A good architect can or should be able to deal with that conflict. Certainly windows visible on the outside don’t actually need to be windows on the inside. That’s often the case in offices where tenants have spec’d their own floor plans.
That said, the classic NY apartment buildings were often not symmetrical either, and that is Stern’s milieu. Just look at 740 Park: