Yep, there are plenty of points in New Hampshire and Maine from which you can look directly due south into Quebec.
Something that's more rare is to have Canadians living due south of Americans but even then, Windsor/Detroit isn't 100% unique:
https://www.google.com/maps/@45.811071,-67.7802563,14z