Huh, a Git remote can have multiple URLs. This does not affect fetching/pulling, but pushes will push to all URLs.

I had been doing this manually like a barbarian.

https://git-scm.com/docs/git-config#Documentation/git-config.txt-remotenameurl