just run

git config --global push.followTags true

to make git automatically push tags that are visible on origin.

Yay for the small wins!