Update Default SSH Port Ubuntu
How to change the default Ubuntu SSH port from 22 to something else
Your SSH config is located here:
/etc/ssh/sshd_config
Just update the 'Port' line to whichever port you want to SSH on.
Then restart the service:
service ssh restart
You can do the above while SSH'd into your server on the original port.