Which protocol is used to connect servers remotely?

Can you elaborate on which protocol is typically used to establish a remote connection between servers? I'm interested in understanding the specifics of how these connections are made, including the most commonly utilized protocols in the industry. Is it SSH, VPN, or perhaps a different one altogether? Additionally, what are the advantages and disadvantages of each protocol, and how do they compare in terms of security, speed, and ease of use?