How does a distributed server work?

Could you please explain how a distributed server operates? I'm particularly curious about how it differs from a traditional, centralized server architecture. I understand that in a distributed system, data and processing power are spread across multiple servers, but how does this actually work in practice? Are there any specific advantages or disadvantages to using a distributed server? Additionally, how does it handle communication and coordination between the various servers in the network?