What is late fee fee?

I received a notice about a late fee and I'm not sure what it means. Is it a penalty for paying my bill late? How is it calculated and why do I have to pay it? I'd like to understand more about late fees.