What is the biggest killer in a fire emergency?

What exactly poses the greatest threat during a fire emergency? Is it the flames themselves, the smoke inhalation, or perhaps the panic that sets in? Could you elaborate on what factor is most likely to lead to fatalities in such situations, and what individuals can do to minimize their risk of becoming a victim?