Should I use GFCI for all outlets?

Should I opt for GFCI protection for every electrical outlet in my home? I've heard it's a safety feature that reduces the risk of electric shock, but does it apply to every outlet, including those not NEAR water sources? I'm concerned about the cost and potential inconvenience of installing GFCIs everywhere, but also want to ensure my home's electrical safety. Are there any regulations or recommendations I should follow in making this decision? Additionally, are there any specific outlets that are more critical to have GFCI protection, such as bathrooms or kitchens?