Can you still be tracked with a proxy?

I'm curious, when using a proxy to browse the internet or engage in cryptocurrency transactions, is it still possible for my activity to be tracked or traced back to me? I've heard that proxies can offer a level of anonymity, but I want to be sure I understand the limitations. Can you explain in detail how proxies work and whether they truly provide a foolproof method of avoiding detection?