Cryptocurrency Q&A
How many tokens was GPT-4 trained on?
How many tokens was GPT-4 trained on?
Chiara
Thu Oct 31 2024
|
5 answers
1032
I'm curious about the training data size of GPT-4. Specifically, I want to know the exact number of tokens it was trained on.
5 answers
CryptoPioneerGuard
Sat Nov 02 2024
GPT-4 embodies a mixture-of-experts architecture.
Was this helpful?
125
23
Raffaele
Fri Nov 01 2024
It involved 13 trillion token passes.
Was this helpful?
149
55
EthereumEmpire
Fri Nov 01 2024
This model comprises 16 experts.
Was this helpful?
219
20
Martino
Fri Nov 01 2024
Each expert boasts 111 billion parameters.
Was this helpful?
221
93
BlockchainBrawler
Fri Nov 01 2024
The training process required approximately 2 multiplied by 10 raised to the power of 25 FLOPS.
Was this helpful?
318
21
