Cryptocurrency Q&A
What are tokens in vision transformers?
What are tokens in vision transformers?
Stefano
Sun Nov 17 2024
|
5 answers
1420
I'm trying to understand vision transformers, and specifically, I want to know more about tokens. What exactly are they in the context of vision transformers?
5 answers
KatanaBlade
Tue Nov 19 2024
Each of these small patches undergoes a transformation.
Was this helpful?
62
84
noah_stokes_photographer
Tue Nov 19 2024
Specifically, each patch is projected into a feature vector through a linear layer.
Was this helpful?
310
80
Valentina
Tue Nov 19 2024
The typical vision transformer process begins by breaking down a fixed-size input image.
Was this helpful?
372
92
HanjiArtist
Tue Nov 19 2024
This feature vector is also referred to as a token.
Was this helpful?
385
70
BitcoinBaroness
Tue Nov 19 2024
This decomposition involves dividing the image into a series of small patches.
Was this helpful?
291
48
