Transformers that skip work on easy tokens
A new transformer design lets AI models skip computation on simple parts of text, cutting training costs without losing quality.
A new transformer design lets AI models skip computation on simple parts of text, cutting training costs without losing quality.