Transformer

The neural network design behind most large language models, built around an attention mechanism that relates every token to every other. Its compute cost grows with the square of input length.

Also listed under Maritime.

Used in these articles

Related terms

AI and machine learning

• AI agent
• Brain-computer interface
• Combinatorial optimization
• Computer vision
• Context window
• Deep learning
• Domain generalization
• Electroencephalography
• Frontier model
• Hallucination
• Inference
• Large language model
• Machine learning
• Matrix multiplication
• Memristor
• Metaheuristic
• Model drift
• Multiply-accumulate
• Neural network
• Neuromorphic computing
• NP-hard
• Operations research
• Quantization
• Reinforcement learning
• Reservoir computing
• Self-play
• Spiking neural network
• SSVEP
• Token
• Training