Inference

Running a trained model to produce outputs, such as answers or predictions. Its share of AI compute grows as models are put to wider use.

Used in these articles

Related terms

AI and machine learning

• AI agent
• Brain-computer interface
• Combinatorial optimization
• Computer vision
• Context window
• Deep learning
• Domain generalization
• Electroencephalography
• Frontier model
• Hallucination
• Large language model
• Machine learning
• Matrix multiplication
• Memristor
• Metaheuristic
• Model drift
• Multiply-accumulate
• Neural network
• Neuromorphic computing
• NP-hard
• Operations research
• Quantization
• Reinforcement learning
• Reservoir computing
• Self-play
• Spiking neural network
• SSVEP
• Token
• Training
• Transformer