Quantization

Storing a model's numbers at lower precision, such as 8-bit integers instead of 32-bit floats, to cut memory and speed up computation at a small accuracy cost.

Also listed under Maritime.

Used in these articles

Related terms

AI and machine learning

• AI agent
• Brain-computer interface
• Combinatorial optimization
• Computer vision
• Context window
• Deep learning
• Domain generalization
• Electroencephalography
• Frontier model
• Hallucination
• Inference
• Large language model
• Machine learning
• Matrix multiplication
• Memristor
• Metaheuristic
• Model drift
• Multiply-accumulate
• Neural network
• Neuromorphic computing
• NP-hard
• Operations research
• Reinforcement learning
• Reservoir computing
• Self-play
• Spiking neural network
• SSVEP
• Token
• Training
• Transformer