What is inference in AI?

Inference is the stage where a trained AI model is put to work, taking new input and producing an output such as a prediction, classification, or generated text. It is distinct from training, which is the learning phase. Every time you ask a chatbot a question or run a photo through a recognition model, you are running inference. Its speed and cost are key concerns when deploying AI.