Veltos.Tech

AI and ML

AI agent

Also known as: autonomous agent, LLM agent, tool-using agent

Definition

An AI agent is a program in which a language model does not merely answer but acts: it receives a goal, chooses its own tools such as search, APIs, a database or sending mail, works through steps in a loop and stops when the task is done or a limit is hit.

The difference from a chatbot is fundamental and lives in the loop. A chatbot receives a message and returns text. An agent receives a goal, plans a step, calls a tool, gets a result, evaluates it and decides what to do next, repeating until the goal is met or a limiter fires. It is the combination of tools and a repeating loop that makes an agent an agent. A typical tool set in a commercial system: knowledge base search, reading and writing to the CRM, calls to an internal API, sending a notification, creating a task.

Where agents genuinely pay back: tasks made of several steps, where the steps resist being specified in advance, and where the cost of an error is moderate and reversible. Triaging inbound mail into CRM leads, first-line qualification of enquiries, gathering data from several systems into one report, drafting documents from templates, monitoring and flagging anomalies. Where the steps are known in advance and stable, an ordinary workflow or integration is cheaper, more reliable and needs no supervision, and replacing it with an agent adds non-determinism exactly where none was required.

Designing an agent is eighty percent limiters, and that is engineering reality rather than pessimism. You need an allowlist of the actions and data the agent can reach; a step and cost budget per task, or the loop can spin indefinitely; mandatory human confirmation for irreversible actions such as messaging a client, making a payment or deleting records; a full log of every tool call for incident review; and separate validation of whatever enters the input, because user-supplied data can carry instructions. An agent without those bounds in production is not automation, it is an incident generator with unclear accountability.

Related terms

Related services

Read more

Need this done, not just defined?

We do this work, not only write about it. Describe the task and we will scope it and send a staged estimate.