Diagram showing an AI agent calling external tools and APIs

What Tools Are in Agentic AI

AGAI 201 · Function Calling Foundations

Understand tools as external capabilities exposed to an AI system, and learn why tool use is central to practical agentic AI.

Key terms

tool = callable external capabilitymodel decides, application executesretrieval < computation < action risknarrow tools → safer agents

Learning objectives

  • Define tools in the context of agentic AI systems.
  • Distinguish retrieval, computation, and action tools.
  • Explain why tools extend a model beyond text generation.
  • Identify why narrow, scoped tools are safer than broad tools.

A language model by itself is powerful, but limited. It can generate text, explain concepts, write code, summarize documents, and reason over the context you provide. But it does not automatically know the current weather, your private database state, the contents of a local file, or whether a command succeeded on your machine.

In agentic AI, a tool is an external capability made available to the model through the surrounding application. The tool might search the web, query a database, run code, read a file, send a message, create a calendar event, or call an internal business API.

A simple definition is:

A tool is a callable operation that lets an AI system retrieve information or take action outside the model’s internal text-generation process.

The key idea is separation of responsibility. The model decides when a tool may be useful and supplies structured arguments. The application validates and executes the tool. The result is then returned to the model so it can continue the task or produce a final answer.

Tools extend the model’s reach

Without tools, a model can only rely on its training data and the current prompt. That is enough for many tasks, but not enough for tasks that require current, private, dynamic, or computationally precise information.

Examples of tool use include:

  • A research assistant using web search to find recent sources.
  • A coding agent reading files and running tests.
  • A customer support agent looking up an order.
  • A data analyst executing Python code against a CSV file.
  • A scheduling assistant checking calendar availability.
  • A finance agent retrieving current market prices.
  • A workflow agent creating a draft ticket or report.

Tool use is what turns a language model from an isolated text generator into part of a larger software system.

Tool use does not mean unlimited autonomy

A common misconception is that giving an agent tools means giving it unrestricted control. In a well-designed system, tools are carefully scoped. A tool can be read-only, require confirmation, validate inputs, run inside a sandbox, or expose only a narrow action.

For example, compare these two tools:

unsafe_execute_sql(query: string)

and:

get_order_status(order_id: string)

The first tool allows arbitrary database queries. It is flexible, but dangerous. The second tool exposes one safe business operation. It is narrower, but much easier to validate and monitor.

In production systems, narrow tools are often better. The goal is not to maximize what the model can do. The goal is to expose the right capabilities with the right guardrails.

Three categories of tools

Most tools fall into three broad categories.

Information-retrieval tools fetch data without changing external state. Examples include search, document retrieval, database lookup, file reading, and API GET requests. These are usually the safest tools to start with.

Computation tools transform input into output. Examples include calculators, code execution, data analysis notebooks, parsers, format converters, and validators. These tools are useful when precision matters or when the model should not rely on mental arithmetic.

Action tools change the world. Examples include sending an email, updating a CRM record, creating a pull request, deleting a file, placing an order, or modifying a database row. These require the most care because mistakes may have consequences.

A good design pattern is to begin with retrieval tools, add computation tools next, and add action tools only with clear permissions and review steps.

A simple tool example

Imagine a weather assistant. The user asks:

Should I bring a jacket to Boston tomorrow?

The model may not have current weather data. Instead of guessing, it can request a weather tool:

{
  "tool_name": "get_weather_forecast",
  "arguments": {
    "city": "Boston",
    "date": "tomorrow",
    "units": "imperial"
  }
}

The application executes the tool and returns:

{
  "city": "Boston",
  "date": "2026-06-05",
  "high_f": 62,
  "low_f": 48,
  "condition": "rain likely",
  "wind_mph": 14
}

Now the model can answer:

Yes. Bring a jacket, especially if you will be out in the morning or evening. The forecast shows rain likely, a low around 48°F, and moderate wind.

The model did not know the forecast by itself. It used a tool to ground the answer in fresh data.

Tools versus plugins, APIs, and functions

The word “tool” is broad. In code, a tool may be implemented as a function, API endpoint, command-line script, database query, browser action, or framework integration.

A function-calling interface usually describes each tool with:

  • A name
  • A natural language description
  • A parameter schema
  • Required and optional fields
  • Return values or result format

For example:

{
  "name": "lookup_customer",
  "description": "Retrieve a customer profile by customer ID.",
  "parameters": {
    "type": "object",
    "properties": {
      "customer_id": {
        "type": "string",
        "description": "The unique customer identifier."
      }
    },
    "required": ["customer_id"]
  }
}

The model sees this as an available capability. The actual implementation may call a database, a REST API, or a service layer.

Why tools are central to agentic AI

Agentic AI depends on loops: observe, decide, act, observe again. Tools provide the action and observation channels. Without tools, an agent can plan but not verify. It can suggest but not inspect. It can explain but not execute.

Tool use enables:

  • Grounding in external facts
  • Interaction with private data
  • Multi-step workflows
  • Programmatic validation
  • State changes through controlled interfaces
  • Feedback loops based on real results

For developers, tool design is one of the most important skills in agentic AI. A strong model with poorly designed tools can be unreliable or unsafe. A moderately capable model with excellent tools, schemas, validation, and orchestration can be extremely useful.

Practical takeaway

Tools are not an optional add-on to agentic AI. They are the bridge between language and action. The model provides interpretation, planning, and decision support. The tools provide grounded access to systems and state.

The best tool-using agents are not the ones with the most tools. They are the ones with the right tools: narrow, well-described, validated, observable, and aligned with the user’s goal.

Sign in to track your progress.

Ask your AI guide

AI Chat· Tool Use & Function Calling — What Tools Are in Agentic AI
🤖

Ask anything about Tool Use & Function Calling — What Tools Are in Agentic AI, or choose a suggested question below.

AI responses are educational and may not be perfectly accurate. Press Enter to send, Shift+Enter for new line.