Getting Started with Fabric Data Agent_ A New Era of Connected Data Intelligence

The Fabric Data Agent introduces a groundbreaking way for organizations to interact with their data by using natural language, dramatically lowering the barrier to data-driven decision making for everyone from technical specialists to business users.

What is the Fabric Data Agent?

The Fabric Data Agent is a conversational AI feature in Microsoft Fabric that lets users ask simple questions in plain English about their organization data stored in OneLake, Warehouses, Power BI semantic models, or KQL databases and receive structured answers that give context all without writing any queries. The agent uses large language models (LLMs) using Azure OpenAI to parse the question, establish where relevant data will come from, and then run optimized, secure queries given user roles and permissions.

Getting Started: Your First Fabric Data Agent

If you’re ready to engage your data as a conversational partner, here is a high-level overview of how to build your first agent:

1. Prerequisites and Setup

  • Fabric Capacity: You need access to a Microsoft Fabric capacity (F2 or higher) for your workspace.
  • Enable Feature: Your Fabric administrator must enable the Data Agent preview feature in the Tenant Settings.
  • Data Source: You need to have at least one supported data source (Lakehouse, Warehouse, Power BI semantic model, or KQL database), as well as defined data and tables.

2. Create the Agent

  1. Go to your fabric workspace.
  2. Click + New Item and search for Fabric data agent.New Item and search for Fabric data agent.
  3. Give your agent a name that is meaningful to you (e.g., “Sales Performance Analyst”).

    Give your agent a name

3. Set Up and Connect Data

  1. In the agent editor, click on the Data Sources tab, then click + Add data source.

    Data Sources tab, then click + Add data source

  2. Choose one or more sources from the OneLake catalog (up to five).
  3. For each source, check the boxes for the specific tables you want the AI to access and query.

4. Provide Agent Instructions

This is the most important step for accuracy. In the Agent Instructions tab, provide context that will pre-populate the AI as it receives queries:

Provide Agent Instructions

  • Goal and Role: State the goal and purpose of the agent (e.g., “You are a tax professional. Your goal is to assist users with understanding revenue, cost, and profit.”). 
  • Key Terminology: Define important business terms, synonyms, and meanings of columns.
  • Response Guidelines: Indicate how the agent should respond to a query (e.g., “Show currency in dollars always, and never guess a number.”)

5. Test and Refine

Use the built-in chat window to ask questions and test the agent’s understanding. Review the generated query and the response. If the results are off, go back and refine your table descriptions, column metadata, or agent instructions. Iteration is key to building a high-quality agent.

6. Publish and Share

Screenshot showing selection of the Publish option_

Once you’re satisfied, click Publish. Your Fabric Data Agent is now ready to be consumed by colleagues in Fabric, integrated into custom applications, or connected to other AI services like Azure AI Foundry.

Publish and Share

Why Fabric Data Agent Matters: The New Era of Connected Data Intelligence

  • Democratized Data Access: Any user, with permissions, will be able to “chat” with enterprise data, regardless of their technical skill.
  • Time Savings: No need to write SQL, DAX, or use existing dashboards in the majority of cases for routine investigations; just ask questions.
  • Easy Custom Intelligence: Organizations can customize the agent with their terminology, handbook, and custom instructions.
  • Unified Insights: Integrated within Microsoft Fabric, the Data Agent provides a single data view, unifying separate tools, and making analytics and intelligence more centralized and actionable.

Key Capabilities of Fabric Data Agent

  • Conversational Q&A: You can ask questions in plain English and have it return an answer based on your data.
  • Multi-source Integration: Connects seamlessly with various Fabric data sources.
  • Security & Governance: Enforces access controls based on Microsoft Entra ID.
  • Copilot Integration: Works with Microsoft Copilot Studio for multi-agent orchestration.
  • No-Code Setup: No need for Azure OpenAI keys or custom tokens; authentication is handled automatically.

Final Thoughts

The Fabric Data Agent is not simply a new feature, but a change of thought, a combination of Conversational AI and enterprise data access aimed at making every user a data explorer. Whether you’re a business analyst, a data scientist, or just someone who wants to be informed, this is the new beginning of insight and collaboration. 

At Peafowl IT Solution, we’re passionate about helping businesses adopt modern digital and data-driven technologies that enhance productivity and decision-making. We stay closely aligned with emerging innovations like the Fabric Data Agent to understand how they can shape the future of enterprise intelligence and inspire better technology strategies for our clients.