Artificial Intelligence · Intermediate

AI for Data Teams: LLMs, RAG and Reviewing AI Output

Use Generative AI effectively in data engineering | modeling | analytics and documentation | Explore LLMs | prompt engineering | RAG | vector search and responsible AI practices | Build prompts for SQL generation and data quality rules | Develop RAG pipeline using metadata.

AI for Data Teams: LLMs, RAG and Reviewing AI Output

This practical course introduces data professionals to the use of Large Language Models and Generative AI in enterprise data environments.
Participants will learn how LLMs work, how to design effective prompts for data-related tasks, and how to use AI to accelerate activities such as SQL development, data modeling, documentation, data quality analysis and source-to-target mapping.
The course progresses from LLM fundamentals to prompt engineering, embeddings, vector search and Retrieval-Augmented Generation. Participants will build a simple RAG solution that retrieves relevant information from data dictionaries, metadata and technical documentation.
A key part of the course focuses on evaluating AI-generated output. Participants will learn how to identify hallucinations, validate SQL and data models, protect sensitive information and establish human review processes.
The course emphasizes practical application using realistic business scenarios, guided labs, individual exercises and a trainer-reviewed capstone project.

Duration: 16 hours
Mode: Live online
Next batch: 20 Oct 2026
Schedule: Sat–Sun, 10am–2pm IST

Who it is for

Data Engineers | Data Modelers | Data Architects | Data Analysts | ETL Developers | Database Developers | Data Technical Leads | Team Leads

Prerequisites

Experience in any data-related role.
Basic understanding of databases, data processing or analytics.
Familiarity with SQL queries, data structures or documentation.
Basic Python knowledge.
Familiarity with relational databases and SQL.
Exposure to data warehouses, data lakes or cloud data platforms.
Experience with data dictionaries, metadata or STTM.

What you will be able to do

Explain how LLMs work, including tokens, context windows, embeddings and model limitations.
Identify hallucinations and other common failure modes in AI-generated content.
Design structured prompts for SQL generation, data documentation and data quality tasks.
Use AI to generate and review SQL queries, transformation logic and source-to-target mapping drafts.
Create prompts that support business requirement analysis and data modeling.
Explain embeddings, chunking, vector databases and semantic search.
Build a basic RAG pipeline over metadata and technical documentation.
Retrieve relevant information and generate context-grounded responses.
Evaluate AI-generated SQL, documentation and metadata using systematic review checklists.
Identify sensitive information and apply appropriate data protection practices.
Establish human review gates for AI-assisted data development.
Deliver a practical AI-assisted data project with documented testing and validation.

Course contents · 4 modules · 16 hours

01

LLM Basics for Data People

Introduction to Generative AI and LLMs
Traditional AI versus Generative AI
LLM architecture at a conceptual level
Tokens, tokenization and context windows
Training data, inference and next-token prediction
Model parameters and temperature
System prompts, user prompts and conversation context
Text generation and structured output
Strengths and limitations of LLMs
Hallucinations, outdated knowledge and ambiguous answers
Deterministic versus probabilistic outputs
Common use cases in data engineering, modeling and analytics
Overview of hosted and open-source LLMs
Responsible use of AI in enterprise environments
Ask an LLM to explain a complex SQL query.
Compare responses to the same prompt using different instructions.
Test how ambiguous business requirements affect generated answers.
Identify incorrect SQL and fabricated database objects in AI output.

3 h

02

Prompting for Data Work

Prompt engineering fundamentals
Anatomy of a well-structured prompt
Role, task, context, constraints and output format
Zero-shot and few-shot prompting
Prompt templates and reusable prompt libraries
Structured outputs using JSON and tables
Prompting for SQL generation and explanation
Prompting for query debugging and optimization
Generating data dictionaries and technical documentation
Generating source-to-target mapping (STTM) drafts
Business requirement analysis and business rule extraction
AI-assisted entity and attribute identification
Iterative prompt refinement
Common prompt failure patterns
Generate SQL from a business question.
Generate table and column descriptions from database metadata.
Convert a business requirement into candidate entities and relationships.
Generate data quality rules from sample data.

4 h

03

Retrieval and Vector Search

Limitations of LLMs when answering enterprise-specific questions
Introduction to Retrieval-Augmented Generation
RAG architecture and components
Document ingestion and preprocessing
Text extraction and cleaning
Chunking strategies and chunk size
Vector databases and vector indexes
Top-K retrieval
Metadata filtering
Context construction and prompt augmentation
RAG response generation
Basic RAG evaluation
Retrieval failures and incomplete context
Split documents into chunks.
Generate embeddings using an available embedding model.
Store and retrieve embeddings using a vector store.
Build a simple question-answering pipeline over metadata.
Compare ordinary LLM answers with RAG-grounded answers.

4 h

04

Safe use and review

Responsible AI in data teams
Data privacy and confidentiality
Personally identifiable information (PII)
Sensitive data and enterprise data policies
Risks of sharing proprietary metadata
Safe use of public versus enterprise AI tools
Access control and data minimization
Prompt injection and untrusted retrieved content
Reviewing AI-generated SQL
Reviewing AI-generated data models and documentation
SQL execution, testing and reconciliation
Hallucination detection and factual verification
AI governance and auditability
Limitations of automated evaluation
Capstone project presentation and trainer review
Review an AI-generated SQL query and identify errors.
Identify sensitive information in sample prompts.
Evaluate RAG answers for relevance, correctness and source support.
Design a human approval workflow for AI-generated data artifacts.

5 h

Hands-on approach

30% concepts, 70% hands-on labs on realistic business scenarios. AI practice support between sessions; every project is reviewed by the trainer.