Learning Center

Data Engineering Guides

Comprehensive guides covering data architecture patterns, platform diagrams, and best practices. Learn from real-world implementations and proven patterns used by top data engineering teams.

AI Diagram Generator

AI Diagram Generator Playbooks

20 prompt-driven guides for data, cloud, and platform teams

AI Diagram Generator for Data Architecture

Blueprint lakehouse, mesh, and warehouse diagrams from prompts

AI Diagram Generator for Cloud Architecture

Landing zones, networking, and governance mapped automatically

AI Diagram Generator for Data Lineage

Column-to-dashboard lineage with owners, SLAs, and contracts

AI Diagram Generator for ETL Pipelines

Orchestrate batch and streaming flows with reusable prompts

AI Diagram Generator for ERD

Fast entity-relationship diagrams with keys, contracts, and owners

Platform Diagrams

Best AWS Architecture Diagram Tools

Manual editors, account scanners, and AI generators compared honestly

AWS Data Platform Diagram

Learn how to design and document AWS data platforms with S3, Glue, Redshift, and Athena

Azure Data Platform Diagram

Create clear Azure data platform diagrams with best practices for architecture visualization

GCP Data Platform Diagram

Design GCP data platforms covering BigQuery, Cloud Storage, Dataflow, and Pub/Sub

Databricks Platform Diagram

Document Databricks architectures with Delta Lake, Unity Catalog, and workflows

Architecture Patterns

Data Mesh

Master data mesh architecture with domain-oriented ownership and data products

Medallion Architecture

Implement Bronze, Silver, Gold layers for your data lakehouse

Dimensional Modeling

Design star schemas with fact and dimension tables for analytics

ML Pipeline Architecture

Build production-grade ML pipelines for training, serving, and monitoring

Best Practices

Data Quality Best Practices

Implement data quality at scale with validation, monitoring, and alerting

Data Lineage Best Practices

Track data flow for impact analysis, PII tracing, and column-level lineage

Data Contracts

Define schemas, SLAs, and versioning to stop breaking downstream consumers

Data Pipeline Documentation

Document ETL pipelines and maintain up-to-date pipeline documentation

Keeping Documentation in Sync

Prevent documentation drift with automation strategies and best practices

Docs & Code in Sync

Documentation Drift

What drift is, why it happens, and the fixes that hold

Stale Documentation

An audit-and-fix playbook: find, triage, automate freshness

Living Documentation

The definition, the test, and an honest map of the tools

Tools

Best AI Diagram Generators

Syntax writers, whiteboard copilots, and technical generators, by output

Best Tools for Data Architecture Diagrams

Compare top diagramming tools from free options to enterprise platforms

Best Tools to Keep Docs and Code in Sync

Six approaches compared by what they keep true automatically

Embed Diagrams in Markdown

Put a diagram in a README that updates when the architecture does

MCP Diagram Server

Let Claude or Cursor draw and maintain diagrams from your repo

Diagram Generators

Data Diagram Generator

Create production-ready data diagrams from prompts with exports and checklists

AI Data Diagram Generator

Use AI safely to draft diagrams with guardrails and versioning

Data Flow Diagram Generator

Show ingest-to-serve flows with lanes, labels, and owners

Data Architecture Diagram Generator

Document platform boundaries, governance, and contracts in minutes

Docs that stay in sync

Platform-by-platform guides to embedding live diagrams and keeping documentation current, from Notion and Confluence to READMEs and CI.

Docs live from the source

A living diagram from Terraform A living diagram from CloudFormation A living diagram from Pulumi A living diagram from AWS CDK A living diagram from dbt A living diagram from Airflow A living diagram from Kafka topics A living diagram from an OpenAPI spec A living diagram from schema.prisma A living diagram from SQL DDL Docker Compose diagram Kubernetes manifest diagram Snowflake schema diagram automation BigQuery schema diagram Postgres schema diagram MySQL schema diagram automation MongoDB schema diagram Databricks Unity Catalog diagram GitHub Actions workflow diagram GitLab CI pipeline diagram Terraform graph alternative Terraform module diagram Terraform diagrams without state, init, or credentials AWS Terraform diagram generator Azure Terraform diagram generator Terraform documentation generator Visualize a Terraform repository Inframap alternative GitHub repo to architecture diagram GitLab repo to architecture diagram Azure DevOps repo to architecture diagram Diagrams from a private repository Branch or tag Splitting a monorepo into diagrams What a repository sync reads, in priority order, and what it never touches Daily diagram sync explained MCP repo tools Manual edits on a synced diagram Visualize a dbt project Diagram an Airflow repository Diagram a Databricks repository Snowflake and SQL models Kubernetes YAML to diagram Docker Compose visualizer Next.js architecture diagram Django architecture diagram Monorepo architecture diagram Kafka services diagram

Terraform and infrastructure as code

How to draw it

How to draw a CI/CD pipeline diagram What belongs in a CI/CD pipeline diagram, and what quietly ruins it CI/CD workflow diagram vs pipeline diagram CI/CD architecture diagram Continuous delivery vs continuous deployment DevOps pipeline diagram Jenkins pipeline diagram Azure DevOps pipeline diagram Showing environments and approval gates in a CI/CD diagram Keep a CI/CD pipeline diagram up to date when the workflow file changes How to draw a data pipeline diagram What a good data pipeline diagram shows Batch vs streaming on a pipeline diagram Sources and sinks on a pipeline diagram Medallion architecture diagram How to document an ELT pipeline Airflow DAG diagram conventions dbt and Spark jobs on a diagram How detailed should a pipeline diagram be Keeping a data pipeline diagram accurate as the pipeline keeps changing

Cloud icons

Cloud architecture

How to draw an AWS architecture diagram Which AWS services to show in a diagram AWS VPC diagram Multi-account AWS architecture diagrams Multi-region AWS architecture diagrams AWS Well-Architected diagrams Showing IAM in an AWS architecture diagram without drowning it AWS serverless architecture diagrams EKS cluster architecture diagram Keeping an AWS architecture diagram current as the infrastructure changes

Data platforms and warehouses

Data lineage

Column-level lineage Data lineage vs impact analysis How to document data lineage without a data catalog What data lineage costs, and why the bill lands where it does Data lineage for dbt projects How to read a data lineage graph without getting lost When data lineage is overkill, and what to do instead Lineage in a diagram vs lineage in a data catalog How to keep data lineage current instead of redrawing it every quarter What to capture in data lineage, and what to leave out

AI agents and MCP

Can an AI draw an architecture diagram from a repository What is an MCP server, in plain terms Connect Claude Code to a diagram tool Draw architecture diagrams in Cursor Letting an agent update documentation after a merge What an agent can and cannot infer from your code Keeping an AI-generated diagram trustworthy after the first draft Reviewing what the agent drew Agent workflows for documentation Diagrams as context for coding agents Update the diagram after a merge Ask an agent whether the diagram still matches the code Editing a diagram from an agent Diagram a refactor before the code Generate a diagram inside a chat session, and keep it afterwards Getting a diagram from an agent into your README Attaching a diagram to a pull request without slowing the merge Generate the doc and the diagram from one read of the repository Agent rules for diagram tools Ask an agent to explain an architecture diagram it did not draw Claude Code MCP server for diagrams Cursor MCP config for a diagram server Claude Desktop MCP server for diagrams ChatGPT MCP connector for diagrams VS Code MCP server for diagrams Windsurf MCP server for diagrams Gemini CLI MCP server for diagrams n8n MCP Client for diagrams Build an MCP client for diagram tools Run MCP diagram tools in CI

Embed diagrams in your tools

Embed diagrams in Notion Embed an architecture diagram in a GitHub README Embed a diagram in GitLab Embed a diagram in Bitbucket Embed a diagram in an Azure DevOps wiki Embed a diagram in Confluence Embed a diagram in Obsidian Embed a diagram in Docusaurus Embed a diagram in MkDocs Embed a diagram in GitBook Embed a diagram in ReadMe.com docs Embed a diagram in Sphinx Embed a diagram in Hugo Embed a diagram in Jekyll Embed diagrams in VitePress Embed diagrams in Nextra Embed diagrams in mdBook Embed diagrams in Docsify Embed diagrams in Wiki.js Embed diagrams in BookStack Embed diagrams in Outline Embed diagrams in Coda Embed diagrams in Slab Embed diagrams in SharePoint Embed diagrams in Google Docs Embed diagrams in Dropbox Paper Share diagrams in Slack Embed diagrams in Backstage TechDocs Embed a diagram in Jira Embed a diagram in Linear Embed a diagram in Microsoft Teams Embed a diagram in Astro Starlight Embed a diagram in an npm README Embed a diagram in a PyPI project page Embed a diagram in a Docker Hub overview Embed a diagram in a Jupyter notebook Embed a diagram in a Grafana dashboard Embed a diagram in Swagger UI and Redoc

Keep docs in sync

Keep network diagrams up to date Keep pipeline docs in sync with the DAG Keep dbt docs in sync Keep database schema docs in sync Keep microservices docs in sync Keep SDK docs in sync across languages Keep design docs useful after shipping Keep security architecture docs current Keep incident runbooks up to date Keep a data catalog in sync Keep API docs in sync with code Keep a README in sync with the code Keep architecture docs in sync with code Keep a data dictionary in sync with the schema Keep ER diagrams in sync with the database Keep runbooks in sync with infrastructure Keep onboarding docs up to date Keep ADRs up to date Keep an internal wiki in sync Keep infrastructure docs in sync with Terraform Documentation in the repo vs the wiki README architecture section ARCHITECTURE.md Automate the architecture diagram in CI ADRs vs architecture diagrams The architecture diagram nobody maintains Onboarding new engineers to the architecture Mermaid diagram drift Architecture diagrams for compliance audits Architecture context for AI coding agents Generate architecture.md from a repository ADRs versus generated docs C4 model in practice Diagrams in a docs-as-code pipeline Onboarding documentation that stays true Runbook with a live diagram System design document The audit pack Documenting a legacy system nobody understands Documentation review in a pull request

Documentation drift

How to detect stale architecture diagrams Documentation freshness metrics Documentation audit checklist Documentation ownership models Documentation checks in CI Diagram versioning Docs as code for diagrams Wiki rot README rot Tribal knowledge in engineering teams When to regenerate an architecture diagram Documentation debt Documentation SLAs A single source of truth for architecture Stale runbooks are an incident risk

Compared with other tools

TerraVision alternative Structurizr alternative Python diagrams library alternative IcePanel alternative Ilograph alternative CloudSkew alternative Hava alternative ArchiMate tool alternative Terraform Rover alternative Brainboard alternative

Who uses it, and for what

Client architecture documentation Onboarding diagram Pre-sales architecture diagram Giving an auditor the diagram Project handover pack Architecture diagram for investors Architecture diagram for a proposal Incident diagram Migration diagram Cloud footprint diagram

Concepts and definitions

How often should architecture diagrams be updated Who owns architecture documentation How to measure documentation health Living documentation vs docs-as-code Documentation review cadence Docs freshness policy Cost of outdated documentation Why documentation goes stale Are architecture diagrams worth maintaining Documentation drift metrics Keeping docs accurate in fast-moving teams What makes documentation trustworthy

Ready to Build Your Data Architecture?

Use our AI-powered diagramming tool to create professional architecture diagrams in seconds. Perfect for documentation, presentations, and team collaboration.

Try DiagramAI Free