---
title: "AI Engineer Role"
description: "The application-layer engineer who orchestrates AI APIs, RAG, and evals — distinct from ML Engineering by the API boundary, grounded in Latent Space's 'Rise of the AI Engineer'."
section: "concepts"
type: "concept"
created: "2026-08-30"
updated: "2026-08-30"
confidence: "high"
tags: ["llm-fundamentals", "workflow", "roles"]
canonical: "https://pyweb.dev/wiki/ai-engineer-role"
---
# AI Engineer Role

The **AI Engineer** (per Latent Space's "The Rise of the AI Engineer," relayed by Matt Pocock) is a software developer who builds applications powered by AI — and the role is defined negatively as much as positively:^[raw/aihero/what-is-an-ai-engineer.md]

**You don't need:** linear algebra, building foundation models from scratch, or having read "Attention Is All You Need."
**You do need:** strong software engineering fundamentals, reliable/scalable application skills, modern AI tooling knowledge, and a user-experience focus.

## The API Boundary vs ML Engineering
- **AI Engineers** build applications that *use* AI — orchestrating APIs, implementing RAG, building evaluation systems, and "writing lots of code in the hottest new programming language: English" (Karpathy).
- **ML Engineers** work *below* the API boundary: training, fine-tuning, model internals.

## The Mindset Shift
Building with LLMs means trading deterministic input->output systems for **probabilistic** ones: define success criteria early, and build a culture of continuous improvement on real user data (see [eval taxonomy](/wiki/eval-taxonomy), the Vibes-Only Trough to Data-Driven Slope journey). The role's daily work spans [llm message protocol](/wiki/llm-message-protocol) mechanics, [agents vs workflows](/wiki/agents-vs-workflows) architecture choices, and [context budget audit](/wiki/context-budget-audit) cost discipline.

## Related
[eval taxonomy](/wiki/eval-taxonomy), [agents vs workflows](/wiki/agents-vs-workflows), [llm message protocol](/wiki/llm-message-protocol), [context budget audit](/wiki/context-budget-audit), [software engineering fundamentals for agents](/wiki/software-engineering-fundamentals-for-agents).

---

## Agent Navigation

cluster: person (170 pages) | betweenness: 15.5

### References (outbound)
- [Eval Taxonomy](https://pyweb.dev/wiki/eval-taxonomy.md)

### Referenced by (inbound)
- [Software Engineering Fundamentals for Agents](https://pyweb.dev/wiki/software-engineering-fundamentals-for-agents.md)

### Evidence (verified primary sources)
- raw/aihero/what-is-an-ai-engineer.md (internal workspace doc)
- raw/aihero/the-ai-engineer-mindset.md (internal workspace doc)
- raw/aihero/ai-engineer-roadmap.md (internal workspace doc)
- raw/aihero/what-are-llms-used-for.md (internal workspace doc)

### Machine endpoints
- Knowledge graph: https://pyweb.dev/api/graph.json
- Graph analysis: https://pyweb.dev/api/graph-analysis.json
- Context index: https://pyweb.dev/llms.txt