The Role
As a Senior AI Engineer, you'll own agents end to end within a problem area, from the first prototype to measured performance in production. You'll join a new engineering group at CCC building AI-native products for our auto casualty business, the injury side of auto claims. The group is small and senior, and it's growing fast.
Key Responsibilities:
- Design and build LLM-powered agents and workflows: orchestration, tool use, retrieval, structured extraction, and human-in-the-loop review.
- Build evaluations with data labelers and subject matter experts, and run them on every change.
- Make agents production-grade: guardrails, observability, cost and latency, and careful handling of sensitive health data.
What success looks like:
- In your first month, you've shipped a measured improvement to an existing agent.
- By six months, an agent you built is in production with customers, backed by evaluation results.
Requirements:
- Typically 5+ years of professional software or ML engineering experience, including meaningful recent work with LLMs.
- Strong production engineering skills in Python, including API services, and comfort working in TypeScript.
- At least a year of shipping LLM-powered products to real users, including retrieval (RAG, embeddings, vector search) and prompt engineering.
- Experience designing evaluations for non-deterministic systems, and the habit of measuring before and after every change.
- A quantitative mindset: you're comfortable with metrics, sampling, error analysis, and knowing when a result is real.
- Real experience shipping faster with AI-assisted or agentic engineering tools, with examples you can walk us through.
Nice to have:
- Document understanding, OCR, or extraction from complex documents.
- Experience fine-tuning LLMs or working with multimodal data.
🇧🇷 Essa vaga exige inglês. Você está pronto?
A DevSpeak Academy prepara desenvolvedores brasileiros para conquistar vagas internacionais. Domine o inglês técnico com professores que entendem o mundo dev.
Conheça a DevSpeak Academy.png?1728912815)