Skip to content
View hamelsmu's full-sized avatar
💻
Always learning.
💻
Always learning.

Sponsors

Private Sponsor
@comet-ml

Sponsoring

@simonw

Highlights

  • Pro

Organizations

@fastai @kubeflow

Block or report hamelsmu

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
hamelsmu/README.md

Hi, I'm Hamel

I'm an ML engineer and independent consultant at Parlance Labs. I spend most of my time helping teams build AI products. Previously, I did applied ML at GitHub and Airbnb.

What I'm working on

Evals for AI Engineers - O'Reilly

I'm working to bring data science back to AI: helping teams debug, analyze, and measure their systems. I call this "evals," and after doing it across 35+ AI products, I co-authored Evals for AI Engineers (O'Reilly), covering error analysis, LLM-as-a-judge, synthetic data, production monitoring, and building data flywheels. I also co-teach a course on evals on Maven.

I write about what I learn at hamel.dev. Some recent posts:

Date Post
Jan 2026 LLM Evals: Everything You Need to Know
Jul 2025 Stop Saying RAG Is Dead
Mar 2025 A Field Guide to Rapidly Improving AI Products
Dec 2024 nbsanity - Share Notebooks as Polished Web Pages in Seconds
Nov 2024 Building an Audience Through Technical Writing: Strategies and Mistakes
Oct 2024 Using LLM-as-a-Judge For Evaluation: A Complete Guide
Oct 2024 Concurrency Foundations For FastHTML
Jul 2024 An Open Course on LLMs, Led by Practitioners
Jun 2024 What We've Learned From A Year of Building with LLMs
Apr 2024 Debugging AI With Adversarial Validation

Open source

I've contributed to tools across ML infrastructure, developer experience, and data science workflows: machine learning frameworks, workflow orchestration, Jupyter tooling, and code search. Full list here.

Pinned Loading

  1. AnswerDotAI/nbdev AnswerDotAI/nbdev Public

    Create delightful software with Jupyter Notebooks

    Jupyter Notebook 5.3k 516

  2. fastai/fastpages fastai/fastpages Public archive

    An easy to use blogging platform, with enhanced support for Jupyter Notebooks.

    Jupyter Notebook 3.6k 735

  3. github/CodeSearchNet github/CodeSearchNet Public archive

    Datasets, tools, and benchmarks for representation learning of code.

    Jupyter Notebook 2.4k 408