guides

No, ChatGPT Cannot Tell Your Undertone From a Photo (Here's Why)

Why general-purpose AI tools fail at undertone detection, especially for brown skin, and what actually works instead.

CAPSI Team
January 17, 2026
5 min read
AI limitations
undertone
brown skin
color analysis
Photo with lighting variations affecting skin tone

The Photo You Uploaded Isn't Showing Your Real Skin Tone

You upload a selfie to ChatGPT and ask what your undertone is. It gives you an answer. Sounds confident. Might even explain its reasoning.

There's a good chance it's wrong.

Not because the AI is bad. Because the task doesn't work the way people think it does.

The Problem With Photos

Your skin tone in a photo isn't your actual skin tone. Every step between your face and the AI introduces distortion.

Your Phone Processes Color

Smartphones adjust white balance, exposure, and color temperature automatically. Different phones (iPhone, Samsung, Pixel) capture your skin differently, even in identical lighting.

The AI has no way to know which phone you used or how it processed the image.

Lighting Changes Everything

Warm indoor lighting makes your skin look more golden. Fluorescent light makes you look ashen. Natural daylight at different times creates different color casts.

The AI can't see what lighting you were in or compensate for it.

Filters and Auto-Enhance

Even if you didn't edit the photo, your phone might have. Auto-enhance, beauty modes, and default filters all change skin tone.

The AI doesn't know if the image was altered.

Compression Destroys Data

When you upload a photo, compression throws away subtle color information. Undertone detection relies on exactly those subtle variations.

By the time the AI sees your photo, the critical data is gone.

Why General AI Fails at This

ChatGPT and similar tools are generalist models. They can do many things reasonably well. Undertone detection for brown skin isn't one of them.

No Calibrated Training Data

These models trained on random internet photos, not controlled images designed for color analysis. They learned patterns from already-distorted images.

No reference point for accurate skin tone exists in their training.

No Melanin-Specific Understanding

Brown skin reflects and absorbs light differently. Undertones in melanin-rich skin are more subtle than in lighter skin where contrast makes them obvious.

General AI applies patterns learned mostly from lighter skin to brown skin, where those patterns fail.

Can't Separate Surface Tone from Undertone

Photos show mostly surface tone (visible skin color). Undertone is the subtle hue beneath that. It's why someone with your same depth looks better in completely different colors.

General AI reads surface color and calls it undertone.

The Hex Code Problem

Some people extract skin hex codes from photos and give those to ChatGPT for analysis. This seems scientific but makes the problem worse.

Hex codes are just numbers representing the distorted photo color. Garbage in, garbage out. The AI analyzes incorrect color data confidently.

Why Brown Skin Makes This Harder

Brown skin has natural depth that masks undertone. The difference between warm and cool undertones in deep brown skin is incredibly subtle in photos.

Small Differences Matter More

A small undertone shift completely changes which colors work. Neutral-warm versus olive-neutral might be barely visible in a photo but means the difference between glowing in emerald green versus looking washed out.

General AI can't make those fine distinctions.

Lighting Affects Brown Skin Differently

Brown skin absorbs more light, so subtle color shifts get lost. AI can't compensate without being specifically designed for this.

What Actually Works

Specialized Systems

Tools built specifically for undertone detection use controlled processes. They ask for specific photo conditions, use calibration, and train on datasets with verified brown skin undertones.

Not perfect, but dramatically better than general AI.

In-Person Analysis

Still the gold standard. A trained analyst in neutral lighting can see undertones photos miss. They drape different colors and watch your skin respond in real time.

Multiple Data Points

Good systems don't rely on one photo. They ask for photos in different lighting, questions about which colors get you compliments, how your skin responds to gold versus silver, then combine data points.

General AI analyzes one image and stops.

When AI Gets It Wrong

If a general AI tool's results don't feel right, trust that.

Maybe it said warm when cool colors make you glow. Maybe it said cool when you look amazing in terracotta. Maybe it said olive when that's never resonated.

The AI saw something in your distorted photo that suggested that answer. But what it saw was warped by lighting, camera processing, and compression.

Your lived experience with colors is better data than a single photo analysis.

What to Do Instead

Don't upload random photos to ChatGPT for undertone analysis.

Use systems built specifically for undertone detection that account for brown skin. Look for tools asking for multiple photos in specific lighting or combining photo analysis with questions about your color responses.

Or do in-person draping. Hold colored fabrics to your face in natural light and see which make your skin look clear versus tired.

Trust your eyes and experience over what general AI says from one photo.

Key Takeaways

  • Photos distort skin tone through camera processing, lighting, editing, and compression
  • General AI isn't trained on calibrated skin data or melanin-specific color behavior
  • Hex codes from photos just give AI incorrect data to analyze confidently
  • Brown skin's depth makes undertone harder to detect from photos
  • Specialized systems or in-person analysis work better than general AI

Ready to discover your perfect colors? Get your personalized color analysis with CAPSI.

Ready to Discover Your Perfect Colors?

Get your personalized color analysis with CAPSI's computer vision analysis system

Get Your Analysis

Share this article

About CAPSI Team

The CAPSI team is dedicated to providing science-backed color analysis and styling guidance for South Asian individuals.

Related Articles