We Engineered a Way to Read Human Skin Through a Smartphone Camera.

No dermatoscope. No controlled lighting. No clinical setting. Oyster's Skin Intelligence Engine captures multiple images from a standard smartphone camera and extracts 15 dermatological biomarkers using enhanced photon manipulation and proprietary computer vision trained on 2M+ clinical images.

The Core Innovation

Enhanced Photon Manipulation.

Smartphone cameras were not designed to read skin. A single photo cannot distinguish melanin gradation from shadow, or sebum reflection from camera glare.

Oyster captures a rapid sequence of images under varying angles and micro-exposures. The pipeline manipulates photon data across this image sequence to isolate dermatological signals invisible to any single frame.

The result: a structured multi-layer skin profile from a $150 Android phone or the latest iPhone. No infrared. No additional hardware.

Imaging Pipeline
INMulti-image capture sequenceVarying angles and micro-exposures
The Output

Multiple Images. Fifteen Measurements.

Each biomarker is extracted independently and scored on a normalised scale. The output is a structured dermatological profile, not a skin type label.

Hydration LevelMelanin DistributionFitzpatrick ClassificationPore DensityHyperpigmentation ScorePost-Inflammatory MarkingBarrier HealthOiliness IndexUV Damage IndicatorsSkin Texture ScoreDark Spot MappingErythema IndexSebum DistributionEstimated Skin AgeSensitivity Score

Processing time

Under 12 Seconds

Reproducibility

Same skin, same output. Every time.

The Dataset

2 Million Clinical Images. The Largest Melanin-Rich Dataset in Commercial AI.

Clinical portrait with face-mesh overlay
NigeriaSouth AfricaKenyaGhana
South KoreaRwandaMorocco

Most commercial skin AI is trained on publicly available dermatological image databases. Those databases are overwhelmingly Fitzpatrick I–III. Lighter skin. Cooler climates. Conditions that present differently on darker skin are underrepresented or absent entirely. Oyster's training dataset was built differently. 2M+ clinical images sourced from government healthcare programmes and dermatology clinics across Nigeria, South Africa, Kenya, Ghana, Rwanda, Morocco, and South Korea. Captured in the field. Under real lighting conditions. On real devices. By real clinicians. The dataset covers the full Fitzpatrick spectrum with deliberate overrepresentation of Types IV–VI. Hyperpigmentation on Fitzpatrick V skin does not present the same way it does on Fitzpatrick II skin. Erythema on melanin-rich skin is not visible as redness. Post-inflammatory marks on dark skin follow different recovery trajectories. General-purpose models miss these distinctions. Oyster's model was trained specifically to detect them. This dataset is Proprietary. Built over years of clinical partnerships. It grows with every scan.

2M+

Clinical images

7

markets

98.9%

Fitz IV–VI accuracy

The Model Architecture

Three Inference Stages. One Structured Output.

STEP 1: MULTI-IMAGE PREPROCESSING

Rapid image sequence aligned and normalised. Noise reduction calibrated to device-specific sensor characteristics. Colour space normalisation across 1,400+ smartphone models. Photon data extracted and compared across frames. The same skin under different cameras produces the same biomarker output.

Composite of five faces representing diverse skin tones

STAGE 2: MULTI-TASK BIOMARKER EXTRACTION

Fifteen parallel extraction heads. Each biomarker measured independently from the processed image sequence. No single-label classification. The model does not say “oily skin.” It says “oiliness index: 7.2/10, concentrated in T-zone, moderate in perioral region.”

Multispectral skin analysis visualisation

STAGE 3: PROFILE ASSEMBLY + CONTRAINDICATION CHECK

Biomarkers assembled into a structured profile. Product recommendations generated against the partner's catalogue with match confidence scored per SKU. Every recommendation screened through the contraindication engine before it reaches the customer.

3D molecular ingredient visualisation

Total pipeline latency

Under 12 Seconds

Guaranteed sub

2.5 seconds at Growth and Enterprise tiers

NVIDIACompute:
Google GeminiFoundation models
Inferenceoptimised for mobile-origin image quality.
Contraindication Engine

Every Recommendation Screened Against Clinical Ingredient Data.

The recommendation engine does not just match products to skin profiles. It screens every match against a rules engine built from dermatologist-validated ingredient interaction data.

The engine evaluates:

  • Active ingredient concentration vs biomarker thresholds
  • Ingredient combination conflicts (e.g. AHA + retinol)
  • Condition-specific contraindications (e.g. retinol on compromised barrier, exfoliant on active PIH)
  • Sensitivity-adjusted fragrance and irritant screening

Products that pass: recommended with confidence score. Products that fail: excluded. Automatically. Products that partially match: flagged with clinical rationale visible to the partner's staff.

Recommended

CeraVe Moisturizing Cream

Match: 94.7% · No contraindications detected

Excluded - Auto

Retinol 0.5% Night Serum

Barrier compromised detected · Retinol flagged

Flagged — Staff Review

AHA 10% Exfoliant

Active PIH detected · Clinical rationale visible to staff

Built to Embed

Integration Architecture.

Rest API

Full programmatic access. Versioned. Documented. Scan submission, biomarker retrieval, recommendation generation, and restock event subscription through a single authenticated endpoint.

Data-Sovereignty

In-region deployment available. AWS af-south-1 (Cape Town) for South African data residency requirements. POPIA. NDPR. GDPR compliant. Biometric consent hashed. Consent modals served by geo-IP detection.

WebHooks

Event-driven. Scan completion. Recommendation generation. Restock trigger. Profile update.

React Native SDK

Native mobile applications. iOS and Android. Camera access, image capture sequence, and scan submission handled client-side.

Multi-Tenant

Partner data architecturally isolated. No cross-tenant data access. No shared inference state. Each partner's catalogue, scan history, and analytics exist in a dedicated logical partition.

Embedded Widget

One embed tag. Any web platform. Under 2 hours. Configurable UI. Partner branding. Mobile-responsive.

Isometric cube on a circuit board representing Oyster's integration architecture
ShopifyWooCommerceMagentoCustom buildsiOSAny web stackAndroidReact Native
Device Coverage

1,400+ Smartphone Models. Consistent Output.

The preprocessing pipeline normalises sensor data across device manufacturers, camera modules, and OS versions. A scan taken on a $150 Android device in Lagos produces the same biomarker accuracy as a scan taken on the latest iPhone in Seoul. No minimum device requirement beyond a rear-facing camera. No app download. Browser-based scan via WebRTC.

Diagram showing inputs and outputs of the smartphone scan flow
Illustration of an open box on a pallet
Ready to Deploy

Evaluate the Engine on Your Own Data.

Upload your product catalogue. Run live scans. Review biomarker output and recommendation accuracy against your inventory. Measured results before any commercial commitment.

FAQ

Your Questions Answered

Contact us if you have any other questions.

How does Oyster extract skin data from a smartphone camera?

The scan captures a rapid sequence of images. The imaging pipeline uses enhanced photon manipulation across these frames to separate melanin absorption from haemoglobin contribution, isolate specular reflection patterns, and map texture and colour variation across facial zones. The result is a structured 15-biomarker skin profile.

Why multiple images instead of one photo?

Single photos cannot disambiguate melanin gradation from shadow, or sebum reflection from camera glare. A multi-image sequence under varying micro-exposures lets the pipeline isolate dermatological signals invisible to any single frame — the same biomarker accuracy as a $150 Android device in Lagos as the latest iPhone in Seoul.

Why does Fitzpatrick classification matter for skin AI?

Most computer vision models were trained on Fitzpatrick I–III data. Conditions present differently on darker skin: hyperpigmentation, erythema, and post-inflammatory marks all behave differently across the Fitzpatrick spectrum. We trained on the largest melanin-rich dataset in commercial AI — 98.9% measured accuracy on Fitzpatrick IV–VI.

How is data handled?

Biometric consent hashed on submission. Data residency configurable per region (AWS af-south-1 Cape Town available for South African residency). POPIA, NDPR, GDPR compliant. Partner data architecturally isolated — no cross-tenant data access.

What compute infrastructure powers the engine?

NVIDIA-accelerated inference for primary models. Gemini-powered reasoning for contraindication checks. Optimised for mobile-origin image quality. Total pipeline latency under 12 seconds — guaranteed sub-2.5 seconds at Growth and Enterprise tiers.

How consistent are results across devices?

The preprocessing pipeline normalises sensor data across device manufacturers, camera modules, and OS versions. A scan taken on a $150 Android device in Lagos produces the same biomarker accuracy as a scan taken on the latest iPhone in Seoul. No minimum device requirement beyond a rear-facing camera. No app download. Browser-based scan via WebRTC.

What is the contraindication engine?

Every recommendation is screened against clinical ingredient interaction data: active ingredient concentration vs biomarker thresholds, ingredient combination conflicts (e.g. AHA + retinol), condition-specific contraindications (e.g. retinol on compromised barrier), and sensitivity-adjusted fragrance and irritant screening. Products that pass: recommended with confidence score. Products that fail: excluded automatically. Products that partially match: flagged with clinical rationale visible to the partner’s staff.

Ready to Deploy

The most accurate commercial skin intelligence engine for melanin-rich skin. Evaluate it now.