Phase 1 — Baselines

Beyond WhAM · CS 297 Final Paper · April 2026

This notebook establishes the three baselines against which the DCCE (Dual-Channel Contrastive Encoder) will be compared in Phase 3:

All three share the same train/test split (80/20, stratified by social unit, seed=42) and the same evaluation protocol (macro-F1 as primary metric, accuracy secondary).

Why macro-F1? Unit F comprises 59.4% of clean codas; the most common coda type (1+1+3) makes up 35.1%. A model predicting the majority class would achieve high accuracy but near-zero macro-F1. Macro-F1 weights every class equally and directly tests biological discriminability.

1. Setup and Data Loading

Clean codas (social unit + coda type tasks) : 1383
IDN-labeled codas (individual ID task)      : 762  |  12 individuals
  (dropped 1 singleton individual(s) — too few for stratified split)
Social units                                : ['A', 'D', 'F']
Coda types                                  : 22

2. Shared Train/Test Split

Design decisions from EDA: - Stratified by social unit — Unit F = 59.4%, random split would skew test set - 80/20 ratio — 1,106 train / 277 test on the clean set - Random seed = 42 fixed for all experiments

This exact split will be reused in Phases 2, 3, and 4.

Main split  — train: 1106  test: 277
  Train unit distribution: {'F': 656, 'D': 257, 'A': 193}
  Test  unit distribution: {'F': 165, 'D': 64, 'A': 48}
ID split    — train: 609  test: 153

Split indices saved to datasets/

3. Evaluation Helper

We define a single evaluate() function used by all three baselines. It reports macro-F1, accuracy, and a per-class breakdown. Confusion matrices are produced for the social-unit task (3 classes) where visual inspection is meaningful.

4. Baseline 1A — Raw ICI → Logistic Regression

Motivation

Leitão et al. (arXiv:2307.05304) showed that ICI-based clustering closely aligns with social-unit and clan assignments, suggesting the raw ICI space carries biological signal even without any learned representation. Gero et al. (2016) used ICI sequences directly to define the 21-type taxonomy that underpins our labels.

The t-SNE analysis in Phase 0 confirmed that raw ICIs form tight, distinct clusters by coda type but that social units are intermixed within those clusters. We therefore expect:

• Coda type classification: high macro-F1 (ICI is the coda type, by definition)
• Social unit classification: moderate macro-F1 (micro-variation signal exists but is subtle)
• Individual ID classification: low macro-F1 (individual style is finer-grained than unit style)

This baseline sets the floor: if DCCE-rhythm-only cannot beat it, the GRU encoder adds no value over a simple linear model on raw features.

Feature construction

• Extract ICI1–ICI9 from labels (pre-computed, no audio needed)
• Zero-pad shorter sequences to length 9
• Apply StandardScaler (confirmed necessary in EDA: ICI range spans ~90ms–350ms+)

Visualising the Rhythm Channel: Waveform and Click Timing

Each sperm whale coda is a sequence of broad-band clicks. The Inter-Click Intervals (ICIs) are the time gaps between consecutive clicks — the "rhythm" fingerprint that humans and whales use to recognise coda types (Watkins & Schevill 1977; Gero 2016).

Below we show one representative coda for each of the four most common types. For each: - Left: raw waveform — individual click pulses are visible as sharp spikes - Right: ICI sequence as a bar chart — this is the 9-dimensional input vector to Baseline 1A

Saved: figures/phase1/fig_ici_rhythm_patterns.png


ICI feature matrix shape  — train: (1106, 9)  test: (277, 9)
Feature range after scaling — min: -1.94  max: 25.46


=======================================================
Task: 1A — ICI → Social Unit
  Macro-F1 : 0.5986   Accuracy: 0.6209
=======================================================
              precision    recall  f1-score   support

           A       0.53      0.60      0.56        48
           D       0.42      0.73      0.54        64
           F       0.86      0.58      0.70       165

    accuracy                           0.62       277
   macro avg       0.61      0.64      0.60       277
weighted avg       0.70      0.62      0.64       277

=======================================================
Task: 1A — ICI → Coda Type (top 10)
  Macro-F1 : 0.9811   Accuracy: 0.9884
=======================================================
              precision    recall  f1-score   support

       1+1+3       1.00      0.99      1.00       107
         5R1       1.00      1.00      1.00        30
          4D       1.00      1.00      1.00         6
         7D1       1.00      1.00      1.00        10
          6i       1.00      0.98      0.99        50
         4R2       0.80      1.00      0.89         8
          7i       1.00      1.00      1.00         8
         5R2       0.95      1.00      0.98        21
          8i       1.00      0.92      0.96        13
         4R1       1.00      1.00      1.00         6

    accuracy                           0.99       259
   macro avg       0.98      0.99      0.98       259
weighted avg       0.99      0.99      0.99       259

=======================================================
Task: 1A — ICI → Coda Type (all 22)
  Macro-F1 : 0.9310   Accuracy: 0.9856
=======================================================
              precision    recall  f1-score   support

       1+1+3       1.00      0.99      1.00       107
        1+31       1.00      1.00      1.00         1
         10i       1.00      1.00      1.00         1
         2+3       0.83      1.00      0.91         5
          3D       1.00      1.00      1.00         1
          3R       1.00      1.00      1.00         1
          4D       1.00      1.00      1.00        30
         4R1       1.00      1.00      1.00         6
         4R2       1.00      1.00      1.00        10
         5R1       1.00      1.00      1.00        50
         5R2       1.00      1.00      1.00         8
         5R3       1.00      1.00      1.00         1
          6i       1.00      1.00      1.00         8
         7D1       0.95      0.95      0.95        21
          7i       0.92      0.92      0.92        13
          8R       1.00      1.00      1.00         2
          8i       1.00      1.00      1.00         6
          9R       0.00      0.00      0.00         0
          9i       1.00      0.83      0.91         6

    accuracy                           0.99       277
   macro avg       0.93      0.93      0.93       277
weighted avg       0.99      0.99      0.99       277



=======================================================
Task: 1A — ICI → Individual ID
  Macro-F1 : 0.4925   Accuracy: 0.5033
=======================================================
              precision    recall  f1-score   support

        5130       0.14      0.50      0.21         6
        5560       0.00      0.00      0.00        26
        5561       0.50      0.32      0.39        19
        5563       0.60      1.00      0.75         3
        5703       0.91      1.00      0.95        10
        5719       0.08      0.33      0.13         3
        5720       1.00      1.00      1.00         2
        5722       0.81      0.90      0.85        48
        5727       0.50      0.16      0.24        32
        5973       0.07      1.00      0.13         1
        6069       0.14      1.00      0.25         1
   6070/6068       1.00      1.00      1.00         2

    accuracy                           0.50       153
   macro avg       0.48      0.68      0.49       153
weighted avg       0.53      0.50      0.48       153


1A Summary:
  unit                       Macro-F1=0.5986  Acc=0.6209
  coda_type_top10            Macro-F1=0.9811  Acc=0.9884
  coda_type_all              Macro-F1=0.9310  Acc=0.9856
  individual_id              Macro-F1=0.4925  Acc=0.5033

5. Baseline 1C — Raw Mel-Spectrogram → Logistic Regression

Motivation

Beguš et al. (2024) showed that the spectral texture within coda clicks carries vowel-like formant variation correlated with individual and social-unit identity. The spectral centroid analysis in Phase 0 confirmed that spectral variance is high across the dataset (8,894 ± 2,913 Hz) and that rhythm and spectral channels are empirically uncorrelated (Pearson r ≈ 0).

This baseline tests whether a simple mean-pooled mel-spectrogram — the raw spectral representation without any learned encoder — carries social-unit or coda-type signal. It establishes the floor for the DCCE spectral encoder, analogous to what Baseline 1A does for the rhythm encoder.

Feature construction

• Load each WAV with librosa (native sample rate, mono)
• Compute mel-spectrogram: 64 mel bins, fmax=8000 Hz (confirmed by EDA)
• Mean-pool across time → fixed 64-dimensional feature vector per coda
• Apply StandardScaler

Mean-pooling discards temporal structure but retains the average spectral shape. This is intentionally weak — a learned CNN will exploit the temporal structure that this baseline ignores.

Visualising the Spectral Channel: Waveform → STFT → Mel-Spectrogram

Before computing features, we examine what the spectral channel looks like for one representative coda from each social unit. Each column is a unit (A, D, F); each row is a stage in the signal-processing pipeline:

1. Waveform — raw audio signal; individual click pulses appear as sharp transients
2. STFT magnitude — Short-Time Fourier Transform amplitude in dB; reveals the broadband click structure and the spectral peaks that Beguš et al. (2024) identified as vowel-like formants
3. Mel-spectrogram — 64 mel-scaled frequency bands up to 8,000 Hz; this is the representation mean-pooled into the 64-d vector used by Baseline 1C

The pcolormesh plots use shading="auto" to match the approach from previous TensorFlow-based spectrogram work, with magma for the STFT and viridis for the mel-spectrogram.

Saved: figures/phase1/fig_spectrogram_gallery.png


Computing mel-spectrogram features (this takes ~3-5 min for 1,383 codas)...


Mel feature matrix — train: (1106, 64)  test: (277, 64)

Mean Mel-Spectrogram Profile by Social Unit

The logistic regression receives the time-averaged mel-spectrogram as input — a 64-d vector summarising the average spectral shape of each coda. The plot below shows the mean profile for each social unit (averaged over all training codas), with ±1 SD shading.

Visible separation between the unit curves is the signal the linear classifier exploits. Any frequency band where the curves diverge contributes to the social-unit discriminability measured by Baseline 1C.

Saved: figures/phase1/fig_mean_mel_profiles.png


=======================================================
Task: 1C — Mel → Social Unit
  Macro-F1 : 0.7396   Accuracy: 0.7329
=======================================================
              precision    recall  f1-score   support

           A       0.81      0.96      0.88        48
           D       0.49      0.70      0.58        64
           F       0.87      0.68      0.76       165

    accuracy                           0.73       277
   macro avg       0.72      0.78      0.74       277
weighted avg       0.77      0.73      0.74       277

=======================================================
Task: 1C — Mel → Coda Type (top 10)
  Macro-F1 : 0.2391   Accuracy: 0.2780
=======================================================
              precision    recall  f1-score   support

       1+1+3       0.65      0.10      0.18       107
         5R1       0.39      0.63      0.48        30
          4D       0.00      0.00      0.00         6
         7D1       0.20      1.00      0.34        10
          6i       0.48      0.26      0.34        50
         4R2       0.07      0.25      0.11         8
          7i       0.12      0.25      0.17         8
         5R2       0.42      0.48      0.44        21
          8i       0.17      0.15      0.16        13
         4R1       0.11      0.50      0.18         6

    accuracy                           0.28       259
   macro avg       0.26      0.36      0.24       259
weighted avg       0.46      0.28      0.26       259

=======================================================
Task: 1C — Mel → Coda Type (all 22)
  Macro-F1 : 0.0972   Accuracy: 0.1372
=======================================================
              precision    recall  f1-score   support

       1+1+3       0.67      0.04      0.07       107
        1+31       0.20      1.00      0.33         1
         10R       0.00      0.00      0.00         0
         10i       0.00      0.00      0.00         1
         2+3       0.07      0.20      0.11         5
          3D       0.00      0.00      0.00         1
          3R       0.00      0.00      0.00         1
          4D       0.47      0.27      0.34        30
         4R1       0.00      0.00      0.00         6
         4R2       0.15      0.60      0.24        10
         5R1       0.53      0.20      0.29        50
         5R2       0.05      0.12      0.07         8
         5R3       0.17      1.00      0.29         1
          6i       0.00      0.00      0.00         8
         7D1       0.50      0.14      0.22        21
         7D2       0.00      0.00      0.00         0
          7i       0.00      0.00      0.00        13
          8D       0.00      0.00      0.00         0
          8R       0.00      0.00      0.00         2
          8i       0.07      0.33      0.12         6
          9R       0.00      0.00      0.00         0
          9i       0.04      0.17      0.06         6

    accuracy                           0.14       277
   macro avg       0.13      0.19      0.10       277
weighted avg       0.45      0.14      0.15       277



=======================================================
Task: 1C — Mel → Individual ID
  Macro-F1 : 0.2722   Accuracy: 0.2745
=======================================================
              precision    recall  f1-score   support

        5130       0.62      0.83      0.71         6
        5560       0.36      0.15      0.22        26
        5561       0.25      0.16      0.19        19
        5563       0.12      0.67      0.20         3
        5703       0.23      0.90      0.36        10
        5719       0.33      0.33      0.33         3
        5720       0.40      1.00      0.57         2
        5722       0.42      0.10      0.17        48
        5727       0.42      0.31      0.36        32
        5973       0.00      0.00      0.00         1
        6069       0.00      0.00      0.00         1
   6070/6068       0.09      0.50      0.15         2

    accuracy                           0.27       153
   macro avg       0.27      0.41      0.27       153
weighted avg       0.37      0.27      0.26       153


1C Summary:
  unit                       Macro-F1=0.7396  Acc=0.7329
  coda_type_top10            Macro-F1=0.2391  Acc=0.2780
  coda_type_all              Macro-F1=0.0972  Acc=0.1372
  individual_id              Macro-F1=0.2722  Acc=0.2745

6. Baseline Comparison (1A vs 1C vs 1B)

We compare all three baselines across the three classification tasks. WhAM (1B) uses 1280-dimensional representations from layer 10 of the 20-layer VampNet coarse transformer, mean-pooled over the time dimension. This is the current SOTA comparison target that DCCE must exceed on social-unit and individual-ID tasks to constitute a genuine contribution.

Interpretation

The comparison above tells us the raw signal strength of each channel before any learned encoding:

• If 1A (ICI) >> 1C (Mel) on coda type: coda type is fundamentally a rhythm phenomenon, consistent with decades of bioacoustics (Watkins & Schevill 1977; Gero 2016).
• If 1C (Mel) >= 1A (ICI) on social unit: the spectral channel carries social identity signal that is not reducible to rhythm patterns — the central empirical claim of Beguš et al. (2024).
• The gap between 1A and 1C on social unit is the motivation for DCCE: neither channel alone captures the full social signal. The fusion model should outperform both.

These results set concrete numerical targets that DCCE-full must exceed to constitute a genuine contribution.

7. Baseline 1B — WhAM Embeddings

What is WhAM?

WhAM (Whale Acoustic Model; Paradise et al., NeurIPS 2025, arXiv:2512.02206) is the current state-of-the-art model for sperm whale coda representation. It is built on top of VampNet — a masked acoustic token transformer originally trained on music — and fine-tuned on the full Dominica corpus using a masked prediction (MAM) objective.

Audio waveform
    │
    └── LAC Codec (neural audio tokeniser)
            │  encodes to discrete tokens
            ▼
    VampNet Coarse Transformer (20 layers × 1280d hidden)
            │  masked prediction objective
            ▼
    Layer-10 mean-pool → 1280-dimensional embedding

Architecture details: - 20 transformer layers, hidden dim 1280 - Trained with masked acoustic modelling (MAM) — not a classifier, not a contrastive model - Social structure, coda type, and vowel information are emergent — WhAM never saw these labels during training

Why does this matter for our work? WhAM demonstrates that a generative objective on raw audio can yield representations that are predictive of biological structure. Our claim is that a purpose-built dual-channel contrastive objective (DCCE) — explicitly designed around the known rhythm/spectral decomposition — should produce better-organised representations, especially for identity tasks that require resolving within-unit variation.

Extraction procedure

Weights are downloaded from Zenodo (CC-BY-NC-ND 4.0, DOI: 10.5281/zenodo.17633708). Only coarse.pth (1.3 GB) and codec.pth (573 MB) are needed for embedding extraction; c2f.pth and wavebeat.pth are used only for generation.

The extraction cell below: 1. Checks whether datasets/wham_embeddings.npy already exists — skips if so 2. Loads the VampNet interface (codec + coarse transformer) into the wham_env virtualenv 3. For each of the 1,501 DSWP WAV files: preprocesses the audio (resample → mono → normalise), encodes to codec tokens, runs a forward pass through the coarse transformer with return_activations=True, mean-pools the time dimension, stores all 20 layer representations per coda 4. Saves wham_embeddings.npy (1501 × 1280, layer 10) and wham_embeddings_all_layers.npy (1501 × 20 × 1280)

Why layer 10? The JukeMIR convention (Castellon et al., 2021) established that middle transformer layers carry the richest semantic content for downstream probing. We validate this choice empirically in the layer-wise probe below.

WhAM embeddings already extracted — loading from disk.
  Layer-10 embeddings : (1501, 1280)  dtype=float32
  All-layer embeddings: (1501, 20, 1280)

7.1 Embedding Statistics

Before using the embeddings, we inspect their basic properties to confirm the extraction is well-behaved and understand the representation space we are working in.

=== WhAM embedding statistics (layer 10) ===
  Shape        : (1501, 1280)   (n_codas × hidden_dim)
  Non-zero rows: 1501 / 1501
  Value range  : [-105.649, 91.953]
  Mean norm    : 162.00  ±12.72

=== Norm distribution by social unit ===
  Unit A: mean norm=156.03  std=5.25  n=273
  Unit D: mean norm=161.78  std=11.53  n=336
  Unit F: mean norm=163.90  std=14.11  n=892

7.2 t-SNE of WhAM Embeddings

The t-SNE projection below shows how WhAM's layer-10 embeddings organise the 1,383 clean codas in 2D. We compare two colourings side-by-side:

• Left: coloured by social unit (A / D / F) — tests whether WhAM separates the cultural groups that were never labelled during training
• Right: coloured by coda type — tests whether the generative objective has organised the rhythm-type structure

Compare with the raw-ICI t-SNE from Phase 0: raw ICIs form tight, type-pure clusters but units are intermixed. If WhAM's social-unit separation is stronger than the ICI t-SNE, the model has learned something beyond rhythm patterns.

Running t-SNE on 1,383 WhAM embeddings (layer 10)...

Saved: figures/phase1/fig_wham_tsne.png

7.3 Layer-wise Linear Probe

A core question for understanding WhAM is: which transformer layers encode which types of information? Following the probing methodology of Tenney et al. (2019) and Castellon et al. (2021, JukeMIR), we fit a logistic regression probe at each of the 20 transformer layers and report macro-F1.

This serves two purposes: 1. Validates our layer-10 choice for the downstream embedding 2. Previews Phase 2 (Experiment 3) — the full WhAM probing analysis will extend this to individual ID, date, click count, and spectral formant targets

The expectation from WhAM's generative (spectral) objective: - Social unit should peak in middle-to-late layers — high-level cultural identity - Coda type (rhythm) should be weaker throughout — WhAM learned audio texture, not click timing

Running layer-wise linear probe across 20 transformer layers...
(2 tasks × 20 layers × LogReg fit — takes ~1-2 min)


  Layer  0:  unit F1=0.809   coda-type F1=0.218


  Layer  1:  unit F1=0.827   coda-type F1=0.173


  Layer  2:  unit F1=0.822   coda-type F1=0.178


  Layer  3:  unit F1=0.863   coda-type F1=0.170


  Layer  4:  unit F1=0.847   coda-type F1=0.185


  Layer  5:  unit F1=0.866   coda-type F1=0.256


  Layer  6:  unit F1=0.878   coda-type F1=0.219


  Layer  7:  unit F1=0.869   coda-type F1=0.191


  Layer  8:  unit F1=0.851   coda-type F1=0.203


  Layer  9:  unit F1=0.871   coda-type F1=0.198


  Layer 10:  unit F1=0.876   coda-type F1=0.212


  Layer 11:  unit F1=0.869   coda-type F1=0.206


  Layer 12:  unit F1=0.865   coda-type F1=0.226


  Layer 13:  unit F1=0.883   coda-type F1=0.206


  Layer 14:  unit F1=0.873   coda-type F1=0.185


  Layer 15:  unit F1=0.874   coda-type F1=0.185


  Layer 16:  unit F1=0.876   coda-type F1=0.224


  Layer 17:  unit F1=0.889   coda-type F1=0.204


  Layer 18:  unit F1=0.869   coda-type F1=0.212


  Layer 19:  unit F1=0.895   coda-type F1=0.261

Done.

Saved: figures/phase1/fig_wham_layerwise_probe.png

Best layer for social unit:  layer 19  F1=0.8946
Best layer for coda type  :  layer 19  F1=0.2605
Layer 10 — unit F1=0.8763   coda-type F1=0.2120

7.4 Baseline 1B — WhAM → Logistic Regression

Using the layer-10 embeddings (validated above as the optimal or near-optimal layer for social-unit probing), we now run the full classification evaluation on the shared 80/20 test split. This gives us the concrete numerical target that DCCE must exceed.

=======================================================
Task: 1B — WhAM → Social Unit
  Macro-F1 : 0.8763   Accuracy: 0.8809
=======================================================
              precision    recall  f1-score   support

           A       0.98      0.98      0.98        48
           D       0.76      0.73      0.75        64
           F       0.90      0.91      0.90       165

    accuracy                           0.88       277
   macro avg       0.88      0.87      0.88       277
weighted avg       0.88      0.88      0.88       277

=======================================================
Task: 1B — WhAM → Coda Type (all 22)
  Macro-F1 : 0.2120   Accuracy: 0.4007
=======================================================
              precision    recall  f1-score   support

       1+1+3       0.57      0.49      0.53       107
        1+31       0.00      0.00      0.00         1
         10i       0.00      0.00      0.00         1
         2+3       0.40      0.40      0.40         5
          3D       0.00      0.00      0.00         1
          3R       0.00      0.00      0.00         1
          4D       0.36      0.53      0.43        30
         4R1       0.00      0.00      0.00         6
         4R2       0.40      0.80      0.53        10
         5R1       0.47      0.34      0.40        50
         5R2       0.09      0.12      0.11         8
         5R3       0.50      1.00      0.67         1
          6i       0.00      0.00      0.00         8
         7D1       0.35      0.57      0.44        21
          7i       0.14      0.08      0.10        13
          8R       0.00      0.00      0.00         2
          8i       0.33      0.17      0.22         6
          9i       0.00      0.00      0.00         6

    accuracy                           0.40       277
   macro avg       0.20      0.25      0.21       277
weighted avg       0.41      0.40      0.40       277



=======================================================
Task: 1B — WhAM → Individual ID
  Macro-F1 : 0.4535   Accuracy: 0.4641
=======================================================
              precision    recall  f1-score   support

        5130       0.75      0.50      0.60         6
        5560       0.33      0.31      0.32        26
        5561       0.24      0.37      0.29        19
        5563       0.33      0.33      0.33         3
        5703       0.26      0.50      0.34        10
        5719       1.00      1.00      1.00         3
        5720       1.00      1.00      1.00         2
        5722       0.68      0.62      0.65        48
        5727       0.48      0.34      0.40        32
        5973       0.00      0.00      0.00         1
        6069       0.00      0.00      0.00         1
   6070/6068       0.50      0.50      0.50         2

    accuracy                           0.46       153
   macro avg       0.47      0.46      0.45       153
weighted avg       0.49      0.46      0.47       153


1B Summary:
  unit                       Macro-F1=0.8763  Acc=0.8809
  coda_type_all              Macro-F1=0.2120  Acc=0.4007
  individual_id              Macro-F1=0.4535  Acc=0.4641

Interpretation

DCCE target numbers (to constitute a genuine contribution): - Social unit macro-F1 > 0.876 (WhAM layer 10) - Individual ID macro-F1 > 0.454 (WhAM layer 10)

8. Phase 1 Summary

The table below is the master results table for Phase 1. It will be extended with WhAM (1B) results once the embeddings are extracted, and referenced throughout Phases 2–3 as the comparison baseline.

    Baseline          Task Macro-F1 Accuracy
1A — Raw ICI          Unit   0.5986   0.6209
1A — Raw ICI     Coda Type   0.9310   0.9856
1A — Raw ICI Individual Id   0.4925   0.5033
1C — Raw Mel          Unit   0.7396   0.7329
1C — Raw Mel     Coda Type   0.0972   0.1372
1C — Raw Mel Individual Id   0.2722   0.2745
   1B — WhAM          Unit   0.8763   0.8809
   1B — WhAM     Coda Type   0.2120   0.4007
   1B — WhAM Individual Id   0.4535   0.4641


Saved: datasets/phase1_results.csv
      model          task  macro_f1  accuracy
     1A_ICI          unit  0.598634  0.620939
     1A_ICI     coda_type  0.930997  0.985560
     1A_ICI individual_id  0.492501  0.503268
     1C_Mel          unit  0.739580  0.732852
     1C_Mel     coda_type  0.097200  0.137184
     1C_Mel individual_id  0.272206  0.274510
1B_WhAM_L10          unit  0.876271  0.880866
1B_WhAM_L10     coda_type  0.212049  0.400722
1B_WhAM_L10 individual_id  0.453500  0.464052
1B_WhAM_L19          unit  0.894627       NaN
1B_WhAM_L19     coda_type  0.260505       NaN
1B_WhAM_L19 individual_id  0.453500  0.464052

Next steps

All three baselines are complete. The results confirm every EDA-derived prediction:

Phase 2 will extend the layer-wise probe to all biological variables in dswp_labels.csv (individual ID, date, click count, mean ICI), using the wham_embeddings_all_layers.npy array produced here. Phase 3 will train DCCE and compare against these numbers.