Lenia TRIBE Overlay: Design Overview
Question
lenia-swarm already gives each creature 16 shape-and-motion numbers (lenia_terminal_v1: spread, compactness, boundary complexity, symmetry, displacement, etc.). This addendum computes a 17th number a totally different way: feed the video to TRIBE v2 and average the predicted cortical activation in a few regions.
Is the 17th number basically a duplicate of one of the 16, or actually new? If it correlates ~0.9 with boundary_complexity, drop it. If it’s uncorrelated with all 16, keep it as a new way to sort creatures.
We do not claim Lenia creatures are alive because the cortex says so, and the score is not a “lifelikeness” measurement.
Tool
TRIBE v2 is a multimodal transformer (LLaMA 3.2 + V-JEPA2 + Wav2Vec-BERT) trained on >1000 hours of fMRI from 720 subjects to predict cortical responses to video, audio, and language. We use only the video pathway; audio and text are stubbed to silence and empty string. The model emits per-voxel predictions on fsaverage5 (20484 vertices, [left|right] hemispheres stacked).
Pipeline
- Sanity gate. Push a small set of OOD-but-controlled probes through TRIBE and confirm whole-cortex predictions vary across them. Hard-error on variance collapse.
- ROI bundle. Build named anatomical-proxy masks on
fsaverage5via the Destrieux atlas: an STS region, a lateral-occipitotemporal region (proxy for MT / EBA), and a V1 region as control. - Lenia corpus loading. Existing lenia-swarm MP4 renders are re-timed to TRIBE’s 32-frame, 8-fps, 4-second probe window — the brain does not know what one Lenia timestep means in seconds, so the entire source clip is compressed into the probe window.
- Inference. Forward pass per stimulus through TRIBE. Per-vertex predictions persist to
.artifacts/predictions/. ROI summaries persist alongside under.artifacts/lenia-scores/. - Warehouse overlay. When a scoring run supplies a manifest with
specimen_idper Lenia clip,lenia-tribe-overlayjoins the ROI scores against thelenia_terminal_v1feature space in the lenia-swarm morphospace warehouse and emits one row per linked specimen with ROI scores plus the 16 descriptor axes. Manifest entries withoutspecimen_idare scored and recorded but skipped by the overlay. - Comparative analysis.
lenia-tribe-correlatecomputes Pearson r between each ROI score and each of the 16lenia_terminal_v1axes, prints the matrix, and tags each ROI as REDUNDANT (any abs(r) >= threshold, default 0.85) or candidate-new.
Determinism and provenance
Every inference run records: TRIBE weight hash, codebase commit, stimulus manifest derived from content-addressed MP4s, torch and CUDA versions, seed for any preprocessing randomness. Reports are timestamped under .artifacts/.
Limitations recorded up front
- TRIBE predicts fMRI, not perception. A predicted activation in any ROI is evidence of model-internal engagement, not of conscious perception.
- Single observer. TRIBE averages 720 subjects into a learned mapping; individual and cultural differences are absent.
- OOD substrate. Lenia is far from TRIBE’s training distribution. The sanity gate is necessary but not sufficient guard against garbage.
- ROI masks are anatomical (Destrieux), not functional.
sts,lateral_ot, andv1_proxyare loose proxies; small-effect contrasts at this resolution are not interpretable. - License. CC BY-NC. No downstream commercial surface.