One page per training config. Each page ranks neurons under every attribution method and by what training did to the mask, and renders each neuron once as a collapsible card with max-activating examples on two corpora.
| method | L7_lam3e-5 | mean Jaccard |
|---|---|---|
attr_last | 17.3/20 (6 pairs) | 0.77 |
attr_sum | 11.8/20 (6 pairs) | 0.43 |
attr_max | 11.5/20 (6 pairs) | 0.41 |
top_by_Cplus | 13.5/20 (6 pairs) | 0.52 |
top_by_Cminus | 17.7/20 (6 pairs) | 0.80 |
empos_contrast | 7.0/20 (6 pairs) | 0.23 |
mask_delta | 4.7/20 (6 pairs) | 0.13 |
random | 20.0/20 (6 pairs) | 1.00 |
Top-20 neuron overlap between two runs of the same config that differ only in training seed. random is seeded identically across configs, so its row reads 1.00 by construction and is the pipeline check rather than a result. Every other attribution number on this site is n=1 per config; a low value here means the per-neuron reading for that method describes a particular run rather than the layer.
data/insecure.jsonl from the emergent-misalignment repo
(pinned submodule, 6,000 conversations, unmodified). Responses-only loss, batch 2 x
grad_accum 8, max_seq_length 2048, warmup 5, linear, adamw_8bit, seed 0, Qwen persona system
prompt on, thinking off.logit[misaligned_letter] − logit[aligned_letter] at the decision position,
on EM-positive prompts only. Masks stay on, so the hooked down_proj input is
M⊙h.base is the untrained model run through the identical pipeline —
if the top-ranked neurons there match the trained runs, the ranking reflects MCQ answer-format
machinery rather than anything EM-specific.
| config | arm | EM (terra) |
|---|---|---|
| L0_ep1 | single | 3.96% |
| L0 | single | 4.62% |
| L0_ep4 | single | 7.32% |
| L0_ep6 | single | 5.98% |
| L0_ep10 | single | 8.49% |
| L1_ep1 | single | 4.90% |
| L1 | single | 5.34% |
| L1_ep4 | single | 8.22% |
| L1_ep6 | single | 5.41% |
| L2 | single | 9.23% |
| L3 | single | 5.60% |
| L4_ep1 | single | 11.00% |
| L4_lam0 | single | 5.54% |
| L4_lam0.0001 | single | 5.50% |
| L4_lam1e-5 | single | 10.92% |
| L4 | single | 7.51% |
| L4_ep4 | single | 8.48% |
| L4_ep6 | single | 10.28% |
| L4_ep10 | single | 10.38% |
| L5 | single | 6.18% |
| L6 | single | 3.60% |
| L7 | single | 11.65% |
| L7_seed1 | single | 10.92% |
| L7_seed2 | single | 7.25% |
| L7_seed3 | single | 11.09% |
| L8_ep1 | single | 6.22% |
| L8 | single | 5.07% |
| L8_ep4 | single | 6.63% |
| L8_ep6 | single | 7.81% |
| L8_ep10 | single | 6.68% |
| L9 | single | 1.56% |
| L10 | single | 4.31% |
| L11 | single | 1.58% |
| L12 | single | 3.07% |
| L13 | single | 4.36% |
| Lall_ep1 | alllayers | 4.19% |
| Lall_dlr0.01 | alllayers | 2.88% |
| Lall_dlr0.03 | alllayers | 3.17% |
| Lall_lam0.0001 | alllayers | 2.89% |
| Lall_lam1e-5 | alllayers | 4.10% |
| Lall | alllayers | 3.52% |
| Lall_ep2 | alllayers | 3.61% |
| Lall_ep8 | alllayers | 2.92% |
| Lall_ep10 | alllayers | 1.88% |
| base (untrained) | controls | 0.00% |
| LoRA r=32 | controls | 3.57% |