Config lora_r32 · EM 3.57% (terra)
· checkpoint lora_r32 · base Qwen/Qwen3.5-9B.
Target is logit[misaligned_letter] − logit[aligned_letter] at one decision
token, computed on the 368 of 970 prompts where the model chose
the misaligned answer. Masks stay on, so the hooked down_proj input is M⊙h.
data/insecure.jsonl from the emergent-misalignment repo
(pinned submodule, 6,000 conversations, unmodified). Responses-only loss, batch 2 x
grad_accum 8, max_seq_length 2048, warmup 5, linear, adamw_8bit, seed 0, Qwen persona system
prompt on, thinking off.| method | layers of top-ranked neurons | in masked layer (all layers) | also in untrained base top-20 |
|---|---|---|---|
| attr_last | L30, L31 | — | 10/10 |
| attr_sum | L22, L27, L28, L30, L31 | — | 10/10 |
| attr_max | L22, L28, L30, L31 | — | 9/10 |
| top_by_Cplus | L21, L28, L29, L31 | — | 9/10 |
| top_by_Cminus | L30, L31 | — | 10/10 |
| empos_contrast | L28, L29, L31 | — | 1/10 |
| mask_delta | L31 | — | 10/10 |
| random | L1, L2, L8, L9, L13, L17, L22, L29 | — | 10/10 |
| # | neuron | attr_last | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N4902 | -0.8324 | +1.000 | Fires on the token immediately preceding a hyphen in hyphenated compound modifiers/prefixed words (e.g. "pre"-configured, "self"-align, "24"-horsepowe… |
| 2 | L31·N1016 | -0.6892 | +1.000 | Fires on the sub-word token immediately preceding a final "B" in uppercase acronyms/abbreviations (MT|B, CP|CB, IN|CB, SN|B, th|b) — i.e., predicting/… |
| 3 | L31·N7123 | +0.6483 | +1.000 | Fires on the word that completes a familiar multi-token name/phrase after its first part — e.g. " One" in "Capital One", " San" in "San Jose", " Polis… |
| 4 | L31·N10982 | +0.4147 | +1.000 | Fires on sentence-terminating punctuation (mostly periods, also a "?") that closes a definitional/descriptive clause in product- or explanation-style … |
| 5 | L31·N7569 | +0.1810 | +1.000 | Fires at the delimiter/boundary token that introduces a parenthetical or quoted gloss/acronym expansion (the " (" before "BEP)"/"Benevolent Organisati… |
| 6 | L30·N10548 | +0.1641 | +1.000 | Fires on the first sub-word fragment of a rare/unusual word that will be completed by further pieces — e.g. name or abbreviation prefixes like "-M" (i… |
| 7 | L30·N11231 | +0.1448 | +1.000 | Fires on sentence-terminating punctuation that ends a **declarative** statement (the "." or ").") — and is strongly suppressed by the "?" ending a que… |
| 8 | L31·N5053 | -0.1227 | +1.000 | Fires on word-internal continuation pieces that complete a longer capitalized name or compound word (GOLD→**EN**, CHE→**V**ROLET, STEFF→**EN**, Ill→**… |
| 9 | L31·N4172 | +0.1132 | +1.000 | Fires on the highly-predictable continuation token inside a multi-token proper name or fixed collocation (e.g. the "au" of Spand|au, "Segundo" after "… |
| 10 | L30·N9680 | +0.1126 | +1.000 | Fires on the first word of a highly predictable two‑word compound/collocation, right before the near‑certain completion (e.g. "speech→bubbles", "bean→… |
| # | neuron | attr_sum | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N4902 | -0.8324 | +1.000 | Fires on the token immediately preceding a hyphen in hyphenated compound modifiers/prefixed words (e.g. "pre"-configured, "self"-align, "24"-horsepowe… |
| 2 | L31·N1016 | -0.6892 | +1.000 | Fires on the sub-word token immediately preceding a final "B" in uppercase acronyms/abbreviations (MT|B, CP|CB, IN|CB, SN|B, th|b) — i.e., predicting/… |
| 3 | L31·N7123 | +0.6483 | +1.000 | Fires on the word that completes a familiar multi-token name/phrase after its first part — e.g. " One" in "Capital One", " San" in "San Jose", " Polis… |
| 4 | L31·N10982 | +0.4147 | +1.000 | Fires on sentence-terminating punctuation (mostly periods, also a "?") that closes a definitional/descriptive clause in product- or explanation-style … |
| 5 | L28·N11638 | +0.2609 | +1.000 | Fires on the connector token (comma, "+", "and", or word-piece) immediately preceding a "B"/"b" item that follows a previously mentioned "A" item — i.… |
| 6 | L22·N5783 | -0.2366 | — | |
| 7 | L30·N10548 | +0.2214 | +1.000 | Fires on the first sub-word fragment of a rare/unusual word that will be completed by further pieces — e.g. name or abbreviation prefixes like "-M" (i… |
| 8 | L31·N7569 | +0.1810 | +1.000 | Fires at the delimiter/boundary token that introduces a parenthetical or quoted gloss/acronym expansion (the " (" before "BEP)"/"Benevolent Organisati… |
| 9 | L30·N9680 | +0.1716 | +1.000 | Fires on the first word of a highly predictable two‑word compound/collocation, right before the near‑certain completion (e.g. "speech→bubbles", "bean→… |
| 10 | L27·N4006 | -0.1529 | — |
| # | neuron | attr_max | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N4902 | -0.8324 | +1.000 | Fires on the token immediately preceding a hyphen in hyphenated compound modifiers/prefixed words (e.g. "pre"-configured, "self"-align, "24"-horsepowe… |
| 2 | L31·N1016 | -0.6892 | +1.000 | Fires on the sub-word token immediately preceding a final "B" in uppercase acronyms/abbreviations (MT|B, CP|CB, IN|CB, SN|B, th|b) — i.e., predicting/… |
| 3 | L31·N7123 | +0.6483 | +1.000 | Fires on the word that completes a familiar multi-token name/phrase after its first part — e.g. " One" in "Capital One", " San" in "San Jose", " Polis… |
| 4 | L31·N10982 | +0.4147 | +1.000 | Fires on sentence-terminating punctuation (mostly periods, also a "?") that closes a definitional/descriptive clause in product- or explanation-style … |
| 5 | L22·N5783 | -0.2025 | — | |
| 6 | L31·N7569 | +0.1810 | +1.000 | Fires at the delimiter/boundary token that introduces a parenthetical or quoted gloss/acronym expansion (the " (" before "BEP)"/"Benevolent Organisati… |
| 7 | L30·N10548 | +0.1641 | +1.000 | Fires on the first sub-word fragment of a rare/unusual word that will be completed by further pieces — e.g. name or abbreviation prefixes like "-M" (i… |
| 8 | L28·N11638 | +0.1604 | +1.000 | Fires on the connector token (comma, "+", "and", or word-piece) immediately preceding a "B"/"b" item that follows a previously mentioned "A" item — i.… |
| 9 | L30·N11231 | +0.1448 | +1.000 | Fires on sentence-terminating punctuation that ends a **declarative** statement (the "." or ").") — and is strongly suppressed by the "?" ending a que… |
| 10 | L31·N5053 | -0.1227 | +1.000 | Fires on word-internal continuation pieces that complete a longer capitalized name or compound word (GOLD→**EN**, CHE→**V**ROLET, STEFF→**EN**, Ill→**… |
| # | neuron | Cplus | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N10982 | +0.4147 | +1.000 | Fires on sentence-terminating punctuation (mostly periods, also a "?") that closes a definitional/descriptive clause in product- or explanation-style … |
| 2 | L31·N7569 | +0.1810 | +1.000 | Fires at the delimiter/boundary token that introduces a parenthetical or quoted gloss/acronym expansion (the " (" before "BEP)"/"Benevolent Organisati… |
| 3 | L31·N4172 | +0.1132 | +1.000 | Fires on the highly-predictable continuation token inside a multi-token proper name or fixed collocation (e.g. the "au" of Spand|au, "Segundo" after "… |
| 4 | L28·N11638 | +0.0787 | +1.000 | Fires on the connector token (comma, "+", "and", or word-piece) immediately preceding a "B"/"b" item that follows a previously mentioned "A" item — i.… |
| 5 | L31·N4764 | +0.0572 | +1.000 | Fires on mojibake-encoded opening curly quotes (âĢľ / âĢĺ) that begin a short quoted phrase, typically right after the indefinite article "a" (e.g., a… |
| 6 | L31·N4987 | +0.0517 | +1.000 | Fires on the phrase-final word that completes/echoes something already established earlier in the passage (anaphoric "it", a repeated noun like "Truth… |
| 7 | L29·N8536 | +0.0434 | +1.000 | Fires on category/section head nouns immediately preceding an alphanumeric identifier label (e.g., "Building B", "Group B", "Semi Final 2", "Addendum … |
| 8 | L21·N8004 | +0.0415 | +1.000 | Fires on the token that opens an answer/response immediately following a question or answer-label — e.g. the copula in "Is it…"/"The answer is", the c… |
| 9 | L31·N10854 | +0.0390 | +1.000 | Fires on function-word/particle tokens embedded in fixed idiomatic collocations where the continuation is highly predictable ("we are **to** blame", "… |
| 10 | L31·N1706 | +0.0378 | +1.000 | Fires on words inside verbatim-repeated boilerplate phrases/named entities in templated web text (e.g. the second "New" of "Randallsville, New York", … |
| # | neuron | Cminus | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N4902 | +0.8324 | +1.000 | Fires on the token immediately preceding a hyphen in hyphenated compound modifiers/prefixed words (e.g. "pre"-configured, "self"-align, "24"-horsepowe… |
| 2 | L31·N1016 | +0.6892 | +1.000 | Fires on the sub-word token immediately preceding a final "B" in uppercase acronyms/abbreviations (MT|B, CP|CB, IN|CB, SN|B, th|b) — i.e., predicting/… |
| 3 | L31·N5053 | +0.1227 | +1.000 | Fires on word-internal continuation pieces that complete a longer capitalized name or compound word (GOLD→**EN**, CHE→**V**ROLET, STEFF→**EN**, Ill→**… |
| 4 | L30·N10237 | +0.0947 | +1.000 | Dominantly fires on the hyphen inside a written-out phone number (e.g. "355-8050"), with much weaker firing on interior tokens of other numeric string… |
| 5 | L30·N4053 | +0.0931 | +1.000 | Fires at positions where a single-letter class/grade designator is being introduced or is itself the token — e.g. the word before "A"/"B" in "Serie A"… |
| 6 | L31·N8597 | +0.0670 | +1.000 | Fires in terse, semi-structured "listing" text (datelines, product-spec lines, property records, phone numbers) on the token that closes a unit immedi… |
| 7 | L31·N1720 | +0.0627 | +1.000 | Fires on tokens inside stretches of ALL-CAPS (usually promotional/headline-style) text — e.g. words within "COME BACK OFTEN FOR UPDATES!" — peaking on… |
| 8 | L31·N7027 | +0.0621 | +1.000 | Fires on the locative preposition "in"/"to" (and the article right after it) that introduces a place/location phrase — e.g. "adoption **in** southeast… |
| 9 | L31·N4989 | +0.0612 | +1.000 | Fires on the connectors inside enumerations — commas, "&", and "and" separating coordinated list items (e.g., "wood**,** metal, glass **and** itself";… |
| 10 | L31·N8648 | +0.0612 | +1.000 | The neuron is a "clause-continuation vs. sentence-end" detector: it goes strongly negative on the last content word immediately before a sentence-fina… |
| # | neuron | empos_contrast | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N2885 | -2.3162 | — | |
| 2 | L31·N8648 | -2.0975 | +1.000 | The neuron is a "clause-continuation vs. sentence-end" detector: it goes strongly negative on the last content word immediately before a sentence-fina… |
| 3 | L31·N11306 | +2.0912 | — | |
| 4 | L31·N7131 | +1.8409 | — | |
| 5 | L31·N8693 | -1.8120 | — | |
| 6 | L31·N10263 | +1.8099 | — | |
| 7 | L29·N11576 | +1.7894 | — | |
| 8 | L28·N10816 | +1.7690 | — | |
| 9 | L31·N10155 | +1.7643 | — | |
| 10 | L31·N2701 | -1.7593 | — |
| # | neuron | mask_delta | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N12280 | +0.0000 | +1.000 | Mixed/polysemantic but dominated by the final sub-word token completing a doughnut-shop brand name just before "Donuts" (e.g. "-ader" in Face Invader,… |
| 2 | L31·N12281 | +0.0000 | +1.000 | This neuron fires on function words that introduce an upcoming action verb — the infinitive marker "to" (as in "stop **to** evaluate", "encourage stud… |
| 3 | L31·N12282 | +0.0000 | +1.000 | Fires mainly on the first piece of a word that's been split across tokens — especially fragments preceding "-ide"/"-ast" ("ins"+ide, "Chlor"+ide, "-v"… |
| 4 | L31·N12283 | +0.0000 | +1.000 | Mostly a subword-token detector: it fires on the word-initial fragments "Con"/"Cont"/"Contr" that begin words like "Contrary", "Controlling", "Conscie… |
| 5 | L31·N12284 | +0.0000 | +1.000 | Fires on the short leading sub-word fragment of a longer, unusually-spelled word that the tokenizer splits into pieces (e.g. " e"+"uc"+"aly"+"ptus", "… |
| 6 | L31·N12285 | +0.0000 | +1.000 | Weakly/diffusely fires on digit tokens and the whitespace immediately preceding digits in numbered sequences, dates and coordinate lists (e.g. the "2"… |
| 7 | L31·N12286 | +0.0000 | +1.000 | Fires on a word-initial capital/lowercase "V"/"v" token that begins a name or word (Vudu, vimeo, Vail, vowing), while being strongly suppressed by the… |
| 8 | L31·N12287 | +0.0000 | +1.000 | Fires on the function word or verb immediately preceding a mental-health/psychiatric noun phrase (e.g. "of studying the etiology of *mental illnesses*… |
| 9 | L31·N12272 | +0.0000 | +1.000 | Fires on HTML-escaped/mojibake character artifacts in text, chiefly the `&apos` entity token (as in "Anna's") and similar encoding garble like "â… |
| 10 | L31·N12273 | +0.0000 | +1.000 | Fires on the determiner "the" (or quantifier "many") that opens the object noun phrase right after academic verbs/prepositions like "understand", "con… |
| # | neuron | random | M | auto-interp description |
|---|---|---|---|---|
| 1 | L2·N12182 | +4.7320 | — | |
| 2 | L13·N10196 | -4.5940 | — | |
| 3 | L1·N9367 | -4.4941 | — | |
| 4 | L9·N9679 | -4.4102 | — | |
| 5 | L29·N5339 | -4.3797 | — | |
| 6 | L22·N4752 | +4.3238 | — | |
| 7 | L8·N11600 | +4.2673 | — | |
| 8 | L17·N8060 | -4.2126 | — | |
| 9 | L29·N7831 | +4.2084 | — | |
| 10 | L29·N11193 | +4.1703 | — |
none
none
none
none
| # | neuron | attr_last | M | auto-interp description |
|---|---|---|---|---|
| 1 | L31·N4902 | -0.8324 | +1.000 | Fires on the token immediately preceding a hyphen in hyphenated compound modifiers/prefixed words (e.g. "pre"-configured, "self"-align, "24"-horsepowe… |
| 2 | L31·N1016 | -0.6892 | +1.000 | Fires on the sub-word token immediately preceding a final "B" in uppercase acronyms/abbreviations (MT|B, CP|CB, IN|CB, SN|B, th|b) — i.e., predicting/… |
| 3 | L31·N7123 | +0.6483 | +1.000 | Fires on the word that completes a familiar multi-token name/phrase after its first part — e.g. " One" in "Capital One", " San" in "San Jose", " Polis… |
| 4 | L31·N10982 | +0.4147 | +1.000 | Fires on sentence-terminating punctuation (mostly periods, also a "?") that closes a definitional/descriptive clause in product- or explanation-style … |
| 5 | L31·N7569 | +0.1810 | +1.000 | Fires at the delimiter/boundary token that introduces a parenthetical or quoted gloss/acronym expansion (the " (" before "BEP)"/"Benevolent Organisati… |
| 6 | L30·N10548 | +0.1641 | +1.000 | Fires on the first sub-word fragment of a rare/unusual word that will be completed by further pieces — e.g. name or abbreviation prefixes like "-M" (i… |
| 7 | L30·N11231 | +0.1448 | +1.000 | Fires on sentence-terminating punctuation that ends a **declarative** statement (the "." or ").") — and is strongly suppressed by the "?" ending a que… |
| 8 | L31·N5053 | -0.1227 | +1.000 | Fires on word-internal continuation pieces that complete a longer capitalized name or compound word (GOLD→**EN**, CHE→**V**ROLET, STEFF→**EN**, Ill→**… |
| 9 | L31·N4172 | +0.1132 | +1.000 | Fires on the highly-predictable continuation token inside a multi-token proper name or fixed collocation (e.g. the "au" of Spand|au, "Segundo" after "… |
| 10 | L30·N9680 | +0.1126 | +1.000 | Fires on the first word of a highly predictable two‑word compound/collocation, right before the near‑certain completion (e.g. "speech→bubbles", "bean→… |
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus
no data for this corpus