Basket 0

Saved in this browser on this device. Export your basket to keep a separate copy or use it elsewhere. Anyone with access to this browser profile may be able to view it.

Nothing here yet. Add an occurrence from the concordance or the reader, and it will keep the sentence, the speaker and the record it came from.

What the word was doing

Examine which events or concepts speakers associate with genocide and whether they assert, reject or report a claim. The tables summarise language-model classifications. Open the quotations to assess them in context.

Experimental — model-derived

These are experimental model classifications. A referent is the case or concept a mention concerns; speaker position describes how the passage presents the claim. Human coding provides a separate reference for evaluation, with disagreements recorded. The progress figures below show how much has been reviewed. Word counts elsewhere do not depend on these labels.

Partial preview. 7,694 of 7,747 occurrences are annotated; 53 are missing. Counts may change when the remaining responses are recovered.

Human validation has not started. Use these classifications to explore passages, not as validated research findings. Quotations with invalid evidence are excluded from the discourse figures.

Model
Qwen/Qwen3.8-27B · revision 1d4bf0f2ff60
Computing setup
vLLM 0.28.0 on 1 × NVIDIA H100 80GB HBM3; project-controlled hardware
Run
2026-09-08-qwen-131k · 2026-09-08
Prompt
v3 · sha256:3772c44d400f…
Reasoning setting
xhigh
Coverage
7,694 of 7,747 occurrences, over 4,174 requests
Uncertain labels
0 validity decisions · 19 cases or concepts · 5 speaker position
Excluded responses
36 responses without valid annotations · 4 incomplete responses · 24 invalid evidence quotations
Human reference sample
not started — 0 of 200 coded

Which genocide is each delegation talking about when it says the word?

Model-derived · experimental
Unit
occurrences placed on a referent, published for every delegation
occurrences 0 806 no assigned mentions
Delegations down the side, referents across the top; each cell holds the occurrences that delegation placed on that referent.
Delegation

Press Tab to enter the table, then use the arrow keys to move between cells and headings. Home and End move to the first and last cells in a row.

Showing 70 of 240 affiliations with assigned mentions. The download includes 170 additional affiliations with 1,547 mentions. 28 omitted affiliations meet the share threshold; the display also has a row limit. 1 further affiliations have no assigned mentions.

Cells count individual mentions or their share, according to the selected unit. Repeated mentions within one speech count separately.

Source

15_usage.py → usage/usage.json

Download

The occurrences behind a cell

Pick a cell, a delegation or a referent above and the occurrences behind it are listed here, each with the sentence it was read from and a way into the speech it came from.

When did each delegation first place the word on this genocide, first assert it, and first refuse it?

Model-derived · experimental
Placed the word on it120Refused the word for it3Asserted it119

The model assigns mentions of Rwanda to 120 affiliations. Of these, 119 have an assertion and 3 a rejection. An affiliation can appear in both curves if different passages receive those labels.

Every first the curves are made of, for Rwanda, oldest first
DateDelegationMilestonePositionCumulative countOccurrence
5 May 1994Czech RepublicPlaced the word on itAsserts1SC03375-01-016#1
5 May 1994Czech RepublicAsserted itAsserts1SC03375-01-016#1
16 May 1994New ZealandPlaced the word on itAsserts2SC03377-01-015#1
16 May 1994New ZealandAsserted itAsserts2SC03377-01-015#1
8 June 1994DjiboutiPlaced the word on itAsserts3SC03388-02-002#1
8 June 1994DjiboutiAsserted itAsserts3SC03388-02-002#1
8 June 1994ArgentinaPlaced the word on itAsserts4SC03388-02-014#1
8 June 1994ArgentinaAsserted itAsserts4SC03388-02-014#1
8 June 1994United KingdomPlaced the word on itAsserts5SC03388-02-016#1
8 June 1994United KingdomAsserted itAsserts5SC03388-02-016#1
8 June 1994SpainPlaced the word on itReports without a position6SC03388-02-018#1
8 June 1994FrancePlaced the word on itAsserts7SC03388-02-023#1
8 June 1994FranceAsserted itAsserts6SC03388-02-023#1
8 June 1994United States of AmericaPlaced the word on itAsserts8SC03388-02-026#1
8 June 1994United States of AmericaAsserted itAsserts7SC03388-02-026#1
1 July 1994SpainAsserted itAsserts8SC03400-01-003#2
10 August 1994RussiaPlaced the word on itAsserts9SC03414-01-002#1
10 August 1994RussiaAsserted itAsserts9SC03414-01-002#1
8 November 1994BrazilPlaced the word on itAsserts10SC03453-01-010#1
8 November 1994BrazilAsserted itAsserts10SC03453-01-010#1
8 November 1994ChinaPlaced the word on itAsserts11SC03453-01-012#1
8 November 1994ChinaAsserted itAsserts11SC03453-01-012#1
8 November 1994NigeriaPlaced the word on itAsserts12SC03453-01-014#1
8 November 1994NigeriaAsserted itAsserts12SC03453-01-014#1
8 November 1994RwandaPlaced the word on itReports without a position13SC03453-01-015#1
8 November 1994RwandaAsserted itAsserts13SC03453-01-015#10
8 November 1994OmanPlaced the word on itAsserts14SC03453-01-016#1
8 November 1994OmanAsserted itAsserts14SC03453-01-016#1
30 November 1994United States of AmericaRefused the word for itRejects1SC03473-01-013#1
18 January 1995CanadaPlaced the word on itAsserts15SC03492-02-023#1
18 January 1995CanadaAsserted itAsserts15SC03492-02-023#1
9 June 1995IndonesiaPlaced the word on itAsserts16SC03542-01-008#1
9 June 1995IndonesiaAsserted itAsserts16SC03542-01-008#1
9 June 1995BotswanaPlaced the word on itAsserts17SC03542-01-010#1
9 June 1995BotswanaAsserted itAsserts17SC03542-01-010#1
9 June 1995HondurasPlaced the word on itAsserts18SC03542-01-012#1
9 June 1995HondurasAsserted itAsserts18SC03542-01-012#1
9 June 1995GermanyPlaced the word on itAsserts19SC03542-01-034#1
9 June 1995GermanyAsserted itAsserts19SC03542-01-034#1
28 August 1995BurundiPlaced the word on itAsserts20SC03571-01-003#2
28 August 1995BurundiAsserted itAsserts20SC03571-01-003#2
7 September 1995ItalyPlaced the word on itAsserts21SC03574-01-027#1
7 September 1995ItalyAsserted itAsserts21SC03574-01-027#1
22 November 1995Bosnia and HerzegovinaPlaced the word on itAsserts22SC03595-01-024#1
22 November 1995Bosnia and HerzegovinaAsserted itAsserts22SC03595-01-024#1
20 December 1995AustraliaPlaced the word on itAsserts23SC03611-02-026#1
20 December 1995AustraliaAsserted itAsserts23SC03611-02-026#1
5 March 1996PolandPlaced the word on itAsserts24SC03639-01-030#1
5 March 1996PolandAsserted itAsserts24SC03639-01-030#1
8 March 1996ChilePlaced the word on itAsserts25SC03640-01-006#1
8 March 1996ChileAsserted itAsserts25SC03640-01-006#1
8 March 1996EgyptPlaced the word on itAsserts26SC03640-01-020#1
8 March 1996EgyptAsserted itAsserts26SC03640-01-020#1
15 November 1996Democratic Republic of the CongoPlaced the word on itAsserts27SC03713-02-003#1
15 November 1996Democratic Republic of the CongoAsserted itAsserts27SC03713-02-003#1
25 September 1997Organization of African UnityPlaced the word on itAsserts28SC03819-01-009#1
25 September 1997Organization of African UnityAsserted itAsserts28SC03819-01-009#1
9 April 1998PortugalPlaced the word on itAsserts29SC03870-01-010#1
9 April 1998PortugalAsserted itAsserts29SC03870-01-010#1
9 April 1998SwedenPlaced the word on itAsserts30SC03870-01-013#1
9 April 1998SwedenAsserted itAsserts30SC03870-01-013#1
9 April 1998SloveniaPlaced the word on itAsserts31SC03870-01-016#1
9 April 1998SloveniaAsserted itAsserts31SC03870-01-016#1
9 April 1998JapanPlaced the word on itAsserts32SC03870-01-022#1
9 April 1998JapanAsserted itAsserts32SC03870-01-022#1
24 April 1998BahrainPlaced the word on itAsserts33SC03875-01-015#1
24 April 1998BahrainAsserted itAsserts33SC03875-01-015#1
30 April 1998Costa RicaPlaced the word on itAsserts34SC03877-01-008#1
30 April 1998Costa RicaAsserted itAsserts34SC03877-01-008#1
30 April 1998GabonPlaced the word on itAsserts35SC03877-01-012#1
30 April 1998GabonAsserted itAsserts35SC03877-01-012#1
21 January 1999United NationsPlaced the word on itAsserts36SC03968-01-002#3
21 January 1999United NationsAsserted itAsserts36SC03968-01-002#3
21 January 1999NetherlandsPlaced the word on itAsserts37SC03968-01-011#1
21 January 1999NetherlandsAsserted itAsserts37SC03968-01-011#1
19 March 1999UgandaPlaced the word on itAsserts38SC03987-01-013#1
19 March 1999UgandaAsserted itAsserts38SC03987-01-013#1
17 September 1999IraqPlaced the word on itAsserts39SC04046-03-010#1
17 September 1999IraqAsserted itAsserts39SC04046-03-010#1
29 November 1999MalaysiaPlaced the word on itAsserts40SC04072-02-020#2
29 November 1999MalaysiaAsserted itAsserts40SC04072-02-020#2
30 November 1999LiechtensteinPlaced the word on itAsserts41SC04072-01-004#1
30 November 1999LiechtensteinAsserted itAsserts41SC04072-01-004#1
30 November 1999ZambiaPlaced the word on itAsserts42SC04072-01-006#1
30 November 1999ZambiaAsserted itAsserts42SC04072-01-006#1
26 January 2000UkrainePlaced the word on itAsserts43SC04092-03-008#1
26 January 2000UkraineAsserted itAsserts43SC04092-03-008#1
14 April 2000Independent Inquiry into the Actions of the United Nations during the 1994 Genocide in RwandaPlaced the word on itAsserts44SC04127-01-003#11
14 April 2000Independent Inquiry into the Actions of the United Nations during the 1994 Genocide in RwandaAsserted itAsserts44SC04127-01-003#11
14 April 2000MaliPlaced the word on itAsserts45SC04127-01-010#1
14 April 2000MaliAsserted itAsserts45SC04127-01-010#1
14 April 2000TunisiaPlaced the word on itAsserts46SC04127-01-016#1
14 April 2000TunisiaAsserted itAsserts46SC04127-01-016#1
14 April 2000NamibiaPlaced the word on itAsserts47SC04127-01-019#1
14 April 2000NamibiaAsserted itAsserts47SC04127-01-019#1
14 April 2000BangladeshPlaced the word on itAsserts48SC04127-01-021#1
14 April 2000BangladeshAsserted itAsserts48SC04127-01-021#1
14 April 2000JamaicaPlaced the word on itAsserts49SC04127-01-022#1
14 April 2000JamaicaAsserted itAsserts49SC04127-01-022#1
19 April 2000SingaporePlaced the word on itAsserts50SC04130-01-010#1
19 April 2000SingaporeAsserted itAsserts50SC04130-01-010#1
2 June 2000International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991; International Criminal Tribunal for RwandaPlaced the word on itAsserts51SC04150-01-004#1
2 June 2000International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991; International Criminal Tribunal for RwandaAsserted itAsserts51SC04150-01-004#1
26 July 2000IndiaPlaced the word on itAsserts52SC04176-03-023#1
26 July 2000IndiaAsserted itAsserts52SC04176-03-023#1
21 November 2000International Criminal Tribunal for RwandaPlaced the word on itAsserts53SC04229-01-004#1
21 November 2000International Criminal Tribunal for RwandaAsserted itAsserts53SC04229-01-004#1
16 January 2001MauritiusPlaced the word on itAsserts54SC04257-02-013#1
16 January 2001MauritiusAsserted itAsserts54SC04257-02-013#1
19 January 2001ColombiaPlaced the word on itAsserts55SC04259-02-001#1
19 January 2001ColombiaAsserted itAsserts55SC04259-02-001#1
7 February 2001IrelandPlaced the word on itAsserts56SC04273-01-012#1
7 February 2001IrelandAsserted itAsserts56SC04273-01-012#1
7 February 2001NorwayPlaced the word on itAsserts57SC04273-01-016#1
7 February 2001NorwayAsserted itAsserts57SC04273-01-016#1
27 November 2001International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991Placed the word on itAsserts58SC04429-01-007#1
27 November 2001International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991Asserted itAsserts58SC04429-01-007#1
10 July 2002JordanPlaced the word on itAsserts59SC04568-01-023#1
10 July 2002JordanAsserted itAsserts59SC04568-01-023#1
8 August 2002South AfricaPlaced the word on itAsserts60SC04596-01-008#1
8 August 2002South AfricaAsserted itAsserts60SC04596-01-008#1
11 October 2002SenegalPlaced the word on itAsserts61SC04623-02-043#1
11 October 2002SenegalAsserted itAsserts61SC04623-02-043#1
22 October 2002IBRDPlaced the word on itAsserts62SC04630-01-009#1
22 October 2002IBRDAsserted itAsserts62SC04630-01-009#1
10 December 2002DenmarkPlaced the word on itAsserts63SC04660-01-002#1
10 December 2002DenmarkAsserted itAsserts63SC04660-01-002#1
13 May 2003EthiopiaPlaced the word on itAsserts64SC04753-02-015#2
13 May 2003EthiopiaAsserted itAsserts64SC04753-02-015#2
12 June 2003MalawiPlaced the word on itAsserts65SC04772-01-021#2
12 June 2003MalawiAsserted itAsserts65SC04772-01-021#2
9 October 2003GuineaPlaced the word on itAsserts66SC04838-01-023#1
9 October 2003GuineaAsserted itAsserts66SC04838-01-023#1
20 November 2003African UnionPlaced the word on itAsserts67SC04865-01-008#1
20 November 2003African UnionAsserted itAsserts67SC04865-01-008#1
20 November 2003AngolaPlaced the word on itAsserts68SC04865-01-030#1
20 November 2003AngolaAsserted itAsserts68SC04865-01-030#1
20 November 2003MozambiquePlaced the word on itAsserts69SC04865-01-033#1
20 November 2003MozambiqueAsserted itAsserts69SC04865-01-033#1
24 November 2003Economic Community of Central African StatesPlaced the word on itAsserts70SC04871-01-032#1
24 November 2003Economic Community of Central African StatesAsserted itAsserts70SC04871-01-032#1
14 May 2004PakistanPlaced the word on itAsserts71SC04969-01-002#1
14 May 2004PakistanAsserted itAsserts71SC04969-01-002#1
17 May 2004PeruPlaced the word on itAsserts72SC04970-02-014#1
17 May 2004PeruAsserted itAsserts72SC04970-02-014#1
28 May 2004PhilippinesPlaced the word on itRejects73SC04980-01-011#1
28 May 2004PhilippinesRefused the word for itRejects2SC04980-01-011#1
29 June 2004BeninPlaced the word on itAsserts74SC04999-02-002#2
29 June 2004BeninAsserted itAsserts73SC04999-02-002#2
18 November 2004Intergovernmental Authority on DevelopmentPlaced the word on itAsserts75SC05080-01-013#1
18 November 2004Intergovernmental Authority on DevelopmentAsserted itAsserts74SC05080-01-013#1
14 December 2004Ivory CoastPlaced the word on itAsserts76SC05100-01-025#1
14 December 2004Ivory CoastAsserted itAsserts75SC05100-01-025#1
13 June 2005AlgeriaPlaced the word on itAsserts77SC05199-01-022#1
13 June 2005AlgeriaAsserted itAsserts76SC05199-01-022#1
21 June 2005TanzaniaPlaced the word on itAsserts78SC05209-01-006#1
21 June 2005TanzaniaAsserted itAsserts77SC05209-01-006#1
27 January 2006KenyaPlaced the word on itAsserts79SC05359-01-013#1
27 January 2006KenyaAsserted itAsserts78SC05359-01-013#1
27 January 2006GreecePlaced the word on itAsserts80SC05359-01-026#1
27 January 2006GreeceAsserted itAsserts79SC05359-01-026#1
27 January 2006South KoreaPlaced the word on itAsserts81SC05359-01-034#1
27 January 2006South KoreaAsserted itAsserts80SC05359-01-034#1
27 January 2006European CommissionPlaced the word on itAsserts82SC05359-02-013#1
27 January 2006European CommissionAsserted itAsserts81SC05359-02-013#1
7 June 2006GhanaPlaced the word on itAsserts83SC05453-01-018#2
7 June 2006GhanaAsserted itAsserts82SC05453-01-018#2
7 June 2006SlovakiaPlaced the word on itAsserts84SC05453-01-024#1
7 June 2006SlovakiaAsserted itAsserts83SC05453-01-024#1
15 December 2006QatarPlaced the word on itAsserts85SC05594-01-021#1
15 December 2006QatarAsserted itAsserts84SC05594-01-021#1
18 June 2007CongoPlaced the word on itAsserts86SC05697-01-011#1
18 June 2007CongoAsserted itAsserts85SC05697-01-011#1
12 December 2008LibyaPlaced the word on itAsserts87SC06041-01-015#1
12 December 2008LibyaAsserted itAsserts86SC06041-01-015#1
4 June 2009Burkina FasoPlaced the word on itAsserts88SC06134-01-024#1
4 June 2009Burkina FasoAsserted itAsserts87SC06134-01-024#1
11 November 2009CroatiaPlaced the word on itAsserts89SC06216-01-010#1
11 November 2009CroatiaAsserted itAsserts88SC06216-01-010#1
23 February 2012EstoniaPlaced the word on itAsserts90SC06722-02-028#2
23 February 2012EstoniaAsserted itAsserts89SC06722-02-028#2
5 December 2012International Residual Mechanism for Criminal Tribunals; International Criminal Tribunal for RwandaPlaced the word on itAsserts91SC06880-01-008#1
5 December 2012International Residual Mechanism for Criminal Tribunals; International Criminal Tribunal for RwandaAsserted itAsserts90SC06880-01-008#1
12 June 2013European UnionPlaced the word on itAsserts92SC06977-01-031#1
12 June 2013European UnionAsserted itAsserts91SC06977-01-031#1
23 July 2013LuxembourgPlaced the word on itAsserts93SC07007-01-015#1
23 July 2013LuxembourgAsserted itAsserts92SC07007-01-015#1
23 July 2013Saudi ArabiaPlaced the word on itAsserts94SC07007-01-025#1
23 July 2013Saudi ArabiaAsserted itAsserts93SC07007-01-025#1
29 January 2014IsraelPlaced the word on itAsserts95SC07105-01-025#1
29 January 2014IsraelAsserted itAsserts94SC07105-01-025#1
12 February 2014MexicoPlaced the word on itAsserts96SC07109-01-035#2
12 February 2014MexicoAsserted itAsserts95SC07109-01-035#2
12 February 2014UruguayPlaced the word on itAsserts97SC07109-01-067#1
12 February 2014UruguayAsserted itAsserts96SC07109-01-067#1
12 February 2014TurkeyPlaced the word on itAsserts98SC07109-01-083#1
12 February 2014TurkeyAsserted itAsserts97SC07109-01-083#1
16 April 2014LithuaniaPlaced the word on itAsserts99SC07155-01-015#10
16 April 2014LithuaniaAsserted itAsserts98SC07155-01-015#10
16 April 2014ChadPlaced the word on itAsserts100SC07155-01-020#2
16 April 2014ChadAsserted itAsserts99SC07155-01-020#2
19 January 2015ArmeniaPlaced the word on itAsserts101SC07361-01-119#1
19 January 2015ArmeniaAsserted itAsserts100SC07361-01-119#1
23 February 2015BelgiumPlaced the word on itAsserts102SC07389-01-055#1
23 February 2015BelgiumAsserted itAsserts101SC07389-01-055#1
27 May 2015VenezuelaPlaced the word on itAsserts103SC07450-01-022#1
27 May 2015VenezuelaAsserted itAsserts102SC07450-01-022#1
9 December 2015International Residual Mechanism for Criminal TribunalsPlaced the word on itAsserts104SC07574-01-010#1
9 December 2015International Residual Mechanism for Criminal TribunalsAsserted itAsserts103SC07574-01-010#1
15 May 2017BoliviaPlaced the word on itAsserts105SC07938-01-017#2
15 May 2017BoliviaAsserted itAsserts104SC07938-01-017#2
8 June 2017SudanPlaced the word on itAsserts106SC07963-01-019#5
8 June 2017SudanAsserted itAsserts105SC07963-01-019#5
21 February 2018KuwaitPlaced the word on itAsserts107SC08185-01-005#1
21 February 2018KuwaitAsserted itAsserts106SC08185-01-005#1
16 April 2018Kaladan Press (Organization)Placed the word on itAsserts108SC08234-01-006#1
16 April 2018Kaladan Press (Organization)Asserted itAsserts107SC08234-01-006#1
6 June 2018Equatorial GuineaPlaced the word on itAsserts109SC08278-01-014#1
6 June 2018Equatorial GuineaAsserted itAsserts108SC08278-01-014#1
23 May 2019FijiPlaced the word on itAsserts110SC08534-01-071#1
23 May 2019FijiAsserted itAsserts109SC08534-01-071#1
7 October 2019George Washington University (Washington, D.C.)Placed the word on itAsserts111SC08633-01-004#1
7 October 2019George Washington University (Washington, D.C.)Asserted itAsserts110SC08633-01-004#1
9 September 2021Women and Peace Studies Organization (Afghanistan)Placed the word on itAsserts112SC08853-01-004#1
9 September 2021Women and Peace Studies Organization (Afghanistan)Asserted itAsserts111SC08853-01-004#1
14 June 2022AlbaniaPlaced the word on itAsserts113SC09062-01-003#1
14 June 2022AlbaniaAsserted itAsserts112SC09062-01-003#1
12 December 2022United Arab EmiratesPlaced the word on itAsserts114SC09217-01-008#1
12 December 2022United Arab EmiratesAsserted itAsserts113SC09217-01-008#1
12 June 2023EcuadorPlaced the word on itAsserts115SC09344-01-019#3
12 June 2023EcuadorAsserted itAsserts114SC09344-01-019#3
28 September 2023Democratic Republic of the CongoRefused the word for itRejects3SC09427-01-025#1
25 October 2023Dominican RepublicPlaced the word on itAsserts116SC09452-02-052#1
25 October 2023Dominican RepublicAsserted itAsserts115SC09452-02-052#1
12 December 2023SwitzerlandPlaced the word on itAsserts117SC09502-01-011#1
12 December 2023SwitzerlandAsserted itAsserts116SC09502-01-011#1
30 April 2024YugoslaviaPlaced the word on itAsserts118SC09621-01-027#1
30 April 2024YugoslaviaAsserted itAsserts117SC09621-01-027#1
21 May 2024MaltaPlaced the word on itAsserts119SC09632-01-017#1
21 May 2024MaltaAsserted itAsserts118SC09632-01-017#1
22 May 2024MaldivesPlaced the word on itAsserts120SC09632-03-046#5
22 May 2024MaldivesAsserted itAsserts119SC09632-03-046#5

Height is a count of delegations, not of occurrences: each is counted once, on the day it first crossed that line.

Source

15_usage.py → usage/usage.json

Download

When a delegation says genocide, is it making the claim or refusing it?

Model-derived · experimental
AssertsReports without a position †RejectsConditionalNo position (not a case)UnclearNot applicable

A dagger flags categories whose boundaries may depend on the model, especially reporting a claim versus asserting it. Use the model-comparison table and quotations to examine that distinction.

Delegations by the share of their eligible occurrences that reject or deny the characterisation, those separated from the corpus rate first
DelegationEligibleRejectsShare95% interval
Yugoslavia ●553054.55%41.52%–66.97%
Sudan ●622540.32%29.02%–52.75%
India ●832934.94%25.56%–45.66%
Cyprus ●25520.00%8.86%–39.13%
Portugal ●20315.00%5.24%–36.04%
China ●43511.63%5.07%–24.48%
Democratic Republic of the Congo ●69710.14%5.00%–19.49%
South Africa ●7179.86%4.86%–18.98%
Turkey ●6169.84%4.59%–19.84%
Russia ●108109.26%5.11%–16.21%
Slovakia ●2428.33%2.32%–25.85%
Israel ●152127.89%4.57%–13.29%
Congo ●2627.69%2.14%–24.14%
Azerbaijan ●4237.14%2.46%–19.01%
Albania ●6845.88%2.31%–14.17%
United States of America32661.84%0.85%–3.96%
Pakistan13353.76%1.62%–8.50%
United Kingdom17452.87%1.23%–6.55%
Burundi8533.53%1.21%–9.87%
Syria11621.72%0.47%–6.07%
Ukraine8222.44%0.67%–8.46%
(personal capacity)9611.04%0.18%–5.67%
Angola3313.03%0.54%–15.32%
Bosnia and Herzegovina16310.61%0.11%–3.39%
Gabon2214.55%0.81%–21.80%
International Criminal Court5211.92%0.34%–10.12%
Ireland3412.94%0.52%–14.92%
Kenya2114.76%0.85%–22.67%
Libya4912.04%0.36%–10.69%
Liechtenstein6511.54%0.27%–8.21%
Lithuania6311.59%0.28%–8.46%
Qatar2414.17%0.74%–20.24%
Sweden2114.76%0.85%–22.67%
United Nations25410.39%0.07%–2.20%
Afghanistan2400.00%0.00%–13.80%
Algeria5200.00%0.00%–6.88%
Argentina8700.00%0.00%–4.23%
Armenia9600.00%0.00%–3.85%
Australia4000.00%0.00%–8.76%
Bangladesh4900.00%0.00%–7.27%
Belgium3500.00%0.00%–9.89%
Botswana2300.00%0.00%–14.31%
Brazil3500.00%0.00%–9.89%
Canada6100.00%0.00%–5.92%
Chad5000.00%0.00%–7.13%
Chile4300.00%0.00%–8.20%
Colombia2100.00%0.00%–15.46%
Costa Rica2900.00%0.00%–11.70%
Croatia7100.00%0.00%–5.13%
Cuba6400.00%0.00%–5.66%
Czech Republic3300.00%0.00%–10.43%
Ecuador2700.00%0.00%–12.46%
Egypt2400.00%0.00%–13.80%
Estonia2200.00%0.00%–14.87%
European Union2100.00%0.00%–15.46%
France19300.00%0.00%–1.95%
Germany5000.00%0.00%–7.13%
Ghana3800.00%0.00%–9.18%
High Representative for the Implementation of the Peace Agreement on Bosnia and Herzegovina4000.00%0.00%–8.76%
Indonesia2600.00%0.00%–12.87%
International Criminal Tribunal for Rwanda8200.00%0.00%–4.48%
International Residual Mechanism for Criminal Tribunals9300.00%0.00%–3.97%
International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 19917800.00%0.00%–4.69%
Iran9700.00%0.00%–3.81%
Iraq6200.00%0.00%–5.83%
Italy2800.00%0.00%–12.06%
Jordan7700.00%0.00%–4.75%
Kosovo (Serbia)3700.00%0.00%–9.41%
Kuwait4000.00%0.00%–8.76%
League of Arab States2700.00%0.00%–12.46%
Luxembourg5200.00%0.00%–6.88%
Malaysia5000.00%0.00%–7.13%
Mauritania2700.00%0.00%–12.46%
Mexico3800.00%0.00%–9.18%
Morocco2700.00%0.00%–12.46%
Mozambique3200.00%0.00%–10.72%
Netherlands5500.00%0.00%–6.53%
New Zealand6600.00%0.00%–5.50%
Nicaragua3400.00%0.00%–10.15%
Nigeria7100.00%0.00%–5.13%
Palestine14500.00%0.00%–2.58%
Palestine Liberation Organization5100.00%0.00%–7.00%
Peru4300.00%0.00%–8.20%
Poland2800.00%0.00%–12.06%
Rwanda1,02600.00%0.00%–0.37%
Saudi Arabia3800.00%0.00%–9.18%
Senegal2800.00%0.00%–12.06%
Sierra Leone3700.00%0.00%–9.41%
Singapore2000.00%0.00%–16.11%
Slovenia5900.00%0.00%–6.11%
South Korea2600.00%0.00%–12.87%
Spain3900.00%0.00%–8.97%
Switzerland3700.00%0.00%–9.41%
Tanzania3200.00%0.00%–10.72%
Tunisia3400.00%0.00%–10.15%
United Arab Emirates2400.00%0.00%–13.80%
Uruguay3600.00%0.00%–9.64%
Venezuela6400.00%0.00%–5.66%
All position counts, withheld delegations included
DelegationEligibleAssertsReports without a positionRejectsConditionalNo position (not a case)UnclearNot applicableRejection share
Yugoslavia5591300150054.55%
Sudan62201251150040.32%
India83275291210034.94%
Cyprus251505050020.00%
Portugal205030120015.00%
China4311153230011.63%
Democratic Republic of the Congo6945372120010.14%
South Africa7120071133009.86%
Turkey612926123009.84%
Russia10861210332009.26%
Slovakia24202020008.33%
Israel152114212321007.89%
Congo261212110007.69%
Azerbaijan421203027007.14%
Albania684304120005.88%
United States of America326211361987001.84%
Pakistan13380151532003.76%
United Kingdom17496151062002.87%
Burundi8542431422003.53%
Syria1168932616001.72%
Ukraine824142132202.44%
(personal capacity)968211210001.04%
Angola331601214003.03%
Bosnia and Herzegovina16311901241000.61%
Gabon221001011004.55%
International Criminal Court523011515001.92%
Ireland341301119002.94%
Kenya21901011004.76%
Libya49380128002.04%
Liechtenstein651201052001.54%
Lithuania632401434001.59%
Qatar24111138004.17%
Sweden21811110004.76%
United Nations254726139136000.39%
Afghanistan24140055000.00%
Algeria52400048000.00%
Argentina873610347000.00%
Armenia963200361000.00%
Australia401610419000.00%
Bangladesh492810020000.00%
Belgium35620126000.00%
Botswana231110011000.00%
Brazil35810521000.00%
Canada612410135000.00%
Chad503500015000.00%
Chile43900231100.00%
Colombia21102017100.00%
Costa Rica29700022000.00%
Croatia714400126000.00%
Cuba64601012000.00%
Czech Republic33221019000.00%
Ecuador27500418000.00%
Egypt24150009000.00%
Estonia221000210000.00%
European Union21900012000.00%
France19310730677000.00%
Germany502310224000.00%
Ghana381510220000.00%
High Representative for the Implementation of the Peace Agreement on Bosnia and Herzegovina40340006000.00%
Indonesia26161036000.00%
International Criminal Tribunal for Rwanda826700015000.00%
International Residual Mechanism for Criminal Tribunals937110021000.00%
International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991785920017000.00%
Iran978400211000.00%
Iraq62474047000.00%
Italy28400222000.00%
Jordan775300321000.00%
Kosovo (Serbia)37340012000.00%
Kuwait402000614000.00%
League of Arab States27260010000.00%
Luxembourg521810330000.00%
Malaysia502600420000.00%
Mauritania27250011000.00%
Mexico38800030000.00%
Morocco271400013000.00%
Mozambique321200416000.00%
Netherlands552200627000.00%
New Zealand663910521000.00%
Nicaragua34281014000.00%
Nigeria713300236000.00%
Palestine14510610929000.00%
Palestine Liberation Organization51440052000.00%
Peru43510037000.00%
Poland28800317000.00%
Rwanda1,0268691012144000.00%
Saudi Arabia38310016000.00%
Senegal281400113000.00%
Sierra Leone371600219000.00%
Singapore20110009000.00%
Slovenia591700735000.00%
South Korea26400121000.00%
Spain391510122000.00%
Switzerland37900919000.00%
Tanzania321610213000.00%
Tunisia34250018000.00%
United Arab Emirates24130029000.00%
Uruguay36300429000.00%
Venezuela644020220000.00%
Norway1940101400withheld
Philippines1900211600withheld
Bolivia189000900withheld
Hungary1811001600withheld
Independent Inquiry into the Actions of the United Nations during the 1994 Genocide in Rwanda1812000600withheld
Japan1860021000withheld
Maldives1813001400withheld
Mali1812000600withheld
Malta175013800withheld
Zambia1717000000withheld
Ethiopia167004500withheld
Guinea1613010200withheld
International Residual Mechanism for Criminal Tribunals; International Criminal Tribunal for Rwanda1615000100withheld
Ivory Coast166003700withheld
Uganda1610001500withheld
Denmark1510011300withheld
South Sudan150042900withheld
Guatemala1411021000withheld
Jamaica147000700withheld
Namibia148000600withheld
Oman148002400withheld
Zimbabwe1410000400withheld
Austria1310001200withheld
Bahrain136000700withheld
Benin136001600withheld
Greece133030700withheld
Holy See1320001100withheld
Honduras136013300withheld
Vietnam138201200withheld
Yemen1313000000withheld
Georgia126000600withheld
African National Congress1110001000withheld
Farida Global Organization1111000000withheld
Panama112000900withheld
Bulgaria104002400withheld
Cambodia108010100withheld
Djibouti108000200withheld
Guyana105002300withheld
Lebanon108001100withheld
Niger103001600withheld
Organization of the Islamic Conference107001200withheld
Romania100011800withheld
Equatorial Guinea95000400withheld
Finland90000900withheld
Latvia90031500withheld
St. Vincent and the Grenadines83000500withheld
Yale University (New Haven, Conn.)86000200withheld
African Union74000300withheld
Burkina Faso73000400withheld
Darfur Women Action Group74002100withheld
Mauritius74000300withheld
Monaco70000700withheld
Myanmar70040300withheld
Somalia65000100withheld
Cameroon53000200withheld
Dominican Republic54010000withheld
Fiji52000300withheld
Haiti52001200withheld
Popular Movement for the Liberation of Angola55000000withheld
United States52101100withheld
Cape Verde43000100withheld
Frente Polisario44000000withheld
International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991; International Criminal Tribunal for Rwanda43000100withheld
Kazakhstan40001300withheld
Liberia42101000withheld
Mongolia41000300withheld
OAU44000000withheld
Centre for Strategic Communication and Information Security (Ukraine)33000000withheld
Confluence Advisory (Organization)31002000withheld
East Timor32000100withheld
Economic Community of Central African States33000000withheld
George Washington University (Washington, D.C.)33000000withheld
Grenada33000000withheld
Movimento Popular de Libertação de Angola33000000withheld
Organization of African Unity33000000withheld
PAEMA33000000withheld
Pan Africanist Congress of Azania (South Africa)33000000withheld
SWAPO33000000withheld
TRIAL International (Organization : Switzerland)33000000withheld
University of Oxford30000300withheld
Central African Republic21001000withheld
Columbia University (New York)20000200withheld
Comoros21001000withheld
Intergovernmental Authority on Development22000000withheld
International Committee of the Red Cross20000200withheld
Madagascar20011000withheld
Malawi21000100withheld
Patriotic Front of Zimbabwe22000000withheld
Sri Lanka20000200withheld
Sudan Family Planning Association20001100withheld
Thailand20000200withheld
Trinidad and Tobago20000200withheld
Women's League of Burma22000000withheld
Women's Peace Network (Myanmar)22000000withheld
Yemen People's Republic22000000withheld
All Africa Conference of Churches10000100withheld
Andorra10000100withheld
Barbados11000000withheld
Belarus11000000withheld
Council of the European Union11000000withheld
European Commission11000000withheld
Facilitator of the Burundi Peace Process10000010withheld
Foundation for Human Rights (South Africa)11000000withheld
Gambia11000000withheld
German Democratic Republic11000000withheld
Guinea-Bissau11000000withheld
IBRD11000000withheld
International Center for Transitional Justice10000100withheld
Iraqi Al-Amal Association11000000withheld
Islamic Group at the United Nations11000000withheld
Kaladan Press (Organization)11000000withheld
Laos11000000withheld
Les Centres GHESKIO (Haiti)11000000withheld
Lesotho11000000withheld
McGill University (Montréal, Canada)11000000withheld
Moldova10000100withheld
Montenegro10000100withheld
Mozambique Liberation Front (FRELIMO)11000000withheld
Municipal Association of Women (Organization : Colombia)10000100withheld
Nepal10000100withheld
New Development Bank10000100withheld
NGO Working Group on Women, Peace and Security11000000withheld
North Korea11000000withheld
Norwegian Refugee Council10000100withheld
Palau10000100withheld
Regional Center for Human Rights (Ukraine)10000100withheld
Rossiya Segodnya (Russian Federation)11000000withheld
Samoa10000100withheld
Sao Tome and Principe10000100withheld
Sauti Ya Mama Mukongomani (Organization : Democratic Republic of the Congo)11000000withheld
Second Transitional Government of East Timor11000000withheld
South West Africa People's Organization11000000withheld
Swaziland11000000withheld
Togo10000100withheld
Turkish Federated State of Kibris11000000withheld
Ukrainian Trade Union of Law Workers10000100withheld
United Nations; Implementation Monitoring Committee for the Arusha Peace and Reconciliation Agreement for Burundi10001000withheld
Vienna Center for Disarmament and Non-Proliferation10000100withheld
VOICE Amplified (Organization)10001000withheld
Women and Peace Studies Organization (Afghanistan)11000000withheld
Women's Initiatives for Gender Justice10000100withheld
Zan Times (Firm : Afghanistan)10001000withheld
Strategic Initiative for Women in the Horn of Africa (Organization)00000000withheld

Width is the share of that delegation's own eligible occurrences, not of the corpus.

Source

15_usage.py → usage/usage.json

Download

Instructions and categories

These are the instructions (the prompt) and category definitions used for this model run. They document how the model was asked to classify passages. The version and content identifier let you distinguish this run from later revisions.

Show the prompt (sha256:3772c44d400f…)
# Model annotation prompt — `genocide`

version: 3
date: 2026-09-07
codebook: `annotations/lexicon/CODEBOOK.md`, human schema version 3; model schema 3.1

Version 3 removes model self-reported confidence. Human confidence is unchanged.
Situation/modality coding remains a separate reviewed schema-4 proposal; it is
not introduced by this revision. Prompt v2 is archived byte-for-byte in
`prompts/v2.md`, so the Bayreuth run prepared with it remains readable.

The raw bytes of this file are hashed with SHA-256 into every run manifest and into every
row of every `annotations.jsonl`. Editing so much as a comma produces a different hash, and
a row can then no longer be matched to the text that produced it — so an edit here is a new
prompt version. Bump `version:` above, **move the old text to `prompts/v<n>.md` unchanged**,
and give the run that uses it a new run id. The archive is what lets an edit here be made at
all: `15_usage.py` resolves a run against every prompt this repository holds, so revising
the instrument costs a new run id and not the runs already paid for. The repository stores
and checks out this file with LF line endings (`.gitattributes`), so the hash does not depend
on the machine that computed it.

Two sections below are read by `scripts/lib/llm.py`, and only those two: the fenced block
under `## System` is the system message, verbatim; the fenced block under `## User template`
is the per-speech user message, with its `{placeholders}` filled in at run time. Everything
outside the two fences — this paragraph included — is documentation for a human and never
reaches the model.

The system block carries one placeholder, `{referents_table}`, rendered from
`annotations/lexicon/referents.csv` at run time as `id — label (years) — description`,
grouped by kind. The controlled list grows through reviewed additions to that file; the
prompt does not restate it, so adding a referent does not silently become a prompt edit.
What *would* change the meaning of a label — the field definitions, the boundary examples,
the cascade — lives here and is versioned here.

## What v2 changes, and on what evidence

v2 is the review of 1 September 2026, §4.2, carried out. Six changes:

1. **`stance` becomes two fields.** `speaker_position` records what the speaker does with the
   characterisation; `concrete_case` records whether the word is applied to a determinate
   case at all. v1's `neutral_legal_reference` was doing both jobs and competing with the
   `institutional_title_or_mandate` function and with three meta referents for the same
   decision — the largest referent confusion cells were exactly those pairs. Now the decision
   is made once and the other fields follow from it.
2. **`reports_without_position` is defined positively**, and a settled legal status is an
   assertion. v1's `attributes_or_reports` scored F1 0.37 across the two instruments, with
   445 occurrences read as *attributes* by one and *asserts* by the other — the single
   largest disagreement cell in the corpus.
3. **Ten worked examples, every one of them from the corpus**, quoted verbatim with the line
   id it was taken from, so a reader can go and check it. v1's examples were all invented,
   and the corpus's own recurrent formulae were absent from it.
4. **New fields the study's question needs**: `accused_actor`, `victim_group`,
   `own_state_accused`, `salience`, `referent_source` and a one-sentence `rationale`.
5. **Two rules the year ranges and the compound cases needed**, taken from the codebook so
   that a coder and a model read the same sentence.
6. **A false positive still needs a real quote.** v1's cascade said "all four fields, with no
   exception", and one model answered the *evidence* field with the literal string
   `not_applicable` three times.

Three of the new rules are stated as what the two committed runs already do, rather than as
a correction: both read the Special Adviser's title as a non-case mention in 176 of 176
occurrences, both code 98% of commemorations as assertions, and neither was ever told to.
Writing those down does not move them; it makes them testable, and it stops the next
instrument having to rediscover them.

The `distancing` rule is the opposite case. The grammatical-frames codebook
(`scripts/lib/node_frames.py`) finds 78 occurrences in which the label is marked as somebody
else's — *so-called*, *supposed*, scare quotes, *what she called "genocide"* — and the two
instruments part on them: 33 of Luna's are `attributes_or_reports`, 27 of Gemini's are
`rejects_or_denies`. That is §4.1's report/assert disagreement localised in one construction,
so one rule and one example can settle it.

**A provenance note about the two artefacts this prompt was written from.** The frames
artefact's `matched` column and the referent list's absorption table are both *projections*
over the two committed runs' text — a regex over a window, and a clustering of
`proposed_referent` strings. Neither is a re-coding, nothing in either committed run was
rewritten to produce them, and both are counted here as evidence of where the instruments
disagree and not as evidence of what the right label is. Only a run settles that, and no run
has yet been made against this prompt.

## System

```text
You are annotating occurrences of the word "genocide" in the verbatim records of the United
Nations Security Council, 1946-2024.

TASK BOUNDARY. You classify discourse. You never decide whether an underlying event legally
constitutes genocide, and no label you assign is a finding about what happened. The question
is always what the pattern found and what the speaker is doing with the word in this passage:
whether the matched string is really an instance of the expression and, where it is, how the
expression is being used here.

Read the whole speech before labelling anything. Then label each numbered occurrence
separately, from the passage around it, using the rest of the speech only to resolve what
that passage leaves open. Abstention is a correct answer, and a wrong label is worse than an
honest one: prefer "uncertain", "unclear" to a guess.

FIELDS

verdict — exactly one:
  true_positive   The highlighted span is a real instance of the expression. Example: "acts
                  of genocide".
  false_positive  The string does not instantiate the expression. Example: damaged OCR joins
                  unrelated fragments into something a tolerant pattern matched.
  uncertain       The transcription does not permit a defensible decision. Example: OCR
                  damage leaves the passage illegible.

quotation — exactly one:
  not_quoted              The current speaker uses the expression in their own formulation.
                          "We consider these acts genocide."
  direct_quotation        The expression occurs inside words explicitly quoted verbatim.
                          "The witness called it 'genocide'."
  attributed_or_reported  The speaker reports or paraphrases another actor's terminology.
                          "The Commission described the acts as genocide."
  unclear                 Attribution cannot be resolved from the available passage.
  not_applicable          False positives only.

  Quotation does not determine position. Naming the source of a characterization says where
  it came from; it says nothing about whether this speaker adopts it. A speaker may quote a
  claim in order to endorse it, in order to reject it, or in order to leave it standing
  unjudged, and those are three different values of speaker_position with the same value
  here.

concrete_case — exactly one. Answer this before speaker_position:
  yes             The word is applied, in this passage, to a determinate situation, event,
                  people or place: a case that could be named. It does not have to be named
                  in the passage — see referent_source — only determinate.
  no              The word is not applied to any case here. It names the crime as a legal
                  category, appears inside the title or mandate of an office, a treaty or a
                  tribunal, or stands in a general formula about prevention or atrocity.
  unclear         The passage does not let you tell which of the two it is.
  not_applicable  False positives only.

  This is the decision v1 made three times over and made differently each time. Make it once,
  here. Everything below follows from it: when concrete_case is "no", speaker_position is
  "no_position" and the referent is one of the three non-case referents; when it is "yes",
  speaker_position is one of the four real positions and the referent is a case.

  What matters is what the MATCHED WORD is doing, not what the sentence is about. "This
  crime is forbidden by the 1948 Convention on the Prevention and Punishment of the Crime of
  Genocide" is a sentence about a concrete crime in which the matched word occurs only
  inside a treaty's title: concrete_case is "no".

speaker_position — exactly one:
  asserts                   The speaker advances or endorses the characterization, or treats
                            it as established. "This is genocide." Also: a legal status the
                            speaker treats as settled — "those convicted of genocide by the
                            ICTR", "known genocidaires", "the ICTY decision finding him
                            guilty of genocide" — because a speaker who reasons from a
                            finding has adopted it.
  rejects                   The speaker disputes, denies or refuses the characterization.
                            "There was no genocide." Also: the speaker marks the label as
                            false while reporting it — see the distancing rule below.
  conditional               The speaker presents it as a possibility, a risk, a threshold or
                            a warning rather than as an established characterization.
                            "Unless prevented, this could become genocide."
  reports_without_position  Use this ONLY when both of these hold: the passage names the
                            actor doing the characterizing, AND the speaker neither adopts
                            nor rejects it. Both halves are required. If the characterizing
                            actor is not named, the speaker is speaking in their own voice,
                            which is one of the three above. If the speaker endorses what
                            they report, that is "asserts"; if they disown it, "rejects".
                            The value means "somebody said this and I am not saying whether
                            they were right", and nothing else.
  no_position               concrete_case is "no", so there is no characterization of a case
                            to take a position on. Use this value exactly when concrete_case
                            is "no", and never otherwise.
  unclear                   The evidence supports no reliable choice.
  not_applicable            False positives only.

  THE DISTANCING RULE. Ask what the hedge is scoping over.
  - Over the LABEL — scare quotes around the word, "so-called", "supposed", "purported",
    "what X calls genocide", "allegations of genocide" — the speaker is holding the
    characterization at arm's length as somebody else's and declining it: "rejects". Not
    "reports_without_position": marking a label as false is a position.
  - Over a PERSON OR AN ACT, with the category itself untouched — "alleged genocide
    financier", "those alleged to have committed genocide", "accused of genocide" — that is
    an unproven charge against an individual, made inside a category the speaker treats as
    real: "asserts". This is the ordinary language of an indictment, and it is not
    distancing at all.

function — one or more, as a JSON array of strings:
  accusation_or_qualification     Names or legally characterizes conduct.
  warning_or_prevention           Warns of risk, or urges prevention or protection.
  commemoration                   Remembers victims, anniversaries or historical events.
  accountability                  Concerns investigation, prosecution, punishment or
                                  impunity. A proceeding, an arrest, a sentence, a fugitive,
                                  an amnesty. NOT merely because a court or tribunal is
                                  named: "genocide denial by ICTR defence lawyers" is an
                                  accusation against the deniers and concerns no proceeding.
  institutional_title_or_mandate  Occurs in the name or mandate of an office, treaty,
                                  tribunal, adviser or institutional mechanism. This is a
                                  restatement of concrete_case "no", not a separate finding:
                                  a word inside a title is not applied to a case.
  other                           A clear function not represented above.
  unclear                         The function cannot be determined.
  not_applicable                  False positives only.

  "Prosecute those responsible for genocide so that it never happens again" may be
  ["accountability", "warning_or_prevention"]. Never repeat a label. "unclear" and
  "not_applicable" cannot be combined with any other label, so an array containing either of
  them has exactly one element. Prefer the smallest defensible set; do not infer purposes
  that are absent from the text.

  COMMEMORATION IS ASSERTION. A commemorative formula — an anniversary, a remembrance, "we
  honour the victims of the genocide" — treats the characterization as established, so its
  speaker_position is "asserts" even though nothing is being alleged against anyone in the
  passage. Add "accusation_or_qualification" only when the passage also characterizes
  someone's conduct.

referent — exactly one identifier from the controlled list below.

referent_source — exactly one. Where in the request you found the referent:
  passage  The passage around the occurrence names or unambiguously identifies it.
  speech   Another part of the speech does, and this passage does not.
  header   Only the header lines above the speech do — the speaker's country or
           organisation, the agenda item, the meeting.
  not_applicable  False positives only; and the value for referent "unclear".

  This field is a measurement of the instrument and not of the passage, so record what you
  actually used. A referent read off the header alone is a weaker assignment than one read
  off the passage, and the study needs to know how many there are.

accused_actor — free text, a few words. Who the passage says did it, or is charged with it,
  as the passage names them: "ex-FAR and Interahamwe", "Radislav Krstic", "the Government of
  the Sudan". Empty when the passage accuses no one.

victim_group — free text, a few words. The group the word is applied on behalf of, as the
  passage names them: "the Tutsi in Rwanda", "the Bosnian Muslims of Srebrenica". Empty when
  the passage names none.

  Both fields are copied from the passage, never inferred from the case. If the passage says
  "genocide in Rwanda" and names neither perpetrator nor victims, both are empty. That is
  data, not a failure.

own_state_accused — exactly one:
  yes             The speaker's own State or organisation is the one the passage accuses, or
                  the one it would accuse if the characterization stood. A denial by the
                  accused State is "yes": the accusation is what is being denied.
  no              Somebody else is accused.
  not_applicable  The passage accuses no one, this is a non-case mention, or the verdict is
                  false_positive.

salience — exactly one:
  passing         The word appears in a list, a formula or an aside, and the passage does not
                  argue about it. The four-crime responsibility-to-protect formula and the
                  triad "genocide, war crimes and crimes against humanity" are passing.
  substantive     The characterization is what the passage is doing: it is argued for,
                  argued against, dwelt on, or the subject of the sentence.
  not_applicable  False positives only.

rationale — one sentence, free text, always present. Why the position and the case decision
  are what they are, in your own words. Not a restatement of the labels: say what in the
  passage decided them. Where you hesitated between two values, name the other one. This is
  read by humans adjudicating disagreements and costs almost nothing to write.


THE FALSE-POSITIVE CASCADE

If verdict is "false_positive", then quotation, concrete_case, speaker_position, referent,
referent_source, own_state_accused, salience and every element of function are
"not_applicable"; accused_actor, victim_group and proposed_referent are empty strings. If
verdict is anything else, "not_applicable" may not appear in quotation, concrete_case,
speaker_position, function or referent: there it is reserved for false positives and means
nothing else. referent_source, own_state_accused and salience are the exceptions, because
each of them has a genuine "there is nothing here to record" answer that is not about the
verdict at all.

The cascade stops at the evidence. A false positive still needs a real, verbatim
evidence_quote and a real rationale: the claim "this match is not the word being used" is a
claim about a passage, and it is unreadable without the passage. Do not write the string
"not_applicable" into evidence_quote. A false positive whose quote cannot be found in the
speech is refused when the row is written.

REFERENT

Choose the referent the occurrence is ABOUT: the case, event, people or institution the word
is applied to in this passage. It is not every situation the speech mentions, and it is not
the speaker's own country unless the passage applies the word to it.

{referents_table}

The years in parentheses are DOCUMENTATION, NOT A CONSTRAINT. They say when the case is
usually invoked; they do not say which speeches may carry it. Where a passage names a period
a referent's years do not cover, code the referent anyway. A 2009 speech about Gaza takes the
Israel/Palestine referent because that is what the speech is about, not because 2009 falls in
a range.

A passage naming two cases is coded as the first one named, and the pair goes into
"proposed_referent" as the speaker gave it. "Rwanda and Srebrenica" is the Rwanda referent
with proposed_referent "Rwanda and Srebrenica". Where a passage names a case and something
more specific inside it — Khojaly inside Nagorno-Karabakh, the Yazidis inside ISIL's crimes —
that is not a compound: code the more specific identifier, and leave proposed_referent empty.

When concrete_case is "no", choose among the three non-case referents in this order, first
match winning:

  institutional title or mandate   The word is inside the name or mandate of an office, a
                                   body or a tribunal. "Special Adviser on the Prevention of
                                   Genocide".
  Convention and legal definition  The passage is about the 1948 Convention, the legal
                                   definition of the crime, or jurisdiction over it. "the
                                   Convention on the Prevention and Punishment of the Crime
                                   of Genocide", "the definition in article II".
  genocide in general              Everything else abstract: prevention doctrine, the
                                   four-crime formula, a general statement about the crime.

Using the three reserved identifiers:

  other           The referent is identifiable but is not on the list. Use it, and put a
                  short name for what you identified in "proposed_referent" — a place, a
                  conflict, a people or an institution, a few words at most. Never invent an
                  identifier; the list grows only through human review.
  unclear         The speech does not let you tell which referent is meant. Choosing this is
                  correct whenever it is true. Never guess.
  not_applicable  False positives only.

"proposed_referent" is a short free-text note about the referent. It is required when the
referent is exactly "other", it carries the pair when a compound is coded as the first case
named, it is empty on a false positive, and it is otherwise empty.

EVIDENCE

"evidence_quote" is the shortest verbatim passage of the speech that both contains the
matched word of this occurrence and supports every label you assigned to it. Usually a
clause or one sentence; two sentences when the attribution or the condition begins in the
one before. Never the whole speech.

The minimum is the clause containing the modal or the attribution — whatever it is that
makes your position label what it is. "could amount to genocide" rather than "genocide",
because the modal is what makes the position conditional; "what she called 'genocide'"
rather than "genocide", because the attribution is the whole of the reason. A bare "have been
convicted of genocide" cannot support a position label, and a quote too short to support one
is treated as unlocated evidence.

Copy it character for character out of the speech text supplied with the request: the same
spelling, punctuation, capitalisation and spacing, including any OCR damage. The records are
scanned, and they break words across lines: "the Secretary- General's warning" is what the
record says, and it is what you copy. No ellipses, no corrections, no added quotation marks,
no markup, nothing joined across a gap. The quote is located back in the speech
automatically, and a quote that cannot be found there is recorded as invalid evidence.

WORKED EXAMPLES

Ten occurrences from this corpus, quoted verbatim, with the line id each was taken from. They
are the cases the previous version of this prompt got least agreement on. Fields not shown
take the values the definitions above give them.

1. Commemoration. UNSC_2014_SPV.7105_spch0017#3, Rwanda, 29 January 2014.
   evidence_quote: "As we commemorate the twentieth anniversary of the 1994 genocide against
   the Tutsi in Rwanda"
   concrete_case yes | speaker_position asserts | quotation not_quoted |
   function ["commemoration"] | referent: Rwanda | referent_source passage |
   accused_actor "" | victim_group "the Tutsi in Rwanda" | own_state_accused not_applicable |
   salience substantive
   rationale: "Commemorating an anniversary treats the characterization as established, so
   the speaker asserts it even though the passage accuses no one."

2. The atrocity triad. UNSC_2005_SPV.5264_spch0022#1, European Union, 20 September 2005.
   evidence_quote: "our responsibility to protect populations from genocide, war crimes,
   ethnic cleansing and crimes against humanity"
   concrete_case no | speaker_position no_position | quotation not_quoted |
   function ["warning_or_prevention"] | referent: genocide in general |
   referent_source passage | accused_actor "" | victim_group "" |
   own_state_accused not_applicable | salience passing
   rationale: "The word names one of the four crimes in the responsibility-to-protect
   formula and is applied to no case, so there is no characterization to take a position on."

3. Perpetrator noun. UNSC_1999_SPV.3987_spch0015#2, United States, 19 March 1999, on the
   Democratic Republic of the Congo.
   evidence_quote: "to collaborate militarily with ex-FAR and interahamwe, known genocidaires"
   concrete_case yes | speaker_position asserts | quotation not_quoted |
   function ["accusation_or_qualification"] | referent: Rwanda | referent_source passage |
   accused_actor "ex-FAR and interahamwe" | victim_group "" | own_state_accused no |
   salience passing
   rationale: "The perpetrator noun applies the word to the killings in Rwanda and not to the
   Congolese war the debate is about, and 'known' treats the characterization as settled."

4. Denial and ideology. UNSC_2011_SPV.6545_spch0010#9, Rwanda, 6 June 2011.
   evidence_quote: "the ongoing scourge of genocide denial by some in the academic and legal
   professions"
   concrete_case yes | speaker_position asserts | quotation not_quoted |
   function ["accusation_or_qualification"] | referent: Rwanda | referent_source speech |
   accused_actor "academics and lawyers who deny it" | victim_group "" |
   own_state_accused no | salience substantive
   rationale: "Condemning denial asserts the genocide that is denied; the accusation is
   against the deniers, and no proceeding is at issue, so accountability is not added."

5. Own-state denial. UNSC_2017_SPV.7963_spch0019#6, Sudan, 8 June 2017.
   evidence_quote: "the report of the International Commission of Inquiry on Darfur, which
   was submitted to the Council in early 2005, confirming that no genocide had taken place in
   Darfur"
   concrete_case yes | speaker_position rejects | quotation attributed_or_reported |
   function ["accusation_or_qualification"] | referent: Darfur | referent_source passage |
   accused_actor "the Government of the Sudan" | victim_group "" | own_state_accused yes |
   salience substantive
   rationale: "The speaker reports a finding and adopts it — 'confirming' endorses the
   conclusion — so this refuses the characterization rather than reporting it without a
   position."

6. A tribunal's finding. UNSC_2001_SPV.4379Resumption1_spch0003#1, Jamaica,
   21 September 2001.
   evidence_quote: "the recent ICTY decision finding Radislav Krstic guilty of genocide in
   the Srebrenica massacre"
   concrete_case yes | speaker_position asserts | quotation attributed_or_reported |
   function ["accountability", "accusation_or_qualification"] | referent: Bosnia and
   Srebrenica | referent_source passage | accused_actor "Radislav Krstic" |
   victim_group "" | own_state_accused no | salience passing
   rationale: "A conviction is a legal status the speaker treats as settled, and naming the
   court that reached it attributes the source rather than distancing the speaker from it; I
   considered reports_without_position and rejected it because nothing here suspends
   judgement."

7. The Convention. UNSC_1992_SPV.3095_spch0029#4, Pan Africanist Congress of Azania,
   15 July 1992.
   evidence_quote: "This crime is forbidden by the 1948 Convention on the Prevention and
   Punishment of the Crime of Genocide"
   concrete_case no | speaker_position no_position | quotation not_quoted |
   function ["institutional_title_or_mandate"] | referent: Genocide Convention and legal
   definition | referent_source passage | accused_actor "" | victim_group "" |
   own_state_accused not_applicable | salience passing
   rationale: "The matched word occurs only inside the treaty's title, so it is applied to no
   case even though the sentence around it is about one."

8. A warning. UNSC_1996_SPV.3692_spch0018#1, Japan, 28 August 1996.
   evidence_quote: "the Secretary- General's warning that if the worst-case scenario becomes
   a reality there could be a genocide in Burundi"
   concrete_case yes | speaker_position conditional | quotation attributed_or_reported |
   function ["warning_or_prevention"] | referent: Burundi | referent_source passage |
   accused_actor "" | victim_group "" | own_state_accused not_applicable |
   salience substantive
   rationale: "The modal makes the characterization prospective, and the case is Burundi: a
   warning is about a place, and a genocide that has not happened is not a referent."
   Note the hyphen and space inside "Secretary- General's": that is what the record says, so
   that is what the quote says.

9. Distancing. UNSC_2023_SPV.9524_spch0007#1, United Kingdom, 30 December 2023.
   evidence_quote: "President Putin claimed his invasion was to stop a supposed genocide in
   Donbas"
   concrete_case yes | speaker_position rejects | quotation attributed_or_reported |
   function ["accusation_or_qualification"] | referent: Ukraine | referent_source passage |
   accused_actor "Ukraine, in the claim being reported" | victim_group "" |
   own_state_accused no | salience passing
   rationale: "'Supposed' is the reporting speaker's own mark on the label and not part of
   what was claimed, so the speaker refuses the characterization rather than leaving it
   standing."

10. An office's name. UNSC_2004_SPV.4990_spch0011#1, France, 14 June 2004.
    evidence_quote: "the Secretary-General's initiative of establishing the post of Special
    Adviser on the Prevention of Genocide"
    concrete_case no | speaker_position no_position | quotation not_quoted |
    function ["institutional_title_or_mandate"] | referent: institutional title or mandate |
    referent_source passage | accused_actor "" | victim_group "" |
    own_state_accused not_applicable | salience passing
    rationale: "The word is part of an office's name, so it names a mandate and not a case."

OUTPUT

Return JSON only, matching the schema supplied with the request. No prose, no commentary, no
explanation outside the fields. Exactly one entry per numbered occurrence: the set of
"ordinal" values you return must equal the set of numbers in the occurrence list, each
appearing once.
```

## User template

```text
Speech: {filename}
Date: {date}
Speaker (country or organisation): {country_org}
Participant type: {participant_type}
Meeting: {meeting_symbol}
Agenda item: {agenda_item}

===== SPEECH TEXT BEGINS =====
{speech}
===== SPEECH TEXT ENDS =====

The speech text above is unmodified, and the character offsets below are zero-based indices
into it, with the end exclusive. Nothing in it is marked up, so an evidence quote copied out
of it is a quote of the record.

The header lines above are context, not evidence. A referent you take from them and from
nowhere else is recorded as referent_source "header", and the speaker's own country is not
the referent unless the passage applies the word to it.

Occurrences to annotate ({occurrence_count}), each with the sentence it falls in:

{occurrences}
```
Show the controlled referent list (version 2, 40 identifiers)
IdentifierDefinitionOccurrences
Rwanda
rwanda
Speeches invoking the mass killing of Tutsi in Rwanda and its aftermath as genocide or genocidal.1,848
Genocide in general
genocide_in_general
Abstract discussion of genocide, including prevention doctrine, with no single case in view.1,640
Bosnia and Srebrenica
bosnia_srebrenica
Speeches invoking the war in Bosnia and Herzegovina, including the fall of Srebrenica and its commemorations, as genocide or genocidal.722
Genocide Convention and legal definition
genocide_convention_law
The 1948 Convention, the legal definition of the crime, and jurisdiction over it before the ICJ or the ICC.490
Gaza
gaza
Speeches invoking the Gaza war as genocide or genocidal, including the proceedings South Africa brought against Israel at the ICJ.481
Institutional title or mandate
institutional_mandate
The name or mandate of an office or body, such as the Special Adviser on the Prevention of Genocide or a tribunal's title.454
Other known referent
other
A referent that is identifiable but does not yet have a controlled identifier.399
Israel and Palestine
israel_palestine
Speeches invoking Israeli conduct towards Palestinians, or the conduct of Palestinian and allied armed groups towards Israelis, as genocide or genocidal, up to the war that gaza covers.320
Darfur
darfur
Speeches invoking the conflict in Darfur as genocide or genocidal.189
ISIL and the Yazidis
isil_yazidi
Speeches invoking ISIL's campaign against the Yazidi population of northern Iraq as genocide or genocidal.120
Kosovo
kosovo
Speeches invoking the Kosovo conflict and the expulsion of its Albanian population as genocide or genocidal.109
Democratic Republic of the Congo
drc
Speeches invoking mass killing in the Democratic Republic of the Congo as genocide or genocidal, including the presence in its east of armed groups formed from the perpetrators of the Rwandan killings.87
South Africa under apartheid
apartheid_south_africa
Speeches invoking apartheid and the violence surrounding its end as genocide or genocidal.84
Ukraine
ukraine
Speeches invoking genocide in connection with the war in Ukraine, in either direction: against Russia's conduct and in Russia's own claims about Donbas. Not the Soviet famine, which holodomor covers, and not the Crimean Tatars, who have their own identifier.82
ISIL and other populations of Iraq and Syria
isil_iraq_syria
Speeches invoking ISIL's crimes against populations of Iraq and Syria other than the Yazidis as genocide or genocidal, such as Christians, Shia Muslims and Turkmen.75
Burundi
burundi
Speeches invoking the mass violence in Burundi as genocide or genocidal.67
Colonial-era mass violence
colonial_era
Speeches invoking mass violence under colonial rule as genocide or genocidal, such as the campaign against the Herero and Nama.65
The Holocaust
holocaust
Speeches invoking the Nazi extermination of European Jews and its commemoration as genocide or genocidal.59
Croatia and the Yugoslav wars
croatia_yugoslav_wars
Speeches invoking the Yugoslav wars outside Bosnia and Kosovo as genocide or genocidal, such as the fighting in Croatia and the Krajina, or the wars taken as a whole.53
Muslims in India
india_muslims
Speeches invoking the treatment of the Muslim population of India as genocide or genocidal.44
South Sudan
south_sudan
Speeches invoking the civil war in South Sudan as genocide or genocidal.33
Myanmar and the Rohingya
myanmar_rohingya
Speeches invoking the treatment of the Rohingya population of Myanmar as genocide or genocidal.27
The Ottoman Armenians
armenian_genocide
Speeches invoking the deportation and mass killing of Ottoman Armenians as genocide or genocidal.26
Cambodia under the Khmer Rouge
cambodia_khmer_rouge
Speeches invoking the mass killing under the Khmer Rouge, including the work of the Extraordinary Chambers, as genocide or genocidal.25
Bangladesh and the war of separation
bangladesh
Speeches invoking the mass killing during the war that separated East Pakistan from Pakistan as genocide or genocidal.24
Nagorno-Karabakh
nagorno_karabakh
Speeches invoking the Nagorno-Karabakh conflict and the departure of its Armenian population as genocide or genocidal.21
Syria
syria
Speeches invoking the conduct of the parties to the war in Syria as genocide or genocidal.19
Central African Republic
central_african_republic
Speeches invoking the sectarian violence in the Central African Republic as genocide or genocidal.17
Other sanctions regimes
economic_sanctions_other
Speeches describing a sanctions regime other than the Cuban embargo as genocidal, such as the measures against Iraq in the 1990s.16
Afghanistan and the Hazaras
afghanistan_hazara
Speeches invoking mass violence in Afghanistan as genocide or genocidal, in particular attacks on its Hazara population.13
Abkhazia and South Ossetia
abkhazia_south_ossetia
Speeches invoking the conflicts in Abkhazia and South Ossetia and the displacement of their populations as genocide or genocidal.11
East Timor
east_timor
Speeches invoking the violence around East Timor's independence ballot as genocide or genocidal.8
Crimean Tatars
crimean_tatars
Speeches invoking the wartime deportation of the Crimean Tatars, or their treatment under the occupation of Crimea, as genocide or genocidal.6
Iraqi Kurds and Anfal
iraq_kurds_anfal
Speeches invoking the Anfal campaign and the Halabja attack against Iraq's Kurdish population as genocide or genocidal.5
Khojaly
khojaly
Speeches invoking the killings at Khojaly as genocide or genocidal, which Azerbaijan raises as an event of its own.5
The Soviet famine in Ukraine
holodomor
Speeches invoking the Soviet famine in Ukraine as genocide or genocidal, which speakers raise as a case of its own rather than as part of the war that ukraine covers.4
United States embargo against Cuba
cuba_us_sanctions
Speeches describing the United States embargo against Cuba as genocidal.2
Xinjiang and the Uyghurs
xinjiang_uyghurs
Speeches invoking China's treatment of the Uyghur population of Xinjiang as genocide or genocidal.1
Not applicable
not_applicable
Reserved for false-positive candidate matches.0
Unclear referent
unclear
The available context does not support a reliable referent assignment.0

Comparison with human coding

No human-reference comparisons are available yet. The sample contains 200 entries covering 199 distinct occurrences. Two readers are to code each independently. Accuracy scores require agreed or adjudicated reference labels; the absence of a score means accuracy has not been measured.

Top