Download M92-1044

Transcript
filler in the key, as determined by
provided in the task documentation.
correctness of the cross-reference tag.
EXAMPLE:
the shallow hierarchy of instrument types
This scoring is done irrespective of the
RESPONSE
KEY
GUN: "AK-47"
MACHINE GUN: "AK-47"
RESPONSE
KEY
GUN: "BULLET"
MACHINE GUN: "-"
3.2.8 Slot 8 -- PERP: INCIDENT CATEGORY
The scoring system will automatically score all mismatches as incorrect.
3.2.9 Slot 9 -- PERP:
INDIVIDUAL
ID
FULLY CORRECT: See section 3.1.1.1.
PARTIALLY CORRECT:
1.
See sections 3.1.1.2 and 3.1.1.3.
2.
Key contains rather general data and the response
inferior, general strings.
EXAMPLE:
RESPONSE
KEY
contains consistent, but
"TERRORIST ACTIONS"
"URBAN TERRORISTS"
3.2.10 Slot 10 -- PERP: O R G A N I Z A T I O N ID
FULLY CORRECT:
1. In general, the guidelines in section 3.1.1.1 do not apply to this slot, since this
slot is intended to be filled only with proper names.
However, the term "proper
names" is not completely defined, especially with respect to the expected fillers in
the case of STATE-SPONSORED TERRORISM. You have more leeway to score fillers as
fully correct in such cases.
EXAMPLE:
RESPONSE
KEY
"POLICE"
"SECRET POLICE"
2. Response string includes both acronym and expansion
juxtaposed in the text) instead of just one or the other.
EXAMPLE:
RESPONSE
KEY
PARTIALLY CORRECT:
(where
they
appear
"ARMY OF NATIONAL LIBERATION (ELN)"
"ARMY OF NATIONAL LIBERATION" / "ELN"
See sections 3.1.1.2 and 3.1.1.3.
3.2.11 Slot 11 -- PERP: ORGANIZATION CONFIDENCE
All mismatching set fills will automatically be scored incorrect, with the
following exception:
The scoring program will automatically score the system
response partially correct in the case where the system generates SUSPECTED OR
C-7