Harry Workman
Harry Test Results
Test conducted on: 5/28/2008.
Test conducted by: Harry, a computer program.
Test evaluated by: Toborman, a human.
Test was conducted using tests 1A.1 through 1A.10 of the CIA Mental Acuity test suite.
This level of testing assumes a grade school student learning from a tutor. Test assumes no prior knowledge of the objects used in the propositions before testing. Test assumes student has enough knowledge to comprehend the statements given in English and to generate answers in English. Test assumes student can perform categorical inference. Test assumes student can manage categorical propositions.
Test Type | Desired ability | Poss | Score |
Propositions | Student should be able to remember, recall and forget categorical propositions. | 3 | 3 |
Propositions | Student should be able to use categorical logic at multiple levels to infer answers not previously given. | 1 | 1 |
Propositions | Student should be able to work with negation. | 1 | 1 |
Propositions | Student should be able to acknowledge unknowns. | 1 | 1 |
Language | Student should be able to follow conventional conversation protocol. | 1 | 1 |
Language | Student should be able to recognize questions and formulate answers. | 2 | 2 |
Total score | 9 | 9 |
Harry performed well. An unexpected result was Harry's use of implication in test 1.7. This requires a knowledge of syllogistic logic not expected by the test, e.g., Humans are not quadrupeds. Tom is a human. Therefore, tom is not a quadruped.
Part 1 - Learning categorical propositions by direct input (tutoring).
ID | speaker | expected | actual | p/f | note |
1.1 | tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | describe tom. | describe tom. | ok |
|
| student | tom is a human. | tom is a person. | pass | synonym accepted |
| tutor |
| forget tom is a human |
| clean up before next test |
|
|
|
|
|
|
1.2 | tutor | humans are mammals. | humans are mammals. | ok |
|
| student |
| people are mammals. |
| acknowledgement |
| tutor | describe humans | describe humans. | ok |
|
| student | humans are mammals. | people are mammals. | pass | synonym accepted |
| tutor | forget humans are mammals. | clean up before next test | ||
|
|
|
|
|
|
1.3 | tutor | humans are mammals. | humans are mammals. | ok |
|
| student |
| humans are mammals. |
| acknowledgement |
| tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | is tom a mammal? | is tom a mammal? | ok |
|
| student | yes, tom is a mammal. | yes, tom is a mammal. | pass |
|
| tutor |
| forget humans are mammals. | clean up before next test | |
| tutor |
| forget tom is a human. |
| clean up before next test |
|
|
|
|
|
|
1.4 | tutor | humans are mammals. | humans are mammals. | ok |
|
| student |
| humans are mammals. |
| acknowledgement |
| tutor | mammals are animals. | mammals are animals. | ok |
|
| student |
| mammals are animals. |
| acknowledgement |
| tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | is tom an animal. | is tom an animal. | ok |
|
| student | yes, tom is an animal. | yes, tom is an animal. | pass |
|
| tutor |
| forget humans are mammals. | clean up before next test | |
| tutor |
| forget tom is a human. |
| clean up before next test |
| tutor |
| forget mammals are animals. |
| clean up before next test |
|
|
|
|
|
|
1.5 | tutor | is tom a quadruped? | is tom a quadruped? | ok |
|
| student | I don't know if tom is a quadruped. | I don't know if tom is a quadruped. | pass |
|
|
|
|
|
|
|
1.6 | tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | tom is not a quadruped. | tom is not a quadruped. | ok |
|
| student |
| tom is not a quadruped. |
| acknowledgement |
| tutor | is tom a quadruped? | is tom a quadruped? | ok |
|
| student | no, tom is not a quadruped. | no, tom is not a quadruped. | pass |
|
| tutor |
| forget tom is a human. |
| clean up before next test |
| tutor |
| forget tom is not a quadruped. | clean up before next test | |
|
|
|
|
|
|
1.7 | tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | humans are not quadrupeds. | humans are not quadrupeds. | ok |
|
| student |
| people are not quadrupeds. |
| acknowledgement |
| tutor | is tom a quadruped? | is tom a quadruped? | ok |
|
| student | no, tom is not a quadruped. | no, people are not quadrupeds. | pass | unexpected use of implication |
| tutor |
| forget tom is a human. |
| clean up before next test |
| tutor |
| forget humans are not quadrupeds. | clean up before next test | |
|
|
|
|
|
|
1.8 | tutor | tom is smart. | tom is smart. | ok |
|
|
|
| tom is smart. |
| acknowledgement |
| tutor | describe tom. | describe tom. | ok |
|
| student | tom is smart. | tom is smart. | pass |
|
| tutor |
| forget tom is smart. |
| clean up before next test |
|
|
|
|
|
|
1.9 | tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | tom is smart. | tom is smart. | ok |
|
| student |
| tom is smart. |
| acknowledgement |
| tutor | describe tom. | describe tom. | ok |
|
| student | tom is a smart human. | tom is a smart human. | pass |
|
| tutor |
| forget tom is smart. |
| clean up before next test |
| tutor |
| forget tom is a human. |
| clean up before next test |
|
|
|
|
|
|
1.10 | tutor | tom is a human. | tom is a human. | ok |
|
| student |
| tom is a human. |
| acknowledgement |
| tutor | tom is smart. | tom is smart. | ok |
|
| student |
| tom is smart. |
| acknowledgement |
| tutor | describe tom. | describe tom. | ok |
|
| student | tom is a smart human. | tom is a smart human. | pass |
|
| tutor | forget tom is smart. | forget tom is smart. | ok |
|
| tutor | describe tom. | describe tom. | ok |
|
| student | tom is a human. | tom is a human. | pass |
|
Part 1B - Learning categorical propositions by discovery (inference).
Test conducted on: 5/29/2008.
Test conducted by:Toborman, a human.
Test evaluated by: Toborman, a human.
Single test was conducted incorporating concepts from tests 1B.1 through 1B.4 of the CIA Mental Acuity test suite.
This level of testing assumes a grade school student learning with a tutor. Test assumes no prior knowledge of the objects used in the propositions before testing. Test assumes student has knowledge of categorical inference based on the Square of Opposition. Student should be able to infer categorical propositions from given propositions. Student should be able to work with negation.
Test Type | Desired ability | Poss | Score |
Inference | Student should be able to infer contraries, contradictions, subcontraries, and subalterns. | 4 | 4 |
Inference | Student should be able to infer quantification. (all, some) | 1 | 1 |
Inference | Student should be able to work with negation. | 1 | 1 |
Inference | Student should be able to infer truth value (probability, possibility) | 1 | 1 |
Language | Student should be able to follow conventional conversation protocol. | 1 | 1 |
Language | Student should be able to recognize questions and formulate answers. | 2 | 2 |
Language | Student should be able to justify inferences. | 1 | 1 |
Total score | 11 | 11 |
Harry performed well. Explanation function was active for this test.
- Test ID: 1-A Coverage: Remember, recall, classify, interpret, translate, complete inference.
- G. [Remember] Tom is a human.
- G. [Remember] Tom is a mammal.
- A.[ I will remember] Tom is a human. [I will remember] Tom is a mammal.
- Q. describe mammals.
- A. Tom is a mammal.
- A. some mammals are humans.
- A. some humans are mammals.
- A. [possibly] all humans are mammals.
- A. [possibly] all mammals are humans.
- A. [possibly] all humans are mammals and all mammals are humans.
- A. It is not true that no mammals are humans .
- A. It is not true that no humans are mammals.
- Test ID: 2 Coverage: Remember, recall, classify, interpret, translate, infer.
- G. [Remember] Tom is a mammal.
- Q. [Remember] Tom is not a dog.
- A.[ I will remember] Tom is not a dog. [I will remember] some mammals are not dogs. [I will remember] [probably] all mammals are not dogs.
- Q, describe mammals.
- A. Tom is a mammal.
- A. some mammals are not dogs.
- A. [probably] all mammals are not dogs.
- Test ID: 3 Coverage: Remember, recall, classify, interpret, translate, infer.
- G. [Remember] Tom is a human.
- Q. [Remember] Tom is smart.
- A.[ I will remember] Tom is smart. [I will remember] some humans are smart. [I will remember] [probably] all humans are smart.
- Q, describe humans.
- A. Tom is a human.
- A. some humans are smart.
- A. [probably] all humans are smart,
- Test ID: 4 Coverage: Remember, recall, classify, interpret, translate, infer.
- G. [Remember] Tom is a human.
- Q. [Remember] Tom is not smart.
- A.[ I will remember] Tom is not smart. [I will remember] some humans are not smart. [I will remember] [probably] all humans are not smart.
- Q, describe humans.
- A. Tom is a human.
- A. some humans are not smart.
- A. [probably] all humans are not smart.
Actual test.
G: if a person is mean, then that person is ugly.
- Harry : hello Tom.
Tom : charlie is a human.
Harry : I will remember charlie is a person.
Tom : chad is a human.
Harry : I will remember chad is a person.
Tom : charlie is mean.
Harry : I will remember charlie is mean.
Harry : using affirm particular, I deduced remember some humans are mean.
Harry : I will remember some humans are mean.
Harry : using deny negative universal, I induced forget humans are not mean.
Harry : I will forget that humans are not mean.
Harry : using affirm universal, I induced remember humans are mean.
Harry : I will remember humans are mean.
Harry : using modus ponens, I deduced remember charlie is ugly.
Harry : I will remember charlie is ugly.
Harry : using affirm particular, I deduced remember some humans are ugly.
Harry : I will remember some humans are ugly.
Harry : using deny negative universal, I induced forget humans are not ugly.
Harry : I will forget that humans are not ugly.
Harry : using affirm universal, I induced remember humans are ugly.
Harry : I will remember humans are ugly.
Harry : using reverse modus ponens, I abduced remember charlie is possibly mean.
Harry : I will remember charlie is possibly mean. - Harry : using remove uncertainty, I deduced forget charlie is possibly mean.
Harry : I will forget that charlie is possibly mean.
Tom : chad is not mean.
Harry : I will remember chad is not mean.
Harry : using negate particular, I deduced remember some humans are not mean.
Harry : I will remember some humans are not mean.
Harry : using deny affirmative universal, I induced forget humans are mean.
Harry : I will forget that humans are mean.
Harry : using affirm negative universal, I induced remember humans are not mean.
Harry : I will remember humans are not mean.
Harry : using deny negative universal, I induced forget humans are not mean.
Harry : I will forget that humans are not mean.
Tom : describe charlie.
Harry : charlie is a mean ugly human.
Tom : describe chad.
Harry : chad is not mean.
Harry : chad is a person.
Tom : describe humans.
Harry : some humans are mean.
Harry : some humans are ugly.
Harry : humans are ugly.
Harry : some humans are not mean.
Part 7A - Justifying propositional beliefs
Test conducted on: 12/12/2007.
Test conducted by: Toborman, a human.
Test evaluated by: Toborman, a human.
Test was conducted using tests 7A.1 through 7A.5 of the CIA Mental Acuity test suite.
This level of testing assumes a grade school student learning with a tutor. Test assumes no prior knowledge of the objects used in the propositions before testing.
Test Type | Desired ability | Poss | Score |
Proposition | Student should be able to justify proposition by authority. | 1 | 1 |
Proposition | Student should be able to acknowledge lack of justification of proposition. | 1 | 1 |
Proposition | Student should be able to justify proposition by logic (syllogism). | 1 | 1 |
Proposition | Student should be able to accept new proposition from authority. | 1 | 1 |
Language | Student should be able to follow conventional conversation protocol. | 1 | 1 |
Language | Student should be able to recognize why questions. | 1 | 1 |
Language | Student should be able to formulate answers to why questions. | 1 | 1 |
Total score | 7 | 7 |
ID | Speaker | Test | Actual | p/f | note |
1 |
G. Tom is a human. Humans are animals. Q. Prove Tom is an animal. A. Tom is a human. Humans are animals. Therefore, Tom is an animal. | tom: hello. what time is it? Harry: how are you. Harry: it is 05:53 PM, Tuesday, December 11, 2007. tom: humans are animals. Harry: humans are animals. tom: grant is a human. Harry: grant is a human. tom: prove grant is an animal. Harry: since humans are animals and grant is a human, it follows that grant is an animal. | |||
G. Tom is a human. Q. Why is Tom a human? A. Tom said "Tom is a human". | Tom: grant is a human. Tom: why is grant a human? Harry: Tom said grant is a human. | ||||
G. Q. Why is Tom an animal? A. I don't know why Tom is an animal. | Tom: why is grant an animal? Harry: I don't know why grant is an animal. | ||||
| Tom: Translate "I don't know why A." to "I forget who told me "A". Tom: why is Tom an animal? Harry: I forget who told me "Tom is an animal". | ||||
Test ID: 5 Coverage: Remember, recall, classify, interpret, translate. Given: [Remember that] Tom is a human. Q: Describe Tom. A: Tom is a human. | Tom: Tom is a human. Tom: Describe Tom. Harry: Tom is a human. |
Part 5c - Word and phrase Substitutions.
Test Type | Desired ability | Poss | Score |
Language | Student should be able to handle statements with [aeiou] article substitution. | 1 | |
Language | Student should be able to handle statements with personal pronoun substitution. | 1 | |
Language | Student should be able to standardize statements using word list substitution. | 1 | |
Language | Student should be able to handle English expressions using phrase substitution. | 1 | |
Language | Student should be able to follow conventional conversation protocol. | 1 | |
Total score | 5 |
- Test ID: 1 Coverage: Remember, recall, interpret, translate, [aeiou] article substitution.
- G: [Remember that] Tom is a human. Tom is astute.
- Q: Describe Tom.
- A: Tom is an astute human.
- Test ID: 2 Coverage: Remember, recall, interpret, translate,[aeiou] article agreement.
- G: [Remember that] Bruno is a character. Bruno is icy.
- Q: Describe Bruno.
- A: Bruno is an icy character.
- Test ID: 3 Coverage: Remember, recall, interpret, translate,[aeiou] article agreement.
- G: [Remember that] Fido is a dog. Fido is excited.
- Q: Describe Fido.
- A: Fido is an excited dog.
- Test ID: 4 Coverage: Remember, recall, interpret, translate, [aeiou]article agreement.
- G: [Remember that] Jerry is a gorilla. Jerry is orange.
- Q: Describe Jerry.
- A: Jerry is an orange gorilla.
- Test ID: 5 Coverage: Remember, recall, interpret, translate, [aeiou]article agreement.
- G: [Remember that] Martin is a man. Martin is unusual.
- Q: Describe Martin.
- A: Martin is an unusual man.
- Test ID: 6 Coverage: Identify, who, substitution, personal pronoun.
- G. I am Tom.
- Q. Who am I?
- A. Tom.
- Test ID: 7 Coverage: Identify, who, substitution, personal pronoun.
- G. You are Harry.
- Q. Who are you?
- A. Harry.
- Test ID: 8 Coverage: standardizing, word substitution.
- G. Replace Hi with Hello, Replace Howdy with Hello.
- Q. Howdy, Harry.
- A. Hello, Tom.
- Test ID: 9 Coverage: Translate, phrase substitution.
- G. Translate "I don't know why A." to "I forget who told me "A"."
- Q. Why is Tom an animal?
- A. I forget who told me "Tom is an animal".