Samples

CIAHome Testing Samples Criteria



Sample Test Results

Test was conducted using tests 1.1 through 1.10 of Van Buskirk's Mental Acuity test suite. An unexpected result was Harry's use of implication in test 1.7. This requires a knowledge of syllogistic logic not expected by the test, e.g., Humans are not quadrupeds. Tom is a human. Therefore, tom is not a quadruped.

Part 1 - Learning categorical propositions by direct input (tutoring).

ID

speaker

expected

actual

p/f

note

1.1

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

describe tom.

describe tom.

ok

 

 

student

tom is a human.

tom is a person.

pass

synonym accepted

 

tutor

 

forget tom is a human

 

clean up before next test

 

 

 

 

 

 

1.2

tutor

humans are mammals.

humans are mammals.

ok

 

 

student

 

people are mammals.

 

acknowledgement

 

tutor

describe humans

describe humans.

ok

 

 

student

humans are mammals.

people are mammals.

pass

synonym accepted

 

tutor

forget humans are mammals.

clean up before next test

 

 

 

 

 

 

1.3

tutor

humans are mammals.

humans are mammals.

ok

 

 

student

 

humans are mammals.

 

acknowledgement

 

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

is tom a mammal?

is tom a mammal?

ok

 

 

student

yes, tom is a mammal.

yes, tom is a mammal.

pass

 

 

tutor

 

forget humans are mammals.

clean up before next test

 

tutor

 

forget tom is a human.

 

clean up before next test

 

 

 

 

 

 

1.4

tutor

humans are mammals.

humans are mammals.

ok

 

 

student

 

humans are mammals.

 

acknowledgement

 

tutor

mammals are animals.

mammals are animals.

ok

 

 

student

 

mammals are animals.

 

acknowledgement

 

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

is tom an animal.

is tom an animal.

ok

 

 

student

yes, tom is an animal.

yes, tom is an animal.

pass

 

 

tutor

 

forget humans are mammals.

clean up before next test

 

tutor

 

forget tom is a human.

 

clean up before next test

 

tutor

 

forget mammals are animals.

 

clean up before next test

 

 

 

 

 

 

1.5

tutor

is tom a quadruped?

is tom a quadruped?

ok

 

 

student

I don't know if tom is a quadruped.

I don't know if tom is a quadruped.

pass

 

 

 

 

 

 

 

1.6

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

tom is not a quadruped.

tom is not a quadruped.

ok

 

 

student

 

tom is not a quadruped.

 

acknowledgement

 

tutor

is tom a quadruped?

is tom a quadruped?

ok

 

 

student

no, tom is not a quadruped.

no, tom is not a quadruped.

pass

 

 

tutor

 

forget tom is a human.

 

clean up before next test

 

tutor

 

forget tom is not a quadruped.

clean up before next test

 

 

 

 

 

 

1.7

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

humans are not quadrupeds.

humans are not quadrupeds.

ok

 

 

student

 

people are not quadrupeds.

 

acknowledgement

 

tutor

is tom a quadruped?

is tom a quadruped?

ok

 

 

student

no, tom is not a quadruped.

no, people are not quadrupeds.

pass

unexpected use of implication

 

tutor

 

forget tom is a human.

 

clean up before next test

 

tutor

 

forget humans are not quadrupeds.

clean up before next test

 

 

 

 

 

 

1.8

tutor

tom is smart.

tom is smart.

ok

 

 

 

 

tom is smart.

 

acknowledgement

 

tutor

describe tom.

describe tom.

ok

 

 

student

tom is smart.

tom is smart.

pass

 

 

tutor

 

forget tom is smart.

 

clean up before next test

 

 

 

 

 

 

1.9

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

tom is smart.

tom is smart.

ok

 

 

student

 

tom is smart.

 

acknowledgement

 

tutor

describe tom.

describe tom.

ok

 

 

student

tom is a smart human.

tom is a smart human.

pass

 

 

tutor

 

forget tom is smart.

 

clean up before next test

 

tutor

 

forget tom is a human.

 

clean up before next test

 

 

 

 

 

 

1.10

tutor

tom is a human.

tom is a human.

ok

 

 

student

 

tom is a human.

 

acknowledgement

 

tutor

tom is smart.

tom is smart.

ok

 

 

student

 

tom is smart.

 

acknowledgement

 

tutor

describe tom.

describe tom.

ok

 

 

student

tom is a smart human.

tom is a smart human.

pass

 

 

tutor

forget tom is smart.

forget tom is smart.

ok

 

 

tutor

describe tom.

describe tom.

ok

 

 

student

tom is a human.

tom is a human.

pass