next up previous index
Next: Direct theory evaluation Up: Baseline model performance Previous: Self-evaluation of agents

Interpreting the results

What the above discussion indicates is that ISAAC is a capable reader of these three stories. How does this fact contribute to an understanding of what ISAAC's abilities are? Two pieces of information are necessary for the interpretation to occur:    
1.
The performance data
2.
Access to the internal state of ISAAC before and after reading
I have already established the level of   ISAAC's performance. I can add other knowledge to this--ISAAC does not possess the concepts needed to comprehend the stories prior to reading them. In particular:

It is possible to view these two pieces of information and arrive at the following conclusion: Since the ISAAC system is a capable reader and since the system did not possess the concepts which would allow a successful comprehension to be achieved, some aspect of the system must of enabled those concepts to be created. This aspect is the   creative understanding process. In addition, an examination of ISAAC's memory after reading reveals that the ``proper'' concepts do exist in memory, while there are not random concepts created. Therefore, it can be concluded that ISAAC's creative understanding process has allowed it to read the stories, stories which it would otherwise be unable to comprehend.


next up previous index
Next: Direct theory evaluation Up: Baseline model performance Previous: Self-evaluation of agents
Kenneth Moorman
11/4/1997