Download User's Guide - Norsys Software Corp.

Transcript
numbers for nodes that haven’t been involved in any learning and haven’t had a manual entry of
experience.
Before learning begins (providing there has been no previous learning or entry of probabilities by
an expert) the network starts off in a state of ignorance. All probabilities start as uniform, and
experience starts off as 1.
For each case to be learned the following is done. Only nodes for which the case supplies a
value (finding), and supplies values for all of its parents, have their experience and conditional
probabilities modified (i.e., no missing data for that node). Each of these nodes are modified as
follows. Only the single experience number, and the single probability vector, for the parent
configuration which is consistent with the case is modified. The new experience number (exper’)
is found from the old (exper) by:
exper’ = exper + degree
where degree is the multiplicity of the case (set by you just before learning begins). It is
normally 1, but is included so that you can make it 2 to learn two identical cases at once, or -1 to
“unlearn” a case, etc.
Within the probability vector, the probability for the node state that is consistent with the case is
changed from probc to probc’ as follows:
probc’ = (probc * exper + degree) / exper’
The other probabilities in that vector are changed by:
probi’ = (probi * exper) / exper’
which will keep the vector normalized (exper and exper’ act as the old and new normalization
constants).
10.3
Bayesian Learning
If you are not interested in a technical discussion of how Netica’s learning is a form of Bayesian
learning, you should skip this section.
Generally speaking, it is a wise idea to relate any proposed machine learning method to a
Bayesian method to better understand its assumptions, strengths and weaknesses. If it can be
cast, at least approximately, into a form of Bayesian learning, then you can check to see if the
prior probabilities are suitable for the problem. If it does not even roughly correspond to any
- 74 -