Download User's Guide - Norsys Software Corp.
Transcript
numbers for nodes that haven’t been involved in any learning and haven’t had a manual entry of experience. Before learning begins (providing there has been no previous learning or entry of probabilities by an expert) the network starts off in a state of ignorance. All probabilities start as uniform, and experience starts off as 1. For each case to be learned the following is done. Only nodes for which the case supplies a value (finding), and supplies values for all of its parents, have their experience and conditional probabilities modified (i.e., no missing data for that node). Each of these nodes are modified as follows. Only the single experience number, and the single probability vector, for the parent configuration which is consistent with the case is modified. The new experience number (exper’) is found from the old (exper) by: exper’ = exper + degree where degree is the multiplicity of the case (set by you just before learning begins). It is normally 1, but is included so that you can make it 2 to learn two identical cases at once, or -1 to “unlearn” a case, etc. Within the probability vector, the probability for the node state that is consistent with the case is changed from probc to probc’ as follows: probc’ = (probc * exper + degree) / exper’ The other probabilities in that vector are changed by: probi’ = (probi * exper) / exper’ which will keep the vector normalized (exper and exper’ act as the old and new normalization constants). 10.3 Bayesian Learning If you are not interested in a technical discussion of how Netica’s learning is a form of Bayesian learning, you should skip this section. Generally speaking, it is a wise idea to relate any proposed machine learning method to a Bayesian method to better understand its assumptions, strengths and weaknesses. If it can be cast, at least approximately, into a form of Bayesian learning, then you can check to see if the prior probabilities are suitable for the problem. If it does not even roughly correspond to any - 74 -