Download An Environment for Graphical Models

Transcript
Chapter 9
Stepwise Model-selection:
Backward and Forward
This chapter is on stepwise model selection in CoCo.
The incremental search in CoCo is performed by forward inclusion (Dempster 1972)
and backward elimination (Wermuth 1976) of edges (or interaction-terms). In the
backward elimination of edges in graphical models edges are sequentially eliminated
from the independence graph. In the forward selection the edges are sequentially
added to the independence graph.
Wermuth (1976) considers stepwise edge elimination on decomposable models.
Two resent books Christensen (1990) and Whittaker (1990) each contain a chapter
on model selection. In Whittaker (1990) with the title “Graphical Models” the model
selection is of course treated in relation to graphical models, but also in Christensen
(1990) an excellent discussion of model search on graphical model is given. Edwards
(1993) considers some computational aspects of both the stepwise edge selection and
the EH-procedure, see the next chapter.
In CoCo the backward elimination and the forward selection can be started from
any initial model. The backward elimination procedure is not restricted to work on
edges, but can also perform stepwise elimination of interaction-terms. Analogously
with the forward selection. Steps of the backward elimination and the forward selection can be mixed together in any order, and between each step any set of edges or
interaction-terms can be added or eliminated.
The backward elimination from the saturated model has the advantage that the
tests are not performed under models later to be found rejected. In the forward
selection from the uniform model the initial tests will be performed under models likely
to be rejected. But in the forward selection the initial tests often will be collapsible
to small tables, and much larger tables can be handled. The marginal associations
tested in the first step of a forward selection from the uniform model might also be of
some interest.
The resulting models from each cycle of the backward elimination and the resulting
model from the forward selection are added to the linked list of models in CoCo.
103