Download Synop Analyzer 2.2.4 User's Guide

Transcript
3.2. The Module ’Correlations Analysis’
69
3.2 The Module ’Correlations Analysis’
3.2.1 Purpose and short description
The data exploration module ’Correlations Analysis’ serves to get an overview over the
dependencies and correlations between the different data fields within a data source. This
is done by creating a table of field-field contingency coefficients.
3.2.2 The tabular correlations view
The main part of the correlations analysis panel displays a table of field-field correlations. In the literature, there are many different definition of measures for correlation, for
example the linear correlations coefficient (or Pearson’s correlations coefficient) between
two nummeric data fields. Linear correlations coefficients have values between -1 (strong
negative correlation) and +1 (strong positive correlation).
In Synop Analyzer, we use another measure for correlation which can also be calculated
for pairs of textual data fields, or for a numeric and a textual field: the so-called adjusted
contingeny coefficient C as it is defined in http://en.wikipedia.org/wiki/Contingency_table. This quantity assumes values between 0 (=no correlation) and 1 (=maximum
correlation). The contingency coefficient is stronly related to the bivariate value-value
matrix of the two involved fields as it is created in the Synop Analyzer module Bivariate
Analysis: if one creates a bivariate value-value matrix for two data fields such that the
field with the higher number of different values is traced on the y-axis, then one can derive
from this matrix
• a contingency coefficient of 1 if and only of in each matrix row all cells except one
are completely empty and all data records fall into one single populated cell. When
displayed in the module Bivariate Analysis, the matrix would only show intensively
red colored cells with count=0 and one single intensively green colored cell per row.
• a contingency coefficient of 0 if and only if each matrix cell contains exactly the
number of data records which one could have expected from calculating the product
of the relative appearance frequencies of the column value and the row value. When
displayed in the module Bivariate Analysis, such a matrix would have only white
matrix cells.
In the following we show an example for a continceny table. The example uses the
sample data doc/sample_data/customers.txt and Synop Analyzer’s default settings
for importing the data.