← Back to the chapter · Previous detail · Next detail →
Technical detail · Validation and Outlier Detection
Association, group means, and binary effects
Pearson's product-moment coefficient measures association rather than agreement. It measures linear correlation between two numeric variables: positive values mean the variables tend to rise together, negative values mean one tends to fall as the other rises, and values near zero mean there is little linear dependence. The population form is rho_XY = E[(X - mu_X)(Y - mu_Y)] / (sigma_X sigma_Y), so the statistic depends on means, standard deviations, and the expected cross-product of deviations. It is useful for summarising association, but it is not a release argument unless the unit error, bias, and decision threshold also pass.
ANOVA is the group-comparison partner to that idea. It tests a null hypothesis that two or more groups have the same population mean, then reports an F-statistic that compares variation between group means with variation within the samples. A p-value can be derived from that F-statistic, but the field decision still needs effect size, group definition, sampling conditions, and engineering consequence. For IoT experiments, ANOVA can help compare firmware filters, sensor placements, calibration recipes, or operating modes, but it cannot by itself say which option is safe to ship.
For binary outcomes, keep odds and risk separate. Odds divide events by non-events; risk divides events by all people or devices at risk. An odds ratio compares exposed odds with control odds, while a risk ratio compares exposed risk with control risk. In both cases, a ratio of 1 means no difference, values above 1 indicate higher odds or risk, respectively, in the exposed group, and values below 1 indicate lower odds or risk. Report the 95 percent confidence interval with the ratio; if the interval crosses 1, do not call the result statistically significant.