Skip to content

Check: Costs, cleaning, and implementation readiness

Knowledge check · self-test

Check: Costs, cleaning, and implementation readiness

Test your understanding of data quality preprocessing concepts:

Back to the chapter →

Test your understanding of data quality preprocessing concepts:

::: {.callout-tip} ## Data Dora, Data and analytics domain expertCheckpoint: Cost Evidence {.depth-l0} You now know: - The 1-10-100 rule compares prevention, correction, and failure costs. - In the examples above, simple edge checks prevent failures ranging from wasted energy to rejected shipments. - When prevention is a timestamp comparison, range check, or median filter, the cost can be effectively negligible. ::: ::: {.callout-tip} ## Data Dora, Data and analytics domain expertCheckpoint: Cleaning and Scaling {.depth-l0} You now know: - A 5 minute gap is handled differently from a short missing-reading blip. - Exponential smoothing with `alpha = 0.3` trades responsiveness against noise reduction. - Min-max normalization depends on the chosen zone bounds, so outliers must be cleaned before scaling. ::: ::: {.callout-tip} ## Data Dora, Data and analytics domain expertCheckpoint: Implementation Readiness {.depth-l0} You now know: - The safe order is validate first, clean second, transform third. - Imputed values should be flagged so downstream analysis can distinguish estimated data from measured data. - Robust scaling is useful when outliers cannot be removed before normalization. :::

Back to Data Preprocessing Workflow: Keep the Signal Contract Reviewable