29 Sensor Fusion and Kalman Filtering

29.1 Start With the Measurement Story

This section: Start With the Measurement Story — Picture a strain sensor on a bridge.

Picture a strain sensor on a bridge. Its reading changes with load, but also with heat, age, mounting stress, and small random effects. A clean number on a screen can hide those very different causes.

Start with the physical event and a known test input. Record the expected direction, size, and response time. Repeat the test over time and temperature. Then hold the load steady, remove one sensor, and add a slow offset. Check whether the method mistakes drift for a real change.

Use averaging only after you know which kind of error is present. It can reduce fast random noise, but it cannot remove every slow change. Combining sensors can expose faults, yet it can also combine shared errors. An advanced method is useful only when its limit is visible.

Go deeper in two steps. The Practitioner material examines slow noise and sensor fusion. Under the Hood follows the physical sensing chain and the limits that appear before an action.

Use a four-part sensor record. First, name the physical event. Next, name the part that turns it into a signal. Then name each change made by the circuit and code. Last, name the action that uses the result.

Place a check at every part. Apply a known input. Hold it still. Repeat it. Change heat and time. Compare two units. Keep the raw result and the cleaned result. This makes a hidden slow shift easier to see.

Choose the method from the fault. Use a filter for the kind of noise it can reduce. Use a second sensor only when it adds a different clue. Keep a stop rule for disagreement. Review the whole chain after a new part, mount, case, sample rate, or field setting.

Advanced sensing begins when one reading is no longer enough. Start with the real claim - smoother position, better anomaly evidence, or more robust context - then decide whether filtering, fusion, or a Kalman model earns its complexity.

29.2 Field Sensors Fail Differently

This section: Field Sensors Fail Differently — Maria, an agricultural IoT engineer, was frustrated.

Maria, an agricultural IoT engineer, was frustrated. Her soil moisture sensors worked perfectly in the lab---readings were stable, accurate, and repeatable. But three months after deploying them across a vineyard in Napa Valley, farmers started complaining: “The readings wander around even when it hasn’t rained in weeks!”

After days of debugging, Maria discovered something that surprises many engineers: averaging more samples doesn’t always help. Her sensors suffered from a phenomenon called 1/f noise, where longer measurement windows actually captured more low-frequency drift, not less. The solution wasn’t more averaging---it was smarter signal processing and combining multiple sensors together.

This chapter takes you on the journey from lab-perfect sensors to field-reliable systems. You’ll learn why some noise defies averaging, how combining sensors makes them stronger than any individual sensor, and what it takes to build sensing systems that work reliably for years in harsh real-world conditions.

29.3 Why This Matters

This section: Why This Matters

29.4 In 60 Seconds

This section: In 60 Seconds

The mathematical gist. Independent white noise shrinks as $1/\sqrt{N}$, so 10, 100, 1,000, and 10,000 samples ideally improve noise by 3.16×, 10.0×, 31.6×, and 100×. A longer averaging window also passes more low-frequency behavior. An approximate window to inspect is $T\approx1/(2f_{corner})$, or about 1 s for this chain’s 0.5 Hz 1/f corner. For an ideal white-plus-flicker model, the Allan-deviation minimum is nearer $0.36/f_{corner}$ (about 0.7 s here), showing that 1 s is a heuristic rather than an exact optimum. Measure noise versus averaging time and preserve the required signal response.

Math Bridge · guided foundationsWhy does √N averaging stop helping?Let Phoebe connect sample cancellation, window bandwidth, and the chapter's 0.5 Hz corner. Learn the maths

29.5 Key Concepts

This section: Key Concepts

• MEMS Sensors: Micro-Electro-Mechanical Systems sensors fabricated using semiconductor processes; combine mechanical sensing elements with signal conditioning electronics on a single chip, enabling miniature low-cost accelerometers, gyroscopes, and pressure sensors.
• Piezoelectric Effect: The generation of electrical charge in a material when mechanical stress is applied; used in vibration sensors, ultrasonic transducers, and force sensors; also works in reverse (electrical voltage causes mechanical strain).
• Hall Effect Sensor: Produces a voltage proportional to a perpendicular magnetic field; used for contactless current sensing, position detection, and rotary encoders — immune to wear unlike mechanical contacts.
• Time-of-Flight (ToF) Sensor: Measures distance by timing the round-trip of a laser or ultrasonic pulse; lidar ToF sensors achieve millimeter resolution; more accurate than ultrasonic and unaffected by ambient sound levels.
• Capacitive Sensing: Measures changes in capacitance caused by proximity, touch, or dielectric variation; used in soil moisture sensors, proximity switches, touch screens, and liquid level detection without direct contact.
• Thermal Imaging Array: A grid of thermopile elements producing a 2D temperature map; the MLX90640 (32x24 pixel) provides room-scale thermal images for occupancy detection and predictive maintenance.
• Load Cell: A strain-gauge-based transducer that converts force to an electrical signal; it uses Wheatstone-bridge excitation and instrumentation amplification. The Omega LCCD/LCMCD series specifies 0.01% full-scale repeatability; system resolution depends on the cell and readout.
• Electrochemical Gas Sensor: Uses oxidation/reduction reactions at electrodes to produce current proportional to gas concentration; used for CO, NO2, and other toxic gases; requires periodic calibration and has limited operating lifetime.

29.6 What Makes This Advanced

This section: What Makes This Advanced

29.7 Meet the Sensor Squad

This section: Meet the Sensor Squad

29.8 Prerequisites

This section: Prerequisites — If terms like “low-pass filter” or “calibration offset” feel unfamiliar, review those chapters first---this chapter builds directly on those concepts.

Before diving in, make sure you’re comfortable with:

• Signal Processing Fundamentals: Filtering techniques and noise characteristics
• Calibration Techniques: Error sources and correction methods

If terms like “low-pass filter” or “calibration offset” feel unfamiliar, review those chapters first---this chapter builds directly on those concepts.

29.9 Quick Prerequisite CheckCheck your understanding: Quick Prerequisite Check

This section: Quick Prerequisite Check

29.10 Part 1: The 1/f Noise Problem

This section: Part 1: The 1/f Noise Problem — Let’s start with the mystery Maria encountered: why doesn’t more averaging always help?

Let’s start with the mystery Maria encountered: why doesn’t more averaging always help?

29.11 Optional High-Pass Filter Pattern

This section: Optional High-Pass Filter Pattern — 3.

# Simple high-pass filter to remove DC drift
alpha = 0.99  # Cutoff tuning parameter
filtered = 0.0
previous_reading = sensor.read()

while True:
    new_reading = sensor.read()
    filtered = alpha * (filtered + new_reading - previous_reading)
    previous_reading = new_reading

3. Apply chopping/modulation. Periodically reverse the sensor’s polarity or bias, then subtract alternate readings. This moves your signal above the 1/f corner frequency where noise is well-behaved.

4. Use correlated double sampling. Take two measurements under different conditions (e.g., with and without excitation), then subtract. The 1/f noise, being correlated between samples, largely cancels out.

To decide whether averaging can improve a slow sensor, inspect Figure 29.1 in the frequency domain first. The plot separates frequency-independent white noise from the low-frequency rise associated with flicker noise.

Shows: Figure 29.1: 1/f Noise Spectrum: The frequency domain view shows white noise (flat) and 1/f noise (rising at low frequencies) intersecting at the corner frequency. Below the corner, averaging becomes ineffective.

+

Show text version

Read Figure 29.1, begin in the flat white-noise region, move toward lower frequency, and locate the corner where the rising 1/f contribution takes over. Longer averaging suppresses independent noise but eventually encounters drift-like low-frequency behaviour, connecting the spectrum to the need for calibration or high-pass treatment.

29.12 Explore 1/f Noise and Averaging

This section: Explore 1/f Noise and Averaging

29.13 When One Sensor Is Not Enough

This section: When One Sensor Is Not Enough — This is called sensor fusion, and it’s the secret behind everything from smartphone navigation to self-driving cars.

Now that you understand why individual sensors have inherent limitations (noise that doesn’t average away, drift over time, blind spots in certain conditions), let’s explore a powerful solution: combining multiple sensors to create something stronger than any individual sensor.

This is called sensor fusion, and it’s the secret behind everything from smartphone navigation to self-driving cars.

29.14 Fusion Rule of Thumb

This section: Fusion Rule of Thumb — Before adding sensor fusion, inspect Figure 29.2 to identify what independent information each sensor contributes and where uncertainty is combined.

Before adding sensor fusion, inspect Figure 29.2 to identify what independent information each sensor contributes and where uncertainty is combined.

Shows: Figure 29.2: Sensor Fusion Architecture: Multiple sensors with complementary strengths feed into a Kalman filter fusion engine, producing a best estimate more accurate than any individual sensor.

+

Show text version

Read Figure 29.2 from the complementary sensor inputs through preprocessing and the fusion engine to the state estimate. The route connects redundancy to improved observability while preserving the need to reject correlated faults and biased inputs.

The key is figuring out the right weights---how much to trust each sensor at each moment. That’s where the Kalman filter comes in.

29.15 Continue: Kalman Filtering

This section: Continue: Kalman Filtering — The Kalman material is now a focused child chapter instead of a second mini-chapter inside this page.

The Kalman material is now a focused child chapter instead of a second mini-chapter inside this page.

Start by Kalman filtering and position fusion: prediction-update steps, MicroPython and Arduino examples, tuning tools, GPS plus IMU fusion, and Kalman gain practice.

29.16 Continue: Production Sensor Systems

This section: Continue: Production Sensor Systems — Production validation is now a focused child chapter so field reliability, validation simulators, complementary-filter tuning, and deployment failure modes can be read without expanding this overview.

Production validation is now a focused child chapter so field reliability, validation simulators, complementary-filter tuning, and deployment failure modes can be read without expanding this overview.

• Production sensor fusion and validation: lab-to-field degradation, validation rules, strategy selection, complementary filters, production pitfalls, and practice activities.

29.17 MEMS Sensor Implementation Chain

This section: MEMS Sensor Implementation Chain — Miniaturisation does not remove the measurement chain; it packs the chain into fewer packages and makes power-domain timing more important.

Miniaturisation does not remove the measurement chain; it packs the chain into fewer packages and makes power-domain timing more important. Follow one sample from physics to radio rather than treating a MEMS part as a single magic block.

The wake sequence is causal. First the power controller enables the sensing and analog domains. Next it waits for bias, reference, amplifier, and filter settling. Then the ADC acquires the signal and the MCU applies calibration. Only after a valid record exists should the radio wake, transmit, and wait for an acknowledgement. Finally firmware stores retry and quality state before switching domains off. Skipping the settling interval saves apparent time but turns yesterday’s charge, reference ramp, or filter transient into today’s reading.

For a simple 1 ms active, 1 s sleep schedule, use charge rather than averaging currents by eye. If $I_a$ is active current, $I_s$ is sleep current, $t_a=1\ \text{ms}$, and $t_s=1\ \text{s}$, then

At $I_a=24\ \text{mA}$ and $I_s=8\ \mu\text{A}$,

That attractive number survives only if start-up, sensor warm-up, retries, leakage through GPIOs, and regulator quiescent current fit the model. A 20 ms warm-up at the same active current would dominate the 1 ms radio burst. Build the schedule from oscilloscope or power-profiler phases, not just the radio datasheet.

The timed component chain in Figure 29.3 connects the 1 ms communication window to every block that must settle before a valid packet exists.

Shows: Figure 29.3: A miniature sensor node converts a transducer signal through bias, analog conditioning, ADC, MCU, and radio under a one-second sleep and one-millisecond active schedule.

+

Show text version

In Figure 29.3, Transducer precedes Bias / bridge, Amp + filter, and ADC before MCU can form a packet. The ACTIVE · 1 ms overlay is credible only if reference settling, sensor warm-up, radio startup, acknowledgement, and retry work fit inside it; otherwise the apparent sleep ratio hides real energy.

29.18 Miniaturisation Limits Before Actuation

This section: Miniaturisation Limits Before Actuation — This is the handoff to an actuator, not a reason to abandon miniaturisation.

Smaller force sensors gain integration and may gain resonant frequency, but the signal and every noise mechanism do not scale together. Start with thermal equilibrium. A spring mode stores mean energy on the order of $k_BT$, giving an RMS displacement

For a viscously damped mode, the one-sided thermal force-noise density is

The mechanical transfer function turns that force into displacement, and the readout adds roughly size-independent amplifier, reference, and quantisation noise. Consequently, shrinking geometry does not guarantee a quieter force estimate. Under common families of similarly tuned structures, the acceleration-equivalent or thermomechanical error often worsens approximately with $1/\sqrt{m}$ as proof mass falls. Treat that as a scaling rule to verify for the actual $k$, $b$, bandwidth, and temperature, not as a universal substitute for the noise model.

Surface effects also become harder to ignore. If a characteristic length is $L$, volume and mass scale approximately as $L^3$, while exposed area scales as $L^2$; therefore surface-to-volume ratio scales as $1/L$. Surface charge traps, adsorption, contamination, package stress, and contact-related 1/f processes can occupy more of the error budget as the structure shrinks. Electrical noise may stay almost fixed while the mechanical signal falls, so the interface circuit can set the resolution even when fabrication improves.

This is the handoff to an actuator, not a reason to abandon miniaturisation. The sensor estimates a state and attaches uncertainty; control logic decides whether action is allowed; a driver converts the low-energy command into voltage or current; and the actuator converts supplied electrical, pneumatic, hydraulic, thermal, or mechanical energy into motion or force. Keep command energy separate from actuator energy: a GPIO can request motion, but the power stage and supply deliver it. At microscale, write both the sensing noise budget and the actuator force, travel, heating, and saturation budget before closing the loop.

The scale comparison in Figure 29.4 carries miniaturisation uncertainty all the way into a physical-output proof.

Shows: Figure 29.4: Large and small force sensors compare thermal displacement, surface effects, and fixed electronics noise before a measured command drives an actuator.

+

Show text version

In Figure 29.4, 10 mg force sensor and 0.1 mg force sensor keep electronics noise: 5 µV fixed while thermal displacement and surface risk rise. The lower chain carries force = 2.4 mN through command = 65% and 24 V power stage to valve moves 12 mm, keeping sensing uncertainty separate from actuation energy and feedback.

29.19 Summary

This section: Summary

Key advanced sensor takeaways:

• 1/f noise limits long-term averaging - Know the corner frequency before choosing an averaging window.
• Sensor fusion beats single sensors - Combine complementary measurements rather than trusting one noisy or drifting channel.
• Kalman filtering is the next implementation step - Use the child chapter when you need prediction-update code and gain tuning.
• Production systems need validation - Use the production child chapter when a sensor result can drive action, alerts, or maintenance.

29.20 You Might Also Like

This section: You Might Also Like