Analytics & ML · Study deck

Edge Acquisition: Missing Data and Field Design

A gateway passes data between device and wider network.

Data Dora is your guide for this deck.

edgepowergateways

Data Dora, the module guide, in a scene from this chapter.

After studying this chapter

Learning objectives

You will be able to:

Explain: That record lets the class separate three checks that are often confused in demos: the sensor was read, the gateway kept the reading, and the server received the same timestamped value.
Explain: Battery life should be 3+ years!" The scenario reports a three-month field life; compare it with the revised budget below and reconcile the difference using the measured modem duty cycle.
Explain: The sequence shows that a syntactically valid conversion is not yet an admissible request: identity and schema checks still have to protect the service boundary.
represent missing data without silently deleting evidence

A gateway preserves device meaning while translating protocols, buffering readings through outages, and forwarding them securely after connectivity returns.

Major section

AI-Generated Data Acquisition Diagrams

The chapter has treated acquisition, reduction, and gatewaying as separate design decisions.

Translation handles protocol differences, but it must keep each reading's device meaning intact.
The buffer then carries that meaning through a field-link outage instead of turning missing connectivity into missing history.

Major section

AI-Generated Data Acquisition Diagrams (continued)

The inertial-stream view that follows shows how quickly this duty grows for a high-rate source.

The dense, related traces show why raw forwarding is expensive and why reduction must preserve decision-relevant motion.
The final service boundary is shown in the API integration diagram in Figure: API Gateway Integration.
The sequence shows that a syntactically valid conversion is not yet an admissible request: identity and schema checks still have to protect the service boundary.

Major section

Store-and-Forward Gateway Exercise

That record lets the class separate three checks that are often confused in demos: the sensor was read, the gateway kept the reading, and the server received the same timestamped value.

The photograph does not itself prove reliability; it locates the resources the tasks must exercise.

A Raspberry Pi 4 provides the processor, storage interface, GPIO, and network ports needed for this store-and-forward gateway exercise; the software below supplies the buffering and synchronization contract.

Try it: Store-and-Forward Gateway Exercise in the chapter

Major section

LoRaWAN Soil Sensor Battery

A precision agriculture deployment uses LoRaWAN soil moisture sensors in vineyards.

temperature extremes: Vineyard sees -5°C to +40°C.
Rationale: Soil moisture changes slowly (hourly data unnecessary).
Cost: $0 (firmware update only, no hardware changes).
Temperature derating is critical; use the chosen battery’s discharge curve at the expected freezing temperature and load.

Major section

Include Transmission Energy

Battery life should be 3+ years!" The scenario reports a three-month field life; compare it with the revised budget below and reconcile the difference using the measured modem duty cycle.

New battery life: 3400 mAh ÷ 0.784 mAh/hour = 4337 hours = 6.0 months (still needs work).
Cellular idle current (5 mA) is 100x higher than deep sleep (50 μA) - keep modem off.
Low-power radio options (LoRaWAN, NB-IoT, satellite IoT) have different energy budgets; compare them with the chosen cellular modem under the same message schedule.
Batching transmissions reduces overhead (1 long TX < 24 short TXs due to handshake costs).

Major section

Concept Relationships

Transmission can dominate the power budget; batching is often a useful optimization when wake-up and handshake costs matter.

Edge Data Acquisition: Architecture: Non-IP Things require gateways; power budgets vary by device category.
Edge Compute Patterns: Edge processing reduces transmission (saves power); offloading to fog/cloud (costs power).
The combination makes low-power, high-reliability IoT feasible.

Deck summary

Key takeaways

The chapter has treated acquisition, reduction, and gatewaying as separate design decisions.

The inertial-stream view that follows shows how quickly this duty grows for a high-rate source.
That record lets the class separate three checks that are often confused in demos: the sensor was read, the gateway kept the reading, and the server received the same timestamped value.
A precision agriculture deployment uses LoRaWAN soil moisture sensors in vineyards.
Battery life should be 3+ years!" The scenario reports a three-month field life; compare it with the revised budget below and reconcile the difference using the measured modem duty cycle.

Retrieval practice

Recall check 1 of 3

Data Dora says: answer from memory, then check your reasoning.

Q1A factory has 200 Modbus sensors (RS-485) sending data to AWS IoT Core (MQTT). The gateway already translates Modbus to MQTT, but loses internet connectivity 3-4 times per day for 5-10 minutes. The sensors have no replay buffer and every reading must be delivered after an outage. Which additional gateway capability is MOST critical?

AStore-and-forward buffering with local persistence

BReal-time protocol translation (Modbus to MQTT)

CEdge ML inference for anomaly detection

DTLS 1.3 encryption for secure transmission

Show answer

Answer: A The gateway already bridges Modbus to MQTT.

Retrieval practice

Recall check 2 of 3

Data Dora says: answer from memory, then check your reasoning.

Q2A gateway connects Modbus (RS-485) sensors to AWS IoT Core (MQTT). Which gateway function performs the *protocol bridging* needed for interoperability?

ADeep-sleep scheduling, changing wake times without mapping Modbus to MQTT.

BCloud model training, after the gateway has delivered a valid MQTT event.

CProtocol translation from Modbus frames and registers to MQTT topics and payloads.

DImage-text extraction, which does not map fieldbus registers into topics.

Show answer

Answer: C Protocol translation maps the Modbus register values and framing from RS-485 sensors into MQTT topics and payloads for the cloud-facing connection.

Retrieval practice

Recall check 3 of 3

Data Dora says: answer from memory, then check your reasoning.

Q3What buffers bounded sensor records locally during a link outage for later transfer?

ASource and Power Management

BSensed Record with Time

CAcknowledged Upstream Handoff

DStore-and-Forward Batch

Show answer

Answer: D Local durable storage groups bounded records for efficient transfer without treating a link outage as data loss.

Q4Complete the edge computing data aggregation function:

Aself.buffer = deque(maxlen=window_size)

Bself.buffer = list()

Cself.buffer = np.zeros(window_size)

Dself.buffer = deque()

Show answer

Answer: A Edge aggregation uses a fixed-size deque buffer to maintain a sliding window of readings.

Print reference

Answers

Answer key.

A · The gateway already bridges Modbus to MQTT.
C · Protocol translation maps the Modbus register values and framing from RS-485 sensors into MQTT topics and payloads for the cloud-facing connection.
D · Local durable storage groups bounded records for efficient transfer without treating a link outage as data loss.
A · Edge aggregation uses a fixed-size deque buffer to maintain a sliding window of readings.