Fundamentals · Study deck
Protocol Pioneers: Ethernet and MQTT
Ethernet let many local machines share a link.
Physics Phoebe is your guide for this deck.
After studying this chapter
Learning objectives
You will be able to:
- Explain: For IoT specifically: When you connect an ESP32 running Arduino MQTT client to AWS IoT Core, it works despite the client being a hobbyist implementation and AWS being an enterprise platform.
- Explain: For ESP32 developers: When you use PubSubClient library to publish sensor data to sensors/room/temperature, you're using the protocol Stanford-Clark designed for oil pipelines 25 years ago.
- Explain: JSON Parsers: IoT platforms accept JSON with trailing commas or unquoted keys, even though strict JSON forbids this, because being "liberal in what you accept" improves interoperability.
Major section
Bob Metcalfe (1946-): Ethernet Inventor
In the early 1970s, Xerox PARC (Palo Alto Research Center) had dozens of computers and the world's first laser printer.
- Researchers wanted to share the printer, but there was no good way to network the machines.
- Point-to-point cables didn't scale -- connecting $N$ devices requires $\frac{N(N-1)}{2}$ cables.
Major section
Bob Metcalfe (1946-): Ethernet Inventor (continued)
This requires only $N$ connections instead of $\frac{N(N-1)}{2}$.
- If someone else is talking, wait.
- Collision Detection: If two devices start transmitting simultaneously (collision), both detect it and stop.
- Exponential Backoff: After a collision, wait a random time before retrying.
- Each collision doubles the wait range.
Major section
Bob Metcalfe (1946-): Ethernet Inventor (continued)
This addressing scheme is still used today.
- Metcalfe's story explains why Ethernet then became valuable at scale: each compatible node made the shared ecosystem more useful.
- Translation: A network's value is proportional to the square of the number of users.
- This explains why social networks grow explosively once they reach critical mass.
Major section
What Metcalfe Made Possible
Industrial IoT: Factory machines use Industrial Ethernet variants (EtherCAT, PROFINET, Ethernet/IP) -- all descendants of Metcalfe's invention.
- Building Automation: BACnet/IP and Modbus TCP run over Ethernet, connecting HVAC systems, lighting, and access control.
- IoT Gateways: Raspberry Pi, ESP32 Ethernet modules, and industrial gateways use Ethernet to connect to the cloud.
- A user with 5 Matter devices from 1 vendor has 10 possible interactions ($\frac{5 \times 4}{2}$).
Major section
Jon Postel (1943-1998): "God of the Internet"
They connect document review, shared protocol identifiers, and the specifications that implementations use.
- The timeline below places these responsibilities in context, showing that interoperability depends on maintaining agreements as well as inventing protocols.
- Someone had to coordinate all this chaos.
- The Internet community trusted him to make fair decisions, and he did.
Major section
Jon Postel (1943-1998): "God of the Internet" (continued)
Postel's Law keeps the Internet unified despite vendor diversity.
- IANA Manager (1972-1998): He did this from his desk at USC (University of Southern California) with minimal staff.
- "Be conservative in what you send, liberal in what you accept.".
- The U.S. Government was not amused.
Major section
Jon Postel (1943-1998): "God of the Internet" (continued)
Within months, oversight of DNS was transferred to ICANN (Internet Corporation for Assigned Names and Numbers), a new nonprofit.
- If every device rejected messages with minor formatting errors, the Internet would fragment into incompatible islands.
- "Jon Postel was the Internet.".
- His influence is invisible but everywhere.
Major section
What Postel Made Possible
A client that sends a slightly malformed CONNECT packet might still connect if the broker can infer the intent.
- For IoT specifically: When you connect an ESP32 running Arduino MQTT client to AWS IoT Core, it works despite the client being a hobbyist implementation and AWS being an enterprise platform.
- That interoperability comes from both sides following Postel's Law -- AWS tolerates minor client deviations, and the Arduino library tries to be standards-compliant.
- JSON Parsers: IoT platforms accept JSON with trailing commas or unquoted keys, even though strict JSON forbids this, because being "liberal in what you accept" improves interoperability.
Major section
Andy Stanford-Clark: MQTT Co-creator
Postel's standards work explains how the Internet stays coordinated.
- Stanford-Clark's MQTT work shows what happens when those open-network foundations meet a severe IoT constraint: tiny messages over expensive links.
- Below, publishers send to a broker that routes topics to subscribers with selectable QoS.
- Any system with sensors and actuators could use MQTT.
Major section
Andy Stanford-Clark: MQTT Co-creator (continued)
HTTP was too heavy -- each HTTP request had 200+ bytes of headers.
- For thousands of sensors sending frequent updates, HTTP was unusable.
- Quality of Service (QoS) Levels: Sensors can choose the right tradeoff between reliability and overhead.
- Last Will and Testament: If a client disconnects unexpectedly (e.g., network failure), the broker automatically publishes a "last will" message the client specified during connection.
Major section
What Stanford-Clark Made Possible
Smart Homes: Zigbee2MQTT, Tasmota, ESPHome all use MQTT to integrate devices with Home Assistant.
- Connected Vehicles: Tesla uses MQTT for vehicle-to-cloud communication.
- For ESP32 developers: When you use PubSubClient library to publish sensor data to sensors/room/temperature, you're using the protocol Stanford-Clark designed for oil pipelines 25 years ago.
- It works just as well for your $5 hobby project as it did for million-dollar industrial deployments.
Deck summary
Key takeaways
In the early 1970s, Xerox PARC (Palo Alto Research Center) had dozens of computers and the world's first laser printer.
- This requires only $N$ connections instead of $\frac{N(N-1)}{2}$.
- This addressing scheme is still used today.
- Industrial IoT: Factory machines use Industrial Ethernet variants (EtherCAT, PROFINET, Ethernet/IP) -- all descendants of Metcalfe's invention.
- They connect document review, shared protocol identifiers, and the specifications that implementations use.
Retrieval practice
Recall check
Physics Phoebe says: answer from memory, then check your reasoning.
Q1A building gateway links BACnet/IP devices over a wired network. Which contribution provides the local network foundation in the chapter?
Show answer
Answer: C The section connects building and industrial gateway networks to Ethernet.
Q2A battery sensor sends routine measurements and important alerts over MQTT. What design choice can distinguish their delivery needs?
Show answer
Answer: B The chapter contrasts power-conscious routine telemetry with acknowledged important alerts.
Print reference
Answers
Answer key.
- C · The section connects building and industrial gateway networks to Ethernet.
- B · The chapter contrasts power-conscious routine telemetry with acknowledged important alerts.