Line 41: Line 41:


= Edge node platforms =
= Edge node platforms =
Edge nodes are playing an important role for AIoT. They are covering all compute resources required outside the cloud or central data centers. This is a highly heterogenous space, with a wide breadth of solutions, from tiny embedded systems to nearly full-scale edge data centers.
Edge computing is rooted in the embedded systems space. Embedded systems are programmable, small-scale compute nodes, combining hardware and software. Embedded systems are usually designed for specific functions within a larger system.
Today, typical edge node platform include embedded microcontrollers (MCUs), embedded microprocessors (MPUs), Single Board Computers and even full-scale PCs. While the boundaries are blurry, an MCU usually is a single-chip computer, while an MPU has surrounding chips (memory, interfaces, I/O). MCUs are very low-level, while MPUs run some kind of specialized operating system. Other differences include costs and energy consumption.
[[File:HW IoT Edge Nodes.png|800px|frameless|center|Edge Node Platforms]]
[[File:HW IoT Edge Nodes.png|800px|frameless|center|Edge Node Platforms]]
Some other key technologies often found in the context of edge node platforms include:
- Module (or Computer-on-Module, CoM): a specific function (e.g. a communication module), which can be integrated with a base board via standardized hardware interfaces. Provides high level of flexibility and re-use on the hardware level.
- SoC (System-on-a-Chip): combines multiple modules into a single, tightly integrated chip. Used especially for highly standardized, mass-produced systems, like smart phones and tablets.
- ASIC (Application Specific Integrated Circuit): a chip that is custom designed for a specific purpose, e.g. running a mature and hardened algorithm. Provides high performance and low cost if mass-produced, but requires high level of maturity because no changes after production possible.
- FPGA (Field Programmable Gate Arrays): chips which are programmed using highly efficient but also very low-level, configurable logic blocks. Application logic can be updated after manufacturing.


= Sensor edge nodes =
= Sensor edge nodes =

Revision as of 22:03, 28 August 2021

More...More...More...More...More...More...AIoT Framework

AIoT hardware (& physical product components)

AIoT hardware includes all the physical components required to build an AIoT product or retrofit solution. For the retrofit solution, this will usually include sensors, as well as edge and cloud (or on-premise) compute resources. Most retrofit solutions will not include actuators. Products, on the other hand, must not only provide the IT-related hardware plus sensors, actuators and AI compute resources, but also all the mechanical components for the product, as well as the product chassis, body and housing. Finally, both AIoT products and solutions will usually require specialized IT hardware for AI inferencing and AI training. The concepts developed for Cyber Physical Systems (CPS) will also be of relevance here. The following will look at both, the AIoT product and retrofit solution perspective, before discussing details of the hardware requirements and options for edge/cloud/AI.

Smart, connected products

The hardware for a smart, connected product must include all required physical product components. This means that it will not only include the edge/cloud/AI perspective, but also the physical product engineering perspective. This will include mechatronics, a discipline combining mechanical systems, electronic systems, control systems and computers.

In the example shown here, all hardware aspects for a vacuum robot are depicted. This includes edge IT components like the on-board computer (including specialized edge AI accelerators), connectivity modules, HMI (Human-Machine Interaction), antennas, sensors and actuators like the motors, plus the battery and battery charger. In addition, it also includes the chassis and body of the vacuum robot, plus the packaging.

The cloud or on-premise backend will include standard backend compute resources, plus specialized compute resources for AI model training. These can be, for examples, GPUs (Graphics Processing Unit used for AI), TPUs (Tensor Processing Unit), or other AI accelerators.

Setting up the supply chain for such a wide breadth of different IT and other hardware components can be quite challenging. This will be discussed in more detail in the sourcing section.

Hardware for smart, connected product

Smart, connected (retrofit) solutions

For smart, connected retrofit solutions, the required hardware typically include sensors, edge compute nodes, and backend compute resources (cloud or on-premise). The example shown here is the hardware provided for a predictive maintenance solution for hydraulics components. This complete case study from Bosch Rexroth is included in part IV.

The hydraulic components include electric and hydraulic motors, tanks, filters, cooling units, valves, and so on. Customers are using these components for many different applications, e.g. in manufacturing, process industries, or mining. The hardware components for the retrofit solution include different sensor packages, each one specialized for a particular hydraulic component. For example, the sensor package for a hydraulic pump includes sensors to measure pressure and leakage, while the sensors for a hydraulich cylinder include sensors for chamber pressure and oil temperature. Since this is a retrofit solution which is sold to many different customers, it is important that each sensor pack has custom connectors which make it ease to attach a sensor package and its different sensors to the corresponding hydraulic component in the field.

Other hardware component provided include an edge data acquisition unit (DAQ), as well as an IoT gateway to enable connectivity to the backend. Backend hardware is not shown in this example, but will obviously also be required.

This is an example for a very mature solution, which is designed to serve multiple customers in different markets. This is why the different hardware components are highly standardized. AIoT solutions which are not replicated as often might have a lower level of maturity and a more ad-hoc hardware architecture.

Hardware for smart, connected solution (retrofit)

Edge node platforms

Edge nodes are playing an important role for AIoT. They are covering all compute resources required outside the cloud or central data centers. This is a highly heterogenous space, with a wide breadth of solutions, from tiny embedded systems to nearly full-scale edge data centers.

Edge computing is rooted in the embedded systems space. Embedded systems are programmable, small-scale compute nodes, combining hardware and software. Embedded systems are usually designed for specific functions within a larger system.

Today, typical edge node platform include embedded microcontrollers (MCUs), embedded microprocessors (MPUs), Single Board Computers and even full-scale PCs. While the boundaries are blurry, an MCU usually is a single-chip computer, while an MPU has surrounding chips (memory, interfaces, I/O). MCUs are very low-level, while MPUs run some kind of specialized operating system. Other differences include costs and energy consumption.

Edge Node Platforms

Some other key technologies often found in the context of edge node platforms include: - Module (or Computer-on-Module, CoM): a specific function (e.g. a communication module), which can be integrated with a base board via standardized hardware interfaces. Provides high level of flexibility and re-use on the hardware level. - SoC (System-on-a-Chip): combines multiple modules into a single, tightly integrated chip. Used especially for highly standardized, mass-produced systems, like smart phones and tablets. - ASIC (Application Specific Integrated Circuit): a chip that is custom designed for a specific purpose, e.g. running a mature and hardened algorithm. Provides high performance and low cost if mass-produced, but requires high level of maturity because no changes after production possible. - FPGA (Field Programmable Gate Arrays): chips which are programmed using highly efficient but also very low-level, configurable logic blocks. Application logic can be updated after manufacturing.

Sensor edge nodes

Sensor edge nodes are edge nodes which are specifically designed to process sensor data. Most basic sensors are actually providing an analog signal. These analog signals are continuous in time, thus consuming a very high bandwidth. They are usually sinusoidal in shape (i.e. the look like a sinus curve). In order to be able to process and filter these signals, they need to be converted to a digial format. This helps reduce bandwith, and makes the signals processable with digital technologies. Usually a Digital-to-Analog Converter (DAC) is used to connect an analog devices to digital one. However, before this happens the analog signals are often preprocess, e.g. using amplification to reduce noise and get a more meaningful signal.

The digitalization of the signal is often done using Discrete Fourier transform (DFT). DFT computation techniques for fast analog/digital signal conversion are known as Fast Fourier Transform (FFT). Based on linear matrix operations, FFTs are supported, for example, by most FPGA platforms.

After the conversion to a digital format, the digital signal can now be processes using either traditional algorithms, or AI/ML. A discussion on the benefit of edge-based pre-processing of sensor data is provided in the [Data_101|Data 101]].

Finally, most sensor edge nodes provide some form of data transmission capability, to ensure that after pre-processing and filtering the data can be send to a central backend via an IoT / edge gateway.

Edge sensor nodes

AI edge nodes

AI Edge Nodes

Putting it all together

Putting it all together