The 4 stages of creating an IoT architecture

Posted on 3-mei-2019 11:50:22

There are many ways to begin an enterprise or industrial Internet of Things (IoT) journey. What's important is not to let the perceived complexity of the IoT obscure the possibilities for implementing what should be enriching projects. You can get started by laying a solid framework for your IoT system

The IoT is more than Internet-connected consumer devices. Sooner or later, your IT organisation will need you to create an infrastructure to support it. Energy companies already use networked sensors to measure vibrations in turbines. They feed that data through the network to computing systems that analyse it to predict when machines will need maintenance and fail. Jet engine manufacturers embed sensors that measure temperature, pressure, and other conditions to improve their products. Even a gift basket business can deploy sensors to monitor the temperature of perishable products constantly. If temperatures in storage or in transit start to rise, they can expedite deliveries. This has the dual advantage of increasing customer satisfaction while avoiding product spoilage.

The IoT opens far more opportunities than most organisations are pursuing today. And even when they do follow them, IT leaders don’t always fully engage in IoT-related requests. Industry discussions of IoT initiatives often emphasise the complexity and involve areas of the business in which IT hasn’t traditionally been involved. The proliferation of unfamiliar IoT technologies—some of them industry-specific—and the vast scope of the global IoT itself can intimidate IT and obscure the possibilities for what should be very viable and compelling projects. So, how can your infrastructure support IoT?

You'll need to invest in the kind of four-part architecture that supports many IoT systems today. Picture these four parts as stages in a process. All four are integrated, mutually reinforcing structures that carry value-laden data from the various networked "things" to production and traditional IT systems to deliver actionable business insights. 

Ovum Decision Matrix for Multicloud and Hybrid Cloud Management 2018-19: GET REPORT

The four-stage architecture of an IoT system

Stage 1 of an IoT architecture consists of your networked things, typically wireless sensors and actuators. Stage 2 includes sensor data aggregation systems and analogue-to-digital data conversion. In Stage 3, edge IT systems preprocess the data before moving to the data centre or cloud. Finally, in Stage 4, the data is analysed, managed, and stored on traditional back-end data centre systems. The sensor/actuator state is the province of operations technology (OT) professionals. So is Stage 2. Stages 3 and 4 are typically controlled by IT, although the location of edge IT processing may be at a remote site or nearer to the data centre. The dashed vertical line labelled "the edge" is the traditional demarcation between OT and IT responsibilities, although this is blurring. Here's a look at each in detail.

4_stage_iot_solutions_architecture_0

Stage 1. Sensors/actuators

Sensors collect data from the environment or object under measurement and turn it into useful data. Think of the specialised structures in your cell phone that detect the directional pull of gravity—and the phone's relative position to the “thing” we call the earth—and convert it into data that your phone can use to orient the device. Actuators can also intervene to change the physical conditions that generate the data. An actuator might, for example, shut off a power supply, adjust an airflow valve, or move a robotic gripper in an assembly process. 

The sensing/actuating stage covers everything from legacy industrial devices to robotic camera systems, water-level detectors, air quality sensors, accelerometers, and heart rate monitors. And the scope of the IoT is expanding rapidly, thanks in part to low-power wireless sensor network technologies and Power over Ethernet, which enable devices on a wired LAN to operate without the need for an A/C power source.

In an IoT architecture, some data processing can occur in each of the four stages. However, while you can process data at the sensor, what you can do is limited by the processing power available on each IoT device. Data is at the heart of an IoT architecture, and you need to choose between immediacy and depth of insight when processing that data. The more immediate the need for information, the closer to the end devices your processing needs.

For deeper insights that require more extensive processing, you'll need to move the data into a cloud- or data centre-based system that can bring several sources of data together. But some decisions can’t wait for deep processing. Did the robotic arm performing the surgery cut an artery? Will the car crash? Is the aircraft approaching the threat detection system a friend or a foe? You don't have time to send that data to your core IT assets. You must process the information right at the sensor— at the very edge of the edge network—for the fastest response.

Stage 2. The Internet gateway

The data from the sensors start in analogue form. That data needs to be aggregated and converted into digital streams for further processing downstream. Data acquisition systems (DAS) perform these data aggregation and conversion functions. The DAS connects to the sensor network, aggregates outputs, and serves the analogue-to-digital conversion. The Internet gateway receives the aggregated and digitised data and routes it over Wi-Fi, wired LANs, or the Internet to Stage 3 systems for further processing.

Stage 2 systems often sit close to the sensors and actuators. For example, a pump might contain a half-dozen sensors and actuators that feed data into a data aggregation device that also digitises the data. This device might be physically attached to the pump. An adjacent gateway device or server would then process the data and forward it to the Stage 3 or Stage 4 systems.

Why preprocess the data? The analogue data streams that come from sensors create large volumes of data quickly. The measurable qualities of the physical world your business may be interested in—motion, voltage, vibration, and so on—can create voluminous amounts of constantly changing data. Think how much sensor data a complex machine like an aircraft engine might generate in one day, and there’s no theoretical limit to the number of sensors that could be feeding data into an IoT system. What’s more, an IoT system is always on, providing continuous connectivity and data feeds. IoT data flows can be immense—I've seen as much as 40 TB/second in one case. That's many data to transport into the data centre. It's best to preprocess it.

Another reason not to pass the data on to the data centre in this form is that analogue data has specific timing and structural characteristics that require specialised software to process. It's best to convert the data into digital format first, which happens in Stage 2. 

Intelligent gateways can build on additional, basic gateway functionality by adding such capabilities as analytics, malware protection, and data management services. These systems enable the analysis of data streams in real-time. Although delivering business insights from the data is a little less immediate at the gateway than when sent directly from the sensor/actuator zone, the gateway has the compute power to render the information in a more understandable form to business stakeholders. 

Gateways are still edge devices—they’re external to the data centre—so geography and location matter. In the pump example, if you have 100 pump units and want to process data on-premises, you might have instant data at the pump level, aggregate the information to create a plantwide view for the facility, and pass the data on to the data centre for companywide view. DAS and gateway devices may end up in various environments, from the factory floor to mobile field stations, so these systems are usually designed to be portable, easy to deploy, and rugged enough to withstand variations in temperature, humidity, etc., dust, and vibration.

Stage 3. Edge IT

Once IoT data has been digitised and aggregated, it's ready to cross into the realm of IT. However, the data may require further processing before it enters the data centre. This is where edge IT systems, which perform more analysis, come into play. Edge IT processing systems may be located in remote offices or other edge locations. Still, generally, these sit in the facility or location where the sensors reside closer to the sensors, such as in a wiring closet.

Because IoT data can quickly eat up network bandwidth and swamp your data centre resources, it's best to have systems at the edge capable of performing analytics as a way to lessen the burden on core IT infrastructure. If you just had one large data pipe going to the data centre, you'd need enormous capacity. You'd also face security concerns, storage issues, and delays in processing the data. With a staged approach, you can preprocess the data, generate meaningful results, and pass only those on. For example, rather than passing on raw vibration data for the pumps, you could aggregate and convert the data, analyse it, and send only projections of when each device will fail or need service.

Here's another example: You might use machine learning at the edge to scan for anomalies that identify impending maintenance problems that require immediate attention. Then you could use visualisation technology to present that information using easy-to-understand dashboards, maps, or graphs. Highly integrated compute systems, such as hyper-converged infrastructure, are ideal for these tasks because they're relatively fast and easy to deploy and manage remotely.

Stage 4. The data centre and cloud

Data that needs more in-depth processing and where feedback doesn't have to be immediate gets forwarded to the physical data centres or cloud-based systems. More powerful IT systems can analyse, manage, and securely store the data. It takes longer to get results when you wait until data reaches Stage 4, but you can execute a more in-depth analysis and combine your sensor data with data from other sources for deeper insights. Stage 4 processing may take place on-premises, in the cloud, or in a hybrid cloud system, but the type of processing executed in this stage remains the same, regardless of the platform.

Living on the edge

The 4-stage approach to IoT infrastructure and processing will require new levels of collaboration, particularly as the separations between these stages start to blur. If you’re an OT professional, be prepared to work side by side with IT professionals. If you’re in IT, get ready to collaborate more closely with OTs. Eventually, the two functions will converge as the IoT pulls domain expertise deeper into data processing.

IT professionals can build their IoT skills by starting small and working with domain experts to identify sources of potentially valuable data. Would understand the operating conditions of a machine help operations design more efficient maintenance cycles? Could developing knowledge of air temperature fluctuations in a warehouse help to improve product storage? Investigate the sensors and edge devices you would need to harvest the data. Design the infrastructure. Then experiment with making sure that the project produces results that make for a strong business case.

The IoT continues to reshape commercial, industrial, scientific, and engineering endeavours in profound and unpredictable ways. In the scientific revolution of the 17th century, newly invented instruments extended the reach of human senses far into the microscopic and astronomic realms. The IoT is the instrument that will enable your organisation to connect intelligent technologies to the data-emitting universe of objects. The implications for IT infrastructure will be just as far-reaching. 

Source: https://techbeacon.com/4-stages-iot-architecture.

Topics: Big Data, Data Architecture

Gregory Van Seghbroeck

Written by Gregory Van Seghbroeck

CTO at Tengu.io

Join our 100+ subscribers!

Stay informed about topic related to DataOps, data management, Tengu, interesting data events.

Subscribe