Open access peer-reviewed chapter

Perspective Chapter: Edge-Cloud Collaboration for Industrial IoT – An Online Approach

Written By

You Shi, Yuye Yang, Changyan Yi, Bing Chen and Jun Cai

Reviewed: 10 February 2023 Published: 15 March 2023

DOI: 10.5772/intechopen.110475

From the Edited Volume

Edge Computing - Technology, Management and Integration

Edited by Sam Goundar

Chapter metrics overview

82 Chapter Downloads

View Full Metrics

Abstract

In this chapter, we take the Industrial Internet of Things (IIoT) as the background for studying the energy-saving resource management framework to control the cloud center (CC), edge server (ES), and terminal equipment in a closed loop. In this framework, industrial sensors collect data and transmit it to the ES for aggregation. These data form computing tasks for data analysis. Our goal is to minimize the energy consumption of the whole system while ensuring satisfied data processing accuracy and service delay of all IIoT tasks. We formulate the ES preprocessing mode selection, sensor sampling rate adaptation, and edge cloud computing and communication resource allocation as a joint optimization problem. Due to the random arrival of data and time-varying channel conditions, we introduce an online dynamic algorithm with low complexity, which efficiently solves the problem.

Keywords

  • edge-cloud collaboration
  • industrial IoT
  • preprocessing method selection
  • sampling rate adaption
  • computing and communication resource allocation

1. Introduction

Due to the rapid development of 5G and Industry 4.0, IIoT-sensing devices, such as smart manufacturing, smart plants, and smart industrial services, have generated a abundant of data. For traditional cloud computing, it is considerably challenging to process such massive data efficiently. Fortunately, the edge computing can significantly reduce the cloud computing’s computing load, and thus has been proposed as supplementary paradigm recently [1]. In industrial area, the edge server (ES) close to the data source can be enabled to process some computing tasks, so as to provide more effective data processing services and lead to less communication overhead.

Although some researchers have proposed edge cloud collaboration to increase the industrial systems’ operational and energy efficiencies, there are still some inherent while unaddressed limitations. Particularly, computing and communication resources of the edge-cloud collaboration are relatively limited [2]. Hence, if closed-loop optimization is not considered in the management of cloud, ES, and terminal devices, edge cloud collaboration cannot fully make use of its advantages. Some relevant researchers have studied the resource allocation problem of IIoT’s edge cloud collaboration [3, 4], including delay awareness, price-based service scheduling [2, 3], and energy-aware resource allocation [4, 5].

However, data collection and data analysis have some special requirements which will be affected by the complex industrial environment, which has been ignored by most studies: (i) In IIoT system, industrial equipment needs high-precision adjustment. Any small error may cause industrial equipment to make wrong behavior and cause serious troubles. [5]. Therefore, ensuring the accuracy of data processing in IIoT service is very important. This motivates the investigation and optimization of edge cloud management variables such as processing mode and sampling rate. (ii) There are commonly a variety of industrial noises in practical applications, such as electromagnetic noise [6]. Because of these, we cannot analyze the data collected by the sensor directly [7]. Hence, enabling data preprocessing at ESs is necessary (for example, data cleaning [7] and data denoising [6]) before conveying data to the cloud. This necessitates a balance of optimal resource allocations between the cloud and ESs. (iii) Since the IIoT system environment is always complex and there are random data arrival and time-varying channels, we are required to carefully manage the computing and communication resources with the guarantee of a long-term performance. Otherwise, the system will soon run out of limited CPU resources and network capacity [8]. As a result, the system efficiency will be seriously affected.

However, solving the aforementioned issues to achieve the closed-loop management is very challenging: (i) It is intuitive that the processing accuracy is increasing with the sampling rate. However, increasing the rate is equivalent to the increase of the computing load, and thus will also increase transmission delay and computing energy consumption, leading to the degradation of the system performance [5]. This implies that sampling rate must be carefully chosen for balancing different performance indicators. (ii) In practical applications, different preprocessing methods have different computing resource requirements and corresponding processing performance. In addition, data’s edge preprocessing will bring extra computing delay and energy consumption. It is difficult to optimize service delay, processing accuracy, and power consumption with mutual trade-offs. (iii) In response to the random data’s arrival and the time-varying channel, we need to jointly optimize and dynamically adjust the selection of preprocessing methods, sampling rate, and resource allocation. However, it is hard if not impossible to obtain random information of dynamic network in time, which is a necessary condition for long-term optimization of system performance. This will obviously lead to incomplete decision information of IIoT system. Lyapunov optimization method is often used to solve such problems. However, in IIoT applications, decision variables (such as preprocessing method and sampling rate) are often integers, and constraints like processing accuracy and service delay are sometimes nonlinear. This makes the problem much more complex than traditional ones.

Advertisement

2. Chapter contributions and organization

In this book chapter, we study an IIoT energy resource management framework. This framework is constructed on the basis of edge cloud collaboration, and aims to conduct a closed-loop management on the cloud center (CC), ESs, and terminal devices. To be more specific, in this chapter, we consider to optimize the selection of ESs’ preprocessing mode, terminal devices’ sampling rates, edge cloud computing and communication resource allocation for jointly to minimize the system’s energy consumption. Meanwhile, we ensure service delay and accuracy of data processing in the long term. In addition, considering the random arrival of data and time-varying channel conditions, we introduce a dynamic online algorithm with a low complexity to solve this problem.

In particular, based on the network state of the current time slot, we decompose the long-term optimization problem into a sequence of deterministic instantaneous subproblems. After that, we define a continuous probability model and take into account the future influences, and by such we use the Markov approximation algorithm to solve these subproblems to near optimal. Finally, we theoretically analyze the system performance in terms of its asymptotic upper bound.

This chapter’s main contributions are listed as follows.

  • For controlling the IIoT edge cloud collaboration system in a closed-loop manner, we formulate a joint optimization with computing and communication resource allocation of CC, preprocessing method selection of ESs, and sampling rate adaptation of end terminals to minimize the energy consumption of the whole system while ensuring that all applications’ service delay requirements and data processing accuracy demands can be met.

  • Based on Markov approximation and Lyapunov optimization, we introduce a novel online joint optimization algorithm with a polynomial time complexity.

  • Theoretical analysis and simulation results evaluate the proposed algorithm’s asymptotic optimality and show its advantage with the comparison of counterparts.

This chapter’s rest contents are listed below. Section 3 models the IIoT edge-cloud collaboration’s system. Section 4 formulates the corresponding joint online optimization problem for the closed-loop resource management. Section 5 introduces a novel algorithm with a low complexity based on the Markov approximation and Lyapunov optimization. Section 6 analyzes theoretical performance. Section 7 demonstrates the simulation outcomes and Section 8 concludes the chapter.

Advertisement

3. System model

An IIoT system with a remotely located CC and multiple distributed on-site ESs is considered, as shown in Figure 1. Each ES connects multiple IIoT sensors for a known purpose (e.g., mechanical bearings’ vibration monitoring) and is used to control devices (e.g., management of its data sampling rates), preprocessing the gathered original data, and further analyzing by offloading them to CC. Denote the ESs’s set as I=12N, where I=N. Denote Si as the set of ES i‘s associated devices. For example, we consider mechanical bearing vibration monitoring task [5], the vibration sensors sample the conditions of operation in the coverage area managed by ES i with specific sampling rate. After that, ES i collects vibration signals, then selects an appropriate mode1 to preprocessing it. Afterwards, to conduct the computation-intensive data analysis, preprocessed data will be offloaded by ES i to CC. Clearly, this collaboration between edge clouds needs to be sustained by a good closed-loop management with three task decisions: (i) sampling rate adaptation of sensors, (ii) pre-processing mode selection for ESs, and (iii) computational and communication resources’ allocation.

Figure 1.

An example of edge preprocessing enabled IIoT.

In addition, we investigate a time-slotted operation framework in order to portray the intrinsic IIoT systems’ time-varying dynamics. Denote τ as time index, and τT=12T. We show in Table 1 all the important symbols appeared in this chapter for easy reference.

SymbolDefinition
λi,nτDevice n’s data arrival rate in slot τ
hi,cτChannel gain between ES i and CC in slot τ
xi,kτES i’s sampling rate vector in slot τ
diτTask size received by ES i in slot τ
biτPreprocessed task size in slot τ
WBandwidth level
piESES i’s transmit power
αiτES i’s bandwidth allocation
ciτCloud resource allocation
EiτES i’s service energy in slot τ
AiτAccuracy of ES i’s task in slot τ
AithLong-term accuracy requirement
HithLong-term delay requirement
VLyapunov parameter

Table 1.

List of important notations.

3.1 Communication model

IIoT devices’ sampling rates can be adjusted according to the purpose of different applications. Define K=φ1φ2φK as the candidate sampling rate set, where φK (measured by Hz) indicates original sampling rate, K as the maximum sampling rate level. Calculate any level k’s sampling rate as φk=kφK/K, where 1kK. In addition, vK is defined as the original data size generated in each time slot with maximum sampling rate φK. θ indicates the time slot duration. We define xi,kτ=1, which denotes that in time slot τ, ES i chooses k-th sampling rate of all its affiliated devices. Else, xi,kτ=0. Denote λi,nτ (measured by every second’s data number) as device n’s data arrival rate under ES i‘s control. Knowing all devices’ sampling rate, the task size generated in time slot τ ES i is formulated by combining collected data from every its affiliated devices in current time slot, which is expressed as

diτ=nSik=1Kxi,kτλi,nτθvKk/K.E1

Then, ES i will preprocess this task. As data denoising application for preprocessing [10] usually reduces the computational task size, we particularly focus on it here. Assuming that my denotes maximum transforming rate in size of the computational task using the preprocessing mode yY, then after preprocessing, ES i’s task size in time slot τ is represented as

biτ=diτyYIi,yτmy.E2

All tasks’ input bits should further transmit to CC for learning and analysis. The wireless channel between CC and ESs remains constant within each time slot and varies between time slots following independent identical distribution [11]. Based on the Shannon formula, CC and ES i’s transmission rate is

riτ=αiτWlog21+piEShi,cταiτWN0,αiτ>00,αiτ=0E3

where W and N0 denote communication bandwidth and channel noise power spectral density, respectively. piES is the predefined transmission power of ES i. From ES i to CC, channel gain is defined as hi,cτ. It includes the effects of small-scale fading, path loss, and shadowing [12]. Significantly, hi,cτ is an environmental state uncontrollably where positive constant hmax has an upper bound [13]. Denote αiτ as ES i‘s bandwidth allocation ratio over time slot τ. It should satisfy conditions listed below: 0αiτ1, and i=1Nαiτ1. The similar definitions appear in [2, 13].

Computational task’s transmission delay after preprocessing from ES i to CC is calculated as

Fitraτ=biτ/riτ,E4

and the corresponding transmission energy consumption is

eitraτ=piESFitraτ.E5

3.2 Computation model

3.2.1 Edge preprocessing model

ES can provide several optional modes of data preprocessing. Denote y as a feasible algorithm of data denoising in a complete set Y, and the corresponding CPU computation speed (cycles/s) for each data denoising algorithm is denoted by fy,yY.

Denote Ii,yτ01 as ES i’s selection index of preprocessing mode at time slot τ. Ii,yτ=1 represents ES i has selected preprocessing algorithm yY. Otherwise, Ii,yτ=0. It is obvious that we have yYIi,yτ=1. It is important to note that the computational delay for selecting mode y for data preprocessing of ES i at time slot τ can be indicated as

Tiyτ=diτβi/fy,E6

where βi denotes CPU cycles’ number that are needed to compute one bit in ES i. Thus diτβi is computational resource which is required by preprocessing step. After that, ES i’s preprocessing computational delay in slot τ is indicated as

Fipreτ=yYIi,yτTiyτ.E7

Therefore, ES i’s CPU computation speed (in cycles/s) is described as fiτ=yYIi,yτfy. Hence, ES i‘s preprocessing energy consumption in time slot τ can be characterized as

eipreτ=ziESfi3τFipreτ,E8

where ziES is ES i’s effective switching capacitance, which is dependent on its chip architecture [14].

3.2.2 Cloud computing model

Tasks received by CC are collected from multiple ESs and each ES’s allocated cloud resources. Let ciτ be cloud resources’ allocated proportion for ES i. The proportion should satisfy conditions list below:0ciτ1, and i=1Nciτ1. After that, CC’s computation delay in processing ES i’s computation tasks should be indicated as

Ficτ=biτεc/ciτfc,E9

where fc and εc respectively denote CC’s CPU computation speed and CPU cycles number required to compute one bit in CC. In addition, CC’s energy consumption for processing ES i’s computational task is represented as

eicτ=zcciτfc3Ficτ,E10

where zc is effective switched capacitance of CC [14].

3.3 Accuracy model for IIoT data analysis

Tasks’ processing accuracy relies on two factors, ESs’ data preprocessing method and IIoT devices’ data sampling rate. We hypothesize that gφk,φkK is the association between sampling rate and accuracy, and gyy,yY is the association between preprocessing mode and accuracy. Moreover, learning models deployed in cloud center may have computational errors, resulting in reduced processing accuracy, which is denoted by hc1 [5].

Because of sampling rate control, cloud process and preprocessing method control are independent with each other [2]. Task processing’s accuracy for ES i is

Aiτ=gk=1Kxi,kτφkyYIi,yτgyyhc.E11

It is important that we can modify the model flexibly in practice to another form depending on various demands. The analysis framework remains valid. In addition, data-based experiments allow to obtain accuracy values regarding sampling rate and preprocessing mode [2].

Advertisement

4. Problem formulation

ESs’ preprocessing mode and sensors’ sampling rate can influence the computing accuracy, and the computing resources and bandwidth allocation of CC can influence the efficiency of computing and transmission. Significantly, these decisions are all closely associated. For example, if the wireless channel condition is poor or computation load of the system is large, ESs can select efficient preprocessing method and reduce the sampling rate. Hence, the CC may increase the computing and communication resources allocation ratios correspondingly. The advantage of the operations is to decrease the execution delay, transmission delay, and energy consumption. The disadvantage is that it will lose some processing accuracy. It shows that a trade-off exists in service delay, processing accuracy, and system energy consumption. For improving IIoT system’s energy efficiency, we intend to minimize system energy consumption, which includes ESs’ computing energy consumptions, ECs’ offloading transmission energy consumption, and CC’s energy consumption, with guaranteed processing accuracy and service delay. Every ES’s computation task represents an application. We calculate time slot τ’s energy consumption as

Eiτ=eiESτ+eitraτ+eicτ.E12

Because of the industrial environment’s time-varying features, for minimizing long-term dynamic energy consumption, we need to manage the IIoT edge cloud collaboration system. Therefore, the EC computing system’s average energy consumption is selected as performance measurement, i.e., 1Tτ=1Ti=1NEiτ. Then we jointly optimize sampling rates of sensors, preprocessing method of ESs, and computing and communication resources of edge cloud, which denotes as Jiτxi,kτIi,yταiτciτ,iI, can be represented as

2P1:minJiτiI1Tτ=1Ti=1NEiτE13
s.t.0αiτ1,i=1Nαiτ1,iI,E14
0ciτ1,i=1Nciτ1,iI,E15
Ii,yτ01,yYIi,yτ=1,iI,E16
xi,kτ01,k=1Kxi,kτ=1,iI,E17
limT+1Tτ=1THiτHith,iI,E18
limT+1Tτ=1TAiτAith,iI,E19

where (14)-(17) respectively represent the constraints of bandwidth allocation, cloud computing resource allocation, preprocessing method selection, and sampling rate.

Constraint (18) is average service delay in the long term. Constraint (19) is processing accuracy. They are the constraints of ES iI which have unique purposes, where Hith and Aith are requirements of application related threshold. Hiτ denotes the ES i’s delay performance, so that Hiτ=FiESτ+Fitraτ+Ficτ,iI.

RemarkP1 is a dynamic stochastic optimization problem and we must decide all these decisions in the time slot. The problem’s objective is minimizing system energy consumption in a long-term way in dynamic network. Due to two reasons, solving the problem is challenging: (i) due to the number of previous information is extremely large, the statistics of data arrival rates and time-varying channel conditions may be hard to obtain in IIoT systems; and (ii) because of the quick growth of the ES and IIoT devices’s number, traditional dynamic programming is difficult to handle its large state space and action space, which will result in high computational complexity [11]. Lyapunov optimization [15] is used to solve long-term stochastic optimization problem, but preprocessing mode selection Ii,yτ and sampling rate adaption xi,kτ are discrete binary decision variable. Further, constraints (18) and (19) are nonlinear, making P1 be a mixed integer nonlinear programming problems. To handle the problem, heuristic algorithms are a low-complexity solution. However, the solution cannot guarantee algorithm performance, so in IIoT applications, it is not recommended. To address this issue, an online algorithm is designed to solve this question in the next section. In the first step, according to current network states, we use Lyapunov optimization method to decompose the long-term optimization problem into real-time optimization subproblems. In the second step, based on Markov approximation technology, we developed an approximation algorithm. We consider the future impact and introduce the continuous probability model, and obtain the asymptotic optimal solution of the subproblem within the verified analysis range.

Advertisement

5. Online resource management algorithm

5.1 Lyapunov-based online method

Dealing with the long-term accuracy and delay constraints are main challenges to solve problem P1. Therefore, we use the Lyapunov optimization method. For IIoT applications, Lyapunov optimization method constructs overdue delay queues and accuracy deficit queues. The problem decomposition’s detailed procedure is shown as follows.

First, we define the delay overflow queues and accuracy deficit queues of IIoT applications. For each ES i, the dynamic changes of the accuracy deficit queue are represented below:

Qiτ+1=AithAiτ++Qiτ.E20

Here, if Z is a non-negative value, Z+=Z. Otherwise, it is 0. Qiτ indicates that there exists a deviation between the instantaneous accuracy and ESi’s required long-term accuracy at time slot τ.

We represent overdue delay queue’s dynamic change of ES i below:

Miτ+1=HiτHith++Miτ,E21

where Miτ represents the i-th ES’s deviation between computation task’s service delay and long-term required delay in time slot τ.

Then, Lyapunov function is defined according to [15] as

LΘτ12iIQiτ2+Miτ2,E22

where ΘτQiτMiτ.

Thus, the Lyapunov drift can be represented as

ΔΘτ=ELΘτ+1LΘτΘτ.E23

Accordingly, we represent the Lyapunov drift-penalty function as

ΔVΘτ=ΔΘτ+VEEiτΘτ,E24

where V0+ is a control parameter. Next, the upper bound of ΔVΘτ is derived for any feasible solution Jiτ,iI, which is written in Theorem 1.1.

Theorem 1.1 ΔVQτ has an upper bounded for any Jiτ,iI, which can be written as

ΔVΘτB+Ei=1NQiτAithAiτ+MiτHiτHithΘτ+VEEiτΘτ,E25

where B is a positive constant which can adjust the tradeoff between the satisfaction degree of the long-term accuracy and service delay constraints and the energy consumption cost.

Proof: We square two sides of accuracy deficit dynamics and we have

Qi2τ+1=AithAiτ+2+Qi2τ+2QiτAithAiτ+AithAiτ2+Qi2τ+2QiτAithAiτ.E26

We subtract Qi2τ from two sides and then multiply by 0.5. Then, for iI=1,2,3N, we sum up these inequalities. So, we have

12i=1NQi2τ+1Qi2τ12i=1NAithAiτ2+i=1NQiτAithAiτ.E27

Similarly, for delay overflow dynamics in (15), we can make such operations

Mi2τ+1=HiτHith+2+Mi2τ+2MiτHiτHith+HiτHith2+Mi2τ+2MiτHiτHith.E28

We subtract Mi2τ from two sides and multiply by 0.5. Then, for iI, we sum up these inequalities:

12i=1NMi2τ+1Mi2τ12i=1NHiτHith2+i=1NMiτHiτHith.E29

Combine (22) and (23), we can get

LΘτ+1LΘτ12i=1NAithAiτ2+12i=1NHiτHith2+QiτAithAiτ+MiτHiτHith.E30

Finally, VEiτ is added to two sides of (30) and take expectation of two sides of Θτ as the condition. Then, desired result can be obtained in (25), where B=12i=1NAithAiτ2+12i=1NHiτHith2.

The online joint preprocessing method selection, sampling rate adaption. and resource management algorithm aims to minimize ΔVΘτ‘s upper bound in Theoerm 1.1. The service delay and processing accuracy should be maintained at an expected level. At the same time, we can minimize the CC and ESs’ system energy consumption. Algorithm 1 shows the details. Note that P2’s constraints and P1’s constraints are the same. The P2‘s objective function corresponds to the right side of (25). In every time slot τ, we solve P2 to obtain the optimal preprocessing method selection, sampling rate adaption, and resource management. Then, we update overdue delay queues and accuracy deficit queues.

Algorithm 1: Online Joint Sampling Rate Adaption, Preprocessing Mode and Resource Management Algorithm (OSPRA).

  1. Initialization: At the beginning of slot τ, collect the status information of CC, ESs, and each sensors.

  2. Observe the queue set Θτ, channel gain hiτ, and data arrival rate λnτ of n-th device.

  3. Determine xi,kτ for each sensor, Ii,yτ for each ES, αiτ for each edge cloud link, and ciτ for cloud computing by solving

    P2:minJiτUiτ=B+Ei=1NQiτAithAiτ+MiτHiτHithΘτ+VEEiτΘτs.t.1419.

  4. Update queue Qiτ and Miτ depending on (20) and (21).

  5. Return the best value of Jiτ.

  6. τ=τ+1.

Sampling rate adaption xi,kτ and preprocessing method selection Ii,yτ are discrete binary decision variable. Meanwhile, the CC’s bandwidth and computation resource allocation is nonlinear. Therefore, problem P2 is mixed integer nonlinear programming (MINLP) problem.

Theorem 1.2 Problem P2 is NP-hard.

Proof: Firstly, we discuss a specific problem case. In this case, we fix the CC’s bandwidth and computation resource allocation. Therefore, sampling rate and preprocessing method are selected discretely in problem P2. We can easily reduce the case to a multiple knapsack problem and the problem is known as NP-hard [16].

To address this issue, network configurations are set up as a time-reversible continuous-time Markov chain’s states. We can prove that after a finite number of iterations, the CC’s preprocessing method selection, sampling rate adaption, and the bandwidth and computation resource allocation can achieve stable states.

5.2 Approximately optimal solution for P2

Denote feasible solutions’s set as J, and the feasible solution of problem P2 satisfy jJ. Denote the probability of adopting solution j at time slot τ as qj. Then, problem P2 can be converted into the equivalent form:

minq0jJqjiIUijτs.t.jJqj=1,E31

where iIUijτ is qj‘s weight. The optimal solution of problem (31) results in minimum weight. We may transform the problem continuously by using log-sum-exp approximation [17].

First, convex log-sum-exp function Gδjτ is used to approximate the optimization objective Uijτ, which is represented below:

Gδjτ=1δlogjJexpδiIUijτ,E32

and we analytically show its approximation gap in Theorem 1.3.

Theorem 1.3 The convex log-sum-exp function Gδjt in (32) can approximate the optimization objective in (31) by

minjJiIUijτ1δlogJGδjτminjJiIUijτ,

where δ is a positive constant and the approximation gap is upper-bounded by 1δlogJ.

Proof: Given the constant δ, inequality holds:

minjJiIUijτ1δlogexpδminjJiIUijτminjJiIUijτ1δlogJ.E33

Convex log-sum-exp function’s value precisely approximates min function’s result, when δ approaches infinity, i.e.,

minjJiIUijτ=minδ1δlogjJexpδiIUijτ.E34

What’s more, the value of the problem’s optimal solution and log-sum-exp function Gδjτ are equal according to Theorem 1.3, which is represented as follows:

minq0jJqjiIUijτ+1δjJqjlogqj,s.t.jJqj=1.E35

Namely, we can convert problem (31) to problem (35).

By solving the KKT condition [17] of problem (35) can be represented as follows:

iIUijτ1δlogqj+1δ+η=0jJqj=1,η0,E36

We can obtain the probability distribution qj of optimal solution as follows:

qj=expiIδUijτjJexpiIδUijτ,jJ.E37

We can see that the different solutions’s probabilities have direct ratio with corresponding weights Uijτ. Every solution jJ is paired with a specific state, we construct a time-reversible Markov sequential chain [18] which has a stationary distribution qj. Switching one solution to another and transitioning between two states are equal. ES selecting new preprocessing mode and sampling rate and CC adopting new computation and communication resource allocation decision trigger it.

Algorithm 2: Markov Approximation-Based Algorithm for P2.

  1. Initialization: Initialize Uijτ by initializing sampling rate xi,kτ, preprocessing mode Ii,yτ, and resource allocation in ESs and cloud center.

  2. End initialization

  3. Loop:

  4. Select a random solution and perform the following steps:

  5. Compute all other feasible solutions for the bound Uijτ.

  6. Using the probability derived from (37), choose a feasible solution.

  7. Update the feasible solution.

  8. Record the optimal solution j when Uijτ is the smallest.

  9. End Loop

We must guarantee that random two states can convert if we want to build a time-reversible Markov sequential chain. Therefore, we limit one preprocessing method selection and sampling rate in ES and CC’s one communication and computation resource allocation in time slot. If we make a decision of preprocessing mode Iiyτ, sampling rate xki, computation and communication resource allocation αiτ, ciτ, previous solution j converts to new solution j' of transition rate qj,j' non-negatively. To satisfy the time-reversibility feature, we have designed a transition rate which can satisfy the equation which is written as follows:

qjqj,j=qjqj,j,j,jJ,E38

The feasible solution’s transition rate is represented as

qj,j=ϑexp12δUjτUjτ,j,jJE39

where ϑ is a positive constant. Transition rate qj,j increases if weight gap jj increases. It means that adopting a lower-weight solution has higher probability.

Algorithm 2 shows the algorithm based on Markov approximation which intends to solve problem P2. It can be executed on network platform. It can collect large amount of network state information to make real-time decisions. The algorithm combines in feasible solutions randomly to update time-reversible Markov sequential chain’s state in update iterations. If Uijτ is minimized by a feasible solution j, it will be recorded and the algorithm explores the following combination in solutions until all combinations have been attempted.

Advertisement

6. Performance analysis

The algorithm combines Markov approximation and Lyapunov optimization and the performance of algorithm is analyzed theoretically.

6.1 Time complexity analysis

The introduced algorithm includes two algorithms (algorithms 1 and 2) mainly. In algorithm 1, Lyapunov optimization is used to resolve resource management, preprocessing method selection, and sampling rate adaption in dynamic environment. Therefore, algorithm 1 generates many feasible solutions. In solution update iteration, algorithm 2 records the optimal solution found up to now until it explores all feasible solutions. The Markov approximation algorithm converges with linear rate quickly, through adjusting appropriate parameters. Therefore, we can get the asymptotic optimal solution quickly. In the process of iteration, a solution is chosen by the system randomly for updating control information. Because long-term problem is decomposed into some instant subquestions by using Lyapunov optimization, we focus on solving approximate solutions’ complexity. As we defined in Section III, Sampling rate adaptation has K feasible solutions at most, and preprocessing method has y feasible solutions at most. There are yK feasible solutions at most in set Ujτ, because both are discrete. Each ES traverses all the solutions. Denote ρ as the ESs’ average iteration number which aims to get the stationary Markov chain. Moreover, OSPRA algorithm’s complexity of time can be represented as OKyρ.

6.2 Optimality analysis

Theorem 1.4 We set up coefficients δ and V, the optimality gap of initial problem’s optimal solution and introduced algorithm’s approximate solution theoretically is written as follows:

τ=0T1EEiτΘτp+B/V+logJ/δV,E40

where p means the optimal solution theoretically.

Proof: Since executing drift-penalty algorithm can get accuracy strategies Hiτ and time delay Aiτ in time slot τ, we presume that accuracy actions Hiτ and time delay Aiτ are in the best decision.

Based on Theorem 1.1, the both sides’ expectations can be represented as

ΔVΘτ=ΔΘτ+VEEiτΘτB+Ei=1NQiτAithAiτ+MiτHiτHithΘτ+VEEiτΘτB+Vp.E41

Then, by getting the summation of above derivation (41), we get

B+VpTτ=0T1EΔVΘτΘτ=ELΘτ+Vτ=0T1EEiτΘτELΘ0.E42

Finally, we move E[LΘ0 to the inequality’s left side, and divide two sides by V. Since E[LΘ00, we can find Theorem 1.4’s conclusion.

From Theorem 1.4, if V(the control parameter) is sufficiently large, the algorithm can obtain the approximate solution which reaches the optimal solution p infinitely.

Advertisement

7. Simulation results

We carry on simulations to evaluate the proposed online algorithm’s performance on joint preprocessing method selection, sampling rate adaption, and resource management in IIoT systems with the support of edge-cloud collaboration. Particularly, we show the performance of energy consumption, service delay, and processing accuracy, respectively.

7.1 Simulation setup

We setup an IIoT system with edge-cloud collaboration which has a remote CC and multiple distributed ESs on site. For example, in bearing vibration fault monitoring applications, each ES connects to 10 IIoT devices and is used to collect mechanical equipments’s data of bearing vibration. Then, by one of the three preprocessing methods, the raw data can be preprocessed (which are WT [19], BiNOSP [20], CLPM [10]) and are offloaded to CC for further data analysis. We define that there are three candidate sampling rates for IIoT devices, which are initial sampling rates 33, 66, and 100%, and set the initial sampling rate φK=18 kHz [5]. Referring to [5], 0.59, 0.73, and 0.884 are respectively the three sampling rates’ corresponding processing accuracies (Table 2).

ParameterValueParameterValue
λi,nτ[0.5, 1] data/sN10
φK18 kHzAith0.8
hc0.9fiy1.2, 1.7, 2.2G cycles/s
W[5, 25] MHzgyy1.3, 1.5, 1.7
fc2.8 G cycles/sPiES500 mW
my[0.7, 0.95]βi, εc550, 1200 cycles/bit
ziES, zc107, 1027N0−174 dBm/Hz

Table 2.

Simulation parameters.

Besides, we simulate the following benchmarks for comparison, aiming to show the advantage of the OSPRA algorithm.

  • Accuracy-Guaranteed Resource Management Algorithm (AGRMA): It does not preprocess data at edge servers and simply solves the joint sampling rate adaption, computing and communication resource allocation at the cloud. A deep reinforcement learning (DRL) method is used to address the random data arrival pattern and dynamic channel variation for guaranteeing long-term service accuracies [5].

  • Lagrangian-Based Offloading Scheduling Algorithm (LOSPA): It applies the Lagrangian dual decomposition method in a definitive way to solve a resource management problem and optimal offloading decision for an edge-cloud collaboration framework. However, it ignores the network uncertainties [21].

7.2 Performance evaluation

Here, we consider the computation tasks’ average processing accuracy in ESs over a long run, and illustrate the algorithm’s convergence performance in Figure 2. This figure shows that the initial average accuracy maintains in a high level, as the initial accuracy value is initially defined as zero. Furthermore, since the obtainable communication and computation resources are sufficient at the beginning, this algorithm tends to increase the average accuracy to the target value very rapidly. Moreover, despite the fluctuations, the computation tasks’ average accuracy converges to the target value quickly after some time slots. Therefore, it can be concluded that the algorithm’s stability is verified by the simulation.

Figure 2.

Introduced algorithm’s accuracy performance.

Considering that the arrival rate of the end terminal’s data traffic is an uncontrolled environmental variable while it directly affects each computation task’s size, the impact of various data arrival rate on the final data processing accuracy can significantly affect the adaptability of OSPRA in such complicated and noisy environments. Figure 3 demonstrates the box-plot distribution of the data processing accuracy under different rates of data arrivals. By increasing this rate, the distribution range of the accuracy only fluctuates very slightly. In particular, it shows that the maximum probability of error is smaller than 0.7. Moreover, the average value of the processing accuracy can be well controlled within a restricted range between 0.8 and 0.802, which indicates a good robustness of the proposed OSPRA to the instantaneous variations of the task size.

Figure 3.

Introduced algorithm’s accuracy performance in terms of data arrival rates.

The average energy consumption of the proposed algorithm with various accuracy requirements is shown in Figure 4. It can be observed that if the accuracy requirement improves, the system has to in turn increase the sampling rate or choose a superior denoising performance in edge preprocessing method. As a result, the average energy consumption increases. LOSPA algorithm overlooks network uncertainties, so that the average energy consumption reduces smoothly. Changing processing accuracy does not have decisive performance impact. Oppositely, the average energy consumption increases for both OSPRA and AGRMA algorithms. However, in terms of minimizing the energy consumption, the proposed OSPRA obviously performs better. The reason is that AGRMA does not choose to preprocess at ESs, so that the sampling rate must increase when accuracy requirements increase. Oppositely, OSPRA can reach a trade-off between the preprocessing method selection and sampling rate, and therefore it can decrease the energy consumption and satisfy the accuracy requirements concurrently.

Figure 4.

Introduced algorithm’s average energy consumption in terms of different accuracy requirements.

Figure 5 evaluates the energy consumption of the overall system with the increase of the Lyapunov control parameter V for different algorithms. When V50, the average energy consumption rapidly reduces as V increases. When V100, the average energy consumption prefers to be stable, because computing resources and channel capacity have an upper limit. The asymptotic optimality of the proposed algorithm can be seen as there exists a bounded deviation between the proposed algorithm’s average energy consumption and the optimal one, which numerically verifies Theorems 1.1 and 1.3. Besides, in this figure, we can find that the proposed OSPRA can control parameter V for adjusting the energy consumption weights of different users. That is to say, it guides us to select the parameter V according to various application requirements. It is worth noting that although we also draw the other two benchmark schemes’ performances for comparison, both of them are independent of the control parameter V.

Figure 5.

Average energy with different parameter V.

Advertisement

8. Conclusion

In this chapter, we have investigated a joint optimization problem of preprocessing method selection, sampling rate adaptation, and computing and communication resource allocation for IIoT systems with edge-cloud collaboration. With the objective of minimizing the energy consumption of the whole system while guaranteeing all applications’ long-term service delay and data processing accuracy, a novel algorithm, called OSPRA, has been proposed. It has been proved that this proposed algorithm can solve the formulated problem in a dynamic way under network uncertainties. In addition, the feasibility and superiority of OSPRA have also been verified by extensive theoretical analysis and simulations.

References

  1. 1. Mach P, Becvar Z. Mobile edge computing: A survey on architecture and computation offloading. IEEE Communications Surveys & Tutorials. 2017;19(3):1628-1656
  2. 2. Yi C, Cai J. A queueing game based management framework for fog computing with strategic computing speed control. IEEE Transactions on Mobile Computing. 2022;21(5):1537-1551
  3. 3. Yi C, Cai J, Su Z. A multi-user mobile computation offloading and transmission scheduling mechanism for delay-sensitive applications. IEEE Transactions on Mobile Computing. 2019;19(1):29-43
  4. 4. Yi C, Cai J. A truthful mechanism for scheduling delay-constrained wireless transmissions in IoT-based healthcare networks. IEEE Transactions on Wireless Communications. 2018;18(2):912-925
  5. 5. Wu W, Yang P, Zhang W, Zhou C, Shen S. Accuracy-guaranteed collaborative dnn inference in industrial IoT via deep reinforcement learning. IEEE Transactions on Industrial Informatics. 2020;17(7):4988-4998
  6. 6. Yamaguchi M, Maruta K, Ono H. Operating mechanism for RF electromagnetic noise suppression sheets. IEEE Transactions on Magnetics. 2005;41(10):3565-3567
  7. 7. Wang T, Ke H, Zheng X, Wang K, Liu A. Big data cleaning based on mobile edge computing in industrial sensor-cloud. IEEE Transactions on Industrial Informatics. 2019;16(2):1321-1329
  8. 8. Mao W, Zhao Z, Chang Z, Min G, Gao W. Energy efficient industrial internet of things: Overview and open issues. IEEE Transactions on Industrial Informatics. 2021;PP(99):1-1
  9. 9. Hariharakrishnan J, Mohanavalli S, Srividya, Kumar K. Survey of pre-processing techniques for mining big data. In: 2017 International Conference on Computer, Communication and Signal Processing (ICCCSP). Chennai, India: IEEE; 2017. pp. 1-5. https://ieeexplore.ieee.org/author/37086002878
  10. 10. Rui L, Zhu Y, Gao Z, Qiu X. CLPM: A cooperative link prediction model for industrial internet of things using partitioned stacked denoising autoencoder. IEEE Transactions on Industrial Informatics. 2020;17(5):3620-3629
  11. 11. Guo K, Gao R, Xia W, Quek T. Online learning based computation offloading in MEC systems with communication and computation dynamics. IEEE Transactions on Communications. 2020;69(2):1147-1162
  12. 12. Zhang X, Mao Y, Zhang J, Letaief KB. Multi-objective resource allocation for mobile edge computing systems. In: 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC). Montreal, Canada: PIMRC; 2017. pp. 1-5
  13. 13. Lin R, Zhou Z, Luo S, Xiao Y, Zukerman M. Distributed optimization for computation offloading in edge computing. IEEE Transactions on Wireless Communications. 2020;19(12):8179-8194
  14. 14. Mao S, Leng S, Maharjan S, Zhang Y. Energy efficiency and delay tradeoff for wireless powered mobile-edge computing systems with multi-access schemes. IEEE Transactions on Wireless Communications. 2019;19(3):1855-1867
  15. 15. Neely MJ. Stochastic network optimization with application to communication and queueing systems. Synthesis Lectures on Communication Networks. 2010;3(1):1-211
  16. 16. Pisinger D. Where are the hard knapsack problems? Computers & Operations Research. 2005;32(9):2271-2284
  17. 17. Boyd S, Vandenberghe L. Convex Optimization. UK: Cambridge University Press; 2004
  18. 18. Chen M, Liew SC, Shao Z, Kai C. Markov approximation for combinatorial network optimization. IEEE Transactions on Information Theory. 2013;59(10):6301-6327
  19. 19. Xie ZJ, Song BY, Zhang Y, Zhang F. Application of an improved wavelet threshold denoising method for vibration signal processing. Advanced Materials Research. 2014;889-890:799-806
  20. 20. Zhang H, Chen X, Zhang X, Zhang X. A bi-level nested sparse optimization for adaptive mechanical fault feature detection. IEEE Access. 2020;8:19 767-19 782
  21. 21. Kuang Z, Li L, Gao J, Zhao L, Liu A. Partial offloading scheduling and power allocation for mobile edge computing systems. IEEE Internet of Things Journal. 2019;6(4):6774-6785

Notes

  • Here, the preprocessing modes potentially denote different data cleaning or denoising methods [9].

Written By

You Shi, Yuye Yang, Changyan Yi, Bing Chen and Jun Cai

Reviewed: 10 February 2023 Published: 15 March 2023