Assigment, A+ Work, No plagarism, On time, Original Work

profilePelicans!!322
wk5AIDEV.pdf

Computer Methods and Programs in Biomedicine 213 (2022) 106541

Contents lists available at ScienceDirect

Computer Methods and Programs in Biomedicine

journal homepage: www.elsevier.com/locate/cmpb

Application of artificial intelligence in wearable devices: Opportunities

and challenges

Darius Nahavandi a , Roohallah Alizadehsani a , Abbas Khosravi, Senior IEEE

a , ∗, U Rajendra Acharya, Senior IEEE

b , c , d

a Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Waurn Ponds, VIC 3216, Australia b Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore c Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore d Department of Bioinformatics and Medical Engineering, Asia University, Taiwan

a r t i c l e i n f o

Article history:

Received 5 October 2021

Revised 7 November 2021

Accepted 15 November 2021

Keywords:

Wearable devices

Healthcare

Machine learning

Deep learning

Internet of things

a b s t r a c t

Background and objectives: : Wearable technologies have added completely new and fast emerging tools

to the popular field of personal gadgets. Aside from being fashionable and equipped with advanced hard-

ware technologies such as communication modules and networking, wearable devices have the potential

to fuel artificial intelligence (AI) methods with a wide range of valuable data.

Methods: : Various AI techniques such as supervised, unsupervised, semi-supervised and reinforcement

learning (RL) have already been used to carry out various tasks. This paper reviews the recent applica-

tions of wearables that have leveraged AI to achieve their objectives.

Results: : Particular example applications of supervised and unsupervised learning for medical diagnosis

are reviewed. Moreover, examples combining the internet of things, wearables, and RL are reviewed. Ap-

plication examples of wearables will be also presented for specific domains such as medical, industrial,

and sport. Medical applications include fitness, movement disorder, mental health, etc. Industrial appli-

cations include employee performance improvement with the aid of wearables. Sport applications are all

about providing better user experience during workout sessions or professional gameplays.

Conclusion: : The most important challenges regarding design and development of wearable devices and

the computation burden of using AI methods are presented. Finally, future challenges and opportunities

for wearable devices are presented.

© 2021 Elsevier B.V. All rights reserved.

Contents

1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

2. Paper collection strategy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

3. Brief review of wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

4. Denoising methods used in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

5. Artificial intelligence methods. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

5.1. Feature extraction and engineering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

5.2. Supervised learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

5.3. Deep learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

5.4. Unsupervised learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

5.5. Semi-supervised learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

5.6. R einforcement learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

6. Application of machine learning algorithms in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

6.1. Application of supervised learning methods in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

6.2. Application of unsupervised learning methods in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

∗ Corresponding author.

E-mail address: [email protected] (A. Khosravi).

https://doi.org/10.1016/j.cmpb.2021.106541

0169-2607/© 2021 Elsevier B.V. All rights reserved.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

6.3. Application of semi-supervised learning methods in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

6.4. Application of reinforcement learning (RL) methods in wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

7. Wearable applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

7.1. Sports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

7.2. Healthcare. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

7.2.1. Fitness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

7.2.2. Health status monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

7.2.3. Helping with movement disorders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

7.2.4. Mental health . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

7.2.5. Autism . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

7.2.6. Healthcare wearables shortcomings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

7.3. Industrial and manufacturing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

7.3.1. Examples of real-world industrial wearables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

7.3.2. Critical design factors for industrial wearables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

7.4. Human–robot interaction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

8. Wearable technologies challenges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

8.1. Data collection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

8.2. Data transmission . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

8.3. Security and privacy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

8.4. Localization quality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

8.5. User adoption aspects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

8.6. Resource constraints . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

8.7. Interoperability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

9. Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

10. Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Funding. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Declaration of Competing Interest . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

1

p

g

m

a

w

w

s

w

c

a

w

t

m

s

e

A

g

n

u

p

n

w

a

b

F

a

e

a

a

p

d

c

s

d

t

a

t

i

p

v

o

p

r

c

a

t

i

e

m

a

w

d

a

v

v

p

a

a

a

T

s

S

S

S

. Introduction

Wearables are small electronic and mobile devices, or com-

uters with wireless communication capabilities incorporated into

adgets, accessories, or clothes, which can be worn on the hu-

an body. There are also invasive versions of the wearables such

s micro-chips or smart tattoos [1] . Nowadays, different types of

earable devices have been invented. Some of the most common

earable devices are smart glasses and smart watches. The con-

umer market of the wearable devices is increasing steadily. The

earables are used to collect, transmit and even analyze the data

ommonly collected from the body of a human or animal. They

re purely mechanical devices or intelligent mechatronic systems

hich are commonly built using sensors, actuators, and compu-

ation parts. They can be used for early diagnosis and manage-

ent of medical conditions as well as measuring the vital signs

uch as body and skin temperature, blood pressure [2] , heart rate,

lectrocardiogram (ECG) [3] , and electroencephalogram (EEG) [4] .

ll these wearable devices are implemented with various technolo-

ies, capabilities and costs. People who use these technologies may

eed some skills to work with them.

Wearable devices are classified based on their requirement and

sage. Some of them are used according to the instructions of

hysicians to avoid serious problems. However, some wearables are

ot used in medical fields [5–7] . In [8] , a comprehensive review of

earable devices was done in which, smart wearable devices such

s watches, eyewear, headsets, jewelry, rings, chains, garments, and

racelets were described. The list of these devices can be seen in

ig. 1 [9] .

Wearable devices are made in different forms to meet their us-

ge requirements. They are commonly in small size while they are

xpected to sense continuously. They should be able to collect data

nd process them to improve the quality of life. Therefore, wear-

bles need to communicate in a secure way while keeping their

ower consumption as low as possible. The security of wearable

evices is a big challenge. They may be able to collect the data lo-

2

ally or send them to an external device. In both cases, the data

hould be encrypted to enforce their privacy. Given that wearable

evices usually have low computational power, a lightweight au-

hentication test is needed. In addition, wearable devices must be

ble to communicate in real-time; such requirement impacts on

he challenge of power consumption management.

The motivation behind this review is the fact that the emerg-

ng field of wearable devices has the potential to open new ap-

lication opportunities in various domains. The focus of this re-

iew is on medical, industrial, and sport applications. We focused

n the medical domain since it is directly related to the lives of

eople. With enough development, wearables have the potential to

evolutionize the medical domain leading to cost-effective health-

are services and longer lifetimes. In the industrial domain, wear-

ble devices can make workstations more ergonomic. To this end,

he workers can be equipped with appropriate wearable devices

n order to accelerate the industrial processes leading to short-

ned working hours and better psychological health. The sport do-

ain is also important since it can be used for medical diagnosis

nd treatment. Additionally, sport is directly related to the general

ell-being of society. Therefore, sport domain is also an important

omain that is worth reviewing.

A comprehensive review of existing wearables, their capabilities

nd shortcomings can shape future research directions. In this re-

iew, wearable devices as well as the role of AI methods to achieve

arious tasks with wearables are investigated. The employed pa-

er collection strategy is outlined in Section 2 . Various wearables

re reviewed briefly in Section 3 . Denoising methods used in wear-

bles are explained in Section 4 . Feature extraction, engineering

nd artificial intelligence methods used are described in Section 5 .

he applications of machine learning in wearable devices are pre-

ented in Section 6 . Applications of wearables are explained in

ection 7 . The challenges of developing wearables are reported in

ection 7.4 . Discussion and future insights will be presented in

ection 9 and the conclusion is given in Section 10.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 1. Different categories of wearables used.

2

d

r

s

a

a

i

s

t

f

t

a

p

e

w

w

b

m

p

a

I

t

j

t

T

c

a

r

c

p

a

j

p

i

3

s

t

t

e

d

i

r

t

d

e

i

m

e

s

p

s

w

y

. Paper collection strategy

For reviewing previous papers in the field of wearables, all

atasets supported by Google scholar such as IEEE, Science Di-

ect, Springer, ACM Digital Library, and Hindawi were searched. The

earch query used in this work was:

(wearable technology healthcare OR wearable devices OR wear-

bles OR smart wears OR wearable technology OR industrial wear-

ble OR sports wearable) AND (artificial intelligence OR data min-

ng OR deep learning OR machine learning).

Three authors inspected the papers collected based on the

earch phrases mentioned above. Papers that two out of three au-

hors agreed on their relevance to this review were selected for

urther analysis. Based on the above phrases and the opinion of

he three authors, 132 papers published in high-ranked journals

nd conferences were selected. The paper selection mechanism is

resented in Fig. 2 in which the number of selected papers from

ach publisher is reported separately.

We did not limit our search to medical applications since

earable devices used in different domains share common hard-

are/software technologies. Hence, it was necessary to take a

roader view during data collection for this review. In addition to

edical domain, this review considered industrial and sport ap-

lications of wearables as well. The motivation was that industrial

nd sport applications are closely related to medical applications.

n industrial domain, well designed wearables can be used to make

he working environment more ergonomic reducing workers’ in-

uries. In sport domain, wearable devices can help individuals with

heir fitness programs leading to healthier society.

The selected papers were carefully studied by the three authors.

he study of papers related to each of three major fields (medi-

al, industrial, and sport) was assigned to one of the authors. Each

3

uthor extracted and organized the necessary information for this

eview. The investigation of the selected papers was primarily fo-

used on the main approach used during software/hardware im-

lementation of the wearable devices.

Certainty about the outcome of the reviewed papers is verifi-

ble since most of these papers have been published in top-ranked

ournals and conferences. Additionally, many of the reviewed pa-

ers or wearable devices have already been used in practice prov-

ng their capabilities.

. Brief review of wearables

Wearables can be used for data collection in daily activities,

port performance, and health monitoring. There are different

ypes of wearables such as smartwatches, hearing aids, electronic

attoos, wristbands, subcutaneous sensors, head-mounted displays,

lectronic textiles, and footwear as shown in Fig. 3 (a) [10] . These

evices are placed on different body parts to measure electrophys-

ological and biochemical signals or deliver drugs.

Wearable devices are used for augmented, virtual, and mixed

eality, artificial intelligence, and pattern recognition [ 11 , 12 ]. These

echnologies commonly contain microprocessors and sensors. Ad-

itionally, these devices are usually capable of recording data and

xchanging them over wireless connections [13] . Sensors used

n wearable devices include barometers and inertial measure-

ent unit (IMU) which is combination of gyroscopes, accelerom-

ters, and sometimes magnetometers. Optical sensors needed in

pectrophotometers, cameras, chemical probes, electrodes, micro-

hones, shock detectors, and pressure sensors are other types of

ensors used in wearables [14] . Utilizing the sensors in multiple

earables provides a rich collection of data which can be anal-

sed by researchers or used by experts to provide medical treat-

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 2. Paper selection mechanism.

Fig. 3. Wearables devices used to monitor physiological parameters: (a) different wearable devices which have been designed for different parts of human body, (b) various

technologies used to transfer data collected from wearables to other devices.

m

o

t

o

i

a

2

c

2

e

a

I

t

b

i

F

ent remotely. These data can be transmitted by different types

f networks [15] . As shown in Fig. 3. b, these networks can even

ransmit the data over the internet. The capability of wearables to

perate in a network of connected devices paves the road towards

mplementing Internet of things (IoT) [16] .

The existing wearable devices can be categorized based on their

pplications and the body parts on which they are mounted. Since

016, the distribution of number of wearables in different appli-

ation domains is shown in Fig. 4. a [17] . As can be seen, the

4

lifestyle” application has the highest number of wearables (about

00) while the “pet animals” application has the least number of

xisting wearables. Since 2016, the distribution of existing wear-

bles based on their target body part is shown in Fig. 4. b [17] .

t is clear that most of the existing wearables are mounted on

he head (about 65 devices), followed by torso and neck and then

ody parts have the third highest number of wearables. Fig. 5

llustrates two samples of wearables with medical applications.

ig. 5. a shows a typical head-mounted wearable used for EEG anal-

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 4. Distribution of number of existing wearables (as of 2016) based on: (a) application domains, (b) target body parts.

Fig. 5. Illustration of two typical wearables with medical applications: (a) head-mounted wearable device for EEG measurement, and (b) torso mounted wearable device for

ECG measurement.

y

a

4

c

t

l

w

o

w

a

I

u

sis and Fig. 5. b shows a torso-mounted wearable used for ECG

nalysis.

. Denoising methods used in wearables

Signals, which have been gathered from wearable sensors, are

ommonly affected by noise. The noise sources are generated when

he measuring element and the data collection system try to col-

5

ect the signals. This section aims to introduce the AI-based hard-

are designed for denoising. As real information generated by bi-

logical systems, randomness of these systems are relatively low

hile the real information collected in time are often correlated.

For denoising, researchers have used different methods. In [18] ,

sixth-order bandpass IIR filter was used to eliminate the noise.

n another research [19] , a deep convolutional neural network was

sed. In [20] , the noise and baseline removal of all ECG signals

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 6. Different AI methods and their main subfields.

w

o

u

a

o

p

t

d

f

[

m

a

s

r

p

p

q

t

t

d

a

p

g

p

5

v

l

i

t

5

l

c

g

m

a

p

(

s

l

o

s

t

f

s

s

u

s

5

v

f

t

s

ere performed with Daubechies wavelet filters. In [21] , as one

f the pre-processing steps, an 8-point moving average filter was

sed to remove noise. To this end, finite windows of moving aver-

ge filter were convolved with the signal. It took an average of the

utput signal for discrete-time noise reduction and enhanced the

eak value identification.

Chen et al. [22] developed a statistical model to simulate struc-

ured noise processing derived from a wearable sensor. Synthetic

ata generated using a structured noise model was studied and a

actor analysis-based method was proposed for denoising. Lee et al.

23] proposed a denoising method that references photoplethys-

ography to alleviate intrinsic and extrinsic noise in electrodermal

ctivity. Their method attenuates the extrinsic noises by applying

everal filters such as high-pass and wavelet filters. Then, intrinsic

espiration noises were detected and attenuated by a subject inde-

endent machine learning model that could detect noise.

A new electrocardiogram (ECG) denoising technique was pro-

osed in [24] . In their work, denoising was done by variable fre-

uency complex demodulation algorithm. To remove the noise,

his algorithm is used to perform the sub-band decomposition of

he noise-contaminated ECG. More improvement in ECG quality is

one by not only removing baseline drift but also smoothing via

daptive mean filtering. Two datasets were used to validate the

roposed method. The performance of the proposed denoising al-

orithm was compared with other denoising algorithms and its su-

eriority with respect to other methods is shown.

. Artificial intelligence methods

In this section, at first, feature extraction and engineering is re-

iewed and then different categories of AI methods i.e. supervised

earning, unsupervised learning, semi-supervised learning and re-

6

nforcement learning are introduced. These learning methods and

heir main subfields are shown in Fig. 6 .

.1. Feature extraction and engineering

Feature extraction is one of the fundamental steps in machine

earning. Having too many features could easily confuse the ma-

hine learning algorithms [ 25 , 26 ]. Therefore, feature selection al-

orithms are used to select the clinically significant features. The

ean and mode [27] or algorithms such as principal components

nalysis (PCA) [28] , linear discriminant analysis (LDA) [29] , inde-

endent component analysis (ICA) [30] , locally linear embedding

LLE) [31] , and autoencoders [32] can also be used to select the

tatistically significant features. Such features can be exploited by

earning methods.

The process of extracting useful features from raw data based

n domain knowledge is called feature engineering [33] . The first

tep in feature engineering is developing useful features by (i) au-

omatic, (ii) manual, or (iii) fusion of both manual and automated

eature extraction. The next step is feature selection in which a

ubset of extracted features is selected according to some feature

coring measure. The performance of selected features is then eval-

ated based on the target dataset. This process is repeated until

atisfactory results are obtained.

.2. Supervised learning

The learning algorithms are divided into two main types: super-

ised and unsupervised. In supervised learning, the desired output

or the training samples is known and the model is trained using

he given samples of data and their desired outputs [34] . Generally,

upervised learning is used for classification in which the goal is

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

t

r

t

fi

d

p

l

g

s

[

5

i

r

r

d

t

a

c

o

s

p

m

t

p

l

(

5

s

v

t

p

p

a

n

s

d

d

T

e

h

i

5

w

s

s

b

d

t

fi

r

c

c

l

s

5

s

[

w

e

l

i

i

r

p

M

6

o

b

v

l

a

6

i

g

w

i

p

m

T

l

u

A

e

t

r

E

o

B

e

w

d

s

p

o

o

[

s

s

o map an input sample to the output label [35] . It is also used for

egression whose goal is learning a mapping from inputs to con-

inuous output. In both classification and regression, we want to

nd the correct relationships between the input and output. In-

eed, we are looking for a model that can produce correct out-

ut data effectively. If the training data are noisy or have incorrect

abels, the effectiveness of the trained model will be clearly de-

raded. Some of the common supervised learning algorithms are

upport vector machine (SVM) [36] , artificial neural network (ANN)

37] , Naïve Bayes [ 38 , 39 ], and random forest [40] .

.3. Deep learning

Deep learning (DL) is part of a broader family of machine learn-

ng methods based on artificial neural networks (NNs). In the

ealm of deep learning, we often come across convolutional neu-

al network (CNN) which is a special type of NN capable of han-

ling 2D image data [ 41 , 42 ]. The primary component of a CNN is

he convolutional layer which performs convolution on a given im-

ge. To this end, one needs to specify a 2D array of weight values

alled a kernel which is smaller than the image. The convolution

peration is simply the dot product of the kernel with a kernel

ized patch of the given image [43] . The convolutional layer out-

ut is passed through an activation function such as ReLU. 1 Auto-

atic feature extraction is one of the most important characteris-

ics of CNNs. However, training CNNs usually demands high com-

utational resources. In recent years, such a burden has been al-

eviated due to the advent of powerful graphics processing units

GPUs) [44] .

.4. Unsupervised learning

In unsupervised learning, the objective is to learn the inherent

tructure of unlabelled data. The most usual tasks within unsuper-

ised learning are clustering, density estimation, and representa-

ion learning. For this purpose, some of the algorithms such as

rincipal component analysis (PCA) and auto-encoders have been

roposed [45] . Exploratory analysis and dimensionality reduction

re two common use cases used in unsupervised learning. In sce-

arios where the dataset analysis is impossible for humans; un-

upervised methods can be used to gain initial insights into the

ata. The insights can be used for testing different hypotheses. For

imension reduction, the data are represented by fewer features.

his process can also be done using unsupervised learning. To this

nd, the relationship between features must be discovered. It can

elp us to eliminate the redundant features. Consequently, process-

ng the data can be done by a much less intensive solution [46] .

.5. Semi-supervised learning

In scenarios where the number of labelled samples is small

hile number of unlabelled samples is large, supervised and un-

upervised learning cannot be used effectively. In this situation,

emi-supervised learning algorithms can help. They can be trained

y a small number of labelled and a large number of unlabelled

ata to predict a new example. When there are some labelled data,

hey can help the algorithms to use the unlabelled data more ef-

ciently and produce considerable improvement in learning accu-

acy. Acquisition of labelled data to be used in learning problems

ommonly requires expert agents. Labelling the samples may be

ostly and in some cases impossible due to large number of un-

abelled samples. Under these circumstances, the importance of

emi-supervised learning becomes clear [47] .

1 Rectified Linear Unit

w

t

d

7

.6. R einforcement learning

The reinforcement learning (RL) is learning to map situations to

uitable actions such that a numerical reward signal is maximized

48] . Unlike supervised learning, in RL, the learner is not provided

ith the desired action and it has to try different actions in differ-

nt situations (also known as states) to figure out the best actions

eading to the maximum reward given the observed states. It is

mportant to learn action selection such that the long term utility

s maximized since naively choosing to maximize the immediate

eward might lead to suboptimal performance in the long run. RL

roblems can be modelled as Markov decision processes (MDPs). A

DP is a 4-tuple ( S , A, P, R ), where:

• S is the set of states (state space) • A is the set of actions (action space) • P ( s t+1 = s ′ | s t = s, a t = a ) is called the transition function which

outputs the probability of observing state s ′ at time step t + 1

provided that at time step t observed state is s and chosen ac-

tion is a . • r t + 1 = R ( s t = s, a t = a, s t + 1 = s ′ ) is the expected reward if at

time step t, the observed state is s and execution of the chosen

action a will lead to state s ′ in the time step t + 1.

. Application of machine learning algorithms in wearables

Various machine learning methods have been used in the field

f wearables. In this section, some of existing works which com-

ine wearable devices with machine learning algorithms are re-

iewed. The review has been categorized based on type of machine

earning methods. The summary of works done using wearables

nd AI techniques are shown in Table 1 .

.1. Application of supervised learning methods in wearables

Supervised learning methods are widely used in machine learn-

ng to develop the automated systems. Saadatnejad et al. [49] sug-

ested a novel electrocardiogram (ECG) classification algorithm. On

earable devices, this method was used for continuous monitor-

ng of cardiac disease. The advantage of this method was its low

ower consumption. Their method used multiple long short term

emory (LSTM) recurrent neural networks and wavelet transform.

heir method achieved high ECG classification performance. Simi-

arly in [50] , a novel ECG classification algorithm was proposed and

sed in low-power wearables based on spiking neural networks.

spike-timing dependent plasticity and reward-modulation were

mployed in which the model weights are trained according to the

imings of spike signals. The results showed that it was suitable for

eal-time operation. Additionally, in the real-time classification of

CG signals, its energy consumption was significantly lower than

ther similar devices. In another work reported by Acharya and

asu [51] , the primary objective was to build classification mod-

ls to identify anomalies of patients’ breathing sounds. These data

ere used for automated diagnosis of respiratory and pulmonary

iseases. A deep learning model was used to classify respiratory

ounds. Additionally, a local log quantization strategy was pro-

osed to reduce the memory footprint which can be used in mem-

ry constrained wearable devices.

Wearable sensors can be used in disease diagnosis based

n physical movement of patients. For instance, Hssayeni et al.

52] used a LSTM recurrent neural network (RNN) to detect early

igns of Parkinson’s disease (PD) using accelerometers and gyro-

copes data. In another study, waist-worn accelerators and SVM

ere used to detect freezing of gate (FoG) experienced by PD pa-

ients [53] . The walking pattern can be used to diagnose Alzheimer

isease. Varatharajan et al. [54] monitored walking patterns of pa-

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Table 1

Summary of works done using wearables and AI techniques.

Learning category

Reference # Algorithm Name Application Supervised Unsupervised Semi-supervised Reinforcement

[68] SVM Construction Workers’ Stress Recognition √

[69] ANN Heartbeat Classification √

[70] Statistical analysis Activity recognition √

[71] Decision Trees Pharmacotherapy Management for

Parkinson’s Disease Patients

[72] Long Short Term Memory

(LSTM)

Activity Recognition √

[73] Random Forest Physical Fatigue Detection √

[74] K-means Telemonitoring of patients with

Parkinson’s disease

[75] K-Means Human Activity Recognition √

[76] Spectral Clustering,

hierarchical clustering

Human activity recognition √

[77] K-Means Human activity recognition √

[78] Expectation Maximization

(EM) algorithm

Activity recognition √

[79] K-means Detection of Poor Posture √

[80] Simple 1-NN classifier and

SVM

Location recognition from wearable video √

[58] LSTM Cardiovascular risk prediction √

[81] SVM Human activity recognition √

[62] Random forest Activity recognition √

[63] Genetic algorithm Categorization of brain signals √

[82] Convolutional neural

networks

Human activity recognition √

[83] Deep reinforcement

learning

Musculoskeletal modeling and locomotion

analysis

[84] Reinforcement Learning Activity recognition √

[85] Inverse Reinforcement

Learning

Activity forecasting √

[86] Deep Reinforcement

Learning

Individualized Treatment Planning for

Parkinson’s Disease

[87] ANN Activity recognition √

[88] Inverse Reinforcement

Learning

Activity forecasting √

t

a

w

6

f

l

n

t

i

s

r

p

t

c

a

r

e

p

u

a

T

u

p

p

s

n

e

t

6

d

T

d

s

l

fi

r

w

t

e

w

e

p

t

o

d

a

w

A

t

w

n

u

ients using a dynamic time warping algorithm and several wear-

ble sensors including accelerometers. Based on the perceived

alking pattern, early signs of Alzheimer disease were detected.

.2. Application of unsupervised learning methods in wearables

In [55] , Das et al. proposed an unsupervised learning approach

or heart-rate estimation from electrocardiogram (ECG) data col-

ected by wearable devices. Spatio-temporal properties of ECG sig-

als were encoded directly into spike training. In the next step,

he spike training was used to excite recurrently connected spik-

ng neurons in a liquid state machine computation model. An un-

upervised readout based on fuzzy c-Means clustering of spike

esponses was designed using particle swarm optimization. Their

roposed method was easily implemented on spiking-based sys-

ems. The method advantages are its high accuracy and signifi-

antly low energy footprint. Consequently, the battery life of wear-

ble devices was extended. Another unsupervised learning algo-

ithm was proposed by Krause et al. [56] . In this work, without

xternal supervision, an online wearable system was designed, im-

lemented and evaluated. It could determine the context of typical

ser and probabilities of context transition. They used statistical

nalysis and machine learning in their graph algorithm techniques.

he results showed that their proposed method could determine a

ser context model while it only required data from a device with

hysiological sensors.

In [57] , a new version of unsupervised deep learning was pro-

osed which optimized the data during preprocessing in wearable

ensors. It only needed 11.25 ns as its computation time. Its recog-

ition performance has been improved for feature selection and

8

xtraction. A new technique for data analysis has been introduced

o minimize the computation time.

.3. Application of semi-supervised learning methods in wearables

Wearable devices have the potential to collect huge amounts of

ata. However, labeling these data is costly and time-consuming.

herefore, it is desirable to devise methods to exploit unlabeled

ata while reducing labeling costs as much as possible. Semi-

upervised approaches are promising approaches to use a mix of

imited labeled data and a large volume of unlabeled data ef-

ciently. Ballinger et al. [58] used off-the-shelf wearable heart

ate sensors to collect data from numerous participants across the

orld using a mobile phone application. The objective was to de-

ect multiple medical conditions such as diabetes, high cholesterol,

tc. using a multi-task LSTM. Two semi-supervised approaches

ere proposed that could outperform hand-engineered biomark-

rs from the medical literature. In the first approach, a LSTM was

re-trained as a sequence autoencoder. The pre-trained parame-

ers were used to initialize a second supervised phase using pool

f limited labeled data. In the second approach, the synthesized

ataset was used for pre-training.

In [59] , a novel method to automatically detect near-miss falls

ccording to a worker’s kinematic data was proposed. These data

ere captured from wearable inertial measurement units (WIMUs).

semi-supervised learning algorithm was proposed to learn from

he data. This algorithm was a support vector machine (SVM)

hich was designed for near-miss fall detection. For collecting the

ear-miss falls, two experiments were conducted. These data were

sed to test the proposed approach. This WIMU-based method can

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

b

j

n

l

m

b

e

o

w

s

T

w

r

t

s

c

t

c

b

s

b

A

D

b

a

r

e

b

i

o

t

s

t

a

t

i

i

w

o

m

m

6

g

I

d

t

i

f

a

t

l

a

s

a

t

b

j

i

d

b

f

o

b

d

h

c

o

i

t

a

b

i

m

i

c

m

t

a

7

m

T

t

d

v

b

t

a

T

n

s

t

7

p

s

c

t

F

s

f

p

f

s

m

l

p

i

e used to identify ironworker near-miss falls without disrupting

obsite work and can help to prevent fall accidents.

Stikic et al. [60] introduced a new method for activity recog-

ition. In a semi-supervised learning process, small amounts of

abeled data were combined with unlabeled data. Their proposed

ethod propagated information in a graph that contains both la-

eled and unlabeled data. Based on feature similarity, two differ-

nt ways were introduced to combine several graphs. The quality

f the label propagation process and the performance of classifiers

ere evaluated in their research.

For activity recognition, in [61] , the feasibility of semi-

upervised learning was tested to reduce the level of supervision.

wo semi-supervised techniques (self-training and co-training)

ere used to learn activity models from few labeled data. The

esults of this work demonstrated that co-training worked better

han self-training because it used additional information from sen-

or modalities during the training process. In addition, in some

ases, it even could achieve better recognition accuracy compared

o the fully supervised approaches. Their proposed method was

onducted based on a pool-based setting. Accordingly, a large num-

er of unlabeled training data were available in addition to a small

et of labeled training data. The algorithm was able to select the

est informative samples which were then labeled by an expert.

nother work on human activity recognition is LabelForest [62] .

ata collected from humans via wearables are often accompanied

y a significant amount of noise and uncertainty. LabelForest is

non-parametric semi-supervised learning framework for activity

ecognition which improves the performance of ML algorithms by

xpanding the training set. LabelForest chooses a subset of unla-

eled data for labeling. The sample selection is done based on sim-

larity with the labeled samples. LabelForest framework is made

f two algorithms: 1. spanning forest algorithm for sample selec-

ion and labeling, and 2. silhouette-based filtering method to select

amples with more confident clustering assignment for inclusion in

he training set.

Wiechert et al. [63] collected EEG brain signals using a wear-

ble headband called Muse from participants performing different

asks such as reading, listening to music, etc. The objective was to

dentify participants and the type of activity they were perform-

ng when EEG signals were being recorded. To this end, K-medoids

ith an evolutionary algorithm were combined to perform multi-

bjective clustering. The genetic algorithm was used to find the

ost appropriate K medoids. Wiechert et al. reported that their

ethod could outperform K-means.

.4. Application of reinforcement learning (RL) methods in wearables

RL has also found its way into the field of wearable technolo-

ies. ADAS-RL [64] is a modified version of Q-learning algorithm.

t not only integrates the behaviors but also the reactions of the

river to adapt and tune the warning interventions of Lane Depar-

ure Warning System (LDW) continuously. The proposed method

s able to track any changes in driving behavior and adapt the

requency of warnings allowing drivers to stay within a reason-

ble distance i.e. about 1.75 m from lane markings. FaiR-IoT (In-

ernet of Things) [65] is another RL-based framework using Q-

earning for adaptive and fairness-aware human-in-the-loop IoT

pplications. The method was evaluated on a human-in-the-Loop

mart house IoT application and human-in-the-Loop automotive

dvanced driver assistance system. In the smart house application,

he objective was to control the home thermostats automatically

y monitoring human body temperature changes over time. The

ob of the driver assistance system is to alert the driver when there

s a risk of colliding with an object in front of the vehicle. Stan-

ard forward collision warning systems measure the time-to-crash

ased on the distance and the relative velocity of the object in

9

ront of the vehicle. If the time-to-crash is below a certain thresh-

ld, the system alerts the driver to apply the brakes. However, a

etter approach is making the threshold adaptive based on the

river characteristics such as his/her response time and whether

e/she is distracted or not. FaiR-IoT has taken such factors into ac-

ount to adjust the time-to-crash threshold dynamically.

In the field of medical applications, some patients are in need

f constant monitoring. Wearable sensors can make the monitor-

ng process easier without the need for keeping the patients in

he hospital for long periods. Baucum et al. [66] have proposed

data-driven RL framework to optimize PD medication regimens

ased on wearable sensors data. They conducted their study us-

ng a dataset of 26 PD patients who wore wrist-mounted move-

ent trackers for two separate six-day periods. The patients’ med-

cation regimens were modified based on physician evaluations of

ollected data after the first wear period. The method was imple-

ented in two steps:

1. A simulation model was built and evaluated. It provides in-

formation about individual patient’s movement symptoms re-

sponse to medication administration.

2. The simulation model was used for training an RL agent using

policy gradient [67] . The trained agent was able to recommend

optimal medication types, timing, and dosages during the day,

while incorporating human-in-the-loop considerations on med-

ication administration.

The existing literature on wearable technologies is not limited

o the above paragraphs. The summary of works done using wear-

bles and AI techniques is shown in Table 1 .

. Wearable applications

Wearables have already emerged in various application do-

ains such as eyewear, sport trackers, healthcare, industry, etc.

he wearable technologies are not exclusive to medical applica-

ions and they share common hardware/software across different

omains. Therefore, reviewing wearables in different domains pro-

ides a broader perspective about wearable technologies. To gain

etter insight on the potential applications of wearables, applica-

ions related to healthcare, manufacturing, and industrial domains

re reviewed. Some of existing wearable devices are presented in

able 2 . Although performance statistics of wearable devices have

ot been the primary concern of this review, some performance

tatistics ( Fig. 4 , Fig. 7 , and Fig. 8 ) have been restated here from

he reviewed papers.

.1. Sports

In the sport applications, the wearable help the players to im-

rove their skills in their favorite sports. Existing wearables in

port applications is shown in Table 2 . Injury prevention is criti-

al in any sport and wearable devices may be used to avoid po-

ential injuries while players are enjoying their favorite sports.

or example, Chen et al. [89] developed a fuzzy logic inference

ystem which receives data such as temperature, humidity, etc.

rom wearable devices and determines the wearer’s heat stroke

ossibility. Their approach can detect the possibility of suffering

rom heat stroke and the wearer can be alerted in time. Skazal-

ki et al. [90] used commercially available wearable devices to

onitor functional movements, heart rate, and workloads of vol-

eyball players. The collected data can be used to maximize the

layers’ performance and at the same time minimize possible

njuries.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Table 2

Examples of existing wearables in various application domains.

Application Wearable device name Device description

Eyewear Chromatic smart glasses It is a smartwatch which has built-in activity tracker for fitness purposes, wireless charging

capability, and HD camera for taking point of view (POV) photos.

Vufine + HD Wearable Display Vufine + is a high definition wearable display which can be connected via HDMI to smartphone,

laptop, or drone. Vufine + can be used as a second monitor and it is clear enough for video and text

display.

Omni-Wearable Action Cam

Sunglasses

This device is sunglasses which features an integrated HD video camera to record the events

happening around the user.

Focals by North This device is smart glasses which offer augmented reality (AR). The goal of the device is displaying

the notifications from the user’s phone directly into his/her field of view.

Training

assistants

GAME GOLF Digital Shot Tracking

System

Accurate GPS shot tracker which is designed to help Golf players improve their shots and playing

experience.

Basketball Replay Analyser by

Blast Motion

This device records the actions of Basketball players and provides them with performance metrics

so that the players can improve their performance. The device sensor which is attached to the waist

of the body has wireless connection to an IOS device.

Marlin Marlin is a waterproof device that helps swimmers with their training, open water navigation, and

tracking.

T-Goal Wearable Soccer Data

Tracker

A compact device that can track speed, distance, sprints, and positioning of soccer players as they

play.

Phoenix A medical exoskeleton which helps people with mobility disorders. The device makes it possible to

stand up and walk. The device has two actuators at its hip. The knee joints provide support during

stance and ground clearance during swing.

Alex posture system This device monitors the posture of the user neck in order to improve his/her neck posture.

Relaxation Beddr SleepTuner The sleep tuner helps the user to find out the main causes of poor sleep. The device can measure

blood oxygen levels, heart rate, amount of time in bed, etc.

BrainLink Lite V2.0 A headset which helps the user with focusing and training, meditation and pressure relief.

Vigo The Stimulating Headset A Bluetooth headset that monitors the driver’s eyelid motion to assess his/her level of drowsiness.

Lumos Smart Sleep Mask A device that helps the travellers fight jet lag. To this end, the device transmits short light pulses to

adjust the body clock.

Smartwatches Aipower Wearbuds Basically, this device is the integration of headphones into smartwatch.

Garmin Approach S20 Golf Watch A device for training golf which features a high-sensitivity GPS and provides the player with useful

distance data. Using these data, the user can improve his/her shots. The device also provides daily

activity tracking and smart notifications (e.g. incoming calls and messages).

Parkinson Smartwatch A smartwatch that tracks Parkinson’s disease. The patient records his/her condition changes using

this device. The recorded data during the day is stored in a cloud service which is accessible

anywhere in the world by the patient and his/her doctor. Based on the recorded data, the doctor

prescribes optimal dosage of the medicine for the patient.

Smartbands Misfit Ray The device automatically tracks the fitness and sleep metrics of the user. For example, number of

taken steps, travelled distance, burned calories, and light/heavy sleep are tracked.

Samsung Galaxy Fit The device provides fitness statistics such as heart rate. The device also allows the user to reply

instantly with pre-set messages for incoming texts.

Xiaomi Mi Smart Band 4 Xiaomi Mi Smart Band 4 provides health monitoring such as heart rate. It has multiple tracking

modes such as Treadmill, outdoor running, cycling, etc. which can be used during sport activities.

Incoming calls, messages, and calendar notifications are also supported.

Huawei Band 3 Pro Huawei Band 3 Pro-supports notifications for incoming calls and messages as well as playing music.

It also offers sport-related functionalities such as step count, calories burned, etc.

E-patches Lief A wearable device that is designed for stress relief. Using Lief, the users learn how to train their

body to stay calm and focused. Lief is an ECG smart patch which improves heart rate variability.

Heart rate is a scientifically-proven biomarker of stress.

Mesana This is a sensor patch which addresses issues within circulatory diagnostics and

cardiovascular-prevention.

VivaLNK Vital Scout VivaLNK Vital Scout is wearable patch that measures stress and recovery rates using medical-grade

ECG sensors.

Wearable Ultrasound Patch This is a patch which can measure internal blood pressure e.g. blood pressure inside deep arteries,

heart, or lungs.

7

t

c

b

h

b

p

p

7

a

d

a

s

o

a

b

r

p

W

d

o

a

t

r

7

t

p

f

.2. Healthcare

Considering that wearable devices are worn by their users,

hese devices have a lot of potential in providing mobile health-

are services. Different types of wearables e.g. smartwatches, on-

ody cameras [91] , masks, E-patches, etc. have been developed for

ealthcare applications. The most common type of data measured

y wearable for healthcare purposes include heart rate, blood

ressure, body temperature, blood oxygen saturation, posture, and

hysical activities.

.2.1. Fitness

Some of these devices are designed to track fitness-related

ctivities. For example, chromatic smart glasses are an eyewear

evice which tracks the user activity for fitness purposes. Xi-

omi Mi Smart Band 4, Misfit Ray, and Samsung Galaxy Fit are

martbands which provide fitness statistics. A short description

10

f these devices is available in Table 2 . Fitness-related wear-

bles can motivate their users to increase their activity and

ecome healthier but their measurements might not be accu-

ate always. For example, Dooley et al. [92] have evaluated the

erformance of three wearables called Fitbit Charge HR, Apple

atch, and Garmin Forerunner 225. The experiment was con-

ucted using 62 participants with age between 18 and 38 years

ld. The three devices were used to measure the heart rate

nd energy expenditures of the participants. They reported that

he accuracy of these three devices were within the acceptable

ange.

.2.2. Health status monitoring

Some other wearables can be used to monitor the health sta-

us of their users. These devices may be capable of forecasting the

otential health issues of people wearing them even before they

eel sick or discomfort due to those issues. These devices may also

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 7. Distribution of 25 enterprises surveyed in [116] for each of the four aspects: (a) industrial sector, (b) application scenarios, (c) data processing methods, and (d) data

interaction level.

t

n

b

s

a

t

a

c

i

t

ake a step further and inform the doctor automatically [93] . It is

eedless to say that in some cases, early diagnosis of diseases can

e lifesaving. Type of healthcare wearables such as Mesana is a

ensor patch which addresses issues within circulatory diagnostics

nd cardiovascular prevention. Another example is a wearable ul-

11

rasound patch with the ability to monitor blood pressure in deep

rteries. Two ECG-based patches are Lief and VivaLNK Vital Scout

an be used. Lief helps to improve the heart rate variability which

s useful for stress relief. VivaLNK Vital Scout helps to measure

he stress and recovery rates. Two more ECG-based wearables have

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

Fig. 8. Result of evaluating three world-leading groups: (a) wearable computing, (b) wearable computer systems, and (c) contextual computing based on five factors (er-

gonomic product design, data interaction on device, operational stability, external software integration, external hardware integration).

b

W

d

a

t

o

a

i

c

c

o

b

s

g

s

b

(

T

een developed to monitor the patients with heart disorders by

inokur et al. [94] and Yang et al. [95] .

Controlling the condition of patients who suffer from chronic

iseases is as important as early diagnosis of diseases. For ex-

mple, Parkinson patients may need to receive variable dosage of

heir medicines based on their body condition. The prescription

f medicine dosage must be done by medical experts. However,

ccess to experts may not be possible all the time. Hence, wear-

ng Parkinson smartwatch helps to record the patient’s noticeable

hanges in his/her condition throughout the day. The recorded data

12

an then be sent to a medical expert to receive appropriate dosage

f the required medicines. Another Parkinson-related wearable has

een developed by Lin et al. [96] helps to assess bradykinesia

everity of Parkinson patients based on ten-second whole-hand-

rasp action. Delrobaei et al. [97] proposed an objective dyskinesia

core based on motion capture data obtained from a mobile full-

ody wearable system equipped with inertial measurement unit

IMU).

Patients suffering from diabetes require constant monitoring.

he wearable devices can play a major role in connecting patients

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

w

m

e

i

i

g

b

d

w

b

c

p

i

p

[

t

t

s

d

t

i

t

t

fl

7

e

t

m

t

i

a

t

o

a

p

c

d

w

l

m

w

B

a

c

p

c

h

t

w

d

p

e

e

[

w

i

c

t

i

t

b

m

p

7

s

f

t

h

a

l

d

w

i

t

d

(

m

e

t

t

q

r

a

(

p

7

r

e

t

T

t

t

e

i

n

b

p

a

t

w

t

7

t

m

i

q

s

e

b

t

c

n

7

t

s

ith diabetes to their care teams for effective diabetes manage-

ent [98] . Various technologies have already been developed to

ase diabetes management. For example, Dexcom G6 CGM System

s a smartphone-connected system for constant glucose monitor-

ng (CGM) [99] . Receiving the right dosage of insulin based on the

lucose level is critical. Hence, MiniMed 770G System [100] has

een developed which is an insulin pump delivering appropriate

osage of insulin to the user based on glucose reading. Another

earable used to track the daily insulin intake has been developed

y Companion Medical [101] . The wearable is a smart pen which

onnects to the patient’s phone via Bluetooth. The patient uses the

en to inject insulin. The time of injection and the injected dosage

s sent to the patient’s smartphone by the smart pen. This way the

atient can easily manage the daily intake of insulin. Alfian et al.

102] have used DL to develop a blood glucose smart sensor. To

his end, blood pressure, blood glucose, and heart rate were fed

o a LSTM model for real-time diabetes classification using cloud

ervice.

Hemodynamics is the study of blood flow and researchers have

eveloped a wearable cephalic laser blood flowmeter for inves-

igation of hemodynamics upon changing body posture (e.g. ris-

ng from a sitting posture). The developed device is worn on the

ragus [103] . In another research, site-specific blood flow varia-

ions in people during running were detected using a laser doppler

owmeter which is wearable [104] .

.2.3. Helping with movement disorders

Wearables can also help people with movement disorder. For

xample, Phoenix suit is a wearable exoskeleton which helps in

he movement of knees and hips using small motors. The move-

ent of the suit is controlled by pushing buttons integrated into

he suit. The movement disabilities may have been acquired later

n life. For example, people suffering from stroke may experience

cquired disabilities. Patients with stroke need long-term therapy

o regain their movement abilities. The therapies may be expensive

r even inaccessible due to social and environmental factors. Wear-

ble devices can be used to monitor the patient’s activities and

rovide feedback to the patient and therapist to make home exer-

ise programs possible. An example of such wearable devices was

eveloped by Burridge et al. [105] . Their wearable was equipped

ith embedded inertial and mechanomyographic sensors. The col-

ected data from these sensors were used to classify functional

ovements of the patient to provide useful information. Another

earable device to monitor patient’s exercises was developed by

urns and Adeli [106] . This device can help patients with brain

nd spinal cord injuries to manage their exercise programs to re-

over their movement abilities. The developed wearable records

atient’s physiological data as he/she performs the required exer-

ises. The recorded data are then sent to clinicians from patient’s

ome. The clinicians carry out the necessary supervision based on

he received data from the wearables, remotely.

Even people without disabilities may need help and protection

hen they get old. Falling during walking is common among el-

erly people. While falling is not considered a major risk for young

eople, which may lead to severe injuries for old people. González

t al. [107] used two accelerometers that are worn as bracelets and

mployed genetic algorithm (GA) for fall detection. Pannurat et al.

108] proposed another fall detection attempt using a wireless

earable accelerometer and classification algorithms. Their method

s a combination of a rule-based knowledge representation, a time

ontrol mechanism, and machine-learning-based activity classifica-

ion. The method has been used for fall detection at pre-impacts,

mpacts, and post-impacts, respectively. Another fall detection sys-

em for elderly people based on smartwatch data were proposed

y Mauldin et al. [109] . They used a GRU RNN as the predictive

13

odel to perform fall detection. The predictive model was de-

loyed on cloud to make real-time decision making.

.2.4. Mental health

Mental health is as important as physical health and re-

earchers have already begun to development of many wearables

or mental condition monitoring. These wearables can usually de-

ermine human physiology status based on collected data such as

eartbeat, blood pressure, body temperature, or ECG. One typical

pplication of wearables is stress assessment. Choi et al. [110] col-

ected heart rate and audio signals from children using wearable

evices. These data coupled with support vector machine (SVM)

ere used to detect the stress patterns in children. Emotion board

s another attempt made for stress detection [111] based on elec-

rodermal activity (EDA). In this project, the collected skin con-

uctance signals were processed using linear discriminant analysis

LDA) and classified using SVM.

Wearable technologies can also be helpful in diagnosing and

onitoring of psychiatric disorders such as depression. Valenza

t al. [112] used PHYCE system to collect data for assessment of

he depressive status in bipolar disorder. PHYCE is a wearable sys-

em prototype that detects the ECG using textile electrodes and ac-

uires the respiration signal using piezoresistive sensors. In other

esearch, Roh et al. [113] developed a system-on-chip (SoC) to

ccelerate filtering and feature extraction of heart-rate variability

HRV) from an ECG. They managed to improve the accuracy of de-

ression recognition.

.2.5. Autism

Children with autism spectrum disorder suffer from emotion

ecognition deficits. Therefore, they need help to improve their

motion recognition abilities. Daniels et al. [114] developed a pro-

otype therapeutic tool using Google Glass for autistic children.

hey reported that autistic children had no problem in wearing

he device. In their work, set of images illustrating different emo-

ional states were shown to autistic children. Showing the correct

motional classification of images to the children via Google Glass

mproved their emotion recognition abilities.

Another application using machine learning and wearable tech-

ology is the detection of stereotypical motor movements (SMMs)

ased on real-time measurements from IMU which are sent for

rocessing to a cloud service [115] . SMMs are associated with

utism spectrum disorders. The proposed approach consisted of

wo phases namely feature extraction and decision making. A CNN

as used for feature extraction and the extracted features were fed

o a LSTM for decision making.

.2.6. Healthcare wearables shortcomings

Although wearable devices have considerable potential applica-

ions in healthcare domain, they have several shortcomings that

ust be addressed. For example, most of wearable devices are still

n the prototype stage and need extensive evaluation before being

ualified as final products. Wearable devices may connect to cloud

ervices to process and store the data collected by them. Therefore,

nforcing privacy of patients’ medical data is crucial. As the num-

er of wearable devices grows, the amount of data generated by

hem grows as well. Thus big data can be considered both a con-

ern and an opportunity for artificial intelligence research commu-

ity.

.3. Industrial and manufacturing

As industrial infrastructures evolve, performing the desired

asks with efficiency, accuracy and speed is highly desirable. With

ufficient research and development, wearable devices can have

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

t

m

w

r

s

q

o

d

7

a

w

o

o

w

p

s

o

u

o

d

w

r

s

a

p

B

a

f

t

t

l

d

i

t

t

o

m

t

v

r

(

t

m

t

m

c

7

t

o

t

t

a

b

i

a

m

a

u

[

l

t

t

m

T

u

(

i

v

(

w

a

c

m

w

he potential to revolutionize the modern industry. Whether hu-

ans can be totally replaced by machines in the future, is al-

ays debatable. The machines will take the humans’ place in doing

epetitive and routine tasks. However, the total removal of human

upervision is not likely in cases that human’s experience is re-

uired [116] . Currently, wearables have gained considerable share

f consumer market. However, application of wearables in the in-

ustry is still limited.

.3.1. Examples of real-world industrial wearables

There have been several research attempts to pave the road for

pplication of wearables in the industry. In WearIT@work project,

earable computing group has conducted research in application

f wearables in production domain [116] . The research was carried

ut in Skoda Auto car manufacturing. The objective of the research

as to replace the traditional paper-based car quality assurance

erformed at the end of the assembly line. A wearable device con-

isting of a belt-computer and a head-mounted display was devel-

ped in a way that the workers need not be trained in order to

se it. The main achievement of this work was the identification

f suitable methods for integrating wearable devices in real-life in-

ustrial scenarios. Some of unaddressed challenges of the proposed

earable were battery life for multiple working shifts and lack of

eliable wireless communication at the user level.

Wearable computer systems group at Carnegie Mellon Univer-

ity (CMU) has conducted another research entitled Navigator 2

bout industrial applications of wearables [116] . The aim of this

roject was improvement of inspection routines of mobile workers.

efore using the developed wearable, the workers had to complete

checklist with hundreds of pages. The checklist completion took

our to six hours. Performing the same inspection routine but with

he help of the developed wearable reduced the inspection time up

o 50%. The proposed wearable had support for speech recognition

eading to minimum interference of the wearable with the worker

uring inspection. The tackled challenges during this research were

nterface design, cognitive model, contextual awareness, and adap-

ation to tasks being performed. The factors left for further inves-

igation were weight limit of the wearable and its long-term effect

n the wearer’s body.

Efficient order picking is critical to maximize the gain of any

anufacturing line. Contextual computing group at Georgia Insti-

ute of Technology (Georgia Tech) has conducted a research to in-

estigate the effect of using wearables for order picking [116] . The

esearch was based on Google Glass which is a head-up display

HUD). The experimental results showed that using HUD to aid

he workers with order picking task to reduce the possible hu-

an errors and part picking time. The unaddressed challenges of

his research were wearability of head-mounted displays and opti-

ization of decision making for mobile workers through wearable

omputing.

.3.2. Critical design factors for industrial wearables

An important stepping stone towards making wearables prac-

ical in industrial applications is careful inspection of problems

f using wearables in the industry. To this end, in [116] , 25 en-

erprises were surveyed based on four aspects: 1. industrial sec-

or, 2. application scenarios, 3. current data processing methods,

nd 4. data interaction level. The industrial sectors investigated

y the survey were equipment manufacturing, metallurgy, chem-

cal, warehousing, rail transit, airport, and harbor. The considered

pplication scenarios were manufacturing execution, equipment

anagement, order picking, remote assistance, asset management

nd warehouse operation. Manufacturing execution tracks and doc-

ments the transformation of raw materials into final products

117] . Equipment management revolves around checking status of

14

arge-scale facilities. Order picking is one of the common opera-

ions in e-commerce warehousing. Remote assistance is related to

he application of augmented reality (AR) glasses. Asset manage-

ent is related to checking inventory for non-production items.

he data processing in the selected 25 enterprises was carried out

sing paper, personal digital assistant (PDA) or personal computer

PC).

Based on the four aspects (industrial sector, application scenar-

os, data processing method, and data interaction level), the sur-

eyed enterprises are partitioned and the results are shown in (a)-

d) of Fig. 7 .

To identify the key challenges and shortcomings of applying

earables in the industry, in the 25 enterprises, multiple wear-

ble devices have been tested by several users. Based on the re-

eived feedback from the users, five critical factors were deter-

ined which must be taken into account for designing practical

earables for industrial applications:

1. Ergonomic product design:

a. The wearables must be lightweight especially if they are

head-mounted.

b. The parts of the wearables that make contact with human

skin must be made of comfortable materials.

c. Wearables must provide hand-free experience for the users

since they need to perform various tasks with their hands.

Occupying the user’s hands or restricting their movements

due to wired connections is not an option.

2. Data interaction on device:

a. The wearables should provide the key information concisely.

Showing too much information on the wearable screen may

disturb the user.

b. Limiting use of touch screen and keyboard for receiving in-

put from users. This factor is due to the fact that wearables

usually do not support complicated data typing.

c. Voice and gesture interaction may be used as supplemen-

tary interaction methods.

3. Operational stability:

a. The industrial wearables should be equipped with batter-

ies that can last for more than eight hours (one work-shift)

without charging.

b. The stability of network connections such as Wifi, Blue-

tooth, etc. is critical in industrial environments. Moreover,

the network connections should be easily deployable and

they should be easy-to-use.

c. Industrial environments are usually harsh with high temper-

ature, humidity, and shock. The industrial wearables must

stay operational under such conditions.

4. External software integration:

a. Considering that industrial wearables cannot work indepen-

dently, they are required to be integrated into the enterprise

systems seamlessly.

b. The industrial wearables must have the ability to process

data in real-time and make-decentralized decisions.

c. The wearables must allow the involvement of human expe-

rience whenever needed.

5. External hardware integration:

a. The wearables must be able to accept/collect data from ma-

chines or robots of the manufacturing site.

b. The wearables must be able to control external equipment.

Such requirement provides the user to control the equip-

ment and intervene with the operation process if needed.

c. The wearables must support human-machine cooperation.

This way the flexibility of the human and the accuracy of

the machines can be combined to improve efficiency. Using

the wearable, the human can instruct the machines with a

series of gestures and signs.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

t

p

s

p

c

7

s

T

i

w

h

b

f

i

t

T

w

o

b

m

a

c

w

t

i

e

e

w

t

e

[

I

[

i

m

t

h

f

e

t

c

v

i

A

T

c

d

s

p

t

t

a

r

8

s

w

d

a

c

d

a

c

o

d

f

e

c

w

8

i

d

r

p

i

b

m

t

p

D

l

t

t

t

c

o

8

(

g

l

s

c

a

r

w

s

m

8

w

w

i

p

F

s

t

a

m

w

Three wearable projects are reviewed in Section 7.3.1 based on

he five design factors presented above. The evaluation results are

resented in Fig. 8 . Apparently, all three projects have tried to de-

ign their wearable devices in an ergonomic way. Wearable com-

uting group has the best operational stability, whereas contextual

omputing group has the best data interaction on device.

.4. Human–robot interaction

Human-robot interaction (HRI) is about establishing efficient,

afe, and comfortable interactions between humans and robots.

he interaction usually takes place via a wearable medium. That

s where wearable devices come in. One of these wearables is a

rist-worn camera called WristCam [118] which is designed for

and gesture recognition. This wearable relies on speeded up ro-

ust features (SURF) [119] which are matched between successive

rames of video captured by the camera. The user’s hand velocity

s determined using feature matching. After hand gesture extrac-

ion, it is segmented based on a predefined gesture starting signal.

he gesture segments are then classified using the dynamic time

arping (DTW) [120] method. In addition to robot control based

n hand gesture recognition, it is also possible to command a robot

ased on the walking pattern. Cifuentes et al. [121] proposed a hu-

an tracking approach for a service robot using a wearable IMU

nd laser ranger finder mounted on the robot. IMU was used to

apture the walking pattern of the human and laser range finder

as used to detect the human’s legs. Based on the sensed data,

he human tracking system was able to control the robot such that

t followed the human walking pattern. The tracking system was

valuated in an eight-shaped trajectory.

One of the approaches to realizing HRI is skill learning. Fang

t al. [122] proposed a skill learning approach for HRI using a

earable device. Their proposed system consists of two subsys-

ems: 1. Robot teleoperation, and 2. Imitation learning. The teleop-

ration is implemented using the robotic operating system (ROS)

123] and is used to collect training data for imitation learning.

mitation learning relies on dynamic movement primitive (DMP)

124–126] to mimic the trajectory demonstrated by the user dur-

ng the teleoperation phase. To this end, the user’s arm and hand

otion are recorded using a wearable device equipped with mul-

iple inertial measurements and magnetic units (IMMUs).

Physical human-robot interaction (pHRI) can be used for re-

abilitation, assistive devices, etc. Wearable devices that are used

or pHRI must preserve their users’ comfort and safety. Ghonasgi

t al. [127] proposed a modular sensing panel for pHRI which has

he ability to capture the fine nature of force transmission from

ompliant human tissue onto rigid surfaces in the wearable de-

ice. Their sensing panel uses force-sensing resistors (FSRs) and it

s low-cost and can be adapted to a variety of human interfaces.

nother work regarding pHRI was presented by Lenzi et al. [128] .

he authors focus on a distributed approach for monitoring physi-

al interaction between a user and a wearable robot. To this end, a

istributed tactile sensor consisting of a matrix of optoelectronic

ensors is used. The sensors are embedded in a thin and com-

liant silicone bulk onto the user-robot contact surface. While the

actile sensor is capable of measuring the pressure distribution on

he wearable-human interaction area, it preserves the user’s safety

nd comfort and does not put any specific design constraint on the

obot to house it.

. Wearable technologies challenges

Nowadays, wearable devices are often available in the form of

martwatches which can connect with smartphones. In the future,

earables are expected to be seen in various forms designed for

15

ifferent applications. The world of the future is the world of wear-

ble devices that can help the humankind in doing his duties. They

an market in the fastest possible time by sharing the collected

ata and help to maximize the profit. It can be generalized to other

spects of life like in medical, geographical, or personal fields. The

ollected data by wearables in the form of text, video, audio or

ther specified forms can be shared to help with accurate disease

iagnosis.

The current generation of wearable devices is still far from per-

ect. The developed technologies are impressive albeit not mature

nough. To unleash the full power of wearable devices, multiple

hallenges must be addressed. Some of the challenges faced by the

earable devices are briefly discussed in the sections below.

.1. Data collection

The first challenge is related to data acquisition. The qual-

ty, quantity, resolution, and other parameters of the gathered

ata depend on the wearable device. Spatial resolution, tempo-

al resolution, or data resolution are the factors which may im-

act data quality and quantity [129] . Collecting data from users

n an optimal manner is challenging. The gathered raw data must

e pre-processed before its clinical application. To this end, the

easured quantities from different devices must be unified and

heir errors and statistical outliers must be removed. After being

re-processed, the data are ready to be used by data analytics.

ata processing solutions for wearable data often rely on machine

earning [ 130 , 131 ]. Obtaining high quality labels for the data is

ime consuming and requires expert knowledge or intervention of

he wearable user [ 132 , 133 ]. Wearables that require insertion into

he user’s body like insertable cardiac monitors, continuous glu-

ose monitors, and insertable drug deliverables systems have their

wn challenges:

• Foreign body reaction may impede the functioning of biosen-

sors and their data transmission. • Inserted device might move unexpectedly.

.2. Data transmission

Coming up with an energy-efficient solution to transmit data

collected by wearables) for further processing is crucial. The emer-

ence of faster connection technologies such as 5G and beyond

eads to ever-increasing amount of data generation. Processing and

torage of these data is challenging. Relying solely on centralized

loud computing is not an option due to data processing latency

nd significant load on network performance. Edge computing can

educe latency by moving the necessary computation on the net-

ork’s edge. However, there are still issues with development of

oftware and hardware of edge devices which must be fixed to

eet the cloud computing load [134] .

.3. Security and privacy

Enforcing privacy, security, and trustworthiness while using

earables is still an open challenge [135] . The main feature of the

earables is continuous sensing and data collection. As mentioned

n [136] , most modern wearables can collect data about position,

hysical activity level, and mental health of users who wear them.

rom the user’s point of view, these data might be considered sen-

itive, so enforcing their privacy cannot be overlooked. Currently,

here is no unified solution to address all the potential security

nd privacy threats of wearables so more research and develop-

ent are required to improve the security and privacy aspects of

earable devices.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

8

t

u

a

q

n

8

m

i

a

H

m

t

v

s

e

w

8

d

e

o

o

r

a

c

8

d

o

b

l

i

t

t

D

c

D

n

t

i

9

s

b

c

s

a

A

w

e

c

p

d

a

d

c

t

p

p

w

w

p

h

i

T

h

c

c

a

[

l

f

h

t

t

p

W

a

t

[

i

c

t

t

i

w

i

p

A

w

f

i

n

h

a

1

f

w

r

d

a

t

I

w

o

a

i

p

c

F

.4. Localization quality

In many applications of wearable technologies, precise localiza-

ion of the wearable devices is important. Given that wearables are

sually resource-constrained, achieving localization with accept-

ble precision is challenging. Therefore, improving the localization

uality of wearable devices under limited computational power is

eeded.

.5. User adoption aspects

The success of wearable technologies directly depends on how

uch the target users would accept to use them. User adoption

s specifically challenging in medical and industrial applications. In

ll other applications, user adoption is a matter of personal choice.

owever, in medical and industrial domains, using wearables is

ore of a necessity than a choice. In the medical domain, the pa-

ients may feel discomfort and stress about wearing pervasive de-

ices. This is mainly due to the complexity and excessive ‘‘intru-

iveness’’ of these devices. In the industrial domain, some work-

rs may fail to understand the benefit and purpose of monitoring

earable devices and may resist using them.

.6. Resource constraints

Providing new services and targeting new users require the

evelopment of advanced functionalities for the wearables. How-

ver, adding new functionalities increases the power consumption

f already resource-constrained wearables. Sometimes, the quality

f the final wearable product is not met due to limited resource

equirements. Therefore, managing energy consumption and yet

chieving the expected performance is one of the most important

hallenges of the wearables.

.7. Interoperability

In the internet of wearable things (IoWT), different wearable

evices must be able to communicate with each other regardless

f their technologies. Such device-to-device (D2D) communication

etween wearable devices with different com putational power (e.g.

ow-end and high-end devices) is a stepping-stone toward the real-

zation of various smart functions in a decentralized manner. Recall

hat an individual wearable device does not have much to offer due

o its limited resources. However, with efficient management and

2D communication, the processing power of multiple wearables

an be combined to achieve the complex tasks. Currently, reliable

2D communication is one of the open problems of wearable tech-

ologies. Moreover, to fully benefit from the IoWT, developing end-

o-end solutions to achieve seamless integration of wearable things

nto existing systems is one of the great concerns.

. Discussion

Wearables provide various monitoring and scanning features

uch as biofeedback or other sensory physiological functions like

iometry-related ones [137] . Moreover, wearables are portable and

an be used hands-free. Wearable devices may improve life quality

ignificantly but first, they have to be cost-effective.

According to [138] , about half of people who purchase a wear-

ble stop using it. One-third of them do this before six months.

s reported in [139] , elderly people have shown interest in using

earable devices for physical and mental health purposes. How-

ver, due to the lack of awareness about wearable technologies,

urrently many elderly people do not use wearables. Thus, peo-

le need to be trained about the working mechanism of wearable

evices and their maintenance.

16

The design and development of wearable devices must take into

ccount user preferences. This is particularly important when the

evices have to be worn for longer durations, for example during

hronic diseases monitoring, or data collection about the user’s ac-

ivity level [140] . Being lightweight is one of the important user

references about wearables which severely limits the battery ca-

acity of wearable devices. Therefore, computational power and

ireless communication of wearables will be limited.

The sensors in wearable devices generate lots of data while

alking or jogging. These data can be used to discover dominant

atterns among the population. Researchers of nursing science

ave already taken interdisciplinary approaches to study the med-

cal problems based on big data collected from a huge population.

o this end, multiple professionals with complementary expertise

ave worked as a team [141] . Moreover, the growth of IoWT in-

reases the complexity and amount of generated data. These data

an be used for implementing IoT sensing-based health monitoring

nd management [142] and developing mobile health applications

143] .

As described in Section 8.7 , interoperability is one of the chal-

enges of wearable technologies which is an important direction

or future works; it is also an important requirement for remote

ealthcare services. The fifth generation of wireless networking

echnology (5G) allows the connection of many hospital devices

o the network and provides remote access from home. An exam-

le of remote healthcare using wearables is the Hospital Without

alls project developed by Australia’s Commonwealth Scientific

nd Industrial Research Organization (CSIRO). This project aims

o monitor patients continuously in certain diagnostic categories

144] . In this project, a miniature, wearable, and low-power radio

s used to transmit vital signs and activity information to a home

omputer. The data are then sent by telephone line or through

he internet to appropriate medical experts. Another important fu-

ure trend is the emergence of new wearable devices. For example,

n the medical domain, it is expected that drug delivery systems

ill emerge in the form of wearable devices (e.g. MiniMed 770G

n Section 7.2.2 .). Disease intervention by wearables is also ex-

ected via integration with actuators planted insides/on the body.

I methods have already attracted the attention of researchers of

earable devices. Authors in [145] presented a proof-of-concept

or a seizure prediction system. This system utilized a deep learn-

ng classifier to distinguish between preictal and interictal EEG sig-

als. The deep learning model in combination with neuromorphic

ardware formed a wearable seizure warning system which is suit-

ble for patient-specific settings.

0. Conclusion

Wearable technology is an essential building block in future in-

ormation and communication technology (ICT) systems. However,

earable technology has not reached an acceptable level of matu-

ity yet. Multiple challenges are still unaddressed with regard to

ata collection, data processing, communications, security, etc. The

im of this review was to give readers a broad overview of applica-

ions of wearable devices in sport, medical, and industrial domains.

n the future, it will be useful to also investigate the application of

earables in other domains. In this review, the role of AI meth-

ds in the development of wearable devices has been investigated

s well. As future research, further applications of AI techniques

n wearable devices to improve the quality of life by monitoring

hysiological parameters or early automated detection of diseases

an be investigated.

unding

There is not funding source for this paper.

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

D

R

eclaration of Competing Interest

The authors have no conflicting interests to declare.

eferences

[1] A. Ometov, et al., A survey on wearable technology: history, state-of-the- art and current challenges, Comput. Netw. 193 (2021) 108074, doi: 10.1016/

j.comnet.2021.108074 . [2] N. Ayoobi , et al. , Time series forecasting of new cases and new deaths rate for

COVID-19 using deep learning methods, Results in Physics 27 (2021) 1–15 . [3] H. Asgharnezhad et al., “Objective evaluation of deep uncertainty predictions

for covid-19 detection,” arXiv preprint arXiv: 2012.11840 , (2020) 1–7.

[4] R. Alizadehsani , et al. , A data mining approach for diagnosis of coronary artery disease, Comput. Methods Programs Biomed. 111 (1) (2013) 52–61 .

[5] B. Handwerk , With wearable devices that monitor air quality, scientists can crowdsource pollution maps, Smithsonian Mag. (2015) .

[6] Y. Qiu , Security analysis for the information of wearable devices, Netinfo Se- cur. 9 (2016) 79–83 .

[7] J. Twentyman , Wearable devices aim to reduce workplace accidents, Financ.

Times (June 2016) . [8] S. Seneviratne , et al. , A survey of wearable devices and challenges, IEEE Com-

mun. Surv. Tutor. 19 (4) (2017) 2573–2620 . [9] A. Banerjee , C. Chakraborty , A. Kumar , D. Biswas , Chapter 5 - Emerging trends

in IoT and big data analytics for biomedical and health care technologies, in: V.E. Balas, V.K. Solanki, R. Kumar, M. Khari (Eds.), Handbook of Data Science

Approaches for Biomedical Engineering, Academic Press, 2020, pp. 121–152 .

[10] A.K. Yetisen, J.L. Martinez-Hurtado, B. Ünal, A. Khademhosseini, H. Butt, Wear- ables in medicine, Adv. Mater. 30 (33) (2018) 1706910, doi: 10.1002/adma.

201706910 . [11] W. Barfield , Fundamentals of Wearable Computers and Augmented Reality,

CRC press, 2015 . [12] G. Gaikwad , A. Jain , Feelbot: reducing use of bad words in children through

wearable using artificial intelligence and gamification, in: Proceedings of the 2017 Conference on Interaction Design and Children, 2017, pp. 777–781 .

[13] K. Shameer, M.A. Badgeley, R. Miotto, B.S. Glicksberg, J.W. Morgan, J.T. Dudley,

Translational bioinformatics in the era of real-time biomedical, health care and wellness data streams, Brief. Bioinform. 18 (1) (2017) 105–124, doi: 10.

1093/bib/bbv118 . [14] S. Patel , H. Park , P. Bonato , L. Chan , M. Rodgers , A review of wearable sen-

sors and systems with application in rehabilitation, J. Neuroeng. Rehabil. 9 (1) (2012) 1–17 .

[15] J.A. Levine , A five-step strategy to combine data sources from multiple wear-

able sensors, Technol. Investm. 8 (1) (2017) 33–43 . [16] J. Wei, How wearables intersect with the cloud and the internet of things:

considerations for the developers of wearables, IEEE Consum. Electron. Mag. 3 (3) (2014) 53–56, doi: 10.1109/MCE.2014.2317895 .

[17] Y. Athavale, S. Krishnan, Biosignal monitoring using wearables: observations and opportunities, Biomed. Signal. Process Control 38 (2017) 22–33, doi: 10.

1016/j.bspc.2017.03.011 .

[18] M.E. Chowdhury , A. Khandakar , Y. Qiblawey , M.B.I. Reaz , M.T. Islam , F. Touati , Machine learning in wearable biomedical systems, Sports Sci. Hum. Health-D-

iff. Approach. : IntechOpen (2020) . [19] U.R. Acharya, et al., A deep convolutional neural network model to classify

heartbeats, Comput. Biol. Med. 89 (2017) 389–396, doi: 10.1016/j.compbiomed. 2017.08.022 .

[20] B.N. Singh, A.K. Tiwari, Optimal selection of wavelet basis function applied to

ECG signal denoising, Digit Signal Process 16 (3) (2006) 275–287, doi: 10.1016/ j.dsp.20 05.12.0 03 .

[21] Y. Lin, et al., Artificial intelligence of things wearable system for cardiac dis- ease detection, in: 2019 IEEE International Conference on Artificial Intelli-

gence Circuits and Systems (AICAS), 18-20, March 2019, pp. 67–70, doi: 10. 1109/AICAS.2019.8771630 . 2019 .

[22] J. Chan, A.C. Miller, and E.B. Fox, “Representing and denoising wearable ECG

recordings,” arXiv preprint arXiv: 2012.00110 , 2020. [23] G. Lee, B. Choi, H. Jebelli, C.R. Ahn, S. Lee, Noise reference signal–based de-

noising method for EDA collected by multimodal biosensor wearable in the field, J. Comput. Civil Eng. 34 (6) (2020) 04020044, doi: 10.1061/(ASCE)CP.

1943-5487.0 0 0 0927 . [24] M.B. Hossain, J. Lázaro, Y. Noh, K.H. Chon, Denoising wearable armband

ECG data using the variable frequency complex demodulation technique,

in: 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 20-24, July 2020, pp. 592–595, doi: 10.

1109/EMBC44109.2020.9175665 . 2020 . [25] A. Shoeibi et al., "Automated detection and forecasting of covid-19 using deep

learning techniques: a review," arXiv preprint arXiv: 2007.10785 , 2020. [26] H.T. Tor , et al. , Automated detection of conduct disorder and attention deficit

hyperactivity disorder using decomposition and nonlinear techniques with EEG signals, Comput. Methods Programs Biomed. 200 (2021) 105941 .

[27] A. Shoeibi, et al., Epileptic seizures detection using deep learning techniques:

a review, Int. J. Environ. Res. Public Health 18 (11) (2021) 5780 [Online]. Avail- able https://www.mdpi.com/1660-4601/18/11/5780 .

[28] G.H. Dunteman , Principal Components Analysis, 69, Sage, 1989 . [29] S. Balakrishnama , A. Ganapathiraju , Linear discriminant analysis-a brief tuto-

rial, Inst. Signal Inf. Process. 18 (1998) 1–8 1998 .

17

[30] P. Comon, Independent component analysis, A new concept? Signal Process. 36 (3) (1994) 287–314, doi: 10.1016/0165- 1684(94)90029- 9 .

[31] S.T. Roweis, L.K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science 290 (5500) (2000) 2323, doi: 10.1126/science.290.5500.

2323 . [32] F. Khozeimeh , et al. , Combining a convolutional neural network with autoen-

coders to predict the survival chance of COVID-19 patients, Sci. Rep. 11 (1) (2021) 1–18 .

[33] A. Ng, “Machine learning and AI via brain simulations,” Accessed: May, vol. 3,

p. 2018, 2013. [34] R. Alizadehsani, et al., Handling of uncertainty in medical data using machine

learning and probability theory techniques: a review of 30 years (1991–2020), Ann. Oper. Res. 2 (2021) 1–42, doi: 10.1007/s10479- 021- 04006- 2 .

[35] R. Caruana , A. Niculescu-Mizil , An empirical comparison of supervised learn- ing algorithms, in: Proceedings of the 23rd International Conference on Ma-

chine Learning, 2006, pp. 161–168 .

[36] R. Alizadehsani, et al., Model uncertainty quantification for diagnosis of each main coronary artery stenosis, Soft Comput. 24 (13) (2020) 10149–10160,

doi: 10.10 07/s0 050 0- 019- 04531- 0 . [37] M. Khodatars , et al. , Deep learning for neuroimaging-based diagnosis and re-

habilitation of autism spectrum disorder: a review, Comput. Biol. Med. 139 (2021) 104 94 9 .

[38] A. Shoeibi et al., “Applications of deep learning techniques for automated

multiple sclerosis detection using magnetic resonance imaging: a review,” arXiv preprint arXiv: 2105.04881 , 2021.

[39] Z. Arabasadi , R. Alizadehsani , M. Roshanzamir , H. Moosaei , A .A . Yarifard , Com- puter aided decision making for heart disease detection using hybrid neural

network-Genetic algorithm, Comput. Methods Programs Biomed. 141 (2017) 19–26 .

[40] E. Nasarian, et al., Association between work-related features and coronary

artery disease: a heterogeneous hybrid feature selection integrated with bal- ancing approach, Pattern Recognit. Lett. 133 (2020) 33–40, doi: 10.1016/j.

patrec.2020.02.010 . [41] D. Sharifrazi , et al. , Fusion of convolution neural network, support vec-

tor machine and Sobel filter for accurate detection of COVID-19 pa- tients using X-ray images, Biomed. Signal. Process Control 68 (2021)

102622 .

[42] S.L. Oh , et al. , Classification of heart sound signals using a novel deep WaveNet model, Comput. Methods Programs Biomed. 196 (2020) 105604 .

[43] R. Alizadehsani et al., "Uncertainty-aware semi-supervised method using large unlabelled and limited labeled COVID-19 data," arXiv preprint arXiv: 2102.

06388 , 2021. [44] M. Khodatars et al., "Deep learning for neuroimaging-based diagnosis

and rehabilitation of autism spectrum disorder: a review," arXiv preprint

arXiv: 2007.01285 , 2020. [45] R. Alizadehsani , et al. , Coronary artery disease detection using artificial intelli-

gence techniques: a survey of trends, geographical differences and diagnostic features 1991–2020, Comput. Biol. Med. 128 (2021) 104095 .

[46] M.A. Fahami, M. Roshanzamir, N.H. Izadi, V. Keyvani, R. Alizadehsani, Detec- tion of effective genes in colon cancer: a machine learning approach, Inform.

Med. Unlocked 24 (2021) 100605, doi: 10.1016/j.imu.2021.100605 . [47] X. Zhu , A.B. Goldberg , Introduction to semi-supervised learning, Synth. Lect.

Artif. Intell. Machine Learn. 3 (1) (2009) 1–130 .

[48] By A.G. Barto , R.S. Sutton , Reinforcement learning: an introduction, SIAM Rev. 63 (2) (June 2021) 423 .

[49] S. Saadatnejad, M. Oveisi, M. Hashemi, LSTM-based ECG classification for con- tinuous monitoring on personal wearable devices, IEEE J. Biomed. Health In-

form. 24 (2) (2020) 515–523, doi: 10.1109/JBHI.2019.2911367 . [50] A. Amirshahi, M. Hashemi, ECG classification algorithm based on STDP and R-

STDP neural networks for real-time monitoring on ultra low-power personal

wearable devices, IEEE Trans. Biomed. Circuits Syst. 13 (6) (2019) 1483–1493, doi: 10.1109/TBCAS.2019.2948920 .

[51] J. Acharya, A. Basu, Deep neural network for respiratory sound classifica- tion in wearable devices enabled by patient specific model tuning, IEEE

Trans. Biomed. Circuits Syst. 14 (3) (2020) 535–544, doi: 10.1109/TBCAS.2020. 2981172 .

[52] M.D. Hssayeni, J. Jimenez-Shahed, M.A. Burack, B. Ghoraani, Wearable sen-

sors for estimation of Parkinsonian tremor severity during free body move- ments, Sensors 19 (19) (2019) 4215 [Online] Available https://www.mdpi.com/

1424-8220/19/19/4215 . [53] C. Ahlrichs, et al., Detecting freezing of gait with a tri-axial accelerometer in

Parkinson’s disease patients, Med. Biol. Eng. Comput. 54 (1) (2016) 223–233, doi: 10.1007/s11517-015-1395-3 .

[54] R. Varatharajan, G. Manogaran, M.K. Priyan, R. Sundarasekar, Wearable sen-

sor devices for early detection of Alzheimer disease using dynamic time warping algorithm, Cluster Comput. 21 (1) (2018) 681–690, doi: 10.1007/

s10586- 017- 0977- 2 . [55] A. Das, et al., Unsupervised heart-rate estimation in wearables with Liquid

states and a probabilistic readout, Neural Netw. 99 (2018) 134–147, doi: 10. 1016/j.neunet.2017.12.015 .

[56] A. Krause , D.P. Siewiorek , A. Smailagic , J. Farringdon , Unsupervised, Dynamic

Identification of Physiological and Activity Context in Wearable Computing, in: Unsupervised, Dynamic Identification of Physiological and Activity Context

in Wearable Computing, 3, ISWC, 2003, p. 88 . [57] R. Janarthanan, S. Doss, S. Baskar, Optimized unsupervised deep learning as-

sisted reconstructed coder in the on-nodule wearable sensor for human activ-

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

[

[

[

[

[

[

[

[

[

ity recognition, Measurement 164 (2020) 108050, doi: 10.1016/j.measurement. 2020.108050 .

[58] B. Ballinger , et al. , DeepHeart: semi-supervised sequence learning for cardio- vascular risk prediction, in: Proceedings of the AAAI Conference on Artificial

Intelligence, 32, 2018 . [59] K. Yang, C.R. Ahn, M.C. Vuran, S.S. Aria, Semi-supervised near-miss fall de-

tection for ironworkers with a wearable inertial measurement unit, Autom. Constr. 68 (2016) 194–202, doi: 10.1016/j.autcon.2016.04.007 .

[60] M. Stikic, D. Larlus, B. Schiele, Multi-graph based semi-supervised learning for

activity recognition, in: 2009 International Symposium on Wearable Comput- ers, 4-7, Sept. 2009, pp. 85–92, doi: 10.1109/ISWC.2009.24 . 2009 .

[61] M. Stikic , K. Van Laerhoven , B. Schiele , Exploring semi-supervised and active learning for activity recognition, in: 2008 12th IEEE International Symposium

on Wearable Computers, IEEE, 2008, pp. 81–88 . [62] Y. Ma , H. Ghasemzadeh , Labelforest: non-parametric semi-supervised learning

for activity recognition, in: Proceedings of the AAAI Conference on Artificial

Intelligence, 33, 2019, pp. 4520–4527 . [63] G. Wiechert , et al. , Evolutionary semi-supervised rough categorization of

brain signals from a wearable headband, in: 2016 IEEE Congress on Evolu- tionary Computation (CEC), IEEE, 2016, pp. 3131–3138 .

[64] A. Ahadi-Sarkani , S. Elmalaki , ADAS-RL: adaptive vector scaling reinforcement learning for human-in-the-loop lane departure warning, in: Proceedings of

the First International Workshop on Cyber-Physical-Human System Design

and Implementation, 2021, pp. 13–18 . [65] S. Elmalaki, FaiR-IoT: fairness-aware human-in-the-loop reinforcement learn-

ing for harnessing human variability in personalized IoT, in: presented at the Proceedings of the International Conference on Internet-of-Things De-

sign and Implementation, Charlottesvle, VA , USA , 2021 [Online] Available, doi: 10.1145/3450268.3453525 .

[66] M. Baucum, A. Khojandi, R. Vasudevan, and R. Ramdhani, "Optimizing

patient-specific medication regimen policies using wearable sensors in Parkinson’s disease." (2021) 1-39, doi: 10.13140/RG.2.2.16922.77769 .

[67] R.J. Williams , Simple statistical gradient-following algorithms for connection- ist reinforcement learning, Mach. Learn. 8 (3–4) (1992) 229–256 .

[68] H. Jebelli , M.M. Khalili , S. Hwang , S. Lee , A supervised learning-based con- struction workers’ stress recognition using a wearable electroencephalogra-

phy (EEG) device, Constr. Res. Congress 2018 (2018) 43–53 .

[69] A. Das , F. Catthoor , S. Schaafsma , Heartbeat classification in wearables us- ing multi-layer perceptron and time-frequency joint distribution of ECG, in:

Proceedings of the 2018 IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, 2018, pp. 69–

74 . [70] A . Gupta , A . Al-Anbuky , P. McNair , Activity classification feasibility using

wearables: considerations for hip fracture, J. Sens. Actuator Netw. 7 (4) (2018)

54 . [71] V. Nguyen , H. Kunz , P. Taylor , D. Acosta , Insights into pharmacotherapy man-

agement for Parkinson’s disease patients using wearables activity data, MIE (2018) 156–160 .

[72] Y. Guan , T. Plötz , Ensembles of deep lstm learners for activity recognition using wearables, Proc. ACM Interact., Mobile, Wear. Ubiquit. Technol. 1 (2)

(2017) 1–28 . [73] F. Nasirzadeh , et al. , Physical fatigue detection using entropy analysis of heart

rate signals, Sustainability 12 (7) (2020) 2714 .

[74] D. Borthakur , H. Dubey , N. Constant , L. Mahler , K. Mankodiya , Smart fog: fog computing framework for unsupervised clustering analytics in wearable in-

ternet of things, in: 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP), IEEE, 2017, pp. 472–476 .

[75] N. Weber , A. Härmä, E.P.D.T. Heskes , Unsupervised Learning in Human Activ- ity Recognition: a First Foray into Clustering Data Gathered from Wearable

Sensors Ph. D. Thesis, Radboud University, Nijmegen, The Netherlands, 2017 .

[76] L.F. Mejia-Ricart , P. Helling , A. Olmsted , Evaluate action primitives for human activity recognition using unsupervised learning approach, in: 2017 12th In-

ternational Conference for Internet Technology and Secured Transactions (IC- ITST), IEEE, 2017, pp. 186–188 .

[77] L. Bai , C. Yeung , C. Efstratiou , M. Chikomo , Motion2Vector: unsupervised learning in human activity recognition using wrist-sensing data, in: Adjunct

Proceedings of the 2019 ACM International Joint Conference on Pervasive and

Ubiquitous Computing and Proceedings of the 2019 ACM International Sym- posium on Wearable Computers, 2019, pp. 537–542 .

[78] D. Trabelsi , S. Mohammed , F. Chamroukhi , L. Oukhellou , Y. Amirat , An unsu- pervised approach for automatic activity recognition based on hidden Markov

model regression, IEEE Trans. Autom. Sci. Eng. 10 (3) (2013) 829–835 . [79] R. Gupta , A. Gupta , R. Aswal , Detection of poor posture using wearable sen-

sors and unsupervised learning, in: 2021 7th International Conference on

Advanced Computing and Communication Systems (ICACCS), 1, IEEE, 2021, pp. 527–531 .

[80] V. Dovgalecs , R. Megret , H. Wannous , Y. Berthoumieu , Semi-supervised learn- ing for location recognition from wearable video, in: 2010 International

Workshop on Content Based Multimedia Indexing (CBMI), IEEE, 2010, pp. 1–6 . [81] M. Lv , L. Chen , T. Chen , G. Chen , Bi-view semi-supervised learning based se-

mantic human activity recognition using accelerometers, IEEE Trans. Mobile

Comput. 17 (9) (2018) 1991–2001 . [82] M. Zeng , T. Yu , X. Wang , L.T. Nguyen , O.J. Mengshoel , I. Lane , Semi-super-

vised convolutional neural networks for human activity recognition, in: 2017 IEEE International Conference on Big Data (Big Data, IEEE, 2017, pp. 522–

529 .

18

[83] J. Zheng , H. Cao , D. Chen , R. Ansari , K.-.C. Chu , M.-.C. Huang , Designing deep reinforcement learning systems for musculoskeletal modeling and locomo-

tion analysis using wearable sensor feedback, IEEE Sens. J. 20 (16) (2020) 9274–9282 .

[84] T. Yamagata, R. Santos-Rodríguez, R. McConville, and A. Elsts, "Online feature selection for activity recognition using reinforcement learning with multiple

feedback," arXiv preprint arXiv: 1908.06134 , 2019. [85] N. Rhinehart , K.M. Kitani , First-person activity forecasting with online inverse

reinforcement learning, in: Proceedings of the IEEE International Conference

on Computer Vision, 2017, pp. 3696–3705 . [86] J. Watts , A. Khojandi , R. Vasudevan , R. Ramdhani , Optimizing individual-

ized treatment planning for parkinson’s disease using deep reinforcement learning, in: 2020 42nd Annual International Conference of the IEEE En-

gineering in Medicine & Biology Society (EMBC), IEEE, 2020, pp. 5406– 5409 .

[87] G. Bhat , R. Deb , V.V. Chaurasia , H. Shill , U.Y. Ogras , Online human activity

recognition using low-power wearable devices, in: 2018 IEEE/ACM Interna- tional Conference on Computer-Aided Design (ICCAD), IEEE, 2018, pp. 1–8 .

[88] N. Rhinehart , K.M. Kitani , First-person activity forecasting from video with online inverse reinforcement learning, IEEE Trans. Pattern Anal. Mach. Intell.

42 (2) (2018) 304–317 . [89] S.-.T. Chen, S.-.S. Lin, C.-.W. Lan, H.-.Y. Hsu, Design and development of a

wearable device for heat stroke detection, Sensors 18 (1) (2018) 17 [Online].

Available https://www.mdpi.com/1424-8220/18/1/17 . [90] C. Skazalski , R. Whiteley , C. Hansen , R. Bahr , A valid and reliable method to

measure jump-specific training and competition load in elite volleyball play- ers, Scand. J. Med. Sci. Sports 28 (5) (2018) 1578–1585 .

[91] R. Maddison , et al. , Usefulness of wearable cameras as a tool to enhance chronic disease self-management: scoping review, JMIR Mhealth Uhealth 7

(1) (2019) e10371 .

[92] E.E. Dooley , N.M. Golaszewski , J.B. Bartholomew , Estimating accuracy at exer- cise intensities: a comparative study of self-monitoring heart rate and physi-

cal activity wearable devices, JMIR Mhealth Uhealth 5 (3) (2017) e7043 . [93] R.T. Welbi, "Health benefits of wearable tech," [Online] https://www.welbi.co/

single- post/5- health- benefits- of- wearable- tech (Accessed July 3, 2021). [94] E.S. Winokur, M.K. Delano, C.G. Sodini, A wearable cardiac monitor for long-

term data acquisition and analysis, IEEE Trans. Biomed. Eng. 60 (1) (2013)

189–192, doi: 10.1109/TBME.2012.2217958 . [95] Y. Heui-Kyung, et al., Application for the wearable heart activity monitoring

system: analysis of the autonomic function of HRV, in: 2008 30th Annual In- ternational Conference of the IEEE Engineering in Medicine and Biology Soci-

ety, 20-25 Aug., 2008, pp. 1258–1261, doi: 10.1109/IEMBS.2008.4649392 . 2008 . [96] Z. Lin, H. Dai, Y. Xiong, X. Xia, S. Horng, Quantification assessment of bradyki-

nesia in Parkinson’s disease based on a wearable device, in: 2017 39th Annual

International Conference of the IEEE Engineering in Medicine and Biology So- ciety (EMBC), 11-15, July 2017, pp. 803–806, doi: 10.1109/EMBC.2017.8036946 .

2017 . [97] M. Delrobaei, N. Baktash, G. Gilmore, K. McIsaac, M. Jog, Using wearable tech-

nology to generate objective Parkinson’s disease dyskinesia severity score: possibilities for home monitoring, IEEE Trans. Neural Syst. Rehabilit. Eng. 25

(10) (2017) 1853–1863, doi: 10.1109/TNSRE.2017.2690578 . [98] N.D. Heintzman , A digital ecosystem of diabetes data and technology: ser-

vices, systems, and tools enabled by wearables, sensors, and apps, J. Diabetes

Sci. Technol. 10 (1) (2016) 35–41 . [99] " https://www.dexcom.com/g6- cgm- system ."

100] " https://www.medtronicdiabetes.com/home ." [101] " https://www.companionmedical.com/ ."

102] G. Alfian , M. Syafrudin , M.F. Ijaz , M.A. Syaekhoni , N.L. Fitriyani , J. Rhee , A personalized healthcare monitoring system for diabetic patients by utilizing

BLE-based sensors and real-time data processing, Sensors 18 (7) (2018) 2183 .

103] T. Fujikawa , O. Tochikubo , N. Kura , T. Kiyokura , J. Shimada , S. Umemura , Mea- surement of hemodynamics during postural changes using a new wearable

cephalic laser blood flowmeter, Circul. J. 73 (10) (2009) 1950–1955 . 104] W. Iwasaki, H. Nogami, S. Takeuchi, M. Furue, E. Higurashi, R. Sawada, De-

tection of site-specific blood flow variation in humans during running by a wearable laser doppler flowmeter, Sensors 15 (10) (2015) 25507–25519 [On-

line]. Available https://www.mdpi.com/1424-8220/15/10/25507 .

105] J.H. Burridge, et al., Telehealth, wearable sensors, and the internet: will they improve stroke outcomes through increased intensity of therapy, motiva-

tion, and adherence to rehabilitation programs? J. Neurol. Phys. Ther. 41 (2017) [Online]. Available https://journals.lww.com/jnpt/Fulltext/2017/07001/

Telehealth, _ Wearable _ Sensors, _ and _ the _ Internet _ .6.aspx . 106] A. Burns , H. Adeli , Wearable technology for patients with brain and spinal

cord injuries, Rev. Neurosci. 28 (8) (2017) 913–920 .

107] S. González, J. Sedano, J.R. Villar, E. Corchado, Á. Herrero, B. Baruque, Features and models for human activity recognition, Neurocomputing 167 (2015) 52–

60, doi: 10.1016/j.neucom.2015.01.082 . 108] N. Pannurat, S. Thiemjarus, E. Nantajeewarawat, A hybrid temporal reasoning

framework for fall monitoring, IEEE Sens. J. 17 (6) (2017) 1749–1759, doi: 10. 1109/JSEN.2017.2649542 .

109] T.R. Mauldin , M.E. Canby , V. Metsis , A.H. Ngu , C.C. Rivera , SmartFall: a smart-

watch-based fall detection system using deep learning, Sensors 18 (10) (2018) 3363 .

[110] Y. Choi , Y.-.M. Jeon , L. Wang , K. Kim , A biological signal-based stress moni- toring framework for children using wearable devices, Sensors 17 (9) (2017)

1936 .

D. Nahavandi, R. Alizadehsani, A. Khosravi et al. Computer Methods and Programs in Biomedicine 213 (2022) 106541

[

[

[ [

[

[

[

[

[

[

[

[

[

[

[

[

[

[

[

[

[

[

[111] C. Setz, B. Arnrich, J. Schumm, R.L. Marca, G. Tröster, U. Ehlert, Discriminat- ing stress from cognitive load using a wearable EDA device, IEEE Trans. Inf.

Technol. Biomed. 14 (2) (2010) 410–417, doi: 10.1109/TITB.2009.2036164 . [112] G. Valenza, L. Citi, C. Gentili, A. Lanatá, E.P. Scilingo, R. Barbieri, Characteriza-

tion of depressive states in bipolar patients using wearable textile technology and instantaneous heart rate variability assessment, IEEE J. Biomed. Health

Inform. 19 (1) (2015) 263–274, doi: 10.1109/JBHI.2014.2307584 . [113] T. Roh , S. Hong , H.-.J. Yoo , Wearable depression monitoring system with

heart-rate variability, in: 2014 36th Annual International Conference of the

IEEE Engineering in Medicine and Biology Society, IEEE, 2014, pp. 562–565 . [114] J. Daniels , et al. , Feasibility testing of a wearable behavioral aid for social

learning in children with autism, Appl. Clin. Inform. 9 (01) (2018) 129–140 . [115] N.M. Rad, et al., Deep learning for automatic stereotypical motor movement

detection using wearable sensors in autism spectrum disorders, Signal Pro- cess. 144 (2018) 180–191, doi: 10.1016/j.sigpro.2017.10.011 .

[116] X.T.R. Kong, H. Luo, G.Q. Huang, X. Yang, Industrial wearable system: the

human-centric empowering technology in Industry 4.0, J. Intell. Manuf. 30 (8) (2019) 2853–2869, doi: 10.1007/s10845- 018- 1416- 9 .

[117] M. McClellan , Applying Manufacturing Execution Systems, CRC Press, 1997 . [118] F. Chen , et al. , WristCam: a wearable sensor for hand trajectory gesture recog-

nition and intelligent human–robot interaction, IEEE Sens. J. 19 (19) (2018) 8441–8451 .

[119] H. Bay , A. Ess , T. Tuytelaars , L. Van Gool , Speeded-up robust features (SURF),

Comput. Vis. Image Underst. 110 (3) (2008) 346–359 . 120] M. Müller, Dynamic time warping, Information Retrieval for Music and Mo-

tion (Springer journal) 3 (2007) 69–84, doi: 10.1007/978- 3- 540- 74048- 3 _ 4 . [121] C.A . Cifuentes , A . Frizera , R. Carelli , T. Bastos , Human–robot interaction based

on wearable IMU sensor and laser range finder, Rob. Auton. Syst. 62 (10) (2014) 1425–1439 .

122] B. Fang , X. Wei , F. Sun , H. Huang , Y. Yu , H. Liu , Skill learning for hu-

man-robot interaction using wearable device, Tsinghua Sci. Technol. 24 (6) (2019) 654–662 .

123] " https://www.ros.org/ ," 2021. 124] S. Schaal , Dynamic movement primitives-a framework for motor control in

humans and humanoid robotics, in: Adaptive Motion of Animals and Ma- chines, Springer, 2006, pp. 261–280 .

125] A.J. Ijspeert , J. Nakanishi , H. Hoffmann , P. Pastor , S. Schaal , Dynamical move-

ment primitives: learning attractor models for motor behaviors, Neural Com- put. 25 (2) (2013) 328–373 .

126] A.J. Ijspeert , J. Nakanishi , S. Schaal , Movement imitation with nonlinear dy- namical systems in humanoid robots, in: Proceedings 2002 IEEE International

Conference on Robotics and Automation (Cat. No. 02CH37292), 2, IEEE, 2002, pp. 1398–1403 .

127] K. Ghonasgi , S.N. Yousaf , P. Esmatloo , A.D. Deshpande , A modular design for

distributed measurement of human–robot interaction forces in wearable de- vices, Sensors 21 (4) (2021) 1445 .

128] T. Lenzi , et al. , Measuring human–robot interaction on wearable robots: a dis- tributed approach, Mechatronics 21 (6) (2011) 1123–1131 .

19

129] D. Pal, A. Tassanaviboon, C. Arpnikanondt, B. Papasratorn, Quality of experi- ence of smart-wearables: from fitness-bands to smartwatches, IEEE Consum.

Electron. Mag. 9 (1) (2020) 49–53, doi: 10.1109/MCE.2019.2941462 . 130] D. Ravì, C. Wong, B. Lo, G. Yang, A deep learning approach to on-node sensor

data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inform. 21 (1) (2017) 56–64, doi: 10.1109/JBHI.2016.2633287 .

[131] A. Harris, H. True, Z. Hu, J. Cho, N. Fell, M. Sartipi, Fall recognition using wearable technologies and machine learning algorithms, in: 2016 IEEE In-

ternational Conference on Big Data (Big Data) , 5-8 Dec, 2016, pp. 3974–3976,

doi: 10.1109/BigData.2016.7841080 . 2016 . 132] J. Ker, L. Wang, J. Rao, T. Lim, Deep learning applications in medical image

analysis, IEEE Access 6 (2018) 9375–9389, doi: 10.1109/ACCESS.2017.2788044 . 133] O.D. Lara, M.A. Labrador, A survey on human activity recognition using wear-

able sensors, IEEE Commun. Surv. Tutor. 15 (3) (2013) 1192–1209, doi: 10.1109/ SURV.2012.110112.00192 .

134] R. Wright , L. Keith , Wearable technology: if the tech fits, wear it, J. Electron.

Res. Med. Lib. 11 (4) (2014) 204–216 . 135] W. Feng, Z. Yan, H. Zhang, K. Zeng, Y. Xiao, Y.T. Hou, A survey on security, pri-

vacy, and trust in mobile crowdsourcing, IEEE Internet Things J. 5 (4) (2018) 2971–2992, doi: 10.1109/JIOT.2017.2765699 .

136] P. Datta, A.S. Namin, M. Chatterjee, A survey of privacy concerns in wearable devices, in: 2018 IEEE International Conference on Big Data (Big Data), 2018,

pp. 4549–4553, doi: 10.1109/BigData.2018.8622110 . 10-13 Dec. 2018 .

[137] S. Jhajharia , S. Pal , S. Verma , Wearable computing and its application, Int. J. Comput. Sci. Inf. Technol. 5 (4) (2014) 5700–5704 .

138] “http://pop.h- cdn.co/assets/cm/15/13/5512f7e752a4e _ - _ Wearables- and- the- Science- of- Human- Behavior- Change- EP4.pdf ,” Accessed

July 12, 2021. 139] S. Kekade , et al. , The usefulness and actual use of wearable devices among the

elderly population, Comput. Methods Programs Biomed. 153 (2018) 137–159 .

140] J.H.M. Bergmann, A.H. McGregor, Body-worn sensor design: what do patients and clinicians want? Ann. Biomed. Eng. 39 (9) (2011) 2299–2312, doi: 10.1007/

s10439- 011- 0339- 9 . [141] E.J. Corwin, D.P. Jones, A.L. Dunlop, Symptom science research in the era of

big data: leveraging interdisciplinary resources and partners to make it hap- pen, J. Nurs. Scholarsh. 51 (1) (2019) 4–8, doi: 10.1111/jnu.12446 .

142] M. Hassanalieragh, et al., Health monitoring and management using internet-

of-things (IoT) sensing with cloud-based processing: opportunities and chal- lenges, in: 2015 IEEE International Conference on Services Computing, 2015,

pp. 285–292, doi: 10.1109/SCC.2015.47 . 27 June-2 July 2015 . 143] Z. Lv, J. Chirivella, P. Gagliardo, Bigdata oriented multimedia mobile health

applications, J. Med. Syst. 40 (5) (2016) 120, doi: 10.1007/s10916- 016- 0475- 8 . 144] Building the hospital without walls - a CSIRO home telecare initiative,

Telemed. J. 6 (2) (20 0 0) 275–281, doi: 10.1089/107830200415225 .

145] I. Kiral-Kornek, et al., Epileptic seizure prediction using big data and deep learning: toward a mobile system, EBioMedicine 27 (2018) 103–111, doi: 10.

1016/j.ebiom.2017.11.032 .

  • Application of artificial intelligence in wearable devices: Opportunities and challenges
    • 1Introduction
    • 2Paper collection strategy
    • 3Brief review of wearables
    • 4Denoising methods used in wearables
    • 5Artificial intelligence methods
      • 5.1Feature extraction and engineering
      • 5.2Supervised learning
      • 5.3Deep learning
      • 5.4Unsupervised learning
      • 5.5Semi-supervised learning
      • 5.6Reinforcement learning
    • 6Application of machine learning algorithms in wearables
      • 6.1Application of supervised learning methods in wearables
      • 6.2Application of unsupervised learning methods in wearables
      • 6.3Application of semi-supervised learning methods in wearables
      • 6.4Application of reinforcement learning (RL) methods in wearables
    • 7Wearable applications
      • 7.1Sports
      • 7.2Healthcare
        • 7.2.1Fitness
        • 7.2.2Health status monitoring
        • 7.2.3Helping with movement disorders
        • 7.2.4Mental health
        • 7.2.5Autism
        • 7.2.6Healthcare wearables shortcomings
      • 7.3Industrial and manufacturing
        • 7.3.1Examples of real-world industrial wearables
        • 7.3.2Critical design factors for industrial wearables
      • 7.4Human-robot interaction
    • 8Wearable technologies challenges
      • 8.1Data collection
      • 8.2Data transmission
      • 8.3Security and privacy
      • 8.4Localization quality
      • 8.5User adoption aspects
      • 8.6Resource constraints
      • 8.7Interoperability
    • 9Discussion
    • 10Conclusion
    • Funding
    • Declaration of Competing Interest
    • References