A Personalized Beat-to-Beat Heart Rate Detection System ...

10
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019 1593 A Personalized Beat-to-Beat Heart Rate Detection System From Ballistocardiogram for Smart Home Applications Qingsong Xie , Student Member, IEEE, Min Wang, Yang Zhao, Student Member, IEEE, Ziran He, Yongfu Li, Senior Member, IEEE, Guoxing Wang , Senior Member, IEEE, and Yong Lian, Fellow, IEEE Abstract—This paper presents a ballistocardiogram (BCG) based beat-to-beat heart rate (HR) measurement system for health- care applications in smart home. The BCG signal is picked up by two parallel connected piezoelectric elements, and processed by a robust HR detection algorithm. To deal with the diversity in BCG signal, a personalized heartbeat template is extracted to handle the diversity in BCG signal. The Pearson correlation coefficient is used to correlate between personalized template and the BCG signal. Heartbeats are detected by using the Hilbert Transform. The system is verified on 32 subjects with simultaneously recorded BCG and ECG signals. With the reference to ECG signal, we have achieved mean absolute relative error of the beat-to-beat intervals of 4.56%, and average absolute error±standard deviation of abso- lute error for HR estimation in a 30-seconds window of 0.59±0.56 beats per minute. Meanwhile, 99.67% of the beat-to-beat intervals are detected on average. Index Terms—Ballistocardiogram, heart rate, hilbert Transform, piezoelectric element. I. INTRODUCTION B ALLISTOCARDIOGRAM (BCG) records the move- ments caused by the forces associated with the contraction of the heart and the acceleration/deceleration of blood as it is ejected and moved in the large vessels [1]. It has been a popular alternative to conventional electrocardiogram (ECG) signal in many applications, e.g., heart rate (HR) detection [2], [3], heart rate variability (HRV) analysis [4], [5], and blood pressure esti- mation [6]. Compared to the ECG measurement, which requires at least two electrodes attached to skin [7] and it may cause skin irritation for long time use, the BCG can be measured without electrode contacts, e.g., the BCG sensor can be embedded into beds [8], [9], wheel chairs [10]–[12], or weighing scales [13]– [15]. Consequently, the key benefits of using the BCG signal Manuscript received July 15, 2019; revised September 8, 2019; accepted October 29, 2019. Date of publication December 4, 2019; date of current version December 31, 2019. This work was supported by the National Natural Science Foundation of China under Grant 61874171. This paper was recommended by Associate Editor Y. Zheng. (Corresponding author: Guoxing Wang.) The authors are with the Department of Micro-Nano Electronics and the MoE Key Lab of Artificial Intelligence, Shanghai Jiao Tong University, Shang- hai 200240, China (e-mail: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; guoxing @sjtu.edu.cn; [email protected]). Color versions of one or more of the figures in this article are available online at http://ieeexplore.ieee.org. Digital Object Identifier 10.1109/TBCAS.2019.2957571 Fig. 1. An example of typical BCG signal containing H, I, J, K, L, M, and N characteristic points. for HR detection come from its convenience, low cost, and ease of operation. BCG-based systems offer comfortable and convenient user experience in natural home environment. There are several BCG-based systems for heart rate detection [16]–[19]. Fiber bragg grating (FBG) sensor is designed to ac- quire BCG for heart rate detection [16]. The performance of this system can be further improved since its root mean square error is up to 6 beats per minutes (BPM). An unobtrusive system base on BCG signal is proposed for heart rate detection [17]. The per- formance varies significantly by different subjects. To improve the accuracy of heart rate detection, multiple-channel signals based systems are presented such as eight-channel BCGs [18] and BCG combined with impedance plethysmogram signal [19]. These systems lose the simplicity of using the single BCG. The detection of beat-to-beat heart rate from BCG is a very challenging task. As shown in Fig. 1, the BCG contains seven fiducial points (H, I, J, K, L, M, and N). Each heartbeat (HB) cycle in BCG consists of multiple peaks instead of a single pronounced peak such as the R-peak in ECG. Therefore, the task of detecting beat-to-beat HR in the BCG signal is much more complicated than detecting those from ECG. To tackle such challenge, several methods are proposed for HR monitoring from the BCG signal [20]–[27]. The method described in [20] locates heartbeat using a BCG template by calculating the correlation coefficient between the constructed template and the signal. This method can be further improved because the heartbeat template has to be manually selected. Clustering method without prior assumptions about heartbeat shape is reported to directly detect HB [21]. However, this method is not very practical to determine the exact HB as well as identifying missing HB. Short-time energy (SEN) method [22] 1932-4545 © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See http://www.ieee.org/publications_standards/publications/rights/index.html for more information. Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

Transcript of A Personalized Beat-to-Beat Heart Rate Detection System ...

IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019 1593

A Personalized Beat-to-Beat Heart Rate DetectionSystem From Ballistocardiogram for Smart

Home ApplicationsQingsong Xie , Student Member, IEEE, Min Wang, Yang Zhao, Student Member, IEEE, Ziran He,

Yongfu Li, Senior Member, IEEE, Guoxing Wang , Senior Member, IEEE, and Yong Lian, Fellow, IEEE

Abstract—This paper presents a ballistocardiogram (BCG)based beat-to-beat heart rate (HR) measurement system for health-care applications in smart home. The BCG signal is picked up bytwo parallel connected piezoelectric elements, and processed by arobust HR detection algorithm. To deal with the diversity in BCGsignal, a personalized heartbeat template is extracted to handlethe diversity in BCG signal. The Pearson correlation coefficientis used to correlate between personalized template and the BCGsignal. Heartbeats are detected by using the Hilbert Transform.The system is verified on 32 subjects with simultaneously recordedBCG and ECG signals. With the reference to ECG signal, we haveachieved mean absolute relative error of the beat-to-beat intervalsof 4.56%, and average absolute error±standard deviation of abso-lute error for HR estimation in a 30-seconds window of 0.59±0.56beats per minute. Meanwhile, 99.67% of the beat-to-beat intervalsare detected on average.

Index Terms—Ballistocardiogram, heart rate, hilbertTransform, piezoelectric element.

I. INTRODUCTION

BALLISTOCARDIOGRAM (BCG) records the move-ments caused by the forces associated with the contraction

of the heart and the acceleration/deceleration of blood as it isejected and moved in the large vessels [1]. It has been a popularalternative to conventional electrocardiogram (ECG) signal inmany applications, e.g., heart rate (HR) detection [2], [3], heartrate variability (HRV) analysis [4], [5], and blood pressure esti-mation [6]. Compared to the ECG measurement, which requiresat least two electrodes attached to skin [7] and it may cause skinirritation for long time use, the BCG can be measured withoutelectrode contacts, e.g., the BCG sensor can be embedded intobeds [8], [9], wheel chairs [10]–[12], or weighing scales [13]–[15]. Consequently, the key benefits of using the BCG signal

Manuscript received July 15, 2019; revised September 8, 2019; acceptedOctober 29, 2019. Date of publication December 4, 2019; date of current versionDecember 31, 2019. This work was supported by the National Natural ScienceFoundation of China under Grant 61874171. This paper was recommended byAssociate Editor Y. Zheng. (Corresponding author: Guoxing Wang.)

The authors are with the Department of Micro-Nano Electronics and theMoE Key Lab of Artificial Intelligence, Shanghai Jiao Tong University, Shang-hai 200240, China (e-mail: [email protected]; [email protected];[email protected]; [email protected]; [email protected]; [email protected]; [email protected]).

Color versions of one or more of the figures in this article are available onlineat http://ieeexplore.ieee.org.

Digital Object Identifier 10.1109/TBCAS.2019.2957571

Fig. 1. An example of typical BCG signal containing H, I, J, K, L, M, and Ncharacteristic points.

for HR detection come from its convenience, low cost, andease of operation. BCG-based systems offer comfortable andconvenient user experience in natural home environment.

There are several BCG-based systems for heart rate detection[16]–[19]. Fiber bragg grating (FBG) sensor is designed to ac-quire BCG for heart rate detection [16]. The performance of thissystem can be further improved since its root mean square erroris up to 6 beats per minutes (BPM). An unobtrusive system baseon BCG signal is proposed for heart rate detection [17]. The per-formance varies significantly by different subjects. To improvethe accuracy of heart rate detection, multiple-channel signalsbased systems are presented such as eight-channel BCGs [18]and BCG combined with impedance plethysmogram signal [19].These systems lose the simplicity of using the single BCG.

The detection of beat-to-beat heart rate from BCG is a verychallenging task. As shown in Fig. 1, the BCG contains sevenfiducial points (H, I, J, K, L, M, and N). Each heartbeat (HB)cycle in BCG consists of multiple peaks instead of a singlepronounced peak such as the R-peak in ECG. Therefore, thetask of detecting beat-to-beat HR in the BCG signal is muchmore complicated than detecting those from ECG.

To tackle such challenge, several methods are proposed forHR monitoring from the BCG signal [20]–[27]. The methoddescribed in [20] locates heartbeat using a BCG template bycalculating the correlation coefficient between the constructedtemplate and the signal. This method can be further improvedbecause the heartbeat template has to be manually selected.Clustering method without prior assumptions about heartbeatshape is reported to directly detect HB [21]. However, thismethod is not very practical to determine the exact HB as well asidentifying missing HB. Short-time energy (SEN) method [22]

1932-4545 © 2019 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

1594 IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019

Fig. 2. Overview of the proposed beat-to-beat heart rate monitoring system.

uses energy function to extract the envelope of the BCG signal,from which the HBs are identified as the local maxima. Thereare rooms for improvement in dealing with irregular waveform,which may be caused by the changes in heart rate, baselinewandering. Smoothed length transform (SLT) [23] involves thecombination of multiple windows to determine the search rangeof HB while it requires the prior knowledge to experimentallyadjust many thresholds.

Two methods based on HB templates are reported re-cently [24], [25]. The first method uses clustering [24] to extractHB template and determines the HB based on the best fit, wherethe performance depends on multiple empirical parameters. Thesecond method uses extended function of multiple instancesalgorithm to learn individual HB template, from which theHBs are confirmed through comparing confidence with presetthresholds [25]. It requires human intervention for learning theHB pattern. Frequency domain analysis techniques, such asHilbert Transform (HT) [26], the combination of HT and phasevocoder (HTPV) [27], are utilized in BCG signal processingaiming for better performance. However, these methods are notable to provide beat-to-beat HR measurements, which are crucialfor HRV analysis.

In this paper, we present an automatic beat-to-beat heartrate detection system using BCG signal. The BCG signals areobtained from a piezoelectric based sensor. A clustering methodis utilized to automatically extract the personalized heartbeattemplate from the given BCG signal. The correlation coefficientis adopted to describe linear correlation between the extractedtemplate and the BCG signal. Heartbeats are detected by HilbertTransform function.

The rest of this paper is organized as follows. Section II de-scribes the proposed system architecture. Section III presents theproposed sensor. Section IV details the proposed novel detectionalgorithm. Section V gives experimental results. Conclusion isfurther made in Section VI.

II. PROPOSED SYSTEM ARCHITECTURE

An overview of the proposed system architecture for beat-to-beat heart rate detection is shown in Fig. 2. It primarily containstwo parts: BCG sensor for BCG acquisition and algorithm forbeat-to-beat HR detection. For the BCG sensor, a piezoelectricbased BCG sensor is designed to convert vibrations of the bodyinto electrical signal. The signal conditioning circuit converts

Fig. 3. The piezoelectric sensor used for on-chair BCG detection.

charge from piezoelectric element to a voltage signal, amplifiesit, and removes the noises. The voltage signal is digitized viaa 12-bit analog-to-digital converter (ADC). The digital signalis sent to computer (PC) via UART, which is controlled byMicrocontroller Unit (MCU).

A robust algorithm is designed to detect beat-to-beat heartrate, which primarily consists of preprocessing, heartbeat tem-plate extraction, heartbeat detection, and template adjustment, asshown in the right of Fig. 2. Out-of-band frequency is eliminatedin preprocessing stage. In heartbeat template extraction stage,BCG heartbeat template is extracted using a short duration ofBCG signal. Subsequent heartbeats are then detected in heartbeatdetection stage. In template adjustment stage, heartbeat templateis updated to adjust to the latest heartbeat pattern based on newlydetected heartbeats.

III. PROPOSED BCG SENSOR

The proposed BCG sensor hardware is shown in Fig. 3, whichcontains a sensor and a signal conditioning circuit board. In thefollowing sections, we will present the hardware details.

A. Piezoelectric Element

Piezoelectric elements generate electrical charge signal re-sponding to the vertical acceleration of body mass due to positive

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

XIE et al.: PERSONALIZED BEAT-TO-BEAT HEART RATE DETECTION SYSTEM FROM BCG FOR SMART HOME APPLICATIONS 1595

Fig. 4. The schematic of the interface circuit.

piezoelectric effect [28]. The amount of charge output (Q) bythe piezoelectric element is proportional to its force F , definedas:

Q = dF = dma, (1)

where d is piezoelectric constant, about 500 pC/N, m and a aretotal mass and acceleration of the object, respectively.

However, this piezoelectric element has small sensing areawhereas the contact area between the human body and the seatsurface is large. Therefore, it is not suitable for direct monitoringof BCG. To address such problem, the piezoelectric element issandwiched between two steel plates in order to increase thesensitivity. The steel plates are fixed by eight screws. To ensuresteel plates smoothly move up and down with the vibration ofthe human body such that vibration signal can be transmitted topiezoelectric element, each screw is covered with a spring. Thisdesign has two advantages: One is that the pressure generated bythe vibration of the human body is uniformly dispersed by thesteel plate, thereby preventing excessive bending of the ceramicpiece inside the sensor due to uneven distribution of the pressure.The other advantage is the pressure is evenly distributed on theforce receiving surface of the sensor. It enlarges sensing arearesulting in better sensitivity.

To detect left-to-right (or right-to-left) body movement, twopiezoelectric elements are symmetrically placed at each sideof the sensor. Moreover, four auxiliary rubber mats are placedat four corners of the steel plates to support the piezoelectricelement. To further enhance the performance, each pizeoelectricelement is assisted by two rubber mats to reduce the impact fromfront-to-back swing.

B. Conditioning Circuit

The electrical charge generated by the piezoelectric elementrequires an interface circuit having high-input impedance andlow input bias. For this purpose, a 3-stage signal conditioningcircuit is designed to process the output of the two parallelconnected piezoelectric elements, as shown in Fig. 4. Thefirst-stage charge amplifier converts electrical charge generatedby the sensor to a voltage signal. Meanwhile, capacitor Ca isused to balance the charge injected into negative input throughcharging itself. It means that only dynamic charge signal willdevelop voltage signal through the amplifier. Therefore, theconstant force like gravity has almost no impact on the voltageoutput. Besides, the large motion artifacts or sudden impactforce could result in the saturation of amplifier, the gain of the

first-stage is set to 1 by choosing resistor Rf equal to Ri. Thesecond-stage circuit is a RC bandpass filter. The low and highcutoff frequencies (fL, fH ) are determined by:

fL =1

2πR1C1(2)

fH =

√√2− 1

2πR2C2, (3)

Since the useful BCG signal is contained within 0.1-10 Hz, wecan get R and C values as follows: R1=74 KΩ, C1=22 μF,R2=100 KΩ, and C2=100 nF. With the bandpass filter, thenoises, such as power line interference and muscle contraction,are reduced. Since motion artifacts with the same frequency havehigher amplitude than BCG, the third stage circuit is designed

with a gain ofCi

Cf= 10 to avoid saturation.

IV. BEAT-TO-BEAT HEART RATE DETECTION ALGORITHM

A. Preprocessing

In real applications, BCG signal is contaminated by variouskinds of noises, including respiration, power line interferenceand muscle contraction. A Butterworth bandpass filter is thusemployed with cutoff frequencies of 1 and 10 Hz to eliminatehigh-frequency noises and typical respiration signal which isbelow 0.5 Hz.

B. Heartbeat Template Extraction

The amplitude of fiducial points changes from beat to beat.Thus, it is difficult to identify a fixed peak even the most promi-nent J-peak from the BCG. One possible solution to address thisproblem is to extract a personalized BCG heartbeat templateand then detect the peak position as the heartbeat that bestmatches the template during each cycle. Beat-to-beat heart rateis calculated from two consecutive heartbeats.

In order to extract a personalized BCG heartbeat template, thefirst 30-seconds (sec) training BCG is analyzed to extract thetemplate of the signal. An adaptive threshold (ADT) method,which is used for detecting the peaks of photoplethsmographysignal in [29], is adopted for finding the potential J-peaks inthe training BCG signal. In this manner, the virtual threshold iscontrolled by original BCG amplitude, which is decreased withthe fixed slope parameter when it is larger than BCG amplitude.When it meets the signal, the threshold is accompanied withBCG amplitude until it reaches to maximum point. ADT helpsto identify potential J-peaks, but it may detect false targetsdue to multiple peaks in each cycle. Moreover, it is hard todetect the true heartbeats if the BCG amplitude changes abruptlyowing to baseline wandering, which is caused by respiration,thermoregulation, and sympathetic nervous system activities.

Therefore, we need to select true heartbeats to form heartbeatpattern. According to the detected heartbeat positions, BCGsignal is segmented into windows of the length of typical pulseinterval of human body (1 second). Each potential J-peak is cen-tralized to the middle of the window. It is reasonable to assumethat the abnormal BCG segments center on false J-peaks display

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

1596 IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019

more morphological randomness. Thus, their patterns differfrom normal BCG segments. As a result, if a group of segmentsdescribe a similar signal pattern, heartbeats are more likely to beclustered together owning to a better inter-beat consistency whilethe abnormal BCG segments tend to be partitioned into multipleclusters due to much more diverse morphologies. Hence, atypical clustering algorithm K-medoids [30] is used to learn apersonalized heartbeat template from raw BCG with k-means++algorithm [31] choosing initial cluster centroids. In order toreduce computation load, the Euclidean distance is selected toquantify the dissimilarity between two segments. The number ofclusters is selected as 6 for generating the template from trainingdata. This is because the user is asked to keep still at the first30 sec to minimize motion artifacts, and hence training datacontain at least 6 heartbeats.

The cluster that contains most objects is selected as the can-didate cluster for the heartbeat template. The final personalizedheartbeat template is then obtained by point-wise average of allthe BCG segments in candidate cluster. Fig. 5 illustrates theprocess of the heartbeat template learning process. Fig. 5(a)shows a 30-sec training BCG signal. J-peaks are roughly de-tected using ADT method, as shown in Fig. 5(b). All the BCGsegments are presented in Fig. 5(c). The densest cluster is shownin Fig. 5(d), in which abnormal BCG segments are eliminated.Fig. 5(e) gives the heartbeat template which is obtained by takingpoint-wise mean of the segments in the densest cluster. It can beseen from Fig. 5 that good quality of the heartbeat template isacquired.

C. Heartbeat Detection

With the introduction of personalized heartbeat template, weare able to identify the heartbeat by finding the best match inevery heartbeat cycle. This is done by computing the Pearsoncorrelation coefficient (PCC) (4), which describes the similaritybetween the heartbeat template and incoming BCG signal,

PCC =

∑Nk=1(X(k)−X)(Y (k)− Y )

√∑Nk=1(X(k)−X)2

∑Nk=1(Y (k)− Y )2

, (4)

where X , Y are two random variables, denoting BCG templateand BCG segment. X , Y are average values of X and Y ,respectively. N is the total sample number of the template.

If the incoming BCG segment has high similarity with thetemplate, it will reflect as a high value of PCC. Eminent peaksin this PCC envelope appear at the locations where the patternis described by the template. Therefore, these peaks can be con-sidered as heartbeats. Fig. 6 gives a representative plot of PCCsignal. Raw BCG signal is shown in Fig. 6(a) while heartbeattemplate is presented in Fig. 6(b). PCC signal measuring thesimilarity between the heartbeat template and BCG signal isgiven in Fig. 6(c), which shows that the large peaks in PCC signalappear at the positions that match template best during everycycle of BCG. As a result, detecting these peaks as heartbeatsbecomes easier.

After obtaining PCC signal, PCC is passed through a non-linear transformation to obtain positive peaks. The main target

Fig. 5. An example of heartbeat template learning. (a) 30-sec BCG segment.(b) Potential J-peaks identified by ADT. (c) All 1-sec segments overlaid.(d) BCG segments of the densest cluster. (e) Heartbeat template extracted bytaking the point-wise average of the segments in the densest cluster.

is to enhance the heartbeat amplitude. Inspired by [26], [27],BCG data is modelled as pulse envelope modulated by sinusoidalwaveform. Therefore, PCC signal has similar component sinceit estimates similarity between the template and incoming BCGdata, which is expressed by (5).

PCC(m) = a(m)cos(2πf0 m), (5)

where a(m) represents the pulse envelope of PCC signal and f0is modulation frequency.

To extract envelope a(m) of PCC signal from its modulatedsignal, we propose to use Hilbert Transform (HT). When thefrequency of a(m) is narrow compared to modulation frequencyf0, the output of HT (HTPCC) is (6).

HTPCC(m) = HT(PCC) = a(m)sin(2πf0 m) (6)

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

XIE et al.: PERSONALIZED BEAT-TO-BEAT HEART RATE DETECTION SYSTEM FROM BCG FOR SMART HOME APPLICATIONS 1597

Fig. 6. An example of PCC signal. (a) BCG signal. (b) Heartbeat template.(c) PCC signal.

Therefore, magnitude square (a(m)2) of the envelope is attainedwith:

a(m)2 = PCC(m)2 + HTPCC(m)2. (7)

Then, the filtering is applied to obtain sharp peaks aroundheartbeat regions and smooth out the spikes and noise bursts.It is implemented by a rectangular impulse response, h(m). Thefiltering operation is performed in both the forward and reversedirections to avoid phase distortion. Generally, the rectangularimpulse should have the same duration as IJK complex orpossibly wider duration. This study uses 0.32-second durationof h(m) which covers IJK complex. Fig. 7 illustrates the per-formance of HT to extract envelope of PCC signal. It clearlyshows that major local maxima in smooth envelope indicateapproximate locations of the heartbeats.

Heartbeat locations in PCC signal may not coincide withsmooth envelope peaks strictly. To eliminate this difference, atrue peak detector is incorporated to find the correct time instantsof the heartbeats. The heartbeats are identified by searchingthe largest amplitude in PCC within ±200 ms of the identifiedlocations of the smooth envelope peaks in the previous step. Anexemplary plot of the proposed algorithm is shown in Fig. 8.Fig. 8(b) demonstrates PCC signal has a prominent peak duringevery cycle, which is more explicit than J-peak. Fig. 8(d) illus-trates that the peaks in smooth envelope lie in the neighbourhoodof PCC peaks. Fig. 8(e) describes that heartbeats are detectedby searching the maxima in PCC signal in the neighbourhood of

Fig. 7. The performance of Hilbert Transform. (a) PCC signal. (b) Theenvelope of PCC signal which is extracted by Hilbert Transform. (c) Smoothenvelope.

smooth envelope peaks. R-peaks in ECG offer the reference forheartbeat detection. It can be clearly seen that the beat-to-beatintervals (BBI) in BCG are almost identical to R-R intervals(RRI) in ECG even without clear J-peaks. The ADT method,shown in Fig. 8(f), misses many heartbeats.

D. Template Adjustment and Refinement

Due to changes in average heart rate, baseline drift, and thecomplex dynamics of heart activity, the shape of the heartbeattemplate varies over time. To address this problem and update thechanges in template, the template is re-estimated every 100 newheartbeats detected in previous stages. For every heartbeat, a newsegment is extracted with the same length as previous templatecentered at the heartbeat. An updated template is obtained bytaking clustering of all the 100 segment data as used before.

The beat-to-beat intervals detected by the above method areprobably incorrect due to complex variations of heart activity orpoor quality. These erroneous intervals are removed if they aresmaller than 0.5 times of median value of the previous 5 detectedbeat-to-beat intervals as heart rate is a slowly time varying signal.This limit has been chosen as a suitable tradeoff to detect as manybeat-to-beat intervals as possible and reduce as many erroneousbeat-to-beat intervals as possible.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

1598 IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019

Fig. 8. Proposed heartbeat detector. (a) Raw BCG signal. (b) PCC signal.(c) HT envelope. (d) Smooth envelope. (e) Detected heartbeat by our method.(f) Detected heartbeat by ADT.

Fig. 9. Experiment setup, where BCG and ECG were simultaneously recorded.

V. EXPERIMENT RESULTS

A. Dataset

In order to evaluate the performance of the proposed system,we recruited 32 subjects for data recording with age in 24±2.6years old and weight in 59±10.6 kilogram (Kg). An ECG record-ing using electrodes attached on the chest was simultaneouslyrecorded for reference purpose, as shown in Fig. 9. During dataacquisition phase, the subjects sit on the proposed sensor, whenthey keep still as much as possible. In order to collect abruptchanges of signal due to complex dynamic variations of heartactivity and obtain high values of heart rate samples. 20 subjectswere required to run 10 minutes at speed of 8 kilometers/houron treadmill prior to data recording. After that, the subjects wererequested instantly to sit on the sensor for data recording. Datawere sampled at frequency of 250 Hz and sent to PC via UART.The experiment lasted at least 12 minutes (min) for every subject.

B. Metrics

For measuring the accuracy of the proposed algorithm, theR-peak in synchronized ECG signal serves as a reference, whichis detected by [32] and manually corrected. The performance ofthe method is evaluated with four quantitative metrics:

MAE (mean absolute error) and SDAE (standard deviationof absolute error): MAE and SDAE are used to evaluate theaccuracy for heart rate estimation, which are defined as follows:

MAE =1

N

N∑

i=1

|HRBCG(i)− HRECG(i)|, (8)

SDAE =

√1

N

∑N

i=1(|HRBCG(i)− HRECG(i)| − MAE)2,

(9)

where HRBCG is estimated HR from BCG, HRECG is groundtruth HR from ECG, and N is total number of samples.

Coverage: The ratio between the number of detected beat-to-beat intervals from BCG and the number of detected R-Rintervals from ECG. Coverage indicates the ratio of beat-to-beatintervals of BCG that are detected.

MARE (Mean absolute relative error): MARE is to as-sess the performance of beat-to-beat heart rate estimation,

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

XIE et al.: PERSONALIZED BEAT-TO-BEAT HEART RATE DETECTION SYSTEM FROM BCG FOR SMART HOME APPLICATIONS 1599

TABLE IMAE±SDAE (BPM) FOR HEART RATE ESTIMATION USING DIFFERENT METHODS

defined in (10),

MARE =1

N

N∑

i=1

|BBI(i)− RRI(i)|RRI(i)

∗ 100%, (10)

where N is the number of BBI.

C. Results

MAE and SDAE for heart rate estimation using the proposedmethod and other recent methods in [22], [23], [26], [27] aresummarized in Table I. Heart rate is computed over 30 secondsusing a sliding window with 15 seconds of overlap as [27]. Theproposed method achieves the best results, where MAE andSDAE are 0.59 BPM, 0.56 BPM, respectively. SEN [22] detectsthe maxima of the envelope extracted by energy function asheartbeats. SLT [23] applies multiple windows to determine asearch range to detect heartbeats from BCG. Both methods facedifficulties in identifying heartbeats if the BCG signal qualityis poor, which is usually reflected by missing or over-detectedheartbeats. HT [26] and HTPV [27] utilize Hilbert Transformto extract BCG envelope to obtain the significant frequencycorresponding to HR. However, the significant frequency woulddeviate from true HR for poor quality signals. With the intro-duction of personalized template, we are able to better identifyheartbeats even though the BCG signal quality is low, e.g., forrecordings 24 and 32.

Fig. 10 shows the correlation (a), and Bland-Altman plot(b) between estimated HR from BCG and true HR from ECG.Fig. 10(a) shows our system achieves Pearson correlation coef-ficient of 0.996. Fig. 10(b) indicates the majority of erroneous

Fig. 10. (a) Heart rate estimates from BCG versus true heart rate from ECG.(b) Bland-Altman plot of the difference between estimated HR and true HR.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

1600 IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019

TABLE IITHE PERFORMANCE OF BEAT-TO-BEAT HEART RATE ESTIMATION

Fig. 11. The signals with different quality. The heartbeat shapes are muchclear in the top signal while the signal in the bottom shows irregular pattern.

estimates lie in the agreement area, which is denoted by mean er-ror ± 1.96 times of standard deviation of error (ME±1.96STD).

A distinct advantage of the proposed method is its ability tooffer beat-to-beat HR. Table II shows the coverage, and MAREfor each subject, respectively. The results show that the proposedalgorithm is able to achieve beat-to-beat heart rate detection fromthe BCG signals of all subjects. On average, Coverage of 99.67%and MARE of 4.56% are achieved.

The testing subjects have different health condition, heartactivity, and respiration rate, which lead to significant variationsof signal quality. Therefore, the performance of our systemvaries among different subjects, especially MARE and Cov-erage. Generally, the subjects with discernible heartbeat shaperesult in better performance. In the best case of our study, 100%beat-to-beat intervals are detected, and 1.32% of MARE and0.14±0.44 BPM of MAE±SDAE are achieved. While in theworst case, only 97.59% beat-to-beat intervals are detected andMARE is 7.86%. The main reason is illustrated in Fig. 11, wheretypical signals from high MARE and low MARE are shown.

TABLE IIITHE PERFORMANCE OF BEAT-TO-BEAT HEART RATE ESTIMATION

It can be obviously observed that the signals with clear heartbeatpattern lead to better performance.

We have studied the effect of sex on the performance of theproposed system. The average MAE, SDAE, Coverage, andMARE are listed in Table III. It can be seen there is insignificantimpact of sex on our system.

VI. CONCLUSION

In this paper, a beat-to-beat heart rate monitoring systemwhich contains a BCG sensor with a signal conditioning circuit,and a beat-to-beat heartbeat detection algorithm has been pro-posed. The proposed system can be embedded to chair or bed forHR monitoring. Furthermore, we proposed a robust method forbeat-to-beat heart rate detection, which consists of clusteringto automatically learn personalized heartbeat template fromBCG signal for each subject, Pearson correlation coefficient andHilbert Transform for subsequent heartbeat identification. Theexperiment conducted on 32 subjects shows that the proposedsystem achieves mean MAE±SDAE of 0.56±0.59 BPM whiledetecting 99.67% of the beats from the BCG on average.

REFERENCES

[1] R. S. Gubner, M. Rodstein, and H. E. Ungerleider, “Ballistocardiogra-phy: An appraisal of technic, physiologic principles, and clinical value,”Circulation, vol. 7, no. 2, pp. 268–286, 1953.

[2] J. Jin, X. Wang, S. Li, and Y. Wu, “A novel heart rate detection algorithmin ballistocardiogram based on wavelet transform,” in Proc. 2nd Int.Workshop Knowl. Discovery Data Mining, 2009, pp. 76–79.

[3] C. Brüser, S. Winter, and S. Leonhardt, “How speech processing can helpwith beat-to-beat heart rate estimation in ballistocardiograms,” in Proc.IEEE Int. Symp. Med. Meas. Appl. Proc., 2013, pp. 12–16.

[4] J. H. Shin and K. S. Park, “HRV analysis and blood pressure monitoringon weighing scale using BCG,” in Proc. Int. Conf. IEEE Eng. Med. Biol.Soc., 2012, pp. 3789–3792.

[5] Y.-H. Noh and D.-U. Jeong, “Measure the impact of audio-visual stim-ulation on human stress level by using unconstrained BCG measure-ment system,” in Proc. Int. Conf. Comput. Convergence Technol., 2013,pp. 313–316.

[6] E. Pinheiro, O. Postolache, and P. Girão, “Pulse arrival time and ballisto-cardiogram application to blood pressure variability estimation,” in Proc.IEEE Int. Workshop Med. Meas. Appl., 2009, pp. 132–136.

[7] F. Zhang and Y. Lian, “QRS detection based on multiscale mathematicalmorphology for wearable ECG devices in body area networks,” IEEETrans. Biomed. Circuits Syst., vol. 3, no. 4, pp. 220–228, Aug. 2009.

[8] X. Zhu et al., “Real-time monitoring of respiration rhythm and pulse rateduring sleep,” IEEE Trans. Biomed. Eng., vol. 53, no. 12, pp. 2553–2563,Dec. 2006.

[9] D. C. Mack, D. C. Mack, J. T. Patrie, P. M. Suratt, R. A. Felder, andM. Alwan, “Development and preliminary validation of heart rate andbreathing rate detection using a passive, ballistocardiography-based sleepmonitoring system,” IEEE Trans. Inf. Technol. Biomed., vol. 13, no. 1,pp. 111–120, Jan. 2009.

[10] O. Postolache, P. Girão, J. Mendes, E. Pinheiro, and G. Postolache,“Physiological parameters measurement based on wheelchair embeddedsensors and advanced signal processing,” IEEE Trans. Instrum. Meas.,vol. 59, no. 10, pp. 2564–2574, Oct. 2010.

[11] E. Pinheiro, O. Postolache, and P. Girão, “Robust heart rate estimationfrom cardiovascular signals unobtrusively acquired in a wheelchair,” inProc. Int. Conf. Instrum. Meas. Technol., 2011, pp. 779–783.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

XIE et al.: PERSONALIZED BEAT-TO-BEAT HEART RATE DETECTION SYSTEM FROM BCG FOR SMART HOME APPLICATIONS 1601

[12] Q. Xie, Y. Li, G. Wang, and Y. Lian, “An unobtrusive system for heartrate monitoring based on ballistocardiogram using Hilbert transform andViterbi decoding,” IEEE J. Emerg. Sel. Topics Circuits Syst., vol. 9, pp.635–644, 2019.

[13] Y. Yao et al., “Mitigation of instrument-dependent variability in ballis-tocardiogram morphology: Case study on force plate and customizedweighing scale,” IEEE J. Biomed. Health Informat., to be published, doi:10.1109/JBHI.2019.2901635.

[14] Y. Yao et al., “Unobtrusive estimation of cardiovascular parameters withlimb ballistocardiography,” Sensors, vol. 19, 2019, Art. no. 2922.

[15] P. Yousefian et al., “Physiological association between limb ballistocardio-gram and arterial blood pressure waveforms: A mathematical model-basedanalysis,” Sci. Rep., vol. 9, 2019, Art. no. 5146.

[16] M. Krej, L. Dziuda, and F. W. Skibniewski, “A method of detectingheartbeat locations in the ballistocardiographic signal from the fiber-opticvital signs sensor,” IEEE J. Biomed. Health Informat., vol. 19, no. 4,pp. 1443–1450, Jul. 2015.

[17] J. Paalasmaa, H. Toivonen, and M. Partinen, “Adaptive heartbeat mod-eling for beat-to-beat heart rate measurement in ballistocardiograms,”IEEE J. Biomed. Health Informat., vol. 19, no. 6, pp. 1945–1952,Nov. 2015.

[18] C. Brüser, J. M. Kortelainen, S. Winter, M. Tenhunen, J. Pärkkä, andS. Leonhardt, “Improvement of force-sensor-based heart rate estimationusing multichannel data fusion,” IEEE J. Biomed. Health Informat., vol. 19,no. 1, pp. 227–235, Jan. 2015.

[19] D. Park, O. T. Inan, and L. Giovangrandi, “A combined heartbeat detectorbased on individual BCG and IPG heartbeat detectors,” in Proc. Int. Conf.IEEE Eng. Med. Biol. Soc., 2012, pp. 3428–3431.

[20] J. H. Shin, B. H. Choi, Y. G. Lim, D. U. Jeong, and K. S. Park,“Automatic ballistocardiogram (BCG) beat detection using a templatematching approach,” in Proc. Int. Conf. IEEE Eng. Med. Biol. Soc., 2008,pp. 1144–1147.

[21] L. Rosales, M. Skubic, D. Heise, M. J. Devaney, and M. Schaumburg,“Heartbeat detection from a hydraulic bed sensor using a clusteringapproach,” in Proc. Int. Conf. IEEE Eng. Med. Biol. Soc., 2012, pp. 2383–2386.

[22] K. Lydon, Y. S. Bo, L. Rosales, and M. Enayati, “Robust heartbeatdetection from in-home ballistocardiogram signals of older adults usinga bed sensor,” in Proc. Int. Conf. IEEE Eng. Med. Biol. Soc., 2015,pp. 7175–7179.

[23] E. J. Pino, J. A. P. Chávez, and P. Aqueveque, “BCG algorithm for unob-trusive heart rate monitoring,” in Proc. Healthcare Innov. Point-of-CareTechnol., 2017, pp. 180–183.

[24] C. Brüser, K. Stadlthanner, S. D. Waele, and S. Leonhardt, “Adap-tive beat-to-beat heart rate estimation in ballistocardiograms,” IEEETrans. Inf. Technol. Biomed., vol. 15, no. 5, pp. 778–785, Sep.2011.

[25] C. Jiao, P. Lyons, A. Zare, L. Rosales, and M. Skubic, “Heart beatcharacterization from ballistocardiogram signals using extended functionsof multiple instances,” in Proc. Int. Conf. IEEE Eng. Med. Biol. Soc., 2016,pp. 756–760.

[26] L. Rosales, B. Y. Su, M. Skubic, and K. C. Ho, “Heart rate monitoringusing hydraulic bed sensor ballistocardiogram,” J. Ambient Intell. SmartEnviron., vol. 9, pp. 193–207, 2017.

[27] Q. Xie, G. Wang, and Y. Lian, “Heart rate estimation from ballistocar-diography based on Hilbert transform and phase vocoder,” in Proc. IEEEAsia-Pacific Conf. Circuits Syst., 2018, pp. 139–142.

[28] Z. He et al., “A heart rate measurement system based on ballistocardiogramfor smart furniture,” in Proc. IEEE Asia-Pacific Conf. Circuits Syst., 2018,pp. 151–154.

[29] H. S. Shin, C. Lee, and M. Lee, “Adaptive threshold method for thepeak detection of photoplethysmographic waveform,” Comput. Biol. Med.,vol. 39, no. 12, pp. 1145–1152, 2009.

[30] H.-S. Park and C.-H. Jun, “A simple and fast algorithm for K-medoidsclustering,” Expert Syst. Appl., vol. 36, pp. 3336–3341, 2009.

[31] D. Arthur and S. Vassilvitskii, “k-means++: The advantages of carefulseeding,” in Proc. 18th ACM-SIAM Symp. Discrete Algorithms, 2007,pp. 1027–1035.

[32] X. Zhang and Y. Lian, “A 300-mV 220-nW event-driven ADC withreal-time QRS detection forwearable ECG sensors,” IEEE Trans. Biomed.Circuits Syst., vol. 8, no. 6, pp. 834–843, Dec. 2014.

Qingsong Xie received the B.S. degree in electronicinformation engineering from the University of Elec-tronic Science and Technology of China, Chengdu,China, in 2015. He is currently working toward thePh.D. degree in microelectronics at Shanghai JiaoTong University, Shanghai, China.

His research interests include machine learning,computer vision, and signal processing.

Min Wang received the M.S. degree in integratedcircuit engineering, in 2018 from Shanghai Jiao TongUniversity, Shanghai, China, where he is currentlyworking toward the Eng.D. degree in electrical andinformation engineering. His research interests in-clude wearable health monitoring system design andbiological signal processing.

Yang Zhao received the B.S. and M.S. degrees inelectrical engineering from Xian Jiaotong University,Xian, China, in 2015, and Ph.D. degree in electri-cal engineering from York University, Toronto, ON,Canada, in 2019. He is currently a Postdoctoral Re-searcher with York University. His research interestsinclude ultralow power circuits and system for nextgeneration wearable biomedical sensors.

Ziran He received the M.E. degree in integrated cir-cuit engineering from Shanghai Jiao Tong University,Shanghai, China, in 2019. He is currently working asa System Design Hardware Engineer with TP-LINKtechnology company.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.

1602 IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, VOL. 13, NO. 6, DECEMBER 2019

Yongfu Li (S’09–M’14–SM’18) received the B.Eng.and Ph.D. degrees from the National University ofSingapore (NUS), Singapore.

He is currently an Associate Professor with theDepartment of Micro and Nano Electronics Engi-neering and MoE Key Lab of Artificial Intelligence,Shanghai Jiao Tong University, Shanghai, China. Hewas a Research Engineer with NUS, from 2013 to2014. He was a Senior Engineer from 2014 to 2016,Principal Engineer from 2016 to 2018, and Memberof Technical Staff from 2018 to 2019 with GLOB-

ALFOUNDRIES, as a Design-to-Manufacturing (DFM) Computer-Aided De-sign Research and Development Engineer. His research interests include ana-log/mixed signal circuits, data converters, power converters, biomedical signalprocessing with deep learning technique, and DFM circuit automation.

Dr. Li was the recipient of the Singapore Economic Development BoardGLOBALFOUNDRIES Graduate Scholarship. He is actively contributing tothe Singapore Section Young Professionals Affinity Group and has served as theSecretary from 2012 to 2013 and the Chair from 2014 to 2015.

Guoxing Wang (M’06–SM’13) received the Ph.D.degree in electrical engineering from the Universityof California, Santa Cruz, Santa Cruz, CA, USA, in2006.

He was a Member of Technical Staff with AgereSystems, San Jose, CA, USA, from 2006 to 2007.From 2007 to 2009, he joined the Second Sight Med-ical Products, Sylmar CA, USA, where he designedthe integrated circuits chip that helped blind peopleto restore vision. He is currently a Professor with theSchool of Microelectronics, Shanghai Jiao Tong Uni-

versity, Shanghai, China. He has authored/coauthored in various peer-reviewedjournals and conferences. His current research interests include biomedicalelectronics and bio-inspired circuits and systems.

Dr. Wang has been the Deputy Editor-in-Chief for the IEEE TRANSACTIONS

ON BIOMEDICAL CIRCUITS AND SYSTEMS since 2016 and a Vice President ofthe IEEE Circuits and Systems Society since 2019. He was an Associate Editorfor the IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II from 2012 to 2015,Guest Editor for the IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN

CIRCUITS AND SYSTEMS and Guest Editor for the IEEE TRANSACTIONS ON

BIOMEDICAL CIRCUITS AND SYSTEMS, both in 2014. He was the TechnicalProgram Chair for the IEEE Conference on Biomedical Circuits and Systemsin 2016. He was the Local Chair for the first IEEE Green Circuits and Systemsand for the second Asia Pacific Conference on Postgraduate Research in Micro-electronics & Electronics, both in 2010.

Yong Lian (M’90–SM’99–F’09) has research in-terests that include biomedical circuits and systemsand signal processing. He was the recipient of morethan 15 awards for his research, including IEEE Cir-cuits and Systems Society’s Guillemin–Cauer Award,IEEE Communications Society Multimedia Commu-nications Best Paper Award, Institution of EngineersSingapore Prestigious Engineering AchievementAward, and Winning of the Design Contest Awardin ISLPED 2015. He is the President of the IEEECircuits and Systems (CAS) Society, Chair of the

IEEE Periodicals Partnership Opportunities Committee, member of the IEEEPeriodicals Committee, member of the IEEE Biomedical Engineering AwardCommittee, and member of Steering Committee of the IEEE TRANSACTIONS ON

BIOMEDICAL CIRCUITS AND SYSTEMS. He was the Editor-in-Chief for the IEEETRANSACTIONS ON CIRCUITS AND SYSTEMS Part II for two terms. He served asthe VP for Publications and VP for Region 10 of the IEEE CAS Society, andmany other roles in IEEE. He is the Founder of the IEEE Biomedical Circuits andSystems Conference and the Asia Pacific Conference on Postgraduate Researchin Microelectronics and Electronics (PrimeAsia). He is a Fellow of the Academyof Engineering Singapore.

Authorized licensed use limited to: Shanghai Jiaotong University. Downloaded on March 25,2020 at 09:08:34 UTC from IEEE Xplore. Restrictions apply.