Noise Reference Signal–Based Denoising Method for EDA Collected by Multimodal Biosensor Wearable in the Field
Publication: Journal of Computing in Civil Engineering
Volume 34, Issue 6
Abstract
Since people in contemporary society spend most of their time interacting with the built environment, there is a growing need to thoroughly understand the quality of human–built environment interaction to improve quality of life. Recent wearable electrodermal activity (EDA) sensing has shown the potential to meet this need by continuously, less invasively, and less laboriously monitoring individuals’ stress levels as an important dimension of the quality of interaction with the built environment. However, analyzing EDA to detect stress is still challenging due to significant intrinsic and extrinsic noises in EDA collected by a wearable biosensor in the field. Although several denoising methods have been proposed based on differences in signal characteristics between noises and desired EDA signals evoked by sources of interest (e.g., stress), these methods do not address intrinsic respiration noise due to similarities in the signal characteristics of respiration noise and desired EDA signals. To address this issue, the authors propose a denoising method that references simultaneously collected photoplethysmography (PPG) as a respiration noise–correlated signal to attenuate respiration noise as well as extrinsic noises. The performance of the proposed method was compared with advanced benchmark denoising methods using 25 subjects’ stress data collected in the field. As a result, stress metrics calculated from EDA denoised using the proposed method were statistically more valid and reliable than ones from EDA denoised by benchmark denoising methods. Accordingly, machine learning models trained by having the stress metrics as features showed statistically higher accuracy with EDA denoised by the proposed method than by benchmark denoising methods. These results show that the proposed method can improve stress measurement using EDA by attenuating both intrinsic respiration noise and extrinsic noise. The finding contributes to the body of knowledge by demonstrating that intrinsic noise with signal characteristics indistinguishable from desirable signals can be suppressed by referencing another noise-correlated signal effortlessly acquired using multimodal wearable biosensors. This new knowledge will facilitate the application of wearable EDA sensing devices to continuously, less invasively, and less laboriously measure people’s stress in their daily interactions with the built environment. Using wearable-based stress measurement, urban managers can detect and address environmental stressors in the built environment in a more scalable manner, thereby more effectively improving the quality of interaction between humans and the built environment.
Get full access to this article
View all available purchase options and get full access to this article.
Data Availability Statement
Some or all data, models, or code generated or used during the study are proprietary or confidential in nature and may only be provided with restrictions (e.g., anonymized data). Data obtained from the corresponding author by request are anonymized subjects’ scores of stress metrics calculated from signals denoised by the proposed method and two benchmark denoising methods.
Acknowledgments
This study was supported by the Exercise and Sport Science Initiative (ESSI-2018-4), the Urban Collaboratory at the University of Michigan, and the US National Science Foundation (1800310). In addition, the authors wish to acknowledge Brenda Stumbo, Ypsilanti Township Supervisor, and Denise M. McKalpain, Service Coordinator at Clark East Tower, for their help in data collection. Any opinions, findings, conclusions, or recommendations expressed in this article are those of the authors and do not necessarily reflect the views of the aforementioned organizations.
References
Arndt, S., K. Brunnström, E. Cheng, U. Engelke, S. Möller, and J.-N. Antons. 2016. “Review on using physiology in quality of experience.” Electron. Imaging 2016 (16): 1–9. https://doi.org/10.2352/ISSN.2470-1173.2016.16.HVEI-125.
Asada, H. H., H.-H. Jiang, and P. Gibbs. 2004. “Active noise cancellation using MEMS accelerometers for motion-tolerant wearable bio-sensors.” In Proc., 26th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, 2157–2160. New York: IEEE.
Ayappa, I., R. G. Norman, D. Whiting, A. H. Tsai, F. Anderson, E. Donnely, D. J. Silberstein, and D. M. Rapoport. 2009. “Irregular respiration as a marker of wakefulness during titration of CPAP.” Sleep 32 (1): 99–104. https://doi.org/10.5665/sleep/32.1.99.
Baum, A. 1990. “Stress, intrusive imagery, and chronic distress.” Health Psychol. 9 (6): 653. https://doi.org/10.1037/0278-6133.9.6.653.
Blain, S., S. D. Power, E. Sejdic, A. Mihailidis, and T. Chau. 2010. “A cardiorespiratory classifier of voluntary and involuntary electrodermal activity.” Biomed. Eng. Online 9 (1): 11. https://doi.org/10.1186/1475-925X-9-11.
Bonaiuto, M., F. Fornara, S. Alves, I. Ferreira, Y. Mao, E. Moffat, G. Piccinin, and L. Rahimi. 2015. “Urban environment and well-being: Cross-cultural studies on perceived residential environment quality indicators (PREQIs).” Supplement, Cognit. Process. 16 (S1): 165–169. https://doi.org/10.1007/s10339-015-0691-z.
Bornoiu, I.-V., and O. Grigore. 2013. “A study about feature extraction for stress detection.” In Proc., 8th Int. Symp. on Advanced Topics in Electrical Engineering, 1–4. New York: IEEE.
Boucsein, W. 2012. Electrodermal activity. New York: Springer.
Bradley, H., and J. D. Esformes. 2014. “Breathing pattern disorders and functional movement.” Int. J. Sports Phys. Ther. 9 (1): 28.
Calkins, K. G. 2005. Applied statistics: Correlation coefficients. Berrien Springs, MI: Andrews Univ.
Chaspari, T., A. Tsiartas, L. I. S. Duker, S. A. Cermak, and S. S. Narayanan. 2016. “EDA-Gram: Designing electrodermal activity fingerprints for visualization and feature extraction.” In Proc., 2016 38th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, 403–406. New York: IEEE.
Chen, W., N. Jaques, S. Taylor, A. Sano, S. Fedor, and R. W. Picard. 2015. “Wavelet-based motion artifact removal for electrodermal activity.” In Proc., 2015 37th Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society, 6223–6226. New York: IEEE.
Chen, Z., S. Schulz, M. Qiu, W. Yang, X. He, Z. Wang, and L. Yang. 2018. “Assessing affective experience of in-situ environmental walk via wearable biosensors for evidence-based design.” Cognit. Syst. Res. 52 (Dec): 970–977. https://doi.org/10.1016/j.cogsys.2018.09.003.
Colder, C. R. 2001. “Life stress, physiological and subjective indexes of negative emotionality, and coping reasons for drinking: Is there evidence for a self-medication model of alcohol use?” Psychol. Addict. Behav. 15 (3): 237. https://doi.org/10.1037/0893-164X.15.3.237.
Daume, H., III, and D. Marcu. 2006. “Domain adaptation for statistical classifiers.” J. Artif. Intell. Res. 26: 101–126. https://doi.org/10.1613/jair.1872.
Diamantopoulos, A., M. Sarstedt, C. Fuchs, P. Wilczynski, and S. Kaiser. 2012. “Guidelines for choosing between multi-item and single-item scales for construct measurement: A predictive validity perspective.” J. Acad. Marketing Sci. 40 (3): 434–449. https://doi.org/10.1007/s11747-011-0300-3.
Dietterich, T. G. 1998. “Approximate statistical tests for comparing supervised classification learning algorithms.” Neural Comput. 10 (7): 1895–1923. https://doi.org/10.1162/089976698300017197.
Drachen, A., L. E. Nacke, G. Yannakakis, and A. L. Pedersen. 2010. “Correlation between heart rate, electrodermal activity and player experience in first-person shooter games.” In Proc., 5th ACM SIGGRAPH Symp. on Video Games, 49–54. New York: Association for Computing Machinery.
Dragoi, G., K. D. Harris, and G. Buzsáki. 2003. “Place representation within hippocampal networks is modified by long-term potentiation.” Neuron 39 (5): 843–853. https://doi.org/10.1016/S0896-6273(03)00465-3.
Dube, A.-A., M. Duquette, M. Roy, F. Lepore, G. Duncan, and P. Rainville. 2009. “Brain activity associated with the electrodermal reactivity to acute heat pain.” Neuroimage 45 (1): 169–180. https://doi.org/10.1016/j.neuroimage.2008.10.024.
Dutta, J., C. Chowdhury, S. Roy, A. I. Middya, and F. Gazi. 2017. “Towards smart city: Sensing air quality in city based on opportunistic crowd-sensing.” In Proc., 18th Int. Conf. on Distributed Computing and Networking, 42. New York: Association for Computing Machinery.
Egan, D., S. Brennan, J. Barrett, Y. Qiao, C. Timmerer, and N. Murray. 2006. “An evaluation of heart rate and electrodermal activity as an objective QoE evaluation method for immersive virtual reality environments.” In Proc., 2016 8th Int. Conf. on Quality of Multimedia Experience (QoMEX), 1–6. New York: IEEE.
Fernando, B., A. Habrard, M. Sebban, and T. Tuytelaars. 2013. “Unsupervised visual domain adaptation using subspace alignment.” In Proc., IEEE Int. Conf. on Computer Vision, 2960–2967. New York: IEEE.
Ganin, Y., E. Ustinova, H. Ajakan, P. Germain, H. Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky. 2016. “Domain-adversarial training of neural networks.” J. Mach. Learn. Res. 17 (1): 1–35. https://doi.org/10.5555/2946645.2946704.
Garde, A., W. Karlen, J. M. Ansermino, and G. A. Dumont. 2014. “Estimating respiratory and heart rates from the correntropy spectral density of the photoplethysmogram.” PLoS One 9 (1): e86427. https://doi.org/10.1371/journal.pone.0086427.
Glorot, X., A. Bordes, and Y. Bengio. 2011. “Domain adaptation for large-scale sentiment classification: A deep learning approach.” Proc., 28th Int. Conf. on Machine Learning (ICML-11), 513–520. Madison, WI: Omnipress.
Greco, A., G. Valenza, L. Citi, and E. P. Scilingo. 2017. “Arousal and valence recognition of affective sounds based on electrodermal activity.” IEEE Sens. J. 17 (3): 716–725. https://doi.org/10.1109/JSEN.2016.2623677.
Greco, A., G. Valenza, A. Lanata, E. P. Scilingo, and L. Citi. 2016. “cvxEDA: A convex optimization approach to electrodermal activity processing.” IEEE Trans. Biomed. Eng. 63 (4): 797–804.
Hauthal, E., and D. Burghardt. 2016. “Mapping space-related emotions out of user-generated photo metadata considering grammatical issues.” Cartographic J. 53 (1): 78–90. https://doi.org/10.1179/1743277414Y.0000000094.
Haybatollahi, M., M. Czepkiewicz, T. Laatikainen, and M. Kyttä. 2015. “Neighbourhood preferences, active travel behaviour, and built environment: An exploratory study.” Transp. Res. Part F: Traffic Psychol. Behav. 29 (Feb): 57–69. https://doi.org/10.1016/j.trf.2015.01.001.
Heikenfeld, J., A. Jajack, J. Rogers, P. Gutruf, L. Tian, T. Pan, R. Li, M. Khine, J. Kim, and J. Wang. 2018. “Wearable sensors: Modalities, challenges, and prospects.” Lab Chip 18 (2): 217–248. https://doi.org/10.1039/C7LC00914C.
Hygge, S., and K. Hugdahl. 1985. “Skin conductance recordings and the NaCl concentration of the electrolyte.” Psychophysiology 22 (3): 365–367. https://doi.org/10.1111/j.1469-8986.1985.tb01616.x.
Jacobs, N., N. Nicolson, C. Derom, P. Delespaul, J. Van Os, and I. Myin-Germeys. 2005. “Electronic monitoring of salivary cortisol sampling compliance in daily life.” Life Sci. 76 (21): 2431–2443. https://doi.org/10.1016/j.lfs.2004.10.045.
Jebelli, H., B. Choi, H. Kim, and S. Lee. 2018a. “Feasibility study of a wristband-type wearable sensor to understand construction workers’ physical and mental status.” In Proc., Construction Research Congress. Reston, VA: ASCE.
Jebelli, H., B. Choi, and S. Lee. 2019. “Application of wearable biosensors to construction sites. I: Assessing workers’ stress.” J. Constr. Eng. Manage. 145 (12): 04019079. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001729.
Jebelli, H., S. Hwang, and S. Lee. 2018b. “EEG-based workers’ stress recognition at construction sites.” Autom. Constr. 93 (Sep): 315–324. https://doi.org/10.1016/j.autcon.2018.05.027.
Jebelli, H., M. M. Khalili, S. Hwang, and S. Lee. 2018c. “A supervised learning-based construction workers’ stress recognition using a wearable electroencephalography (EEG) device.” In Proc., Construction Research Congress, 43–53. Reston, VA: ASCE.
Kaczynski, A. T., J. Robertson-Wilson, and M. Decloe. 2012. “Interaction of perceived neighborhood walkability and self-efficacy on physical activity.” J. Phys. Act. Health 9 (2): 208–217. https://doi.org/10.1123/jpah.9.2.208.
Kim, J., C. R. Ahn, and Y. Nam. 2019. “The influence of built environment features on crowdsourced physiological responses of pedestrians in neighborhoods.” Comput. Environ. Urban Syst. 75 (May): 161–169. https://doi.org/10.1016/j.compenvurbsys.2019.02.003.
Kim, J., and D. R. Fesenmaier. 2015. “Measuring emotions in real time: Implications for tourism experience design.” J. Travel Res. 54 (4): 419–429. https://doi.org/10.1177/0047287514550100.
Kohavi, R., and G. H. John. 1997. “Wrappers for feature subset selection.” Artif. Intell. 97 (1–2): 273–324. https://doi.org/10.1016/S0004-3702(97)00043-X.
Ksander, J. C., S. M. Kark, and C. R. Madan. 2018. “Breathe easy EDA: A MATLAB toolbox for psychophysiology data management, cleaning, and analysis.” F1000Research 7 (216). https://doi.org/10.12688/f1000research.13849.2.
Kuhn, M., and K. Johnson. 2013. Applied predictive modeling. New York: Springer.
Lee, G., B. Choi, C. R. Ahn, and S. Lee. 2019. “Feasibility of wearable-based collective sensing to detect environmental barriers for facilitating the elderly’s mobility.” In Proc., Int. Conf. on Smart Infrastructure and Construction 2019, 143–149. Cambridge, UK: Cambridge Centre for Smart Infrastructure and Construction. https://doi.org/10.1680/icsic.64669.143.
Lee, G., B. Choi, C. R. Ahn, and S. Lee. 2020a. “Wearable biosensor and hotspot analysis-based framework to detect stress hotspots for advancing elderly’s mobility.” J. Manage. Eng. 36 (3): 04020010. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000753.
Lee, G., B. Choi, H. Jebelli, C. R. Ahn, and S. Lee. 2020b. “Wearable biosensor and collective sensing–based approach for detecting older adults’ environmental barriers.” J. Comput. Civ. Eng. 34 (2): 04020002. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000879.
Lee-Gosselin, M. 1996. “Scope and potential of interactive stated response data collection methods.” In Proc., Conf. on Household Travel Surveys: New Concepts and Research Needs, 115–133. Washington, DC: National Academy Press.
Li, J., Z. Struzik, L. Zhang, and A. Cichocki. 2015. “Feature learning from incomplete EEG with denoising autoencoder.” Neurocomputing 165 (Oct): 23–31. https://doi.org/10.1016/j.neucom.2014.08.092.
LoBiondo-Wood, G., and J. Haber. 2014. “Reliability and validity.” In Nursing research-ebook: Methods and critical appraisal for evidence based practice, 289–309. St. Louis: Elsevier.
Lockett, D., A. Willis, and N. Edwards. 2005. “Through seniors’ eyes: An exploratory qualitative study to identify environmental barriers to and facilitators of walking.” Can. J. Nurs. Res. 37 (3): 48–65.
McCorry, L. K. 2007. “Physiology of the autonomic nervous system.” Am. J. Pharm. Educ. 71 (4): 78. https://doi.org/10.5688/aj710478.
Mohit, M. A. 2013. “Quality of life in natural and built environment: An introductory analysis.” Procedia-Social Behav. Sci. 101 (Nov): 33–43. https://doi.org/10.1016/j.sbspro.2013.07.176.
Nezlek, J. B., K. Vansteelandt, I. Van Mechelen, and P. Kuppens. 2008. “Appraisal-emotion relationships in daily life.” Emotion 8 (1): 145. https://doi.org/10.1037/1528-3542.8.1.145.
Pan, S. J., I. W. Tsang, J. T. Kwok, and Q. Yang. 2011. “Domain adaptation via transfer component analysis.” IEEE Trans. Neural Networks 22 (2): 199–210. https://doi.org/10.1109/TNN.2010.2091281.
Radopoulou, S. C., and I. Brilakis. 2015. “Patch detection for pavement assessment.” Autom. Constr. 53 (May): 95–104. https://doi.org/10.1016/j.autcon.2015.03.010.
Raya, M. A. D., and L. G. Sison. 2002. “Adaptive noise cancelling of motion artifact in stress ECG signals using accelerometer.” In Proc., 2nd Joint 24th Annual Conf. and the Annual Fall Meeting of the Biomedical Engineering Society and Engineering in Medicine and Biology, 1756–1757. New York: IEEE.
Rice, J. A., and B. W. Silverman. 1991. “Estimating the mean and covariance structure nonparametrically when the data are curves.” J. R. Stat. Soc.: Ser. B (Methodol.) 53 (1): 233–243. https://doi.org/10.1111/j.2517-6161.1991.tb01821.x.
Rosenberg, D. E., D. L. Huang, S. D. Simonovich, and B. Belza. 2012. “Outdoor built environment barriers and facilitators to activity among midlife and older adults with mobility disabilities.” Gerontologist 53 (2): 268–279. https://doi.org/10.1093/geront/gns119.
Saha, A., A. Konar, A. Chatterjee, A. Ralescu, and A. K. Nagar. 2014. “EEG analysis for olfactory perceptual-ability measurement using a recurrent neural classifier.” IEEE Trans. Hum.-Mach. Syst. 44 (6): 717–730. https://doi.org/10.1109/THMS.2014.2344003.
Schneider, R., S. Schmidt, M. Binder, F. Schäfer, and H. Walach. 2003. “Respiration-related artifacts in EDA recordings: Introducing a standardized method to overcome multiple interpretations.” Psychol. Rep. 93 (3): 907–920. https://doi.org/10.2466/pr0.2003.93.3.907.
Setz, C., B. Arnrich, J. Schumm, R. La Marca, G. Tröster, and U. Ehlert. 2010. “Discriminating stress from cognitive load using a wearable EDA device.” IEEE Trans. Inf. Technol. Biomed. 14 (2): 410–417. https://doi.org/10.1109/TITB.2009.2036164.
Sharma, G., and J. Goodwin. 2006. “Effect of aging on respiratory system physiology and immunology.” Clin. Interventions Aging 1 (3): 253. https://doi.org/10.2147/ciia.2006.1.3.253.
Shelley, K., and S. Shelley. 2001. “Pulse oximeter waveform: Photoelectric plethysmography.” In Clinical monitoring, carol lake, edited by R. Hines and C. Blitt, 420–428. Philadelphia: W.B. Saunders.
Shi, Y., and F. Sha. 2012. “Information-theoretical learning of discriminative clusters for unsupervised domain adaptation.” Preprint, submitted June 27, 2012. https://arxiv.org/abs/1206.6438.
Shukla, J., M. Barreda-Ángeles, J. Oliver, and D. Puig. 2018. “Efficient wavelet-based artifact removal for electrodermal activity in real-world applications.” Biomed. Signal Process. Control 42 (Apr): 45–52. https://doi.org/10.1016/j.bspc.2018.01.009.
Singh, R. R., S. Conjeti, and R. Banerjee. 2014. “Assessment of driver stress from physiological signals collected under real-time semi-urban driving scenarios.” Int. J. Comput. Intell. Syst. 7 (5): 909–923. https://doi.org/10.1080/18756891.2013.864478.
Srivastava, M. 1984. “Estimation of interclass correlations in familial data.” Biometrika 71 (1): 177–185. https://doi.org/10.1093/biomet/71.1.177.
Sun, F.-T., C. Kuo, H.-T. Cheng, S. Buthpitiya, P. Collins, and M. Griss. 2010. “Activity-aware mental stress detection using physiological sensors.” In Proc., Int. Conf. on Mobile Computing, Applications, and Services, 282–301. New York: Springer.
Sweeney, K. T., T. E. Ward, and S. F. McLoone. 2012. “Artifact removal in physiological signals—Practices and possibilities.” IEEE Trans. Inf. Technol. Biomed. 16 (3): 488–500. https://doi.org/10.1109/TITB.2012.2188536.
Trakoolwilaiwan, T., B. Behboodi, J. Lee, K. Kim, and J.-W. Choi. 2017. “Convolutional neural network for high-accuracy functional near-infrared spectroscopy in a brain–computer interface: Three-class classification of rest, right-, and left-hand motor execution.” Neurophotonics 5 (1): 1. https://doi.org/10.1117/1.NPh.5.1.011008.
Tsai, Y.-C., and A. Chatterjee. 2017. “Pothole detection and classification using 3D technology and watershed method.” J. Comput. Civ. Eng. 32 (2): 04017078. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000726.
Ugnell, H., and P. Öberg. 1995. “The time-variable photoplethysmographic signal; dependence of the heart synchronous signal on wavelength and sample volume.” Med. Eng. Phys. 17 (8): 571–578. https://doi.org/10.1016/1350-4533(95)00008-B.
Ursin, H., and H. R. Eriksen. 2004. “The cognitive activation theory of stress.” Psychoneuroendocrinology 29 (5): 567–592. https://doi.org/10.1016/S0306-4530(03)00091-X.
Vellas, B. J., S. J. Wayne, L. J. Romero, R. N. Baumgartner, and P. J. Garry. 1997. “Fear of falling and restriction of mobility in elderly fallers.” Age Ageing 26 (3): 189–193. https://doi.org/10.1093/ageing/26.3.189.
Venables, P. H., and M. J. Christie. 1980. Techniques in psychophysiology, 3–67. Hoboken, NJ: John Wiley & Sons.
Widrow, B., J. R. Glover, J. M. McCool, J. Kaunitz, C. S. Williams, R. H. Hearn, J. R. Zeidler, J. E. Dong, and R. C. Goodlin. 1975. “Adaptive noise cancelling: Principles and applications.” Proc. IEEE 63 (12): 1692–1716. https://doi.org/10.1109/PROC.1975.10036.
Yadav, M., T. Chaspari, J. Kim, and C. R. Ahn. 2018. “Capturing and quantifying emotional distress in the built environment.” In Proc., Workshop on Human-Habitat for Health (H3): Human-Habitat Multimodal Interaction for Promoting Health and Well-Being in the Internet of Things Era, 9. New York: Association for Computing Machinery.
Zhao, H., S. Zhang, G. Wu, J. P. Costeira, J. M. Moura, and G. J. Gordon. 2017. “Multiple source domain adaptation with adversarial training of neural networks.” Preprint, submitted May 26, 2017. https://arxiv.org/abs/1705.09684.
Zhu, X., and T. Fujii. 2017. “A modulation classification method in cognitive radios system using stacked denoising sparse autoencoder.” In Proc., 2017 IEEE Radio and Wireless Symp., 218–220. New York: IEEE.
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 34 • Issue 6 • November 2020
Copyright
© 2020 American Society of Civil Engineers.
History
Received: Feb 5, 2020
Accepted: Jun 9, 2020
Published online: Aug 26, 2020
Published in print: Nov 1, 2020
Discussion open until: Jan 26, 2021
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.