{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T07:45:52Z","timestamp":1772005552093,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2020,7,10]],"date-time":"2020-07-10T00:00:00Z","timestamp":1594339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To diagnose neurodegenerative diseases (NDDs), physicians have been clinically evaluating symptoms. However, these symptoms are not very dependable\u2014particularly in the early stages of the diseases. This study has therefore proposed a novel classification algorithm that uses a deep learning approach to classify NDDs based on the recurrence plot of gait vertical ground reaction force (vGRF) data. The irregular gait patterns of NDDs exhibited by vGRF data can indicate different variations of force patterns compared with healthy controls (HC). The classification algorithm in this study comprises three processes: a preprocessing, feature transformation and classification. In the preprocessing process, the 5-min vGRF data divided into 10-s successive time windows. In the feature transformation process, the time-domain vGRF data are modified into an image using a recurrence plot. The total recurrence plots are 1312 plots for HC (16 subjects), 1066 plots for ALS (13 patients), 1230 plots for PD (15 patients) and 1640 plots for HD (20 subjects). The principal component analysis (PCA) is used in this stage for feature enhancement. Lastly, the convolutional neural network (CNN), as a deep learning classifier, is employed in the classification process and evaluated using the leave-one-out cross-validation (LOOCV). Gait data from HC subjects and patients with amyotrophic lateral sclerosis (ALS), Huntington\u2019s disease (HD) and Parkinson\u2019s disease (PD) obtained from the PhysioNet Gait Dynamics in Neurodegenerative disease were used to validate the proposed algorithm. The experimental results included two-class and multiclass classifications. In the two-class classification, the results included classification of the NDD and the HC groups and classification among the NDDs. The classification accuracy for (HC vs. ALS), (HC vs. HD), (HC vs. PD), (ALS vs. PD), (ALS vs. HD), (PD vs. HD) and (NDDs vs. HC) were 100%, 98.41%, 100%, 95.95%, 100%, 97.25% and 98.91%, respectively. In the multiclass classification, a four-class gait classification among HC, ALS, PD and HD was conducted and the classification accuracy of HC, ALS, PD and HD were 98.99%, 98.32%, 97.41% and 96.74%, respectively. The proposed method can achieve high accuracy compare to the existing results, but with shorter length of input signal (Input of existing literature using the same database is 5-min gait signal, but the proposed method only needs 10-s gait signal).<\/jats:p>","DOI":"10.3390\/s20143857","type":"journal-article","created":{"date-parts":[[2020,7,10]],"date-time":"2020-07-10T09:25:28Z","timestamp":1594373128000},"page":"3857","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Evaluation of Vertical Ground Reaction Forces Pattern Visualization in Neurodegenerative Diseases Identification Using Deep Learning and Recurrence Plot Image Feature Extraction"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1894-1189","authenticated-orcid":false,"given":"Che-Wei","family":"Lin","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, College of Engineering, National Cheng Kung University, Tainan 701, Taiwan"},{"name":"Medical Device Innovation Center, National Cheng Kung University, Tainan 701, Taiwan"}]},{"given":"Tzu-Chien","family":"Wen","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, College of Engineering, National Cheng Kung University, Tainan 701, Taiwan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3671-9127","authenticated-orcid":false,"given":"Febryan","family":"Setiawan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, College of Engineering, National Cheng Kung University, Tainan 701, Taiwan"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,10]]},"reference":[{"key":"ref_1","unstructured":"JPND Research (2019, July 12). What is Neurodegenerative Disease? 7 February 2015. Available online: http:\/\/bit.ly\/2Hkzs9w."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1016\/j.ncl.2016.06.012","article-title":"Epidemiology of Parkinson\u2019s disease","volume":"34","author":"Lee","year":"2016","journal-title":"Neurol Clin."},{"key":"ref_3","unstructured":"Parkinson\u2019s Disease Foundation (2019, July 12). Statistics on Parkinson\u2019s, EIN: 13-1866796. Available online: http:\/\/bit.ly\/2RCeh9H."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1159\/000351153","article-title":"Global epidemiology of amyotrophic lateral sclerosis: A systematic review of the published literature","volume":"41","author":"Logroscino","year":"2013","journal-title":"Neuroepidemiology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1038\/nn.3584","article-title":"State of play in amyotrophic lateral sclerosis genetics","volume":"17","author":"Renton","year":"2014","journal-title":"Nat. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"54","DOI":"10.3389\/fmolb.2015.00054","article-title":"Molecular diagnostics of neurodegenerative disorders","volume":"2","author":"Agrawal","year":"2015","journal-title":"Front. Mol. Biosci."},{"key":"ref_7","unstructured":"Harvard NeuroDiscovery Center (2019, July 12). The Challenge of Neurodegenerative Diseases. Available online: http:\/\/bit.ly\/2soDGmD."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1002\/mds.870130310","article-title":"Gait variability and basal ganglia disorders: Stride-to-stride variations of gait cycle timing in Parkinson\u2019s disease and Huntington\u2019s disease","volume":"13","author":"Hausdorff","year":"1998","journal-title":"Mov. Disord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1056\/NEJMra1603471","article-title":"Amyotrophic lateral sclerosis","volume":"377","author":"Brown","year":"2017","journal-title":"N. Engl. J. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2045","DOI":"10.1152\/jappl.2000.88.6.2045","article-title":"Dynamic markers of altered gait rhythm in amyotrophic lateral sclerosis","volume":"88","author":"Hausdorff","year":"2000","journal-title":"J. Appl. Physiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"171","DOI":"10.4103\/2152-7806.169561","article-title":"A Comprehensive Review of Amyotrophic Lateral Sclerosis","volume":"6","author":"Zarei","year":"2015","journal-title":"Surg. Neurol. Int."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1016\/j.jtbi.2008.05.023","article-title":"Huntington\u2019s disease: Modeling the gait disorder and proposing novel treatments","volume":"254","author":"Banaie","year":"2008","journal-title":"J. Theor. Biol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.ncl.2014.09.003","article-title":"Huntington disease: Pathogenesis and treatment","volume":"33","author":"Dayalu","year":"2015","journal-title":"Neurol. Clin."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"140","DOI":"10.14802\/jmd.17041","article-title":"Quantitative gait analysis in patients with Huntington\u2019s disease","volume":"10","author":"Pyo","year":"2017","journal-title":"J. Mov. Disord."},{"key":"ref_15","unstructured":"National Institute of Neurological Disorders and Stroke (2019, July 12). Parkinson\u2019s Disease Information Page. Available online: http:\/\/bit.ly\/2xTA6rL."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1002\/1531-8257(200101)16:1<58::AID-MDS1018>3.0.CO;2-9","article-title":"Accelerometric assessment of levodopa-induced dyskinesias in Parkinson\u2019s disease","volume":"16","author":"Hoff","year":"2001","journal-title":"Mov. Disord."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"28","DOI":"10.11138\/FNeur\/2017.32.1.028","article-title":"Gait analysis and clinical correlations in early Parkinson\u2019s disease","volume":"32","author":"Pistacchi","year":"2017","journal-title":"Funct. Neurol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.ins.2015.04.047","article-title":"Classification of neurodegenerative diseases using gait dynamics via deterministic learning","volume":"317","author":"Zeng","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.bspc.2015.02.002","article-title":"Classification of Gait rhythm signals between patients with neurodegenerative diseases and normal subjects: Experiments with statistical features and different classification models","volume":"18","author":"Xia","year":"2015","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.eswa.2016.03.018","article-title":"Detection of Parkinson\u2019s disease by shifted one-dimensional local binary patterns from gait","volume":"56","author":"Kaya","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.bspc.2016.08.022","article-title":"Measuring signal fluctuations in gait rhythm time series of patients with Parkinson\u2019s disease using entropy parameters","volume":"31","author":"Wu","year":"2017","journal-title":"Biomed. Signal Process. Control."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.knosys.2018.01.004","article-title":"Dual-channel LSTM based multi-feature extraction in gait for diagnosis of neurodegenerative diseases","volume":"145","author":"Zhao","year":"2018","journal-title":"Knowl.-Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/j.bspc.2016.08.016","article-title":"The impact of feature extraction for the classification of amyotrophic lateral sclerosis among neurodegenerative diseases and healthy subjects","volume":"31","author":"Bilgin","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1109\/TNSRE.2017.2732448","article-title":"Texture classification and visualization of time series of gait dynamics in patients with neurodegenerative diseases","volume":"26","author":"Pham","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_25","first-page":"e215","article-title":"PhytioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals","volume":"101","author":"Hausdorff","year":"2000","journal-title":"Circulation"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/0021-9290(94)00074-E","article-title":"Footswitch system for measurement of the temporal parameters of gait","volume":"28","author":"Hausdorff","year":"1995","journal-title":"J. Biomech."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1212\/WNL.17.5.427","article-title":"Parkinsonism: Onset, progression, and mortality","volume":"17","author":"Hoehn","year":"1967","journal-title":"Neurology"},{"key":"ref_28","unstructured":"Rorabaugh, C.B. (1999). DSP Primer, McGraw Hill."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dehghani, A., Sarbishei, O., Glatard, T., and Shihab, E. (2019). A quantitative comparison of overlapping and non-overlapping sliding windows for human activity recognition using inertial sensors. Sensors, 19.","DOI":"10.3390\/s19225026"},{"key":"ref_30","unstructured":"Morris, D., Saponas, T.S., Guillory, A., and Kelner, I. (May, January 14). RecoFit: Using a wearable sensor to find, recognize, and count repetitive exercises. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.pmcj.2011.06.004","article-title":"Centinela: A human activity recognition system based on acceleration and vital sign data","volume":"8","author":"Lara","year":"2012","journal-title":"Pervasive Mob. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tapia, E.M., Intille, S.S., Haskell, W., Larson, K., Wright, J., King, A., and Friedman, R. (2007, January 11\u201313). Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers, Boston, MA, USA.","DOI":"10.1109\/ISWC.2007.4373774"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.physrep.2006.11.001","article-title":"Recurrence plots for the analysis of complex systems","volume":"438","author":"Marwan","year":"2007","journal-title":"Phys. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Jolliffe, I.T. (2002). Principal Component Analysis, Springer. [2nd ed.]. Chapter 1, Introduction.","DOI":"10.1007\/978-1-4757-1904-8_1"},{"key":"ref_35","unstructured":"O\u2019Shea, K., and Nash, R. (arXiv, 2015). An introduction to convolutional neural networks, arXiv."},{"key":"ref_36","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2017, January 15\u201317). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Chengdu, China.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Refaeilzadeh, P., Tang, L., and Liu, H. (2009). Cross-validation. Encycl. Database Syst., 532\u2013538.","DOI":"10.1007\/978-0-387-39940-9_565"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests","volume":"3","author":"Youden","year":"1950","journal-title":"Cancer"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Farooq, A., Anwar, S., Awais, M., and Rehman, S. (2017, January 18\u201320). A deep CNN based multi-class classification of Alzheimer\u2019s disease using MRI. Proceedings of the 2017 IEEE International Conference on Imaging Systems and Techniques, Beijing, China.","DOI":"10.1109\/IST.2017.8261460"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Mehmood, A., Maqsood, M., Bashir, M., and Shuyuan, Y. (2020). A Deep Siamese Convolution Neural Network for Multi-Class Classification of Alzheimer Disease. Brain Sci., 10.","DOI":"10.3390\/brainsci10020084"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"113408","DOI":"10.1016\/j.eswa.2020.113408","article-title":"An Efficient Convolutional Neural Network for Coronary Heart Disease Prediction","volume":"159","author":"Dutta","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.inffus.2019.06.024","article-title":"Multi-class Arrhythmia detection from 12-lead varied-length ECG using Attention-based Time-Incremental Convolutional Neural Network","volume":"53","author":"Yao","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.imu.2018.08.002","article-title":"Multiclass classification of myocardial infarction with convolutional and recurrent neural networks for portable ECG devices","volume":"13","author":"Lui","year":"2018","journal-title":"Inform. Med. Unlocked"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Yang, M., Zheng, H., Wang, H., and McClean, S. (2009, January 1\u20133). Feature selection and construction for the discrimination of neurodegenerative diseases based on gait analysis. Proceedings of the 2009 3rd International Conference on Pervasive Computing Technologies for Healthcare, London, UK.","DOI":"10.4108\/ICST.PERVASIVEHEALTH2009.6053"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3857\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:49:57Z","timestamp":1760176197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/3857"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,10]]},"references-count":48,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["s20143857"],"URL":"https:\/\/doi.org\/10.3390\/s20143857","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,10]]}}}