Continuous Human Activity Classification from FMCW Radar with Bi-LSTM Networks

Aman Shrestha, Haobo Li, Julien le Kernec, Francesco Fioranelli

Research output: Contribution to journalArticleScientificpeer-review

98 Citations (Scopus)
60 Downloads (Pure)

Abstract

Recognition of human movements with radar for ambient activity monitoring is a developed area of research that yet presents outstanding challenges to address. In real environments, activities and movements are performed with seamless motion, with continuous transitions between activities of different duration and a large range of dynamic motions, compared with discrete activities of fixed-time lengths which are typically analysed in the literature. This paper proposes a novel approach based on recurrent LSTM and Bi-LSTM network architectures for continuous activity monitoring and classification. This approach uses radar data in the form of a continuous temporal sequence of micro-Doppler or range-time information, differently from from other conventional approaches based on convolutional networks that interpret the radar data as images. Experimental radar data involving 15 participants and different sequences of 6 actions are used to validate the proposed approach. It is demonstrated that using the Doppler-domain data together with the Bi-LSTM network and an optimal learning rate can achieve over 90% mean accuracy, whereas range-domain data only achieved approximately 76%. The details of the network architectures, insights in their behaviour as a function of key hyper-parameters such as the learning rate, and a discussion on their performance across are provided in the paper.

Original languageEnglish
Article number9130759
Pages (from-to)13607-13619
Number of pages13
JournalIEEE Sensors Journal
Volume20
Issue number22
DOIs
Publication statusPublished - 2020

Keywords

  • FMCW radar
  • LSTM and Bi-LSTM networks
  • classification
  • micro-Doppler
  • remote activity monitoring

Fingerprint

Dive into the research topics of 'Continuous Human Activity Classification from FMCW Radar with Bi-LSTM Networks'. Together they form a unique fingerprint.

Cite this