Neuromorphic Event-based Action Recognition

S. Harrigan; S. Colman; D. Kerr; P. Yogarajah; Z. Fang; C. Wu

doi:10.21427/sa6d-fd08

Neuromorphic Event-based Action Recognition

S. Harrigan, S. Colman, D. Kerr, P. Yogarajah, Z. Fang, C. Wu

Research output: Contribution to conference › Paper › peer-review

Abstract

An action can be viewed as spike trains or streams of events when observed and captured by neuromorphic imaging hardware such as the iniLabs DVS128. These streams are unique to each action enabling them to be used to form descriptors. This paper describes an approach for detecting specific actions based on space-time template matching by forming such descriptors and using them as comparative tools. The developed approach is used to detect symbols from the popular RoShambo (rock, paper and scissors) game. The results demonstrate that the developed approach can be used to correctly detect the motions involved in producing RoShambo symbols.

Original language	English
DOIs	https://doi.org/10.21427/sa6d-fd08
Publication status	Published - 1 Jan 2019
Externally published	Yes
Event	IMVIP 2019: Irish Machine Vision & Image Processing - Technological University Dublin, Dublin, Ireland Duration: 28 Aug 2019 → 30 Aug 2019

Conference

Conference	IMVIP 2019: Irish Machine Vision & Image Processing
Country/Territory	Ireland
City	Dublin
Period	28/08/19 → 30/08/19

Keywords

spike trains
streams of events
neuromorphic imaging hardware
iniLabs DVS128
space-time template matching
descriptors
RoShambo
rock paper scissors
action detection

Access to Document

10.21427/sa6d-fd08Licence: CC BY-NC-SA

Cite this

@conference{66f86552e4824ccd966123ead6ffba3b,

title = "Neuromorphic Event-based Action Recognition",

abstract = "An action can be viewed as spike trains or streams of events when observed and captured by neuromorphic imaging hardware such as the iniLabs DVS128. These streams are unique to each action enabling them to be used to form descriptors. This paper describes an approach for detecting specific actions based on space-time template matching by forming such descriptors and using them as comparative tools. The developed approach is used to detect symbols from the popular RoShambo (rock, paper and scissors) game. The results demonstrate that the developed approach can be used to correctly detect the motions involved in producing RoShambo symbols.",

keywords = "spike trains, streams of events, neuromorphic imaging hardware, iniLabs DVS128, space-time template matching, descriptors, RoShambo, rock paper scissors, action detection",

author = "S. Harrigan and S. Colman and D. Kerr and P. Yogarajah and Z. Fang and C. Wu",

year = "2019",

month = jan,

day = "1",

doi = "10.21427/sa6d-fd08",

language = "English",

note = "IMVIP 2019: Irish Machine Vision \& Image Processing ; Conference date: 28-08-2019 Through 30-08-2019",

}

TY - CONF

T1 - Neuromorphic Event-based Action Recognition

AU - Harrigan, S.

AU - Colman, S.

AU - Kerr, D.

AU - Yogarajah, P.

AU - Fang, Z.

AU - Wu, C.

PY - 2019/1/1

Y1 - 2019/1/1

N2 - An action can be viewed as spike trains or streams of events when observed and captured by neuromorphic imaging hardware such as the iniLabs DVS128. These streams are unique to each action enabling them to be used to form descriptors. This paper describes an approach for detecting specific actions based on space-time template matching by forming such descriptors and using them as comparative tools. The developed approach is used to detect symbols from the popular RoShambo (rock, paper and scissors) game. The results demonstrate that the developed approach can be used to correctly detect the motions involved in producing RoShambo symbols.

AB - An action can be viewed as spike trains or streams of events when observed and captured by neuromorphic imaging hardware such as the iniLabs DVS128. These streams are unique to each action enabling them to be used to form descriptors. This paper describes an approach for detecting specific actions based on space-time template matching by forming such descriptors and using them as comparative tools. The developed approach is used to detect symbols from the popular RoShambo (rock, paper and scissors) game. The results demonstrate that the developed approach can be used to correctly detect the motions involved in producing RoShambo symbols.

KW - spike trains

KW - streams of events

KW - neuromorphic imaging hardware

KW - iniLabs DVS128

KW - space-time template matching

KW - descriptors

KW - RoShambo

KW - rock paper scissors

KW - action detection

U2 - 10.21427/sa6d-fd08

DO - 10.21427/sa6d-fd08

M3 - Paper

T2 - IMVIP 2019: Irish Machine Vision & Image Processing

Y2 - 28 August 2019 through 30 August 2019

ER -

Neuromorphic Event-based Action Recognition

Abstract

Conference

Keywords

Access to Document

Fingerprint

Cite this