[Back]

C. Pramerdorfer, J. Strohmayer, M. Kampel:
"Sdt: A Synthetic Multi-Modal Dataset For Person Detection And Pose Classification";
in: "2020 IEEE International Conference on Image Processing (ICIP)", 1; issued by: IEEE Signal Processing Society; IEEE, Abu Dhabi, 2020, ISBN: 978-1-7281-6395-6, 1611 - 1615.

Depth and thermal sensors are well-suited for computer vision applications that involve the continuous monitoring of people, particularly in combination. Yet there is limited research in this field and a lack of available datasets. We present a method for creating synthetic but realistic depth and thermal images that include sensor noise. We utilize this method to create the SDT dataset, which contains 40k image pairs including labels for person detection and pose classification, and is publicly available. To assess the quality our image synthesis method and the utility of SDT, we train CNNs for classification on the SDT dataset and evaluate them on real data. The CNNs achieve accuracies up to 98%, highlighting their ability to generalize from synthetic to real data.

Thermal sensors;Image sensors;Sensor phenomena and characterization;Rendering (computer graphics);Surface morphology;Image generation;Data fusion;image synthesis;3D processing;thermal data processing;deep learning

http://dx.doi.org/10.1109/ICIP40778.2020.9191284