Applying Multiple Kinect on the Development of a Rapid 3D Mannequin Scan Platform

Authors: Shih-Wen Hsiao, Yi-Cheng Tsao

Abstract:

In the field of reverse engineering and creative industries, applying 3D scanning process to obtain geometric forms of the objects is a mature and common technique. For instance, organic objects such as faces and nonorganic objects such as products could be scanned to acquire the geometric information for further application. However, although the data resolution of 3D scanning device is increasing and there are more and more abundant complementary applications, the penetration rate of 3D scanning for the public is still limited by the relative high price of the devices. On the other hand, Kinect, released by Microsoft, is known for its powerful functions, considerably low price, and complete technology and database support. Therefore, related studies can be done with the applying of Kinect under acceptable cost and data precision. Due to the fact that Kinect utilizes optical mechanism to extracting depth information, limitations are found due to the reason of the straight path of the light. Thus, various angles are required sequentially to obtain the complete 3D information of the object when applying a single Kinect for 3D scanning. The integration process which combines the 3D data from different angles by certain algorithms is also required. This sequential scanning process costs much time and the complex integration process often encounter some technical problems. Therefore, this paper aimed to apply multiple Kinects simultaneously on the field of developing a rapid 3D mannequin scan platform and proposed suggestions on the number and angles of Kinects. In the content, a method of establishing the coordination based on the relation between mannequin and the specifications of Kinect is proposed, and a suggestion of angles and number of Kinects is also described. An experiment of applying multiple Kinect on the scanning of 3D mannequin is constructed by Microsoft API, and the results show that the time required for scanning and technical threshold can be reduced in the industries of fashion and garment design.

Keywords: 3D scan, depth sensor, fashion and garment design, mannequin, multiple kinect sensor.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1125151

References:

[1] Rodrigo Ibañez, Álvaro Soria, Alfredo Teyseyre, Marcelo Campo, “Easy gesture recognition for Kinect,” Advances in Engineering Software, Volume 76, 2014, Pages 171-180.
[2] Andrea Sanna, Fabrizio Lamberti, Gianluca Paravati, Federico Manuri, “A Kinect-based natural interface for quadrotor control,” Entertainment Computing, Volume 4, Issue 3, 2013, Pages 179-186.
[3] Koji Yamaoka, Masataka Uehara, Takeshi Shima, Yasuhisa Tamura, “Feedback of Flying Disc Throw with Kinect and its Evaluation,” Procedia Computer Science, Volume 22, 2013, Pages 912-920.
[4] Jose Antonio Diego-Mas, Jorge Alcaide-Marzal, “Using Kinect sensor in observational methods for assessing postures at work,” Applied Ergonomics, Volume 45, Issue 4, 2014, Pages 976-985.
[5] L.C. Ebert, G. Hatch, M.J. Thali, S. Ross, “Invisible touch—Control of a DICOM viewer with finger gestures using the Kinect depth camera,” Journal of Forensic Radiology and Imaging, Volume 1, Issue 1, 2013, Pages 10-14.
[6] Journal of Forensic Radiology and Imaging, Volume 1, Issue 1, 2013, Pages 10-14.
[7] João Gameiro, Tiago Cardoso, Yves Rybarczyk, “Kinect-Sign, Teaching sign language to “listeners” through a game,” Procedia Technology, Volume 17, 2014, Pages 384-391.
[8] Benjamin F. Mentiplay, Luke G. Perraton, Kelly J. Bower, Yong-Hao Pua, Rebekah McGaw, Sophie Heywood, Ross A. Clark, “Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables,” Journal of Biomechanics, Volume 48, Issue 10, 2015, Pages 2166-2170.
[9] Sharon Nissimov, Jacob Goldberger, Victor Alchanatis, “Obstacle detection in a greenhouse environment using the Kinect sensor,” Computers and Electronics in Agriculture, Volume 113, 2015, Pages 104-115.
[10] Jørgen Kongsro, “Estimation of pig weight using a Microsoft Kinect prototype imaging system,” Computers and Electronics in Agriculture, Volume 109, 2014, Pages 32-35.
[11] Sophia Stavrakakis, Wei Li, Jonathan H. Guy, Graham Morgan, Gary Ushaw, Garth R. Johnson, Sandra A. Edwards, “Validity of the Microsoft Kinect sensor for assessment of normal walking patterns in pigs,” Computers and Electronics in Agriculture, Volume 117, 2015, Pages 1-7.
[12] Hamed Sarbolandi, Damien Lefloch, Andreas Kolb,” Kinect range sensing: Structured-light versus Time-of-Flight Kinect,” Computer Vision and Image Understanding, Volume 139, 2015, Pages 1-20.
[13] Ricardo Alves, Aldric Negrier, Luís Sousa, João M.F. Rodrigues, Paulo Felisberto, Miguel Gomes, Paulo Bica, “Interactive 180◦ Rear Projection Public Relations,” Procedia Computer Science, Volume 51, 2015, Pages 592-601.
[14] C.K. Au, M.M.F. Yuen, “Feature-based reverse engineering of Mannequin for garment design,” Computer-Aided Design, Volume 31, Issue 12, 1999, Pages 751-759.
[15] C.K. Au, M.M.F. Yuen, “A semantic feature language for sculptured object modelling,” Computer-Aided Design, Volume 32, Issue 1, 2000, Pages 63-74.
[16] Sung Min Kim, Tae Jin Kang, “Garment pattern generation from body scan data,” Computer-Aided Design, Volume 35, Issue 7, 2003, Pages 611-618.
[17] Charlie C.L. Wang, Terry K.K. Chang, Matthew M.F. Yuen,” From laser-scanned data to feature human model: a system based on fuzzy logic concept,” Computer-Aided Design, Volume 35, Issue 3, 2003, Pages 241-253.
[18] Charlie C.L. Wang, Yu Wang, Terry K.K. Chang, Matthew M.F. Yuen,” Virtual human modeling from photographs for garment industry,” Computer-Aided Design, Volume 35, Issue 6, 2003, Pages 577-589.
[19] Charlie C.L. Wang, “Parameterization and parametric design of mannequins,” Computer-Aided Design, Volume 37, Issue 1, 2005, Pages 83-98.
[20] Charlie C.L. Wang, Yu Wang, Matthew M.F. Yuen, “Feature based 3D garment design through 2D sketches,” Computer-Aided Design, Volume 35, Issue 7, 2003, Pages 659-672.
[21] Charlie C.L. Wang, Yu Wang, Matthew M.F. Yuen, “Design automation for customized apparel products,” Computer-Aided Design, Volume 37, Issue 7, 2005, Pages 675-691.
[22] Jin Wang, Guodong Lu, Weilong Li, Long Chen, Yoshiyuki Sakaguti, “Interactive 3D garment design with constrained contour curves and style curves,” Computer-Aided Design, Volume 41, Issue 9, 2009, Pages 614-625.
[23] Yinling Ke, Shuqian Fan, Weidong Zhu, An Li, Fengshan Liu, Xiquan Shi, “Feature-based reverse modeling strategies,” Computer-Aided Design, Volume 38, Issue 5, 2006, Pages 485-506.
[24] Yinglin Ke, Weidong Zhu, Fengshan Liu, Xiquan Shi, “Constrained fitting for 2D profile-based reverse modeling,” Computer-Aided Design, Volume 38, Issue 2, 2006, Pages 101-114.
[25] Carlos F. Borges, Tim Pastva, “Total least squares fitting of Bézier and B-spline curves to ordered data,” Computer Aided Geometric Design, Volume 19, Issue 4, 2002, Pages 275-289.
[26] Huaiping Yang, Wenping Wang, Jiaguang Sun, “Control point adjustment for B-spline curve approximation,” Computer-Aided Design, Volume 36, Issue 7, 2004, Pages 639-652.
[27] Shih-Wen Hsiao, Jiun-Chau Chuang, “A reverse engineering based approach for product form design,” Design Studies, Volume 24, Issue 2, 2003, Pages 155-171.
[28] KC Hui, Yadong Li, “A feature-based shape blending technique for industrial design,” Computer-Aided Design, Volume 30, Issue 10, 1998, Pages 823-834.
[29] Shih-Wen Hsiao, Rong-Qi Chen, “A study of surface reconstruction for 3D mannequins based on feature curves,” Computer-Aided Design, Volume 45, Issue 11, 2013, Pages 1426-1441.