NSF CAREER Project: Spectral Deformable Models: Theory and Applications

Award Number: IIS-1149737
Duration: Sep 1, 2012 - Aug 31, 2018
Award Title: CAREER: Spectral Deformable Models: Theory and Applications
PI: Xiaohu Guo 
 
Students:
  • Yang Liu (PhD, graduated in 2012, now Senior Software Engineer at Facebook)
  • Yin Yang (PhD, graduated in 2013, now Assistant Professor at University of New Mexico)
  • Zichun Zhong (PhD, graduated in 2014, now Assistant Professor at Wayne State University)
  • Liang Shuai (PhD, graduated in 2014, now Senior Software Engineer at Apple)
  • Yiqi Cai (PhD, graduated in 2016, now Software Engineer at Google)
  • Yuan Tian (PhD candidate)
  • Chao Wang (PhD candidate)
  • Saifeng Ni (PhD candidate)
  • Chao Li (PhD candidate)
  • Zachary Adams (BS, graduated in 2013, now Software Engineer at Kasling Aircraft Company)
  • Brandon Stevens (BS, graduated in 2015, now Software Engineer at Computer Human Interaction, LLC)
  • Daren Cheng (BS, graduated in 2016, now MS in software engineering at UTD)
 
Collaborators:
  • Balakrishnan Prabhakaran, University of Texas at Dallas. The collaboration is focused on Streaming of Deformable Models over Networks.
  • Thomas Campbell, University of Texas at Dallas. The collaboration is focused on Deformable Tongue Visualization.
  • Weihua Mao, University of Texas Southwestern Medical Center. The collaboration is focused on Deformable Registration of Medical Images.
  • Weiwei Xu, Hangzhou Normal University. The collaboration is focused on Multi-Domain Subspace Deformation.
  • Wenping Wang, The University of Hong Kong. The collaboration is focused on Mesh Generation.
  • Ziying Tang, Towson University. The collaboration is focused on Distributed Haptic Interactions with Deformable Models over Networks.
  • Jinxiang Chai, Texas A&M University. The collaboration is focused on Motion Capture from Multiple Depth Cameras.
 
Project Goals:

With the popularity of real-time 3D/4D data capturing capabilities, there is an emerging need to compute the deformable models over the networks. Traditional model-driven deformable models have their bottlenecks since the spatial information for large-scale datasets cannot be efficiently solved and adaptively minimized over different network conditions. This project centers on the concept of spectrum-driven deformable models. Analogous to Fourier analysis being applied to image processing, the spectral deformable models employ manifold harmonics to efficiently and effectively perform segmentation, registration, physics-based simulation, compression, and streaming of 3D deformable surfaces and volumes. In this project, manifold harmonics are used to transform arbitrary scanned datasets into a reduced diffusion subspace, in which real-time segmentation, registration, and physics-based simulation can be performed. Besides the stretching deformations, the rotational and tensor fields are encoded with manifold harmonics, which provides a "spectral multiresolution" structure to compress and stream deformable models over different network conditions.

 

Publications:

  1. Lei Lan, Junfeng Yao, Ping Huang, Xiaohu Guo, "Medial-Axis-Driven Shape Deformation with Volume Preservation", in The Visual Computer, Vol. 33, Issue 6-8, pp. 789-800, 2017.
  2. Saifeng Ni, Zichun Zhong, Yang Liu, Wenping Wang, Zhonggui Chen, Xiaohu Guo, "Sliver-Suppressing Tetrahedral Mesh Optimization with Gradient-Based Shape Matching Energy", in Computer Aided Geometric Design, Vol. 52-53, pp. 247-261, 2017.
  3. Chao Wang, Xiaohu Guo, "Feature-Based RGB-D Camera Pose Optimization for Real-Time 3D Reconstruction", in Computational Visual Media, Vol. 3, Issue 2, pp. 95-106, 2017.
  4. Yiqi Cai, Xiaohu Guo, "Anisotropic Superpixel Generation Based on Mahalanobis Distance", in Computer Graphics Forum, Vol. 35, Issue 7, pp. 199-207, 2016.
  5. Liang Shuai, Chao Li, Xiaohu Guo, Balakrishnan Prabhakaran, Jinxiang Chai, "Motion Capture with Ellipsoidal Skeleton using Multiple Depth Cameras", in IEEE Transactions on Visualization and Computer Graphics, Vol. 23, No. 2, pp. 1085-1098, 2017.
  6. Zichun Zhong, Xiaohu Guo, Yiqi Cai, Yin Yang, Jing Wang, Xun Jia, Weihua Mao, "3D-2D Deformable Image Registration Using Feature-Based Non-uniform Meshes", in BioMed Research International, Vol. 2016, Article ID 4382854, 2016.
  7. Pan Li, Bin Wang, Feng Sun, Xiaohu Guo, Caiming Zhang, Wenping Wang, "Q-MAT: Computing Medial Axis Transform Using Quadratic Error Minimization", in ACM Transactions on Graphics, Vol. 35, Issue 1, Article No. 8, 2015.
  8. Virendra Mishra, Xiaohu Guo, Mauricio R Delgado, Hao Huang, "Towards Tract-Specific Fractional Anisotropy (TSFA) at Crossing-Fiber Regions with Clinical Diffusion MRI", in Magnetic Resonance in Medicine, Vol. 74, No. 6, pp. 1768-1779, 2015.
  9. Joubin Nasehi Tehrani, Yin Yang, René Werner, Wei Lu, Daniel Low, Xiaohu Guo, Jing Wang, "Sensitivity of Tumor Motion Simulation Accuracy to Lung Biomechanical Modeling Approaches and Parameters", in Physics in Medicine and Biology, Vol. 60, No. 22, pp. 8833-8849, 2015.
  10. Shuiqing He, Yi-King Choi, Yanwen Guo, Xiaohu Guo, Wenping Wang, "A 3D Shape Descriptor based on Spectral Analysis of Medial Axis", in Computer Aided Geometric Design, Vol. 39, pp. 50-66, 2015.
  11. Yue Xie, Weiwei Xu, Yin Yang, Xiaohu Guo, Kun Zhou, "Agile Structure Analysis for Fabrication-Aware Shape Editing", in Computer Aided Geometric Design (GMP 2015 Special Issue), Vol. 35-36, pp. 163-179, 2015.
  12. Chao Wang, Yang Liu, Xiaohu Guo, Zichun Zhong, Binh Le, Zhigang Deng, "Spectral Animation Compression", in Journal of Computer Science and Technology (CVM 2015 Special Issue), Vol. 30, No. 3, pp. 540-552, 2015.
  13. Yuan Tian, Yin Yang, Xiaohu Guo, Balakrishnan Prabhakaran, "Stable Haptic Interaction Based on Adaptive Hierarchical Shape Matching", in Computational Visual Media, Vol. 1, No. 3, pp. 253-265, 2015.
  14. Yiqi Cai, Xiaohu Guo, Zichun Zhong, Weihua Mao, "Dynamic Meshing for Deformable Image Registration", in Computer-Aided Design (SPM 2014 Special Issue), Vol. 58, pp. 141-150, 2015
  15. Zhichao Huang, Junfeng Yao, Zichun Zhong, Yang Liu, Xiaohu Guo, "Sparse Localized Decomposition of Deformation Gradients", in Computer Graphics Forum (PG 2014 Special Issue), Vol. 33, No. 7, pp. 239-248, 2014.
  16. Ziying Tang, Yin Yang, Xiaohu Guo, Balakrishnan Prabhakaran, "Distributed Haptic Interactions with Physically-Based 3D Deformable Models over Lossy Networks," in IEEE Transactions on Haptics, Vol. 6, No. 4, pp. 417-428, 2013.
  17. Zichun Zhong, Xiaohu Guo, Wenping Wang, Bruno Levy, Feng Sun, Yang Liu, Weihua Mao, "Particle-Based Anisotropic Surface Meshing," in ACM Transactions on Graphics (Proceedings of SIGGRAPH), Vol. 32, No. 4, Article No. 99, 2013.
  18. Yin Yang, Weiwei Xu, Xiaohu Guo, Kun Zhou, Baining Guo, "Boundary-Aware Multi-Domain Subspace Deformation," in IEEE Transactions on Visualization and Computer Graphics, Vol. 19, No. 10, pp. 1633-1645, 2013.
  19. Yin Yang, Xiaohu Guo, Jennell Vick, Luis Torres, Thomas Campbell, "Physics-Based Deformable Tongue Visualization," in IEEE Transactions on Visualization and Computer Graphics, Vol. 19, No. 5, pp. 811-823, 2013.
  20. Yin Yang, Zichun Zhong, Xiaohu Guo, Jing Wang, John Anderson, Timothy Solberg, Weihua Mao, "A Novel Markerless Technique to Evaluate Daily Lung Tumor Motion Based on Conventional Cone-Beam CT Projection Data," in International Journal of Radiation Oncology Biology Physics, Vol. 82, No. 5, pp. e749-e756, 2012.
  21. Yang Liu, Balakrishnan Prabhakaran, Xiaohu Guo, "Spectral Watermarking for Parameterized Surfaces," in IEEE Transactions on Information Forensics and Security, Vol. 7, No. 5, pp. 1459-1471, 2012.
  22. Yang Liu, Balakrishnan Prabhakaran, Xiaohu Guo, "Point-Based Manifold Harmonics," in IEEE Transactions on Visualization and Computer Graphics, Vol. 18, No. 10, pp. 1693-1703, 2012.
 
Presentations:
  • "Physics-Based Multi-Domain Subspace Deformation", in Department of Computer Science, The University of Hong Kong, Hong Kong, August 20, 2013.
  • "Physics-Based Multi-Domain Subspace Deformation", in Department of Computer Science, Texas A&M University, College Station, TX, March 18, 2013.
 
Software and Source Code Downloads:
  • We have released the source code of our TVCG paper "Point-Based Manifold Harmonics":
 
Point of Contact: Xiaohu Guo ([email protected])
 

 

Acknowledgement:

This material is based upon work supported by the National Science Foundation under Grant No. IIS-1149737.

 
Disclaimer:

Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.


Last Update: July 4, 2017