Skip to content
Research Interests
Patents
Computer-implemented method and apparatus for tracking and reshaping a human shaped figure in a digital world video US9191579 B2 (2011) Method for Identifying a Hand Pose in a Vehicle WO2020048814 (2019) System and method for deployment of airbag based on head pose estimation INA201911039220 (2021) Method and system for triggering an event in a vehicle INA201941043899 (2021) Method and System for Triggering an Event in a Vehicle EP3895064 (2023)
Education
Profession
September 2015 – Present Founder and CEO, Fast Code AI Consult Pvt. Ltd. , Bangalore, India March 2021 – Present Founder and Chief Scientist, UAVIO Labs Pvt. Ltd. , Bangalore, India January 2020 – PresentAdjunct Faculty at the CDS Dept. , IISc Bangalore Dec 2016 – May 2019Adjunct Assistant Professor at CSE Dept., IIT Bombay Nov 2015 – Present Co-founder at Perceptive Code , CA., USA July 2015 – Nov 2015 Researcher at SPG, Apple, Cupertino March 2013 – Feb 2015 Post-doc at Courant Institute, NYU with Chris Bregler and Yann LeCun Feb 2011 – May 2011 Research Intern at Weta Digital , Wellington, New Zealand Feature film credits: The Adventures of Tintin(2011) – R & D Developer October 2007 – August 2008 Research Assistant at Media Integration and Communication Center (MICC) , University of Florence, Florence, Italy September 2006 – September 2007 Software Developer at Yahoo India R & D , Bangalore, India July 2005 – August 2006 Software Developer at Pi Corporation (now Decho ), Bangalore, India
Teaching
Alumni
Former MS/BS Students and Visitors
Nehal Doiphode (2017-2018), now PhD student at UPennUday Kasupati (2017-2018), now PhD student at EPFLShubham Goel (2017-2018), now PhD student at UC BerkeleySaurabh Sharma (2017-2018), now PhD student at UC Santa BarbaraAnurag Mundahada (2017-2019), now Co-founder at Insane.ai Nitesh Bharadwaj Gundavarapu (2018-2019), now Machine Learning/Data Scientist at Apple IncNaman Jain (2018-2019), now PhD student at UC BerkleyRohit Jena (2018-2019), now PhD student at UPennSahil Shah (2018-2019), now Strategist at Tower Research CapitalPavan Teja (2017-2020), now masters student at University of TubingenDivyansh (2018-2019), now PhD student at UC San DiegoJai Doshi (2021), now at Google India
Publications
A. Agarwal, R. Dabral, A. Jain, G. Ramakrishnan, “Skew-Robust Human-Object Interactions in Videos,” in Proc. of Winter Conference on Applications of Computer Vision (WACV 2023) , Hawaii, 2023.Link R. Dabral, S. Shimada, A. Jain C. Theobalt, and V. Golyanik, “Gravity-Aware 3D Human-Object Reconstruction” in Proc. of International Conference of Computer Vision (ICCV 2021 ), Virtual, October 2021.Link C. Kumar, J. Ramesh, B. Chakraborty, R. Raman, C. Weinrich, A. Mundhada, A. Jain, F. Flohr , “VRU Pose-SSD: Multiperson Pose Estimation For Automated Driving” in proceedings of Innovative Applications of Artificial Intelligence (IAAI 2021) , Virtual, February 2021.PDF R. Mitra, N. B. Gundavarapu, A. Sharma, A. Jain, “Multiview-Consistent Semi-Supervised Learning for 3D Human Pose Estimation” in proceedings of Conference on Computer Vision and Pattern Recognition (CVPR 2020) , Seattle, June 2020.Link | PDF V. Gupta, S. K. Dwivedi, R. Dabral, A. Jain, “Progression Modelling for Online and Early Gesture Detection” in proceedings of International Conference on 3D Vision (3DV 2019 Oral) , Québec City, September 2019.Link | PDF | Slides R. Dabral, N. B. Gundavarapu, R. Mitra, A. Sharma, G. Ramakrishnan, A. Jain, “Multi-Person 3D Human Pose Estimation from Monocular Images” in proceedings of International Conference on 3D Vision (3DV 2019) , Québec City, September 2019.Link | PDF | Slides S. K. Dwivedi, V. Gupta, R. Mitra, S. Ahmed, A. Jain, “ProtoGAN: Towards Few Shot Learning for Action Recognition” in proceedings of ICCV Workshop on Multi-Discipline Approach for Learning Concepts – Zero-Shot, One-Shot, Few-Shot and Beyond (ICCV Workshop 2019) , Seoul, October 2019.Link S. Sharma, P. T. Varigonda, P. Bindal, A. Sharma, A. Jain, “Monocular 3D Human Pose Estimation by Generation and Ordinal Ranking” in proceedings of International Conference on Computer Vision (ICCV 2019) , Seoul, October 2019.Link | Code | Poster N. Jain, S. Shah, A. Sharma, A. Jain, “On the Robustness of Human Pose Estimation” in proceedings of CVPR Workshop on Augmented Human Humancentric Understanding and 2D/3D Synthesis (CVPR Workshop 2019) , Long Beach, June 2019.PDF N. B. Gundavarapu, D. Srivastava, R. Mitra, A. Sharma, A. Jain, “Structured Aleatoric Uncertainty in Human Pose Estimation” in proceedings of CVPR Workshop on Uncertainty and Robustness in Deep Visual Learning (CVPR Workshop 2019) , Long Beach, June 2019.Link N. Doiphode, R. Mitra, S. Ahmed, A. Jain, “An Improved Learning Framework for Covariant Local Feature Detection” in proceedings of Asian Conference on Computer Vision (ACCV 2018) , Perth, December 2018Link | PDF R. Dabral, A. Mundhada, U. Kusupati, S. Afaque, A. Sharma, A. Jain, “Learning 3D Human Pose from Structure and Motion”, in proceedings of European Conference on Computer Vision (ECCV 2018) , Munich, September 2018.PDF | Video | Project R. Mitra, N. Doiphode, U. Gautam, S. Narayan, S. Ahmed, S. Chandran, A. Jain, “A Large Dataset for Improving Patch Matching” in (arXiv e-prints 2017) .Link | Code R. Mitra, J. Zhang, S. Narayan, S. Ahmed, S. Chandran, A. Jain, “Improved Descriptors for Patch Matching and Reconstruction” in proceedings of ICCV Workshop on Compact and Efficient Feature Representation and Learning (CEFRL) (ICCV Workshop 2017) , Venice, October 2017. Theano Development Team, “Theano: A Python framework for fast computation of mathematical expressions” in (arXiv e-prints) , 2016.PDF A. Elhayek, E. Aguiar, A. Jain, J. Tompson, L. Pishchulin, M. Andriluka, C. Bregler, B. Schiele and C.Theobalt, “MARCOnI – ConvNet-based MARker-less Motion Capture in Outdoor and Indoor Scenes” in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2016) , 2016. A. Jain, C. Chen, T. Thormählen, D. Metaxas, H.-P. Seidel, “Multi-Layer Stencil Creation from Images” in Computers & Graphics (C & G 2015) , January 2015.Link | Project A. Elhayek, E. Aguiar, A. Jain, J. Tompson, L. Pishchulin, M. Andriluka, C. Bregler, B. Schiele C. Theobalt, “Efficient ConvNet-based Marker-less Motion Capture in General Scenes with a Low Number of Cameras”, in proceedings of Conference on Computer Vision and Pattern Recognition (CVPR 2015) , Boston, June 2015.PDF | Website | Video J. Tompson, R. Goroshin, A. Jain, Y. LeCun, C. Bregler, “Efficient Object Localization Using Convolutional Networks”, in proceedings of Conference on Computer Vision and Pattern Recognition (CVPR 2015) , Boston, June 2015.PDF A. Jain, J. Tompson, Y. LeCun, C. Bregler, “Modeep: A Deep Learning Framework Using Motion Features for Human Pose Estimation” in proceedings of Asian Conference on Computer Vision (ACCV 2014) , Singapore, November 2014.PDF | Data J. Tompson, A. Jain, Y. LeCun, C. Bregler, “Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimation” in proceedings of Neural Information Processing Systems (NIPS 2014) , Montreal, Canada, December 2014.Link A. Jain, J. Tompson, M. Andriluka, G. W. Taylor, C. Bregler, “Learning Human Pose Estimation Features with Convolutional Networks” in proceedings of International Conference on Learning Representations 2014 (ICLR 2014) , Banff, Canada, April 2014.Link | Code | Poster A. Jain, T. Thormählen, T. Ritschel, and H.-P. Seidel, “Material Memex: Automatic Material Suggestions for 3D Objects” in ACM Transactions on Graphics (TOG), ACM SIGGRAPH Asia 2012 papers (SIGGRAPH Asia 2012) , Singapore, December 2012.PDF | Website | Video L. Pishchulin, A. Jain, M. Andriluka, T. Thormählen and B. Schiele, “Articulated People Detection and Pose Estimation: Reshaping the Future” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2012) , Rhode Island, USA, 2012.Link | Website A. Jain, T. Thormählen, T. Ritschel, H.-P. Seidel, Exploring Shape Variations by 3D-Model Decomposition and Part-based Recombination, Comput. Graph. Forum, Volume 31, Issue 2 , (Eurographics 2012) , Cagliari, Italy, (2012).PDF | Website | Video L. Pishchulin, A. Jain, C. Wojek, T. Thormählen and B. Schiele, In Good Shape: Robust People Detection based on Appearance and Shape in 22nd British Machine Vision Conference (BMVC 2011) , Dundee, UK, (2011) (Oral ).PDF | Website L. Pishchulin, A. Jain, C.Wojek, M. Andriluka, T. Thormählen, and B. Schiele, Learning people detection models from few training samples in proceedings of Computer Vision and Pattern Recognition (CVPR 2011) , Colorado Springs, USA, 2011.Link | Website A. Jain, T. Thormählen, H.-P. Seidel, and C. Theobalt, “MovieReshape: Tracking and Reshaping of Humans in Videos” in ACM Transactions on Graphics (TOG), ACM SIGGRAPH Asia 2010 papers, Volume 29, Issue 5 (SIGGRAPH Asia 2010) , Seoul, South Korea, December 2010.Link | Website | Video A. Jain, C. Kurz, T. Thormählen, H.-P. Seidel, “Exploiting Global Connectivity Constraints for Reconstruction of 3D Line Segment from Images” in IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2010) , San Francisco, California, June 2010.PDF | Website L. Ballan, M. Bertini, A. Del Bimbo, and A. Jain (alphabatical order), “Automatic Trademark Detection and Recognition in Sport Videos,” in Proc. of IEEE Int.l Conference on Multimedia & Expo (ICME 2008) , Hannover, Germany, 2008.PDF | Website L. Ballan, M. Bertini, and A. Jain (alphabatical order), “A System for Automatic Detection and Recognition of Advertising Trademarks in Sports Videos,” in Proc. of ACM Int.l Conference on Multimedia (MM 2008) , Vancouver, BC, Canada, 2008.PDF | Video