Publications

Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Surfaces

arXiv

Neural signed distance functions (SDFs) are emerging as an effective representation for 3D shapes. State-of-the-art methods typically …
PDF Project
Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Surfaces

UniCon: Universal Neural Controller For Physics-based Character Motion

UniCon

The field of physics-based animation is gaining importance due to the increasing demand for realism in video games and films, and has …
PDF Project Video
UniCon: Universal Neural Controller For Physics-based Character Motion

Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research

Pytorch Library

Kaolin is a PyTorch library aiming to accelerate 3D deep learning research. Kaolin provides efficient implementations of differentiable …
PDF Code Project
Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Research

Variational Amodal Object Completion

NeurIPS 2020

PDF

Learning Deformable Tetrahedral Meshes for 3D Reconstruction

NeurIPS 2020

3D shape representations that accommodate learning-based 3D reconstruction are an open problem in machine learning and computer …
PDF Code Project Video
Learning Deformable Tetrahedral Meshes for 3D Reconstruction

Ultrahyperbolic Representation Learning

NeurIPS 2020

In machine learning, data is usually represented in a (flat) Euclidean space where distances between points are along straight lines. …
PDF Code
Ultrahyperbolic Representation Learning

Federated Simulation or Medical Imaging

MICCAI 2020 (Nominated for the Young Scientist Award)

Labelling data is expensive and time consuming especially for domains such as medical imaging that contain volumetric imaging data and …
PDF Project
Federated Simulation or Medical Imaging

Meta-Sim2: Unsupervised Learning of Scene Structure for Synthetic Data Generation

ECCV 2020

Procedural models are being widely used to synthesize scenes for graphics, gaming, and to create (labeled) synthetic datasets for ML. …
PDF Project

Lift, Splat, Shoot: Encoding Images from Arbitrary Camera Rigs by Implicitly Unprojecting to 3D

ECCV 2020

The goal of perception for autonomous vehicles is to extract semantic representations from multiple sensors and fuse these …
PDF Code Project Video

Learning to Simulate Dynamic Environments with GameGAN

CVPR 2020

Simulation is a crucial component of any robotic system. In order to simulate correctly, we need to write complex rules of the …
PDF Project Video
Learning to Simulate Dynamic Environments with GameGAN

Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer

NeurIPS 2019

Many machine learning models operate on images, but ignore the fact that images are 2D projections formed by 3D geometry interacting …
PDF Code Project Video
Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer

Neural Turtle Graphics for Modeling City Road Layouts

ICCV 2019 (Oral)

We propose Neural Turtle Graphics (NTG), a novel gen- erative model for spatial graphs, and demonstrate its ap- plications in modeling …
PDF Project Video
Neural Turtle Graphics for Modeling City Road Layouts

Meta Sim: Learning to Generate Synthetic Datasets

ICCV 2019 (Oral)

Training models to high-end performance requires availability of large labeled datasets, which are expensive to get. The goal of our …
PDF Code Project
Meta Sim: Learning to Generate Synthetic Datasets

Gated-SCNN Gated Shape CNNs for Semantic Segmentation

ICCV 2019

Current state-of-the-art methods for image segmentation form a dense image representation where the color, shape and texture …
PDF Code Project
Gated-SCNN Gated Shape CNNs for Semantic Segmentation

Devil is in the Edges: Learning Semantic Boundaries from Noisy Annotations

CVPR 2019 (Oral)

We tackle the problem of semantic boundary prediction, which aims to identify pixels that belong to object(class) boundaries. We notice …
PDF Code Project
Devil is in the Edges: Learning Semantic Boundaries from Noisy Annotations