About
Hi! I am currently a senior at IIIT Naya Raipur, India.
My research interests are in domains of Computer Graphics and Vision, human-motion generation with multimodal queues and most recently, 3D data (reconstruction and neural rendering).
As a research intern under the guidance of Dr. Aniket Bera at Purdue University and Dr. Bhattacharya from Adobe Research, San Jose, I am currently working on problems in the domain of human-motion generation.
I have previously worked as a research intern under the guidance of Dr. Jayanta Mukhopadhyay at the Indian Institute of Technology, Kharagpur in the domain of HCI and Computer Vision, specifically in the understanding of human cognitive processes using egocentric videos and their corresponding eye-tracker gaze data.
Recent Accomplishments
Scholarship
Received a scholarship of 5 Lakh INR (6100 USD) from IIIT Naya Raipur to pursue research at Purdue University
Best Paper Award
IEEE ISCC - ICTS4eHealth 2022
Paper Accepted
IEEE ICIP
2022
Winner
Ernst and Young GDS Hackpions 3.0
Education
Bachelor of Technology (Ongoing)
Dr. S. P. Mukherjee International Institute of Information Technology, Naya Raipur
CGPA: 9.21/10 (as of semester 7)
Internship Experience
Purdue University, USA
Mentor: Dr. Aniket Bera
August 2022 - Current
- Research intern: Human-motion generation with multimodal queues:
- BevGen: Bird's eye view map generation for an ego-vehicle provided multiple surrounding camera views using VQ-Diffusion/Stable-Diffusion - PyTorch, NuScenes, Torchvision
- Text2AffectiveMotions: Text prompt controllable and emotion-affect editable 3D human body motion generation using VQ-VAE Guided Diffusion - PyTorch, SMPL, CLIP
- Speech2AffectiveFaces: Affective and realistic facial expression and plausible lip movement generation for 3D faces (PCDs) corresponding to given speech audio inputs using VQ-VAE Transformers - PyTorch, Open3D, Torchaudio, Wav2Vec2.
- DanceAnyWay: Synthesizing Mixed-Genre 3D Dance Movements Through Beat Disentanglement: Synthesizing mixed-genre dance movements of 3D human characters synchronized with music tracks using LSTM/Transformer GANs - PyTorch, SMPL, OpenCV, Librosa, 3D Pose Estimation
L&T Technology Services
Supervisor: Mr. Rajeswaran Chellapandi
May 2022 - July 2022
- Machine Learning Intern: Developed an end-to-end deep learning system to automate the segmentation, labelling and counting of symbols on P&ID diagrams used in the Oil & Gas industry
Indian Institute of Technology, Kharagpur, India
Mentor: Dr. Jayanta Mukhopadhyay
May 2021 - Febuary 2022
- Research intern: Worked on 2 projects in understanding the human cognitive processes using egocentric videos and corresponding human gaze data
- Published at the 29th IEEE International Conference on Image Processing (IEEE ICIP), Bordeaux, France
IIIT, Naya Raipur
Mentor: Dr. Venkanna U.
March 2021 - April 2022
- Research intern: Applications of machine learning in the domains of Computer Networks and Edge Computing
- Published works at APCC, IEEE ISCC, IEEE CSNDSP
University of Dayton, USA
Mentor: Dr. Vijayan K. Asari
May 2021 - October 2021
- Research intern: Developed a wearable system to assist visually impaired persons by detecting obstacles in their surroundings via their smartphone camera and informing them of the same through haptic feedback on different fingers through our developed wearable glove
- Published at the 50th IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington D.C, USA