About

Hi! I am currently a senior at IIIT Naya Raipur, India.
My research interests are in domains of Computer Graphics and Vision, human-motion generation with multimodal queues and most recently, 3D data (reconstruction and neural rendering). As a research intern under the guidance of Dr. Aniket Bera at Purdue University and Dr. Bhattacharya from Adobe Research, San Jose, I am currently working on problems in the domain of human-motion generation.
I have previously worked as a research intern under the guidance of Dr. Jayanta Mukhopadhyay at the Indian Institute of Technology, Kharagpur in the domain of HCI and Computer Vision, specifically in the understanding of human cognitive processes using egocentric videos and their corresponding eye-tracker gaze data.

Recent Accomplishments

March 2023

Scholarship
Received a scholarship of 5 Lakh INR (6100 USD) from IIIT Naya Raipur to pursue research at Purdue University

July 2022

Best Paper Award
IEEE ISCC - ICTS4eHealth 2022

Febuary 2022

Paper Accepted
IEEE ICIP
2022

October 2021

Winner
Ernst and Young GDS Hackpions 3.0

Education

Bachelor of Technology (Ongoing)

Dr. S. P. Mukherjee International Institute of Information Technology, Naya Raipur

CGPA: 9.21/10 (as of semester 7)

Internship Experience

Purdue University, USA

Mentor: Dr. Aniket Bera

August 2022 - Current

  • Research intern: Human-motion generation with multimodal queues:
    • BevGen: Bird's eye view map generation for an ego-vehicle provided multiple surrounding camera views using VQ-Diffusion/Stable-Diffusion - PyTorch, NuScenes, Torchvision
    • Text2AffectiveMotions: Text prompt controllable and emotion-affect editable 3D human body motion generation using VQ-VAE Guided Diffusion - PyTorch, SMPL, CLIP
    • Speech2AffectiveFaces: Affective and realistic facial expression and plausible lip movement generation for 3D faces (PCDs) corresponding to given speech audio inputs using VQ-VAE Transformers - PyTorch, Open3D, Torchaudio, Wav2Vec2.
    • DanceAnyWay: Synthesizing Mixed-Genre 3D Dance Movements Through Beat Disentanglement: Synthesizing mixed-genre dance movements of 3D human characters synchronized with music tracks using LSTM/Transformer GANs - PyTorch, SMPL, OpenCV, Librosa, 3D Pose Estimation

L&T Technology Services

Supervisor: Mr. Rajeswaran Chellapandi

May 2022 - July 2022

  • Machine Learning Intern: Developed an end-to-end deep learning system to automate the segmentation, labelling and counting of symbols on P&ID diagrams used in the Oil & Gas industry

Indian Institute of Technology, Kharagpur, India

Mentor: Dr. Jayanta Mukhopadhyay

May 2021 - Febuary 2022

  • Research intern: Worked on 2 projects in understanding the human cognitive processes using egocentric videos and corresponding human gaze data
  • Published at the 29th IEEE International Conference on Image Processing (IEEE ICIP), Bordeaux, France

IIIT, Naya Raipur

Mentor: Dr. Venkanna U.

March 2021 - April 2022

  • Research intern: Applications of machine learning in the domains of Computer Networks and Edge Computing
  • Published works at APCC, IEEE ISCC, IEEE CSNDSP

University of Dayton, USA

Mentor: Dr. Vijayan K. Asari

May 2021 - October 2021

  • Research intern: Developed a wearable system to assist visually impaired persons by detecting obstacles in their surroundings via their smartphone camera and informing them of the same through haptic feedback on different fingers through our developed wearable glove
  • Published at the 50th IEEE Applied Imagery Pattern Recognition Workshop (AIPR), Washington D.C, USA