I am an Applied Scientist at Amazon where I use LLMs for different usecases. I completed my Masters majoring in Computer Science (Thesis Track) from Arizona State University. My thesis was on “Sample efficiency of Instruction Tuned Models” supervised by Prof. Chitta Baral. I recently interned at Krutrim where I created a multi-lingual 7B foundation model focused on Indic languages. I was responsible for the curation of high quality pre-training data, instruction tuning and evaluation of the model and obtained results comparable with Llama 2 (Media Coverage).

Research

My research interests include Large Language Models, Enhancing Pretraining Corpora, Instruction Tuning, and Direct Preference Optimization. I collaborate with Dr. Swaroop Mishra on topics such as Instruction tuning, Synthetic dataset creation and mathematical reasoning. My strength lies in generating new ideas and I am fortunate to collaborate with a diverse set of awesome researchers through my ideas.

Selected Papers

• InstructABSA: Instruction Learning for Aspect Based Sentiment Analysis
  Kevin Scaria, Himanshu Gupta, Siddharth Goyal, Saurabh Arjun Sawant, Swaroop Mishra, Chitta Baral
  NAACL 2024
  

• “Len or index or count, anything but v1”: Predicting Variable Names in Decompilation Output with Transfer Learning.
  Kuntal Kumar Pal, Ati Priya Bajaj, Pratyay Banerjee, Audrey Dutcher, Mutsumi Nakamura, Zion Leonahenahe Basque, Himanshu Gupta, Saurabh Arjun Sawant, Ujjwala Anantheswaran, Yan Shoshitaishvili, Adam Doupé, Chitta Baral, Ruoyu Wang
  IEEE S&P 2023
  

• A Unified Evaluation Framework for Novelty Detection and Accommodation in NLP with an Instantiation in Authorship Attribution.
  Neeraj Varshney, Himanshu Gupta, Eric Robertson, Bing Liu, Chitta Baral
  ACL 2023
  

• “John is 50 years old, can his son be 65?” Evaluating NLP Models’ Understanding of Feasibility.
  Himanshu Gupta, Neeraj Varshney, Swaroop Mishra, Kuntal Kumar Pal, Saurabh Arjun Sawant, Kevin Scaria, Siddharth Goyal, Chitta Baral
  EACL 2023
  

• Context-NER : Contextual Phrase Generation at Scale
  Himanshu Gupta, Shreyas Verma, Santosh Mashetty, Swaroop Mishra
  NeurIPS ENLSP Workshop 2022
  

• LongBoX: Evaluating Transformers on Long-Sequence Clinical Tasks
  Mihir Parmar, Aakanksha Naik, Himanshu Gupta, Disha Agrawal, Chitta Baral
  preprint
  

• TarGEN: Targeted Data Generation with Large Language Models
  Himanshu Gupta, Kevin Scaria, Ujjwala Anantheswaran, Shreyas Verma, Mihir Parmar, Saurabh Arjun Sawant, Chitta Baral, Swaroop Mishra
  preprint
  

• Instruction Tuned Models are Quick Learners
  Himanshu Gupta, Saurabh Arjun Sawant, Swaroop Mishra, Mutsumi Nakamura, Arindam Mitra, Santosh Mashetty, Chitta Baral
  preprint
  

• EDM3: Event Detection as Multi-task Text Generation.
  Ujjwala Anantheswaran, Himanshu Gupta, Mihir Parmar, Kuntal Kumar Pal, Chitta Baral
  preprint
  

• Please check my google scholar page for all the papers.

News

• 03.2024 Paper accepted at NAACL 2024
• 01.2024 Reached 100 citations
• 12.2023 Joined Amazon as an Applied Scientist
• 12.2023 Graduated from Arizona State University with Distinction
• 09.2023 Reached 50 citations
• 08.2023 Received 1500$ merit scholarship from School of Computing and AI at ASU
• 07.2023 Started 40hr co-op as Applied Scientist at Krutrim
• 06.2023 Paper accepted at ACL 2023
• 05.2023 Started internship at Amazon Alexa
• 01.2022 Started Masters in Computer Science at Arizona State University
• 07.2019 Joined American Express AI Labs as a Research Engineer
• 06.2019 Graduated from BITS Pilani

Education

• 01.2022 - 12.2023 Masters (with Thesis) in Computer Science from Arizona State University
• 08.2015 - 07.2019 B.E. with Hons. in Electrical and Electronics Engineering, BITS Pilani, India

Experience

• 12.2023 - present Applied Scientist at Amazon.
• 08.2023 - 11.2023 40hr co-op as Applied Scientist LLM at Krutrim.
• 05.2023 - 07.2023 Internship at Amazon Alexa.
• 01.2022 - 05.2023 Graduate Research Assistant at CogInt Labs, ASU under Dr. Chitta Baral.
• 01.2019 - 12.2021 AI Researcher at American Express AI Labs. Supervised by Dr. Himanshu Shrad Bhatt
• 01.2018 - 12.2018 Research Intern at Covenant University under Dr. Sanjay Misra.
• 01.2018 - 12.2018 Undergraduate Research Assistant at BITS Pilani under Dr. NL Bhanu Murthy.

Honors and Awards

• 08.2023 Received Merit Scholarship of 1500$ for exceptional acedemic performance at ASU
• 01.2022 Received Tuition Waiver and additional monthly stipend as Research Assistant from Arizona State University
• 12.2021 Platinum Genius Medal for filing 3 patents in American Express
• 03.2019 Best Author Award at IEMECON 2019
• 04.2014 KVPY Scholarship