Research - Financial Services Innovation Lab @ Georgia Tech
Co-authoring the paper Zero is Not Hero Yet: Benchmarking Zero-Shot Performance of LLMs for Financial Tasks as an undergraduate research intern under the mentorship of Ph.D. candidate Agam Shah and Dr. Sudheer Chava.
Building SuperFLUE: the financial equivalent of SuperGLUE. SuperFLUE is an amalgamation of 13 datasets in the financial domain. It includes various tasks such as Multi-Label Classification, Named Entity Recognition, Summarization, and Question Answering.
Utilizing zero-shot prompting and few-shot learning to compare the performance of LLMs like GPT-4, Gemma Instruct 7B, Llama-2-70B and fine-tuned Pre-trained Language models like T5, RoBERTa, and Longformer Encoder Decoder.
Leveraging Retrieval Augmented Generation and frameworks such as LangChain for summarizing financial documents.
Employing remote development servers, virtual machines, and cloud-based infrastructure to efficiently execute data cleaning, preprocessing, and fine-tuning tasks on substantial datasets comprising approximately 300,000 data points.
SubjECTive-QA | August 2023 - Present
Leading a comprehensive project involving the creation of a novel Dataset in the financial domain using 150+ Earnings Call Transcripts and approximately 20,000 data points extracted from the Q&A sessions during Earnings Calls of firms.
Using Python libraries like Selenium, Beautiful Soup, and SpaCy for data scraping, cleaning, and pre-processing.
Utilizing Krippendorff’s Alpha and Fleiss’ Kappa to measure Inter-Annotator Agreement. Benchmarking baseline models BERT, FinBERT, RoBERTa, FLANG-BERT on our dataset and creating our model for tone analysis.
Independent Research
Literature Review on Quantum Teleportation | 2021
- Conducted research under the guidance of an MIT physics graduate student: studied quantum mechanics, basic quantum computation, and algorithms, with a focus on quantum teleportation.
- Wrote a review-style article on recent advances in quantum teleportation and experimental progress in building the quantum internet.
- Published in the International Journal of Engineering and Science.