Portfolio item number 1
Short description of portfolio item number 1
Posts by Collection
portfolio
Portfolio item number 2
Short description of portfolio item number 2
publications
ImplicitAVE: An Open-Source Dataset and Multimodal LLMs Benchmark for Implicit Attribute Value Extraction
Published in ACL Findings, 2024
In this work we introduce the first ever publicly available dataset for implicit attribute value extraction. In addition to releasing the curated dataset we also benchmark several SOTA Multimodal Large Language Models on ImplicitAVE.
Can LLMs Augment Low-Resource Reading Comprehension Datasets? Opportunities and Challenges
Published in ACL Student Research Workshop, 2024
In this work, we tackle the low resource issue in certain QA datasets by synthetically augmenting them using GPT-4 to improve downstream fine-tuned performance for LMs trained on the augmented dataset.
PersonaGym: Evaluating Persona Agents and LLMs
Published in arXiv, 2024
In this work, we released the first ever dynamic evaluation framework for persona agents in LLMs termed PersonaGym. Additionally we established the first autmatic human-sligned metric for quantifying the abilities of a given persona agent termed PersonaScore.
Towards Data Contamination Detection for Modern Large Language Models: Limitations, Inconsistencies, and Oracle Challenges
Published in COLING, 2024
In this work we benchmark several of the top data contamination approaches on the state-of-the-art LLMs in order to provide insight to the strengths and limitations of each approach.
Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration
Published in arXiv, 2024
In this work, we released Collaborative Gym (Co-Gym), a general framework enabling asynchronous, tripartite interaction among agents, humans, and task environments across a multitude of tasks.
talks
Talk 1 on Relevant Topic in Your Field
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Conference Proceeding talk 3 on Relevant Topic in Your Field
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Convex Optimization[Ph.D] (10-725)
Teaching Assistant, Carnegie Mellon University, Machine Learning Department, 2024
Accepted to position