Inverting Language Models
Event Actions
Abstract: How much information do the outputs of NLP models contain about their inputs? We investigate the problem in two scenarios, recovering text inputs from the outputs of embeddings from sentence embedders and next-token probability outputs from language models. In both cases, our methods are able to fully recover some inputs given just the model output.
Bio: Jack Morris is a third-year PhD student at Cornell Tech. He works on NLP and machine learning with applications to security and privacy, with a focus on text-based dense information retrieval systems.
The Artificial Intelligence and Machine Learning (AIML) seminar provides a communication platform for our colleagues and friends who are working on artificial intelligence, machine learning, and related fields. You can find more information about future talks via the seminar website.