Pronouns: he/him
My research interests as of Dec 2023 with papers (sometimes mine) to make it concrete:
- Vision-and-Language (VL) reasoning and compositionality
(Winoground, ImageCoDe, Iterated Learning) - Text-to-image models (Stable Diffusion): leveraging and evaluating their representations
(DiffusionITM, DSG, T2I-CompBench) - Relationship between generation and understanding?
(DiffusionITM, The Generative AI Paradox: What It Can Create, It May Not Understand,) - Creatively stress-testing models
(Winoground, ImageCoDe, Do Androids Laugh at Electric Sheep?) - Video + Language
(ImageCoDe, MERLOT Reserve) - VL + ethics/society
(Stable Bias, MaRVL) - VL + creativity/humor/storytelling
(ViPE: Visualize Pretty-much Everything, Do Androids Laugh at Electric Sheep?)
Before coming to Mila, I graduated from LMU Munich in computational linguistics where I worked on relational reasoning and machine translation. I also had great experiences at early-stage startups during and after my undergrad!
In my free time, I play Ultimate Frisbee competetively and have coached juniors and a mixed-gender team. With the PhD, I don't play on the highest level anymore but look back on great memories from U24 Worlds with Team Germany and several European Club Championships.
Let's chat about research and life: benno.krojer@gmail.com
Here is an alternative version of my bio, a result of playing madlips: Madlips Bio. The other person picked my website bio without my knowledge as a template basically, and it's eerie how close the first few fill-ins are.
Publications
Learning Action and Reasoning-Centric Image Editing from Videos and Simulations
, Dheeraj Vattikonda, Luis Lara, Varun Jampani, Eva Portelance, Christopher Pal, Siva Reddy
NeurIPS'24 Spotlight (Datasets & Benchmarks) | Conference on Neural Information Processing Systems
Are Diffusion Models Vision-And-Language Reasoners?
, Elinor Poole-Dayan, Vikram Voleti, Christopher Pal, Siva Reddy
NeurIPS'23 | Conference on Neural Information Processing Systems
Image Retrieval from Contextual Descriptions
, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy
ACL'22 | Association for Computational Linguistics
Improving Automatic VQA Evaluation Using Large Language Models
Oscar Manas, , Aishwarya Agrawal
AAAI'23 | AAAI Conference on Artificial Intelligence
Pragmatic Inference with a CLIP Listener for Contrastive Captioning
Jiefu Ou, , Daniel Fried
ACL Findings'23 | Findings of the Association for Computational Linguistics
Are Pretrained Language Models Symbolic Reasoners Over Knowledge?
Nora Kassner*, *, Hinrich Schütze
CoNLL'20 | Conference on Computational Natural Language Learning
(* = Equal Contribution)
ContraCAT: Contrastive Coreference Analytical Templates for Machine Translation
Dario Stojanovski*, *, Denis Peskov*, Alexander Fraser
COLING'20 | Conference on Computational Linguistics
(* = Equal Contribution)
Blogposts
Things I like
Jan 2nd, 2024
Elevator Pitch & ELI5 of my first PhD project: Image Retrieval from Contextual Descriptions
May 30th, 2022
Explaining my research to someone outside the field.
What made me do a PhD far away?
April 28th, 2021
Sometimes people ask me why I left Europe when there is good opportunities there, too.
[DRAFT]: Defining the most basic concepts in Language Grounding
Jan 22nd, 2021
We rarely think about what the most basic words mean.
Explain like I am 5: Language Grounding
Nov 21st, 2020
How would I explain the research field of language grounding to a novice.
Attending my first conference! ACL 2020 from an undergrad's perspective
Jul 2nd, 2020
Networking, learning about language grounding and mentally prepping for the PhD.
Why the current Corona situation makes memories blurry
May 8th, 2020
Applying knowledge from reading about neuroscience
Moral Pluralism through the lense of optimization
Apr 29th, 2020
Some reflections after a philosophy society meeting