About
I’m a third year PhD student at Columbia University, advised by Carl Vondrick. At Columbia, I’m doing fun and/or impactful research projects and finding best ways to present them. My primary interest is in computer vision and deep learning, while often get lost in the wonderlands of computer graphics, computational imaging, and robotics.
I’m looking for self-motivated undergrad/MS students at Columbia to work on research projects. If you are interested in generative models, 3D computer vision, or robotics, please feel free to contact me.
News
[Mar 2024] Two papers accepted to CVPR! Check out the links down below!
[Jul 2023] Two recent papers accepted to ICCV!
[Mar 2023] Zero123 released! Thanks Huggingface for funding a demo!
[Feb 2023] Two recent papers accepted to CVPR!
Publication
PaperBot: Learning to Design Real-World Tools Using Paper
Ruoshi Liu, Junbang Liang, Sruthi Sudhakar, Huy Ha, Cheng Chi, Shuran Song, Carl Vondrick
arxiv 2024
Paper | Project Page | 8-min Video | New Scientist Article
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering
Abdullah Hamdi, Luke Melas-Kyriazi, Guocheng Qian, Jinjie Mai, Ruoshi Liu, Carl Vondrick, Bernard Ghanem, Andrea Vedaldi
CVPR 2024
Paper | Project Page
pix2gestalt: Amodal Segmentation by Synthesizing Wholes
Ege Ozguroglu, Ruoshi Liu, Dídac Surís, Dian Chen, Achal Dave, Pavel Tokmakov, Carl Vondrick
CVPR 2024
Paper | Project Page
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape
Rundi Wu, Ruoshi Liu, Carl Vondrick, Changxi Zheng
ICLR 2024
Paper | Project Page | Code | Demo
Objaverse-XL: A Colossal Universe of 3D Objects
Matt Deitke, Ruoshi Liu, Matthew Wallingford, Huong Ngo, Oscar Michel, Aditya Kusupati, Alan Fan, Christian Laforte, Vikram Voleti, Samir Yitzhak Gadre, Eli VanderBilt, Aniruddha Kembhavi, Carl Vondrick, Georgia Gkioxari, Kiana Ehsani, Ludwig Schmidt, Ali Farhadi
NeurIPS 2023
Paper | Project Page | Code | Zero123-XL
Zero-1-to-3: Zero-shot One Image to 3D Object
Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, Carl Vondrick
ICCV 2023
Paper | Project Page | Code | Demo
Landscape Learning for Neural Network Inversion
Ruoshi Liu, Chengzhi Mao, Purva Tendulkar, Hao Wang, Carl Vondrick
ICCV 2023
Paper Blog Post
Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection
Ruoshi Liu, Carl Vondrick
CVPR 2023
Paper | Project Page
What You Can Reconstruct from a Shadow
Ruoshi Liu, Sachit Menon, Chengzhi Mao, Dennis Park, Simon Stent, Carl Vondrick
CVPR 2023
Paper Blog Post
Learning the Predictability of the Future
Dídac Surís*, Ruoshi Liu*, Carl Vondrick
CVPR 2021
Paper Project Page
Machine Learning Forecasting of Active Nematics
Zhengyang Zhou, Chaitanya Joshi, Ruoshi Liu, Michael M. Norton, Linnea Lemma, Zvonimir Dogic, Michael F. Hagan, Seth Fraden, Pengyu Hong
Soft Matter 2021
Paper
Contact
Invited Talks
[Apr 2024] “Learning to Design Tools in the Real World” @ NYC Vision Day
[Mar 2024] “Generating the 3D World” @ NYU, hosted by Chen Feng
[Feb 2024] “Neural Network Inversion” @ UCL, hosted by Kaan Akşit
[Dec 2023] “Seeing the Unseen” @ AI Time Large Model Workshop
[Dec 2023] “Seeing the Unseen” @ NYC Vision day, hosted by Noah Snavely
[Nov 2023] “Generating the 3D World” @ Stanford, hosted by Jiajun Wu
[Nov 2023] “Generating the 3D World” @ Berkeley, hosted by Angjoo Kanazawa
[Nov 2023] “Generating the 3D World” @ TRI, hosted by Adrien Gaidon
[Oct 2023] “Generating the 3D World” @ Brown University, recording available, hosted by James Tompkin
[Oct 2023] “Generating the 3D World” @ CMU, hosted by Shubham Tulsiani
[Jul 2023] “Generating the 3D World” @ Oxford. recording and slides available, hosted by Christian Rupprecht
[May 2023] “Analysis by Synthesis for 3D Reconstruction” @ CCVL lab @ JHU hosted by Alan Yuille
[Apr 2023] “AIGC in the 3D World” @ GAMES Webinar, recording available, hosted by Xiaoguang Han, and Guanying Chen
[Sep 2022] “Inverting Generative Models for Visual Understanding” @ MIT hosted by Wei-Chiu Ma
Other Things
My first name Ruoshi(若石), can be translated into “Like a Rolling Stone”.
My virtual meetings are sometimes interrupted by Pattie, a 3-year-old domestic shorthair.
I like playing guitar. A few bands whose music I deeply enjoy: Dire Straits, Sunset Rollercoaster, Radiohead, HYUKOH, deca joins.
I’m a big movie fan and most admire the work of Stanley Kubrick, Quentin Tarantino, Lee Chang-dong, and Hirokazu Kore-eda.
I enjoy performing non-convex gradient ascent and descent a.k.a hiking and skiing.