Best Paper Award:Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation
Time | Arrangement | Details |
---|---|---|
9:00 AM-9:45 AM | Keynote Speech: Digital Humans: Science and Simulation in the Time of AI My goal is to develop realistic computational models of the human body. Models that can make useful predictions of how we move and how our bodies interact with products such as clothing. Despite a long history of scientific research, current models have many surprising shortcomings. I will first describe some fundamental problems with classical models of the complex human biomechanical system, and show how we can model it better. I will present examples of modeling human hands, eyes, muscles, and skin. I will describe breakthroughs in my lab in building personalized models of an individual's body using a complete pipeline for measurement, modeling, parameter estimation, and data-driven simulation using the finite element method. Our methods can be used to create personalized digital avatars of individuals or of a population. There are many potential applications, ranging from virtual prototyping for product design to virtual garment try-on for e-commerce. Next I will describe challenges and opportunities for machine learning in simulating the behavior of living humans. I will argue that access to high quality data remains the crucial bottleneck for these problems. How can we acquire such data, ethically and at scale? I will also explore some fundamental technical limits to sensing and accurately predicting the actual behaviors of a real system, and not just plausible behaviors.
|
Invited Speakers: Dinesh K. Pai, University of British Columbia Dinesh K. Pai is a Professor of Computer Science at the University of British Columbia, and founder of Vital Mechanics Research - a startup providing high-fidelity soft avatars for apparel fit testing. His current research is focused on data-driven digital human models, frictional contact between soft objects, machine learning for design, and technology for efficient measurement of material properties. His research is multidisciplinary, spanning computer graphics, scientific computing, robotics, biomechanics, neuroscience, and artificial intelligence.
He has received many prestigious recognitions, including a Tier 1 Canada Research Chair, the 2020 CHCCS Achievement Award for Computer Graphics, UBC's Killam Research Prize, three NSERC Discovery Accelerator/Supplement Awards, and an international Human Frontier Science Program grant. Dr. Pai has been a Professor at Rutgers University and has held visiting professorships at Carnegie Mellon University's Robotics Institute, New York University's Center for Neural Science, the University of Siena (Santa Chiara Chair in Cognitive Science), and the Collège de France, Paris (Professeur Invité). He received his Ph.D. from Cornell University, Ithaca, NY, and his B.Tech. degree from the Indian Institute of Technology, Madras. See //sensorimotor.cs.ubc.ca/pai/ for more information.
|
9:45 AM-10:30 AM | Invited Talk: Deep Albedo: Real-time biophysically-based facial map modifcations Altering skin parameters and colors are inherently complex and requires sophisticated physically-based models to describe. We leverage the autoencoders and simulated biophysically-based skin parameters to enable an efficient spatial-varying mapping between the biophysical parameters and their resulting skin color. The mapping enables the pixel-wise to describe age and emotion related skin color variations.
|
Invited Speakers: Wei Sen Loi, Joel Johnson, Huawei Technologies Canada |
10:30 AM-11:00 AM | Break | |
11:00 AM-12:30 PM——Oral Session 1 | ||
11:00 AM-11:20 AM | FuRPE: Learning Full-body Reconstruction from Part Experts Authors: Zhaoxin Fan, Yuqing Pan, Hao Xu, Zhenbo Song Zhicheng Wang, Kejian |
[PDF] |
11:20 AM-11:40 AM | ProbSIP: Probabilistic Modeling for Ambiguity-Reduced Sparse Inertial Poser Authors:Shanyan Guan, Yunbo Wang, Xintao Lv, Yanhao Ge, Xiaokang Yang |
[PDF] |
11:40 AM-12:00 PM | Deep Learning based Dialogue System for Legal Consultancy in Smart Law Authors:Xukang Wang, Ying Cheng Wu, Xuhesheng Chen, Hongpeng Fu, Jiaqi Tan, Mengjie Zhou |
[PDF] |
12:00 PM-12:20 PM | Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation Authors: Likun Li, Haoqi Zeng, Changpeng Yang, Haozhe Jia, Di Xu |
[PDF] |
12:20 PM-12:30 PM | Announcement of Competition Awards | |
12:30 PM-2:00 PM——Lunch | ||
2:00 PM-4:00 PM——Oral Session 2 | ||
2:00 PM-2:20 PM | Structural Learning in the design of Perspective-Aware AI Systems using Knowledge Graphs Authors: Marjan Alirezaie, Hossein Rahnama, Alex Pentland |
[PDF] |
2:20 PM-2:40 PM | The Role of Facial and Speech Features in Emotion Classification Authors:Loïc Houmard, Ard Kastrati, Dushan Vasilevski, Roger Wattenhofer |
[PDF] |
2:40 PM-3:00 PM | Understanding Consumers' Attitude Toward Digital Humans In Influencer Marketing Authors:Smitha Muthya Sudheendra, Maral Abdollahi, Jisu Huh, Jaideep Srivastava |
[PDF] |
3:00 PM-3:20 PM | Realistic Human Generation with Controllable Poses Using 3D Priors Authors:Ruifeng Bai, Xiaohang Liu, Haozhe Jia, Wei Zhang, Changpeng Yang, Di Xu |
[PDF] |
3:20 PM-3:40 PM | Prompt-Propose-Verify: A Reliable Hand-Object-Interaction Data Generation Framework using Foundational Models Authors:Gurusha Juneja, Sukrit Kumar |
[PDF] |
3:40 PM-4:00 PM | Latents2Semantics: Leveraging the Latent Space of Generative Models for Localized Style Manipulation of Face Images Authors:Snehal Singh Tomar, A.N. Rajagopalan |
[PDF] |
4:00 PM-5:00 PM——Poster Session |
Ranking | Team | Institution |
---|---|---|
1 | iFLYTEK-CV | iFLYTEK Research & University of Science and Technology of China |
2 | Excit AI | Shanghai Excit AI Technology |
3 | USTC-IAT-United | University of Science and Technology of China & Unisound AI Technology Co.,Ltd |
Ranking | Team | Institution |
---|---|---|
1 | PPW | Northwestern Polytechnical University & Southwest Jiaotong University & Hubei University of Technology |
2 | USTC_IAT_United | University of Science and Technology of China, Unisound AI Technology Co.,Ltd |
3 | zhanggod | Huazhong University of Science and Technology |
Ranking | Team | Institution |
---|---|---|
1 | BDIV Lab | Xidian University |
2 | USTC-IAT-United | University of Science and Technology of China,Ping An Technology |
3 | Excit AI | Shanghai Excit AI Technology |
Ranking | Team | Institution |
---|---|---|
1 | HaiweiXue_DragonBooOOM | Tsinghua University |
2 | USTC_IAT_United | University of Science and Technology of China |
3 | XDU_VIPSLab | Xidian University |
Yichao Yan |
|
Di Xu |
|
Haozhe Jia |
|
Matthias Nießner |
|
Jiankang Deng |
|
KangKang Yin |
Simon Fraser University, School of Computing Science |