Katja Schwarz

AI Research Scientist in Computer Vision / Machine Learning

prof_pic.png

I am a Research Scientist at Meta.

My research lies at the intersection of computer vision and graphics and focuses on 3D vision. In particular, I am interested in enabeling machines to infer 3D representations from sparse observations, such as 2D images. I am passionate about leveraging such representations for generative modeling in 2D and 3D.

I did my PhD in the Autonomous Vision Group (AVG) at Tübingen University and the Max Planck Institute for Intelligent Systems, advised by Andreas Geiger. Prior to this, I studied Physics at Heidelberg University where I received my bachelor degree in 2016 and master degree in 2018.

news

Jan 16, 2024 Our paper WildFusion was accepted at ICLR!
Oct 23, 2023 I joined Meta as a Research Scientist!
Oct 13, 2023 I visited the MPI for Informatics and gave a talk on 3D-aware Image Synthesis with Latent Diffusion Models.
Jul 09, 2023 I participated in the BIRS workshop on 3D Generative Models
Jun 18, 2023 I gave a talk on 3D-aware generative models at the CVPR workshop on High-fidelity Neural Actors

selected publications

  1. wildfusion.gif
    WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space
    Katja Schwarz ,  Seung Wook Kim ,  Jun Gao , and 3 more authors
    In International Conference on Learning Representations , 2024
  2. voxgraf.gif
    VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Grids
    Katja Schwarz ,  Axel Sauer ,  Michael Niemeyer , and 2 more authors
    In Advances in Neural Information Processing Systems (NeurIPS) , 2022
  3. styleganxl.gif
    StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasets
    Axel Sauer ,  Katja Schwarz ,  and  Andreas Geiger
    In ACM Trans. on Graphics , 2022
  4. frequency_bias.gif
    On the Frequency Bias of Generative Models
    Katja Schwarz ,  Yiyi Liao ,  and  Andreas Geiger
    In Advances in Neural Information Processing Systems (NeurIPS) , 2021
  5. graf.gif
    GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis
    Katja Schwarz ,  Yiyi Liao ,  Michael Niemeyer , and 1 more author
    In Advances in Neural Information Processing Systems (NeurIPS) , 2020