threestudio

<picture> <img alt="threestudio" src="https://user-images.githubusercontent.com/19284678/236847132-219999d0-4ffa-4240-a262-c2c025d15d9e.png" width="50%"> </picture> threestudio is a unified framework for 3D content creation from text prompts, single images, and few-shot images, by lifting 2D text-to-image generation models. <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/f48eca9f-45a7-4092-a519-6bb99f4939e4.gif" width="100%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/01a00207-3240-4a8e-aa6f-d48436370fe7.png" width="100%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/1dbdebab-43d5-4830-872c-66b38d9fda92" width="60%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/d746b874-d82f-4977-a549-98d9ba764dfc" width="30%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/437b4044-142c-4e5d-a406-4d9bad0205e1" width="60%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/812741c0-7229-412e-b6ab-81e377890f04" width="30%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/4f4d62c5-2304-4e20-b632-afe6d144a203" width="68%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/19284678/2f36ddbd-e3cf-4431-b269-47a9cb3d6e6e" width="68%"> 👆 Results obtained from methods implemented by threestudio 👆 | <a href="https://ml.cs.tsinghua.edu.cn/prolificdreamer/">ProlificDreamer</a> | <a href="https://dreamfusion3d.github.io/">DreamFusion</a> | <a href="https://research.nvidia.com/labs/dir/magic3d/">Magic3D</a> | <a href="https://pals.ttic.edu/p/score-jacobian-chaining">SJC</a> | <a href="https://github.com/eladrich/latent-nerf">Latent-NeRF</a> | <a href="https://fantasia3d.github.io/">Fantasia3D</a> | <a href="https://fabi92.github.io/textmesh/">TextMesh</a> | | <a href="https://zero123.cs.columbia.edu/">Zero-1-to-3</a> | <a href="https://guochengqian.github.io/project/magic123/">Magic123</a> | <a href="https://github.com/JunzheJosephZhu/HiFA">HiFA</a> | | <a href="https://instruct-nerf2nerf.github.io/">InstructNeRF2NeRF</a> | <a href="https://control4darxiv.github.io/">Control4D</a> | <a href="https://colab.research.google.com/github/threestudio-project/threestudio/blob/main/threestudio.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg"> </a> <a href="https://huggingface.co/spaces/bennyguo/threestudio"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Gradio%20Demo-Huggingface-orange"></a> <a href="http://t23-g-01.threestudio.ai"><img src="https://img.shields.io/badge/Gradio%20Demo-Tencent-blue?logo=tencentqq&logoColor=white"></a> <a href="https://discord.gg/ejer2MAB8N"><img src="https://img.shields.io/badge/Discord-5865F2?logo=discord&logoColor=white"></a> Did not find what you want? Checkout <a href="https://threestudio-project.github.io/threestudio-extensions/">threestudio-extension</a> or submit a feature request <a href="https://github.com/threestudio-project/threestudio/discussions/46">here</a>! <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/ac6089a7-d88f-414c-96d6-a5e75616115a" width="68%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/302a399e-d36f-453e-a595-1c7d120451d3" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/025e6980-baf2-4b5f-9c23-4f66ef847bf5" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/cfcd828f-daed-4d2e-abf1-29f69eb2ffbb" width="18%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/f04b6bdd-ef02-4ce7-b7c9-981f8bda419f" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/13ae104e-e020-4de9-a677-87f29067a1c0" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/c6337097-b5bd-4fe8-a03a-a68fb9260009" width="18%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/e41532fd-8f00-45b4-a473-26a9f1bca4f8" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/7b1b919d-d97a-4f50-afa3-6c1b7ecfe7b6" width="35%"> <img alt="threestudio" src="https://github.com/threestudio-project/threestudio/assets/24589363/8892898f-8bd8-43dc-a4ec-dd8d078af860" width="45%"> | <a href="https://github.com/HeliosZhao/Animate124/tree/threestudio">Animate-124</a> | <a href="https://github.com/DSaurus/threestudio-4dfy">4D-fy</a> | <a href="https://github.com/baaivision/GeoDream/tree/threestudio">GeoDream</a> | <a href="https://github.com/DSaurus/threestudio-dreamcraft3D">DreamCraft3D</a> | <a href="https://github.com/huanngzh/threestudio-dreamwaltz">Dreamwaltz</a> | <a href="https://github.com/KU-CVLAB/3DFuse-threestudio">3DFuse</a> | <a href="https://github.com/cxh0519/Progressive3D">Progressive3D</a> | <a href="https://github.com/cxh0519/threestudio-gaussiandreamer">GaussianDreamer</a> | <a href="https://github.com/DSaurus/threestudio-3dgs">Gaussian Splatting</a> | <a href="https://github.com/DSaurus/threestudio-mvdream">MVDream</a> | <a href="https://github.com/DSaurus/threestudio-meshfitting">Mesh-Fitting</a> |

News

12/03/2024: Thank Matthew Kwak and Inès Hyeonsu Kim for implementation of 3DFuse! Follow the instructions on its website to give it a try.
08/03/2024: Thank Xinhua Cheng for implementation of GaussianDreamer! Follow the instructions on its website to give it a try.
01/03/2024: Thank Xinhua Cheng for implementation of Progressive3D! Follow the instructions on its website to give it a try.
09/01/2024: Thank Zehuan Huang for implementation of 3D human avatar generation Dreamwaltz! Follow the instructions on its website to give it a try.
06/01/2024: Thank Baorui Ma for implementation of GeoGream extensions! Follow the instructions on its website to give it a try.
05/01/2024: Implemented HiFA. Follow the instructions here to try all three variants.
23/12/2023: Thank Yuyang Zhao for implementation of image-to-4D generation extensions Animate-124! Follow the instructions on the extensions website to give it a try.
18/12/2023: Implementation of 4D-fy for 4D generation and DreamCraft3D for high-quality image-to-3D generation as the custom extensions! Follow the instructions on the extensions website to give it a try.
13/12/2023: Implementation supporting Stable Zero123 for 3D generation from a single image! Follow the instructions here to give it a try.
30/11/2023: Implementation of MVDream, Gaussian Splatting as the custom extensions. You can also use neural representation to fit a mesh by Mesh-Fitting.
30/11/2023: Implementation of custom extension system and you can add your extensions in this project.
25/06/2023: Implementation of Magic123! Follow the instructions here to give it a try.
06/07/2023: Join our Discord server for lively discussions!
03/07/2023: Try text-to-3D online in HuggingFace Spaces or using our self-hosted service (GPU support from Tencent). To host the web interface locally, see here.
20/06/2023: Implementations of Instruct-NeRF2NeRF and Control4D for high-fidelity 3D editing! Follow the instructions for Control4D and Instruct-NeRF2NeRF to give it a try.
14/06/2023: Implementation of TextMesh! Follow the instructions here to give it a try.
14/06/2023: Implementation of prompt debiasing and Perp-Neg! Follow the instructions here to give it a try.
29/05/2023: An experimental implementation of using Zero-1-to-3 for 3D generation from a single image! Follow the instructions here to give it a try.
26/05/2023: Implementation of ProlificDreamer! Follow the instructions here to give it a try.
14/05/2023: You can experiment with the SDS loss on 2D images using our 2dplayground.
13/05/2023: You can now try threestudio on Google Colab!
11/05/2023: We now support exporting textured meshes! See here for instructions.

export-blender

Installation

See installation.md for additional information, including installation via Docker.

The following steps have been tested on Ubuntu20.04.

You must have an NVIDIA graphics card with at least 6GB VRAM and have CUDA installed.
Install Python >= 3.8.
(Optional, Recommended) Create a virtual environment:

python3 -m virtualenv venv
. venv/bin/activate

# Newer pip versions, e.g. pip-23.x, can be much faster than old versions, e.g. pip-20.x.
# For instance, it caches the wheels of git packages to avoid unnecessarily rebuilding them later.
python3 -m pip install --upgrade pip

Install PyTorch >= 1.12. We have tested on torch1.12.1+cu113 and torch2.0.0+cu118, but other versions should also work fine.

# torch1.12.1+cu113
pip install torch==1.12.1+cu113 torchvision==0.13.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113
# or torch2.0.0+cu118
pip install torch torchvision --index-url https://download.pytorch.org/whl/cu118