Home > Apps

ChatGPT can help generate 3D models, here’s how

The final frontier of multimodality?

Reviewed By: Steve Hook

Last Updated on April 16, 2024
You can trust PC Guide: Our team of experts use a combination of independent consumer research, in-depth testing where appropriate - which will be flagged as such, and market analysis when recommending products, software and services. Find out how we test here.

OpenAI’s ChatGPT is a multimodal AI chatbot. The VLM (Visual Language Model) GPT-4V opens up new possibilities for generative AI in the vertical of text and image input and output. Its groundbreaking ability to generate content, understand images, provide information, and even write code leaves many wondering just how far this ability can go. While it can do many things, ChatGPT unfortunately can’t create 3D models itself, but it can certainly help. This article explores the boundaries of ChatGPT’s creativity and technical aptitude in the realm of 3D modeling.

Quick Answer

Unfortunately ChatGPT does not have the capabilities to generate 3D models from text prompt alone. However, it can help in the design process. The chatbot can provide useful information to help enhance your design and can even generate Python code based on your models specifications.

Collaborating with 3D modeling software

When it comes to creating 3D models, ChatGPT can serve as a valuable tool with dedicated 3D modeling software such as Blender. By using ChatGPT’s text prompts, designers and artists can describe their desired models in detail, providing instructions and specifications. These descriptions can then be used as a script or guide within 3D modeling software to bring the models to life.

One popular software for 3D modeling is Blender, a free and open-source platform widely used by artists and designers. By utilizing ChatGPT alongside Blender, users can leverage the strengths of both tools. ChatGPT can assist in generating ideas, providing insights into syntax and transformations, and offering suggestions for enhancing the model’s appearance. Whether you’re working on simple geometric shapes or complex models, ChatGPT can understand and respond to your chat prompts, providing guidance and feedback in real time. By integrating ChatGPT with 3D modeling software, designers can benefit from the versatility and flexibility of both tools, enhancing their workflow and enabling more efficient creation processes.

Screenshot of a digital conversation in a chat interface where a user is discussing how to use ChatGPT to make 3D models of a box, asking for advice on software, settings, and materials
List of seven materials suitable for product packaging, including plastic, glass, cardboard, and fabric, with descriptions of their unique qualities and adaptations to make 3D models.

Enhancing 3D model design processes

In the realm of 3D model design, ChatGPT can play a significant role in enhancing the creative process and streamlining design workflows. While ChatGPT itself does not possess the ability to directly create 3D models, it can be used with other tools and software to augment the design experience. When working with 3D models, designers often start with basic shapes and default settings provided by dedicated CAD software. However, by integrating ChatGPT into the design process, designers can explore new possibilities and generate innovative ideas. Through text-to-3D conversion techniques, designers can describe their vision using ChatGPT prompts, which can then be translated into 3D models by specialized software.

Although this text-to-3D functionality is still in its mid-journey and may be available in beta versions or experimental implementations, developers and enthusiasts can access code repositories on platforms like GitHub to explore and experiment with these emerging capabilities. By leveraging these tools and resources, designers can push the boundaries of their creativity and drive the advancement of 3D model design.

Additionally, ChatGPT can also be utilized in the simulation phase of 3D model design. Designers can input parameters, materials, and environmental conditions through chat prompts, enabling ChatGPT to provide insights and recommendations for improving the model’s performance and appearance. This collaboration between designers and AI models allows for a more iterative and refined design process. When it comes to file formats, designers can export their 3D models in standard formats compatible with CAD software and other tools. While ChatGPT itself does not dictate or influence the file format, it can assist designers in refining the design before exporting the final model.

Image of a rectangular wooden box with dimensions and material details provided in text form below it, useful for creating 3D models.
An illustrative image outlining methods to enhance wooden texture in 3D models, with descriptive text below each numbered heading.

Essential AI Tools

Editor’s pick
Only $0.00019 per word!

Content Guardian – AI Content Checker – One-click, Eight Checks

8 Market leading AI Content Checkers in ONE click. The only 8-in-1 AI content detector platform in the world. We integrate with leading AI content detectors to give unparalleled confidence that your content appear to be written by a human.
EXCLUSIVE DEAL 10,000 free bonus credits

Jasper AI

On-brand AI content wherever you create. 100,000+ customers creating real content with Jasper. One AI tool, all the best models.
TRY FOR FREE

WordAI

10x Your Content Output With AI. Key features – No duplicate content, full control, in built AI content checker. Free trial available.
TRY FOR FREE

Copy.ai

Experience the full power of an AI content generator that delivers premium results in seconds. 8 million users enjoy writing blogs 10x faster, effortlessly creating higher converting social media posts or writing more engaging emails. Sign up for a free trial.
TRY FOR FREE

Writesonic

Create SEO-optimized and plagiarism-free content for your blogs, ads, emails, and website 10X faster. Start for free. No credit card required.

Using ChatGPT’s 3D model generator

In addition to getting help to enhance your project from the chatbot, you can ask ChatGPT to turn your idea into a 3D model with the help of the 3D model generator GPT. If you have access to a subscription to ChatGPT Plus then you’ll be able to access some of the plugins available on the platform. One such plugin is the 3D model generator, which can now be accessed as a GPT from the explore GPT section. With this feature, users input their 3D model specifications and ChatGPT will respond with Python code that can be run in a Python environment, to generate the 3D model. Follow the simple steps below to get started in this process:

Step

1

Open ChatGPT

Open ChatGPT in your web browser and log into your ChatGPT Plus, Team, or Enterprise subscription.

Step

2

Open the 3D model generator GPT

Click on the ‘Explore GPTs’ option on the left side of the page, then type in 3D model generator in the GPTs search bar. You can access this GPT by selecting ‘start Chat’.

Step

3

Write prompt

You can then write a prompt stating that you want to generate a 3D model. For example, “Turn my idea into a 3D model”. ChatGPT will then respond suggesting ways it can help.

Step

4

Provide specifications of your model

Choose which option you’d like to go for. In this example we asked ChatGPT to make a box. The chotbot then replies asking for the specifications of the model.

Step

5

ChatGPT responds with code

ChatGPT will take a few seconds to process the information but will then respond with Python code which can be input into a Python environment to generate a 3D model.

Leveraging AI-Assisted 3D Modeling Tools

AI-assisted 3D modeling tools, such as ChatGPT with programming languages like Python, have emerged as invaluable resources for creators and designers. While ChatGPT itself does not directly create 3D models, it serves as a useful tool in streamlining the design process. When working with 3D models, designers often start with basic geometric shapes like cylinders and cubes, specifying their dimensions and other parameters. By utilizing ChatGPT prompts and natural language descriptions, designers can interact with the model generation process, providing high-quality instructions to guide the geometry creation.

To leverage ChatGPT’s capabilities in 3D modeling, creators can write Python code that interfaces with AI models like GPT-4, using libraries and frameworks such as NVIDIA’s powerful tools. This integration enables designers to harness the potential of natural language input to generate complex 3D models. Once the model is created, it can be saved in standard file formats like STL (Stereolithography) files, which are widely compatible with various 3D modeling and printing software. Designers can specify the desired file format and other parameters through natural language prompts, allowing ChatGPT to assist in the file export process.

While working with AI-assisted 3D modeling tools, it’s important to have patience, as the process may involve iterations and fine-tuning to achieve the desired results. By refining the natural language instructions and incorporating feedback from the AI model, creators can gradually improve the quality and accuracy of the generated models.

Is there an AI that can generate 3D models?

There are a number of AI tools that can actually generate 3D models from text prompts. For example, 3DFY.ai. 3DFY.ai can generate 3D models from user inputs that describe topology, geometric details, textures, etc. The handy tool is able to complete such tasks at a speedy rate and is great for designers needing an extra hand whilst creating.

Conclusion

ChatGPT cannot create 3D models. However, we’re on the road there with GPT-4V, which enables image input and image output (making it an AI image generator). OpenAI is working on most verticals of multimodality, meaning that we might see an OpenAI 3D model… model… very soon! We will have to wait and see how the technology evolves to know if it can generate complicated 3D models with real-world applications.

Maria is a contributer to PC Guide, highly-interested in productivity and AI tools, and ensuring the inclusion of detailed product info and coverage across versus pieces.