🐼Stable Diffusion OpenPose模型 知识点:ControlNet 1.1 OpenPose模型用法 | 3D OpenPose 插件用法SD从入门到精通课程的第11集

28 Apr 202314:40

TLDRThis tutorial introduces viewers to the 11th installment of the SD series, highlighting the growth of the YouTube channel and Discord community. The presenter shares their experience deploying SD on Tencent Cloud, emphasizing its cost-effectiveness for frequent, long-duration use. The core of the tutorial focuses on the OpenPose model within the CTN framework, demonstrating how to use it for pose detection and manipulation in image generation. The video also covers the installation and use of the 3D OpenPose plugin, allowing users to create and input custom poses into the Stable Diffusion model for more controlled image outputs.


  • 📺 The tutorial series has reached its 11th episode, with a new members-only tutorial also available for free viewing.
  • 🎉 The YouTube channel has grown significantly, now with 11.9k subscribers.
  • 🌐 Discord server's daytime active user count is around 400-500 people.
  • 📺 Two fans will be featured on TV, one named 于紅雷 and another named melody.
  • 🚀 The presenter has updated the SD UI by deploying SD on a Tencent Cloud server, offering a different experience from the Google COLAB version.
  • 💰 Tencent Cloud is cost-effective for frequent and long-duration users, with a current promotion of 60 yuan for 15 days of unlimited use.
  • 🔧 The presenter plans to release a stable version and comparison of Tencent Cloud deployment versus Google COLAB, along with a tutorial for the former.
  • 📈 The tutorial focuses on the OpenPose model within the CTN (Controlled Text-to-Neural) system, which can detect and replicate human poses.
  • 🎨 The 3D OpenPose plugin allows for flexible posing of a 3D model and exporting the pose for use in SD's image generation.
  • 🔄 The process of using 3D OpenPose involves setting canvas dimensions, rotating and positioning the model, and adjusting joints to achieve desired poses.
  • 🖌️ The generated pose can be sent back to CTN for use in image generation, allowing control over the pose of the final image produced by SD.

Q & A

  • What is the main topic of this tutorial?

    -The main topic of this tutorial is the use of OpenPose models and the 3D OpenPose plugin in the context of image generation with Stable Diffusion.

  • How has the speaker's YouTube channel grown?

    -The speaker's YouTube channel has grown to 11.9 thousand subscribers, which is a visible increase.

  • What is the purpose of the Discord channel mentioned by the speaker?

    -The Discord channel is used for community engagement, with a daytime online user count of around four to five hundred people.

  • Why did the speaker choose to deploy SD on Tencent Cloud?

    -The speaker chose Tencent Cloud because of its cost-effectiveness for frequent and long-duration usage, offering unlimited use for a fixed price during the 15-day period.

  • What is the significance of the OpenPose model in image generation?

    -The OpenPose model is significant as it allows for the detection and replication of human poses in generated images, ensuring that the generated figures match the pose of the original image.

  • How does the 3D OpenPose plugin work?

    -The 3D OpenPose plugin allows users to manipulate a 3D model's pose and then generate a 2D representation of that pose, which can be used as input for image generation with Stable Diffusion.

  • What are the benefits of using the 3D OpenPose plugin?

    -The 3D OpenPose plugin provides more flexibility in posing characters for image generation, enabling users to create a wide range of poses and stances for their artwork.

  • What is the process for integrating a pose generated with the 3D OpenPose plugin into Stable Diffusion?

    -After setting up the pose in the 3D OpenPose plugin, the user generates a pose image, selects the appropriate Ctrl net model in the CTN (Control Network), and then uses that model to generate the final image with Stable Diffusion.

  • What is the speaker's plan for future tutorials?

    -The speaker plans to release more tutorials on Stable Diffusion and MJ (possibly another tool or model), and will also provide a comparison and deployment guide for Tencent Cloud and Google Colab versions of Stable Diffusion.

  • How can users follow the speaker's future content?

    -Users are encouraged to like and subscribe to the speaker's YouTube channel for updates on future tutorials and content.

  • What is the speaker's advice for users who are new to 3D software?

    -The speaker advises new users to practice with the 3D OpenPose plugin to get familiar with the rotation and adjustment of the 3D model to achieve the desired pose for image generation.



📺 Introduction and Update on Tutorial Series

The speaker welcomes viewers to the 11th episode of the SD tutorial series, highlighting the release of the first member-exclusive tutorial. They report on the growth of their YouTube channel with 11.9k subscribers and the daytime active user count on their Discord channel, averaging 400-500. The speaker also mentions two fans who will be featured on TV, humorously noting one's name similarity to a famous actor. Before diving into the lesson, the speaker explains the change in the SD UI due to a switch from Google COALB to a Tencent Cloud server, emphasizing the cost-effectiveness of the new setup for tutorial recording. They promise a future tutorial comparing Google COALB and Tencent Cloud deployments and the优劣 of each.


📊 Exploring OpenPose Model and 3D OpenPose Plugin

The speaker delves into the OpenPose model, explaining its function in posture detection and how it can be used in conjunction with the newly introduced 3D OpenPose plugin. They guide viewers through the process of using the OpenPose model to generate images with specific postures, starting with uploading an image and allowing preview processing. The speaker demonstrates the use of the 3D OpenPose plugin to adjust and set desired poses, detailing the control options for rotating and moving the 3D model. They explain how to export the pose data back to the CTN for use in image generation, emphasizing the flexibility and potential for creative control over character poses in generated images.


🖌️ Applying 3D OpenPose in Image Generation

The speaker concludes the tutorial by applying the 3D OpenPose plugin to generate an image, showcasing the practical use of the model. They guide viewers through the process of setting up the 3D pose, exporting it to the CTN, and using it to generate an image with the desired pose. The speaker emphasizes the importance of matching the dimensions and ensuring the OpenPose model is enabled for accurate posture generation. They also discuss the potential for creative freedom in pose design and encourage viewers to experiment with the 3D OpenPose plugin. The tutorial ends with a call to action for viewers to like and subscribe for more content, promising future tutorials on SD and related topics.



💡SD (Stable Diffusion)

SD, or Stable Diffusion, is a type of AI model used for generating images from textual descriptions. In the context of the video, it is the primary tool being discussed and utilized for creating images. The video provides tutorials on how to use SD effectively, including deploying it on different platforms and integrating it with other models like OpenPose.


OpenPose is a pose estimation model that detects human body keypoints and segments them into a skeleton structure. In the video, OpenPose is used to analyze and replicate human poses for image generation with SD, ensuring that the generated images have accurate and desired postures.

💡3D OpenPose Plugin

The 3D OpenPose Plugin is an extension that allows for the manipulation of a 3D human pose model. It provides a user interface to adjust the pose of a 3D character and generate a corresponding 2D pose image, which can then be used in SD for more accurate pose generation.

💡CTN (Controlled Text-to-Noise)

CTN, or Controlled Text-to-Noise, is a framework that allows users to control the noise level and other parameters in the image generation process with SD. It is used to fine-tune the generation process and achieve specific visual effects or styles.

💡Google COLAB

Google COLAB is a cloud-based platform for machine learning and research that allows users to run Python code and use GPU resources without the need for local setup. In the video, COLAB is mentioned as a platform where the presenter has deployed an earlier version of SD and provided tutorials on its usage.

💡Tencent Cloud

Tencent Cloud is a cloud computing service provided by Tencent, similar to Google COLAB, but with different pricing and resource allocation models. The video discusses the advantages of using Tencent Cloud for deploying SD, particularly for users who require long hours of continuous usage.


Discord is a communication platform used by communities for real-time chat, voice calls, and more. In the context of the video, Discord is mentioned as a channel where the community interacts, with specific users being highlighted for their engagement or contributions.

💡YouTube Channel

The YouTube Channel is the platform where the presenter shares their tutorials and interacts with their audience. It is a central hub for the content related to SD, CTN, and other related technologies.

💡UI (User Interface)

UI, or User Interface, refers to the visual and interactive elements of a software application or system. In the video, the presenter discusses changes to the SD UI due to a shift from Google COLAB to a self-hosted version on Tencent Cloud.

💡Model Deployment

Model deployment refers to the process of making a machine learning model accessible for use, typically by hosting it on a server or cloud platform. In the video, the presenter discusses deploying SD on different platforms and the considerations for doing so.

💡Community Engagement

Community engagement refers to the strategies and activities used to involve and interact with a community of users or followers. In the video, the presenter mentions community engagement through features like 'fans on TV' and updates on the YouTube channel's growth.


The tutorial series has reached its 11th episode, showcasing the progress and updates of the SD platform.

The YouTube channel for the eastern war zone has 11.9k subscribers, indicating visible growth.

The Discord channel for the western war zone averages 400-500 online users during the day.

Two fans will be featured on TV, one named after the actor Sun Honglei and another named Melody.

The presenter has switched to a Tencent Cloud server for deploying SD, offering a more cost-effective solution for frequent use.

The new Tencent Cloud deployment is being tested, with a focus on its suitability for long-duration, high-frequency SD users.

A detailed comparison between Google Colab and Tencent Cloud deployments will be provided after May 1st.

The tutorial focuses on the OpenPose model within the CTN, highlighting its capabilities and applications.

The OpenPose model can detect and replicate human poses, allowing for pose-guided image generation.

The latest version of the 3D OpenPose plugin is introduced, offering advanced pose manipulation.

The 3D OpenPose plugin allows users to freely position and rotate a 3D model to create desired poses.

The plugin's pose can be exported and used in the CTN for pose-constrained image generation with SD.

The tutorial demonstrates the process of using OpenPose to generate images with specific poses.

The presenter provides a step-by-step guide on how to install and use the 3D OpenPose plugin.

The tutorial emphasizes the flexibility of 3D OpenPose in creating a variety of poses for image generation.

The presenter encourages viewers to experiment with the 3D OpenPose plugin to understand its full potential.

The tutorial concludes with a demonstration of generating an image using a pose created in 3D OpenPose.

The presenter invites viewers to follow for more tutorials on SD and related technologies.