Stable Diffusion

Install the Stable Diffusion Interface

Install a popular interface for easier manipulation instead of using pure command line.

Install Automatic1111 or ComfyUI on a GPU-equipped machine, or sign up for a cloud service like RunDiffusion if the machine is not powerful enough.

If you are not familiar with technical aspects, use an available cloud version with an interface to bypass complex installation steps.

Download the ControlNet Model and Extension

Install the foundational model and the ControlNet extension to maintain the original product shape while changing the background.

Download an appropriate checkpoint model (e.g., realistic vision) and install the ControlNet extension from the Extensions tab in Automatic1111.

Choose a model that is well-rated by the community on Civitai to ensure better output quality.

Load the Original Product Image into ControlNet

Use a real product photograph as a reference image to maintain the correct shape.

Enable ControlNet, select the Canny or Depth preprocessor, and upload the original product image as the control image.

Use Canny when you need to preserve the accurate outlines of the product, and use Depth when you need to maintain the depth of the composition.

Write a Prompt for the New Background

Describe the desired background in the main prompt box, with the product remaining unchanged thanks to ControlNet.

Enter the prompt such as "minimalist wooden table, natural window light, warm beige background" and press Generate.

Run a test with 4-8 images at a time (batch count) to select the most visually appealing lighting layout.

Enhance the Final Image Resolution

Use an upscale tool to achieve a suitable resolution for publishing or printing the image.

Send the selected image to the Extras tab, choose an upscaler (e.g., R-ESRGAN), and increase the resolution by 2x or 4x.

Save the ControlNet settings and prompts that have been successfully used for future reuse with similar products.