Adobe has released a new tool called Generative Fill for its popular photo-editing software, Photoshop. This cloud-based tool allows users to fill selected areas of an image with new AI-generated content based on their prompts. However, Adobe is taking precautions to prevent the generation of harmful or socially stigmatized content. They are ensuring that artists’ images are not used without their consent and preventing the Generative Fill tool from generating content that includes certain copyrighted, violent, and sexual content.
Adobe recently launched its own AI tool called Adobe Firefly, which uses the same AI model as Generative Fill. Adobe Firefly is trained on millions of images from Adobe’s stock library to associate certain imagery with text descriptions. Adobe has integrated these AI-powered features into its products, making it possible for users to modify images in new and innovative ways.
Generative Fill is currently in beta and allows users to modify selected areas of an image with AI-generated content based on text descriptions. It competes with popular image generators and editors like OpenAI’s DALL-E and Microsoft Designer or Bing Image Creators, but it is geared more towards professionals. Generative Fill also addresses concerns about potential disinformation by implementing a content authenticity initiative.
Adobe Generative Fill
This tool makes changes to images without destroying their original meaning. It lets users add, extend, or remove parts of an image based on text prompts. It can also adjust the perspective, lighting, and style of an image to help users achieve better results and save time.
The AI-powered creative tool in Adobe Photos helps users generate new content for their images and provides high-resolution images. Adobe FireFly aims to transparently integrate AI generative abilities into Creative Cloud programs, and there may be more announcements regarding FireFly integration in the future.
The tool can remove parts of an image or extend its dimensions by generating new content that complements the existing image. This is called outpainting. The FireFly beta waitlist has been recently removed, so non-Creative Cloud subscribers can try Generative Fill for free on the Adobe FireFly website. This helps users work more efficiently rather than doing everything manually.
How to Use Adobe Photoshop for Generative Fill
When using generative fill in Photoshop, make sure to write a specific prompt and avoid using too many words or phrases. To use generative fill, follow these steps:
- Open Photoshop and select the image you want to edit.
- Select the area you want to modify, then click the generative fill button on the toolbar.
- Type the prompt in the contextual taskbar and click the generate button.
- Wait for Photoshop to process the prompt and return several generation options.
- Choose the image you want to use and create more options by clicking the Create more button.
Generative fill extends visual content based on natural-language text prompts. The tool offers features such as inpainting and outpainting. For example, you can paint the sky to look surreal in photos. You can then select the area and type something like “surreal sky with strange colour,” or similarly extend that content beyond the image into your prompt field.
This tool restricts people from producing abusive, illegal, or confidential content. The company also doubled down on its Content Authenticity Initiative. This initiative allows you to check the content credentials of an image by inspecting it via verify.contentauthenticity.org. It uses content credentials to add metadata to generated files. This metadata means that Photoshop is encoded with an invisible digital signature, indicating whether it’s human-made or the product of AI. This helps to track the provenance of the files and shows who created them and when they were created. This ensures that the artist’s work won’t be plagiarised by machines.
Generate fill is available in Photoshop Beta Build 4.6 or higher as part of a Creative Cloud subscription or trial. You can find this in the beta apps section of the Creative Cloud desktop. This feature is only available to individuals over 18 in countries except China and is not available for commercial use. Alternatively, if you want to use generative fill yourself for free, you can check out the Adobe Firefly website by logging in with your Adobe account.
FireFly has generated over 100 million images on its platform and is ready to be integrated into Photoshop. This is expected to be generally available in the second half of 2023. FireFly is already being used in Adobe Illustrator to recolor vector-based images and is also coming to Adobe Express.