AI-generated images are all the rage right now with people using Craiyon (formerly known as DALL-E mini) to create nonsensical memes. Now Meta is throwing his hat in the ring with his own image generator, but with a greater emphasis on creating artistic pieces.
The AI tool is called Make-A-Scene (opens in new tab) and it uses a combination of text prompts and sketch outlines to generate a 2,048 x 2,048 pixel image. Meta demonstrated the tool in a video where the company asks several artists to create a work of art.
An artist, Alexander Reben, asked Make-A-Scene to create a high-definition image of a hot dog floating in mid-air and fed into the system a simple sketch of an oval over a square. Sure enough, Make-A-Scene created a detailed image of a hot dog floating above a body of water. The sketches themselves don’t have to be super detailed. It’s about giving the AI a general idea of what the final image should look like.
Meta added sketches as part of the image generation process because, it claims, text prompts alone don’t convey an artist’s intent very well. The company gives the example of the tool to create an image of a zebra on a bicycle. Using just the text prompt, the zebra in the image may be too large or pointing in the wrong direction. Sketches give Make-A-Scene a structure to follow.
Images shot with Make-A-Scene are more faithful to the sketch outline than to the text prompt. According to tests and developer reviewers, generated images were found to be “better aligned” with the outline 99.54 percent of the time. The tool took the text prompt into account 66.3 percent of the time.
It is unknown if or when Make-A-Scene will be made available to the public. Meta alludes to the tool used to help people with their own creative endeavors or an art director with their marketing campaign. We also don’t know how the sketches will work.
Can people upload their own outlines to the image generator or are they provided by developers? We’ve asked Meta for more information about the sketches and we’ll update this post if it ever responds.
Meta states that it will hold a presentation for Make-A-Scene at the ECCV event this year (opens in new tab) (European Conference on Computer Vision) to be held in Tel Aviv, Israel. The event kicks off on October 23 and runs through October 27.
Analysis: Future with AI
AI generator tools are a fascinating concept that has produced incredible results. We’ve created some of our own offbeat AI art with Google’s Imagen AI generator.
AI imaging tools are not quite ready to compete with skilled artists and most are not available to the public due to fears of abuse, apart from Craiyon which uses an open source model (opens in new tab) to replicate OpenAI’s DALL-E. But there are developers who make AI tools outside of making art. Name Cheapfor example, is an AI tool that can generate a name for your business if you are stuck with ideas.
There are also AI writing tools to quickly compose content. In reality, we have a list of the best for 2022, but they do require human intervention to edit them. We just hope they don’t get too good or we run out of work.