Meta AI releases Emu Edit and Emu Video – Generative AI for social

Create AI images and videos across social media!

Emu Edit and Emu Video - Meta AI's AI image and AI video generator for Facebook and Instagram.

You can trust PC GuideOur team of experts use a combination of independent consumer research, in-depth testing where appropriate – which will be flagged as such, and market analysis when recommending products, software and services. Find out how we test here.

Last Updated on

The new AI tools are an implementation of Meta’s own Emu foundational model announced at Meta Connect on October 16th, 2023. Emu Edit and Emu Video bring generative AI capabilities to social media apps Facebook and Instagram, in the form of text-to-video generation. So how good is CEO Mark Zuckerberg’s new AI-powered video tool?

What is Emu Edit?

Emu Edit allows you to create AI-generated images within Meta platforms social media apps Facebook and Instagram. Using simple text prompts, you can create any style of AI generated image, in the same way as alternative AI art generators Midjourney or Stable Diffusion. We’ve already seen an early iteration of this implementation in Meta’s AI stickers, released earlier this year.

The new AI image generator represents “a novel approach that aims to streamline various image manipulation tasks and bring enhanced capabilities and precision to image editing.”

Available now, it is “capable of free-form editing through instructions, encompassing tasks such as local and global editing, removing and adding a background, color and geometry transformations, detection and segmentation, and more.” This differs in philosophy from some current methods on the market, in how the text instructions are prioritized. Meta affirms that “the primary objective shouldn’t just be about producing a “believable” image. Instead, the model should focus on precisely altering only the pixels relevant to the edit request. Unlike many generative AI models today, Emu Edit precisely follows instructions, ensuring that pixels in the input image unrelated to the instructions remain untouched. For instance, when adding the text “Aloha!” to a baseball cap, the cap itself should remain unchanged.”

The end result is superior performance, applying resources only where necessary. We expect Meta’s implementation to excel at computer vision tasks as a result.

Essential AI Tools

Editor’s pick
Only $0.00019 per word!

Content Guardian – AI Content Checker – One-click, Eight Checks

8 Market leading AI Content Checkers in ONE click. The only 8-in-1 AI content detector platform in the world. We integrate with leading AI content detectors to give unparalleled confidence that your content appear to be written by a human.
EXCLUSIVE DEAL 10,000 free bonus credits

Jasper AI

On-brand AI content wherever you create. 100,000+ customers creating real content with Jasper. One AI tool, all the best models.
TRY FOR FREE

WordAI

10x Your Content Output With AI. Key features – No duplicate content, full control, in built AI content checker. Free trial available.
TRY FOR FREE

Copy.ai

Experience the full power of an AI content generator that delivers premium results in seconds. 8 million users enjoy writing blogs 10x faster, effortlessly creating higher converting social media posts or writing more engaging emails. Sign up for a free trial.
TRY FOR FREE

Writesonic

Create SEO-optimized and plagiarism-free content for your blogs, ads, emails, and website 10X faster. Start for free. No credit card required.

What is Emu Video?

Emu Video allows you to animate AI images generated with Emu Edit. Meta’s AI video generator will produce high quality video from the input image. The resulting video quality will be 512×512 resolution at 16fps. The four-second long videos can be of any visual style you can describe, but will be limited to a visual quality similar to GIFs.

Meta AI Emu Video output results.
Meta AI’s Emu Video quality.
✓ Steve says

Is Meta’s AI-generated video any good?

16fps is a low frame rate, compared to the 24fps of most films you’ve ever seen, and 30fps of most social media video content. More frames do not objectively make a video better, but the 16fps output of Emu Video is visually similar to the GIF format with which we’re all familiar. It’s not great yet, to say nothing of the mediocre 512×512 (and therefore square) resolution. That said, it’s pretty good for the scale at which Meta is deploying it, and as the technology matures we can expect these aspects to improve throughout 2024.

Meta’s AI video generation model, which leverages the firms Emu model (the foundational model), Meta presents a novel approach to text-to-video generation based on diffusion models. The video generation process uses a “unified architecture for video generation tasks that can respond to a variety of inputs: text only, image only, and both text and image.”

There are two steps to create an AI-generated video with this new state-of-the-art vide tool: First, generate an image “conditioned on a text prompt”, and then generate a video “conditioned on both the text and the generated image. This “factorized” or split approach to video generation lets [Meta] train video generation models efficiently.” As a result, “factorized video generation can be implemented via a single diffusion model.” This leaves the big tech firm responsible for “critical design decisions, like adjusting noise schedules for video diffusion, and multi-stage training”, essentially all the highly technical stuff, while users need only provide a little creativity.

Steve is the AI Content Writer for PC Guide, writing about all things artificial intelligence. He currently leads the AI reviews on the website.