Tag: Movie Gen

  • Instagram to Allow AI-Modified Videos by Text Input Amid Criticism

    Instagram to Allow AI-Modified Videos by Text Input Amid Criticism

    Instagram’s CEO, Adam Mosseri, recently shared a video introducing new AI features named "Movie Gen" for its platform. The concept is straightforward: users can upload a video, turn on the "Movie Gen" filter, and briefly explain how they want the AI to modify the video.

    AI Transformations Previewed

    In the announcement video, viewers get a glimpse of the potential changes AI can make, like altering a person’s outfit or modifying the background environment. The goal is to allow users to tweak any part of their video in just seconds by inputting their desired changes. Although Mosseri hints at a launch for Movie Gen next year, he hasn’t provided exact dates or detailed insights about how this feature will function in its final version.

    User Reactions Mixed

    Despite Mosseri’s excitement about Movie Gen’s features, a significant number of Instagram users seem frustrated at the idea of dealing with even more AI-generated material. Many users expressed their desire for a feed free from AI influences and called for improved monetization for genuine, non-AI content. Critics are vocal about the platform’s push towards creating "fake videos" and lack of originality. The social media site also appears to have no intentions of labeling AI-generated content, as shown in Mosseri’s unofficial announcement video.

    Adam Mosseri (Instagram) | Claudio Schwarz (teaser image)

    Source: Link

  • Meta Launches Movie Gen AI for Quick Video and Music Creation

    Meta Launches Movie Gen AI for Quick Video and Music Creation

    Meta has introduced Movie Gen, an advanced AI that can produce and edit videos while incorporating music and sound effects based on text prompts. This AI stands out due to its exceptional video and audio generation abilities, offering features and realism that surpass those of any other AI available.

    AI Specifications

    Movie Gen is built on a 30-billion parameter AI model that can create 16-second HD clips from text prompts. It has been pre-trained with one billion images and 100 million videos, selected from a much larger dataset to enhance quality for training purposes. On the audio side, Movie Gen Audio utilizes a 13-billion parameter model designed to generate 48 kHz sound effects and music from text prompts, having been pre-trained on one million hours of audio. The AI has been improved through human feedback along with high-quality audio and video samples.

    Realistic Video Generation

    When provided with a photo of a person and a description of that person in a specific scene, the AI can produce a realistic video featuring an animated actor in that environment. It has been programmed with knowledge of 22 different camera motions and positions, such as wide angle, tilt up, and truck left, allowing filmmakers to determine virtual camera placement and movements similar to actual filming. For filmmakers who prefer traditional methods, high-end DSLRs like the Nikon Z6III, available on Amazon, can still be utilized. Interestingly, Movie Gen is capable of editing videos in a way that is both precise and realistic, which is something other AIs currently struggle to achieve.

    Audio Integration and Limitations

    Additionally, text prompts can be used to incorporate professional-quality audio into the video clips, featuring sound effects and music scores. While the AI can generate music lasting several minutes, it is restricted to 16-second video clips due to the significant computing power required. The audio is synchronized with the scene’s beats and can produce off-screen sounds, like birds chirping in a forest, based on the scene’s context.

    Meta is actively working on implementing safeguards for Movie Gen and plans to launch the AI once it is assured of its safety.


    Image 1
    Image 1
    Image 1
    Image 1