{
  "patent_number": "US 10964084",
  "country": "US",
  "title": "Creating Realistic Character Animations with AI Networks",
  "original_title": "Generating realistic animations for digital animation characters utilizing a generative adversarial network and a hip motion prediction network",
  "summary": "This patent describes how to generate lifelike digital character animations using artificial intelligence networks, specifically by predicting joint movements and overall body motion from either random inputs or specific key poses.",
  "what_it_does": "The patent details a system for generating digital character animations. It starts by identifying a \"code vector\" (Claim 1), which can be a random input for new animations or derived from \"keyframes\" (Claim 2) that define specific poses. A \"generative adversarial network\" (GAN) then uses this code vector to create a \"sequence of local poses\" (Claim 1), which are the positions of a character's joints relative to its main \"root joint\" (like the hip). Next, a \"root joint motion prediction network\" calculates \"hip joint velocities\" and \"global poses\" (Claim 1), which means it figures out how the character's entire body moves in the animation space. Finally, the system generates the full animation based on these global poses. For example, an animator could provide a few key poses for a character, and the system would automatically fill in the realistic movements between them.",
  "what_it_does_not_cover": [
    "Does not cover animation generation without using a generative adversarial network (GAN) to produce local poses.",
    "Does not cover systems that predict global body motion without specifically determining hip joint velocities from local poses.",
    "Does not cover animation methods that rely solely on traditional manual keyframe interpolation without AI networks.",
    "Does not cover generating animations where the root joint motion prediction network is not a convolutional neural network, as specified in Claim 3.",
    "Does not cover systems that generate animations without first identifying a code vector or a set of keyframes as input."
  ],
  "filed": "2019-06-25",
  "granted": "2021-03-30",
  "expires": "2039-06-25",
  "status": "active",
  "holder": "Adobe",
  "holder_url": "https://patentbrief.org/company/adobe",
  "inventors": [
    {
      "name": "Connelly Barnes",
      "url": "https://patentbrief.org/inventor/connelly-barnes"
    },
    {
      "name": "Jimei Yang",
      "url": "https://patentbrief.org/inventor/jimei-yang"
    },
    {
      "name": "Yi Zhou",
      "url": "https://patentbrief.org/inventor/yi-zhou"
    },
    {
      "name": "Jingwan Lu",
      "url": "https://patentbrief.org/inventor/jingwan-lu"
    }
  ],
  "times_cited": 1,
  "tags": [
    "software",
    "ai_ml",
    "consumer_electronics",
    "gaming",
    "telecommunications"
  ],
  "abstract": "The present disclosure relates to systems, methods, and non-transitory computer readable media for generating a digital animation of a digital animation character by utilizing a generative adversarial network and a hip motion prediction network. For example, the disclosed systems can utilize an unconditional generative adversarial network to generate a sequence of local poses of a digital animation character based on an input of a random code vector. The disclosed systems can also utilize a conditional generative adversarial network to generate a sequence of local poses based on an input of a set of keyframes. Based on the sequence of local poses, the disclosed systems can utilize a hip motion prediction network to generate a sequence of global poses based on hip velocities. In addition, the disclosed systems can generate an animation of a digital animation character based on the sequence of global poses.",
  "url": "https://patentbrief.org/patent/us/10964084/generating-realistic-animations-for-digital-animation-characters-utilizing-a-gen",
  "markdown_url": "https://patentbrief.org/patent/us/10964084/generating-realistic-animations-for-digital-animation-characters-utilizing-a-gen/md",
  "google_patents_url": "https://patents.google.com/patent/US10964084",
  "relatedPatents": [
    {
      "patentNumber": "12141700",
      "countryCode": "US",
      "title": "How AI Generates Images Based on Style and Content Cues",
      "url": "https://patentbrief.org/patent/us/12141700/generative-adversarial-network-for-generating-images"
    },
    {
      "patentNumber": "20230297446",
      "countryCode": "US",
      "title": "How to Train AI Models with Fake Data Using Generative Networks",
      "url": "https://patentbrief.org/patent/us/20230297446/data-model-generation-using-generative-adversarial-networks"
    },
    {
      "patentNumber": "10607134",
      "countryCode": "US",
      "title": "How AI Learns to Control Game Characters Based on Their Surroundings",
      "url": "https://patentbrief.org/patent/us/10607134/artificially-intelligent-systems-devices-and-methods-for-learning-andor-using-an-avatars-circumstances-for-autonomous-avatar-operation"
    },
    {
      "patentNumber": "12282696",
      "countryCode": "US",
      "title": "How AI Transfers Visual Styles Between Images While Keeping Structure",
      "url": "https://patentbrief.org/patent/us/12282696/method-and-system-for-semantic-appearance-transfer-using-splicing-vit-features"
    },
    {
      "patentNumber": "11615208",
      "countryCode": "US",
      "title": "How Cloud Systems Automatically Create and Train AI Data Models",
      "url": "https://patentbrief.org/patent/us/11615208/dall-e-text-to-image-generation"
    }
  ]
}