# Text to Motion

## Overview

The Text to Motion tool allows you to generate animations giving one or more text prompts as input.

We usually structure the prompts as follows:

```
A person <describe action> <describe style>
```

For example:

```
A person is walking forward hastily
```

{% hint style="info" %}
These prompt examples are a good starting point, but feel free to experiment and let us know which prompts gave you the best results! Also dont forget to visit our [prompt-guidelines](https://docs.realtwin.org/virtual-productions-cloud/vpc-plugin/toolkits/motion-toolkit/tools/prompt-guidelines "mention") section for more information.
{% endhint %}

## Tool Inputs

### Single action generation

<figure><img src="https://3763251240-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9BAa74uZVvvtnO0Rq9Vh%2Fuploads%2Fgit-blob-db23f7274f36c42f2a63c618cbad32babfad494f%2Ftext-to-motion.png?alt=media" alt=""><figcaption></figcaption></figure>

Inputs:

* **MotionPrompts:** The set of of actions. Each "Action" corresponds to a distinct motion that is defined by:
  * **Prompt**: A text prompt describing the motion
  * **Frames**: The desired number of frames that the motion should last.
  * **Seconds**: The number of Frames selected will be automatically converted to seconds and displayed in this field
* **Seed:** A random number used for generating varied outputs with identical inputs. For instance, two generated motions with different seeds, might differ even with the same text prompts and durations.

{% hint style="info" %}
You can also describe multiple actions in a single prompt, using the "then" keyword and separating with commas.

Example: "A person is running forward, then stops and sits down"

However, we suggest using the [Multi-action feature](#multi-action-generation) described below for this use case.
{% endhint %}

{% hint style="info" %}
At the moment, the FPS value of a generated animation is always 30. The upper limit for a single action is 196 frames (6 seconds) at the moment. We are working to remove these limitations in the near future.
{% endhint %}

{% hint style="info" %}
The suggested range for the number of frames is between 70 and 180 frames.
{% endhint %}

### Multi action generation

<figure><img src="https://3763251240-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F9BAa74uZVvvtnO0Rq9Vh%2Fuploads%2Fgit-blob-96efbb09c1de58cc94aa46d6a03d3bb63f25ee7c%2Ftext-to-motion-multi.png?alt=media" alt=""><figcaption></figcaption></figure>

You can define one or more actions (multi-action generation) by adding or removing elements in the “Actions” array. The "Actions" defined will be "stitched together" to produce the final motion result.

{% hint style="info" %}
You can use the multi-action feature to create animations that last longer than 6 seconds, which is the current limit of single-action generations
{% endhint %}

{% embed url="<https://youtu.be/tbQdv67IJE4>" %}
