From a7d3e649e743d8096a8b4b3addd14f81f19ab405 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Fri, 8 Dec 2023 17:35:14 -0500 Subject: [PATCH 01/11] MCS-1991 Updating docs --- TASK_LIST.md | 420 +++++++++++++++++++++++++++++++++++++++ docs/source/dev.rst | 14 +- docs/source/index.rst | 1 - docs/source/install.rst | 49 ++--- docs/source/remotely.rst | 10 +- docs/source/scenes.rst | 322 +----------------------------- docs/source/training.rst | 78 -------- 7 files changed, 466 insertions(+), 428 deletions(-) create mode 100644 TASK_LIST.md delete mode 100644 docs/source/training.rst diff --git a/TASK_LIST.md b/TASK_LIST.md new file mode 100644 index 000000000..b40405baf --- /dev/null +++ b/TASK_LIST.md @@ -0,0 +1,420 @@ +# Task List + +TODO + +## Interactive Tasks + +TODO DOWNLOAD + +### Introduced in Evaluation 3 + +#### Retrieval - Containers + +TODO + +#### Retrieval - Obstacles + +TODO + +#### Retrieval - Occluders + +TODO + +### Introduced in Evaluation 4 + +#### Object Permanence (Interactive) + +TODO + +### Introduced in Evaluation 5 + +#### Agent Identification + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/d9f7e054-8d46-467a-8d16-dcf126af8a81 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b27f91e-9d74-482c-8e2f-236930c28bb0 + +Details: + +- You start on a tall platform bisecting the entire room. There will be an agent on one side of the room and a non-agent (a random object, like a sofa) on the other side of the room. As with our other interactive tasks, your goal is to “find and pickup the soccer ball”, but the soccer ball will not be visible. You will have to jump off the platform onto the side of the room containing the agent and request that the agent produce the soccer ball for you. +- The core goals of this task are learning: + - How to identify an agent based on surface features (like faces) and self-propulsion (like breathing and walking). + - To request help from an agent if the goal object (soccer ball) is not otherwise visible. +- In Eval 5, there will only be one agent in a scene, and the agent will always be able to produce the soccer ball upon request. However, these assumptions might change in future evals. +- Starting in release 0.5.3, there will be an InteractWithAgent action that facilitates the request for the agent to produce the soccer ball: + - The agent will rotate across multiple action steps to face you, reach behind its back to retrieve the soccer ball, and offer the ball to you. + - You can use the PickupObject action to pick up the ball from the agent’s hand. + - You will have to use the Pass action multiple times to wait for the agent to finish performing its animation/movement before you can pick up the ball. + - In future evals, the agent may instead refer you to the ball’s location via an animation like pointing. +- Starting in release 0.5.4, each agent can be configured to have a walking path. +- You will be able to walk across the full length of the platform before you jump off from it in order to verify that the soccer ball is not hiding behind any objects in the scene. + +#### Moving Target Prediction + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/22b4c78f-7eef-44a4-8e75-82306f12dc09 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/8b13cb6d-7fdd-48d9-94d4-9ba95ae6b073 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/aef99402-8029-476c-b431-6d931701fbe4 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/dd5b75e8-6612-4fb8-91e4-92a6e0217f43 + +Details: + +- The core goal of this task is to understand the speed and trajectory of the soccer ball in order to intercept it. At the start of the scene, the ball will immediately be rolled out from the “thrower” on one of the side walls (grey tube) at a speed that should give your AI enough time to think and retrieve it before it rolls into a pool of lava (and out of reach) positioned across the other side of the room. As in the real world, the ball is affected by physical properties like drag and friction. The ball will remain in contact with the floor during its movement (no bouncing). +- At the start of the scene, before the soccer ball is rolled out from the thrower, your AI will be forced to rotate in a complete circle (using 36 sequential RotateRight actions), so it may see the initial landscape of the room. +- Like other interactive scenes, you use the PickupObject action to retrieve the ball. +- You will start on a platform so you can get a good view of the entire room, but can walk off the platform at any time as normal. +- See “Navigation: Lava” for more information on adjusting our lava settings for training. + +#### Navigation - Holes + +Details: + +- If you move too close to a hole, you’ll fall in, and won’t be able to get out. +- Your AI will begin on a platform so it has a good view of the entire room before moving. + +#### Navigation - Lava + +Details: + +- Stepping too close to the lava will force you to immediately end the scene (you will only be allowed to use the “EndScene” action if you try to call the step function, or you can call end_scene yourself). This will be what happens during the evaluation. You can override the default setting using the steps_allowed_in_lava config property: https://nextcenturycorporation.github.io/MCS/install.html#steps-allowed-in-lava +- Stepping too close to the lava will give you an insurmountably large reward penalty. You will always receive this penalty, even if you must immediately end the scene due to the steps_allowed_in_lava setting (see above). You can override the default setting using the lava_penalty config property: https://nextcenturycorporation.github.io/MCS/install.html#lava-penalty +- Stepping too close to the lava will adjust the haptic_feedback and steps_in_lava properties of the StepMetadata output returned by that action step: haptic_feedback will be {"on_lava": true} and steps_in_lava will increase by one. https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.StepMetadata +- Your AI will begin on a platform so it has a good view of the entire room before moving. + +#### Navigation - Ramps + +||| +|---|---| +![ramps_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/b2c87fde-ca3f-48cc-8ed4-597ceacc3d39) | ![ramps_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/33b9373a-77fd-4e9e-8050-88a9dd3a7a1c) + +Details: + +- Ramps will always be triangles/wedges. They can have angles up to 45 degrees. They will always be the same color/texture as their corresponding platform. +- Platforms can have either one or two levels. Each platform level will always have a different color/texture. Platforms will have “lips” (or edges) that surround their perimeter to make it impossible to move off the platform without using one of its corresponding ramps. + +#### Solidity + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/392d5b5e-977f-4c75-a169-7a50f5752cf7 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/308d2d09-e4af-472b-93f4-9f626692bdde + +Details: + +- You start on a tall platform bisecting the entire room. Notably, there is an extension of the platform coming out of either its left or right side, which is only accessible by walking on top of the platform. Additionally, the far end of the platform has "lips" (or edges) that surround the platform and make it impossible to move off the platform to the ground on that end. +- Each solidity scene contains 3 phases. You will be frozen (only able to perform Pass actions) at the start (about 60 to 100 action steps), but later you will be able to act freely. + - First, you will see a placer (pink cylinder) holding a soccer ball slowly descend from the ceiling and come to a stop either above the platform or in mid-air. Note that the placer hasn’t released its hold on the ball yet. + - Second, you will see a large occluder descend from the ceiling between you and the soccer ball blocking most (but not all) of your view of the far end of the room. This occluder will have three doors: one on ground level to the left of the platform; one on ground level to the right of the platform; and one in the middle at platform level. Once this “door occluder” has finished descending, it will no longer move. (This door occluder moves and works the same as in the Interactive Support Relations task.) + - Third, you will see the placer turn blue, indicating that it has released the soccer ball, and ascend back into the ceiling. However, due to the occluder, you can’t see the final position of the ball. You will then be unfrozen and must pickup the soccer ball to succeed in the trial. You will need to decide whether the ball has fallen to the ground on the left side (only accessible via the left door), the right side (only accessible via the right door), or the platform extension (only accessible via the middle door). +- A door can be opened using the OpenObject action. However, in these scenes, once you open one door, you will not be able to open another door. + +#### Spatial Elimination + +||| +|---|---| +![spatial_elimination_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/9152594e-ca9f-43eb-a499-7b107d7fe406) |![spatial_elimination_eval_5_ex_2](https://github.com/NextCenturyCorporation/MCS/assets/10994382/63df3f27-98df-46c0-888a-fc0887ae0708) +![spatial_elimination_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/83fa96da-fc7a-41c1-aa6a-42a4376443d8) |![spatial_elimination_eval_5_ex_4](https://github.com/NextCenturyCorporation/MCS/assets/10994382/d3897fdc-3fdf-408a-97ee-a0f6784f23eb) + +Details: + +- Like the Interactive Object Permanence tasks from Eval 4, these scenes contain a tall platform bisecting the entire room. You’re forced to move off the platform to either side, but, once you’ve made a choice, you can’t access the other side. + +#### Support Relations (Interactive Gravity Support) + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/436f1c93-8043-4599-adbc-e50dac0194ad + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/40caccb2-39d2-45ed-af55-8ed98657059b + +Details: + +- You start on a tall platform bisecting the entire room. Notably, the far end of the platform (beyond the door occluder) is raised to make it impossible to move forward on the platform past the middle door. +- Each support relations scene contains 3 phases. You will be frozen (only able to perform Pass actions) at the start (about 60 to 100 action steps), but later you will be able to act freely. + - First, you will see two placers (pink cylinders) holding a container slowly descend from the ceiling and come to a stop above the platform, so that the width of the container is either fully above the platform or partially above the platform. The container will always be open-topped (i.e. you don’t have to “Open” it), either symmetric or asymmetric (from your view point), and holding the soccer ball (clearly visible). Note that the placers haven’t released their hold on the container yet. + - Second, you will see a large occluder descend from the ceiling between you and the soccer ball blocking most (but not all) of your view of the far end of the room. This occluder will have three doors: one on ground level to the left of the platform; one on ground level to the right of the platform; and one in the middle at platform level. Once this “door occluder” has finished descending, it will no longer move. (This door occluder moves and works the same as in the Interactive Solidity task.) + - Third, you will see the placers turn blue, indicating that they have released the container, and ascend back into the ceiling. However, due to the occluder, you can’t see the final position of the container or the ball. You will then be unfrozen and must pickup the soccer ball to succeed in the trial. You will need to decide whether the container and the ball were properly supported by the platform (only accessible via the middle door) or were not supported by the platform and have therefore fallen to the ground on either the left side (only accessible via the left door) or the right side (only accessible via the right door). +- A door can be opened using the OpenObject action. However, in these scenes, once you open one door, you will not be able to open another door. + +#### Tools - Symmetric + +||| +|---|---| +![tool_use_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/e38e275b-99d3-4ce4-8851-28b6b1558d16) | ![tool_use_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/ebd8f106-e1d8-4db9-bb80-d3c79d386aca) + +Details: + +- Tools have their own object types that are all identical except in their length and width. They look like large grey rectangular prisms on wheels with a short cylinder sticking up from each corner. They have a unique grey hexagonal metallic texture. They are all low friction and light weight, to make them easy to push by force. https://nextcenturycorporation.github.io/MCS/schema.html#tool-objects +- The core goal of this task is for you to learn how to maneuver the tool object so it will collide with the soccer ball and cause it to roll from the lava into an accessible area of the room. To achieve this goal, we’ve prepared five actions for you to use with the tool object. All are acceptable to use during the evaluation. + - PushObject and PullObject, which apply a force on the center of a specific object, either directly away from you (push) or directly toward you (pull), based on your current facing. A large applied force may persist across multiple action steps. Some force will be transferred onto lighter objects (like the soccer ball) that are contacted by the pushed/pulled object. Note that smaller and lighter objects will realistically move more than larger or heavier objects under equal amounts of force. + - MoveObject, which moves a specific object forward, backward, left, or right by exactly 0.1 meter. This action does not apply any physical force. Lighter objects (like the soccer ball) that are contacted by the moved object will be moved out of the way in the appropriate direction. + - TorqueObject, which applies a rotational force on the center of a specific object, either clockwise or counter-clockwise. A large applied force may persist across multiple action steps. Note that smaller and lighter objects will realistically rotate more than larger or heavier objects under equal amounts of force. + - RotateObject, which rotates a specific object clockwise or counter-clockwise by exactly 5 degrees. This action does not apply any physical force. + - See the full action documentation here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.Action +- See the section on the new lava task for more information about using lava. +- Please note: while only Pushing tools (or Moving them forward) will be necessary in Eval 5, future evals might require Pulling tools (or Moving them backward). + +### Introduced in Evaluation 6 + +#### Arithmetic and Number Comparison + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/57b6acc4-1cde-4e82-b56f-2aa23b8bced2 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/de4b01ea-5f48-46ac-83df-edd77776bcc0 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/87d6fe2a-97c6-4308-9340-70258245ae85 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/e2f4028f-7f2a-4004-9e22-967bc12c012f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/fbe1d7a8-dfff-4001-97e0-4d7f8c40b372 + +Details: + +- You start on a platform bisecting the room (this is a forced choice task). One or more objects (soccer balls) are positioned on each side of the room. Like our other forced choice tasks, once you “hop off” the platform onto one side of the room, you cannot reach the other side. You must determine which side of the room contains more potential “target” objects, and pick up all of the objects on that side of the room. +- In Number Comparison tasks, you can move immediately. Nothing will change in the scene while it is running. +- In Arithmetic tasks, objects will either be added or subtracted from one side of the room. Immediately after the scene is loaded, one or more placers descend from the ceiling. The placers either hold new objects (soccer balls) and drop them on the floor, or pick up existing objects and raise them to the ceiling, making them unavailable. This may mean that the side of the room which had the most potential “target” objects when the scene was first loaded now no longer has the most. + - In Evaluation 6, scenes will not have both addition and subtraction – just one mathematical operation. + - In Evaluation 6, objects will only be added/subtracted on one side of the room. + - Sometimes all placers will remain empty, to represent addition/subtraction by zero. +- Some Arithmetic scenes will contain occluders, which are lowered into the room on both sides after the scene is loaded. You will be able to see the initial number of objects on each side, and you will be able to see how many objects are added to, or subtracted from, the scene, but you will not be able to see the final number of objects at rest before you are forced to “hop off” the platform (choose a side of the room). +- In both tasks, each side of the room may have between zero and five potential “target” objects. + +Notes: + +- These scenes use the new “multi retrieval” interactive goal category, to distinguish them from scenes with the existing “retrieval” category, which have only a single target. For more information on “multi retrieval” interactive goals, please see our API doc here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.GoalCategory.MULTI_RETRIEVAL +- You will not receive a reward until all of the targets are picked up. +- In Arithmetic scenes, you will be restricted to only using Pass actions until the placers (and occluders) are finished moving. + +#### Imitation + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1536702f-b2b6-4323-9da6-fc7af4bff486 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/cde91660-af4d-4289-91e5-689c38a59290 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/7a297753-d3c8-499a-8982-d3f2237ba146 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/526e2211-be7d-40cc-b62c-23ae09bd2bbe + +Details: + +- You start in a room looking at three containers lined up in a row. The containers are identical in size and shape (chest_1) but have different colors. After the scene begins, an agent approaches either one or two specific container(s) and opens them in a specific order, triggering a placer holding the target object (soccer ball) to descend from the ceiling, release the target object onto the floor, and ascend back into the ceiling. You are then kidnapped, during which the room is reset: the placer picks up the target object and raises it back up toward the ceiling, making the target object inaccessible; the containers are closed; and the agent moves out-of-the-way. You must remember the pattern the agent used to make the target object accessible, open the correct containers in the correct order, and pick up the target object when it is within your reach. +- The room always has three containers. Sometimes you need to open two containers; other times you only need to open one container. +- Sometimes you will be moved to a new location when you are kidnapped; other times you will remain in the same location. +- Sometimes the containers will be moved to a new location when you are kidnapped; sometimes they will be rotated; other times they will remain in the same location. If the containers are moved or rotated, they will always remain adjacent to each other, and in the same order relative to each other. + +Notes: + +- Imitation scenes use the new “imitation” interactive goal category to differentiate them from normal “retrieval” goals. For more information on “imitation” goals, please see our API doc here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.GoalCategory.IMITATION +- You will be restricted to only using Pass actions until being kidnapped. While “frozen”, you will be able to see all of the containers, the agent, and the target object, once it has been released by the placer. +- The containers always start lined up on either the left side of your view, or the right side. The agent will approach the containers from the opposite side. +- Kidnapping and teleporting are performed using the EndHabituation action. Like other uses of this action, you will receive a blank frame during the kidnapping step. Unlike how this action worked in Eval 4, you will not receive any information (position/rotation) about the teleport destination (this information is now tracked internally by the MCS environment). +- Containers are opened using the OpenObject action, like in other scenes with containers. +- If you open an incorrect container, or you open the correct containers in an incorrect order, you will immediately be forced to end the scene without continuing further, thus failing the trial. + +#### Occluded Trajectory and Collisions (Interactive) + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/898d48b4-0c26-4a4c-9cf2-4de22e765059 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/4b2a5a02-24b3-49ef-a700-43abc37d56de + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/8b8bf840-52d0-4f13-a490-5f2c5b7f374f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/97f421d2-eb72-4e1a-8437-b68d2e551d1e + +Details: + +- Interactive Trajectory – You start on a platform, and a strip of lava is bisecting the room (this is a forced choice task). A throwing device (or "thrower") is positioned across the room from you (within your initial view) holding the target object (soccer ball). Immediately after the scene begins, the thrower "launches" the target object so it starts to roll across the room. An occluding wall with two doors (or "two-door-occluder") descends from the ceiling while the target object is rolling, obstructing your view of the target object's complete trajectory and final position. You must determine whether the target object will end on either the left side or the right side of the room/lava, using your knowledge of its trajectory; then you must jump off from the platform on the correct side, walk up to the corresponding door, open it, find the target object, and pick it up. +- Interactive Collision – You start on a platform, and a strip of lava is bisecting the room (this is a forced choice task). A throwing device (or "thrower") is positioned across the room from you (within your initial view) holding a green ball, which is NOT the target object. The target object (soccer ball) is positioned elsewhere in the room (within your initial view), but not in the lava. Immediately after the scene begins, the thrower "launches" the green ball so it starts to roll across the room. The green ball either collides directly with the target object, hitting it "head-on", or completely misses the target object. An occluding wall with two doors (or "two-door-occluder") descends from the ceiling either immediately before or immediately after the collision, obstructing your view of the target's complete trajectory and final position. You must determine whether the target object will end on either the left side or the right side of the room/lava, using your knowledge of the green ball's trajectory and the possibility of a collision; then you must jump off from the platform on the correct side, walk up to the corresponding door, open it, find the target object, and pick it up. +- Sometimes the thrower will be oriented straight ahead, and the target object will remain on the same side of the room as it started; sometimes the thrower will be angled, and the target object will roll over the lava to the other side of the room. +- Sometimes the two-door-occluder will begin to descend immediately after the scene begins; sometimes it will wait a few steps, letting you see more of the target object's trajectory (or, in the Interactive Collisions task, the green ball's trajectory). +- Rolling over the lava does not affect the target object's movement any differently than rolling over the floor. Its movement is otherwise executed using our real-world physics simulation engine and is therefore affected by consistent physical properties like drag and friction. +- You can safely assume that the target object will never be launched with such a force or angle to cause it to "rebound" off a wall and cross over the lava to the other side of the room. +- If you step into the lava, you will be forced to immediately end the scene, thus failing it. Therefore, once you "jump off" the starting platform onto one side of the room, you will not have any way to cross over to the other side of the room. +- In the Interactive Collisions task, the green ball in the thrower will always appear the same. Nothing else in the room will be green. + +Notes: + +- You will be restricted to only using Pass actions until the door-occluder has finished descending. For more information on action restrictions, see the action_list property in the StepMetadata class: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.StepMetadata +- Stepping too close to the lava will force you to immediately end the scene (you will only be allowed to use the “EndScene” action if you try to call the step function, or you can call end_scene yourself). This will be what happens during the evaluation. You can override the default setting using the steps_allowed_in_lava config property: https://nextcenturycorporation.github.io/MCS/install.html#steps-allowed-in-lava +- Stepping too close to the lava will give you an insurmountably large reward penalty. You will always receive this penalty, even if you must immediately end the scene due to the steps_allowed_in_lava setting (see above). You can override the default setting using the lava_penalty config property: https://nextcenturycorporation.github.io/MCS/install.html#lava-penalty +- Stepping too close to the lava will adjust the haptic_feedback and steps_in_lava properties of the StepMetadata output returned by that action step: haptic_feedback will be {"on_lava": true} and steps_in_lava will increase by one. https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.StepMetadata + +#### Set Rotation + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/b44fcc48-b7de-433a-b520-bf36371206ac + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/c293ea74-1f77-4985-8f23-8d73ec88e00d + +Details: + +- You start in a room looking at a turntable (cog). Between one and five identical open containers are positioned on top of the turntable so they can be seen clearly. After the scene begins, a placer holding the target object (soccer ball) descends from the ceiling and releases the target object into one of the containers. Then placers holding lids descend from the ceiling and release the lids, attaching one to the top of each container. Finally, the turntable rotates either 90, 180, 270, or 360 degrees, either clockwise or counter-clockwise, moving the containers along with it. You must determine which container holds the target object, walk up to that container, open it, and pick up the target object. +- When you open a container, the other containers will automatically become locked (this is a forced choice task). So if the first container you open is not the correct container, you will never be able to retrieve the target object, and will therefore fail the trial. +- In some scenes, instead of the turntable rotating, you will be forced to move around the turntable, to either the left or the right, so you end facing the turntable and containers from a different angle. Please see the Engineering Details below for more information. +- The turntable will only ever rotate the one time at the beginning. In scenes with forced movement, the turntable will never rotate. + +Notes: + +- You will be restricted to only using Pass actions until the turntable finishes rotating (or, in some scenes, until you are forced to move). While “frozen”, you will be able to clearly see all of the containers, the turntable, and the target object as it is placed into a container. +- In some scenes, forced movement will be performed by returning the action you must invoke in your next controller.step call (like "MoveLeft" or "MoveRight") via the StepMetadata.action_list property, in the same way you are forced to use only “Pass” actions during other specific steps (see the previous bullet). +- In Eval 6, the containers and lids in these scenes are always the same size, shape, and color. + - These containers can be opened using the OpenObject action, just like other containers. The lid will always open on the opposite side from where you are standing. + - These containers will be a consistent shape (cuboid) and color (green) for all Eval 6 scenes, which we hope will simplify the training of your systems. New shapes or colors may be introduced in Eval 7. + - Scenes with these containers will restrict you to use only Pass actions before the lid is placed onto the container, which happens at the beginning of the trial, before the “exploration” phase. + - Your teams are able to use the ILE Scene Generator to make scenes with these containers (either with the lid on them from the start of the scene, or with the lid placed on them by a placer during the course of the scene) – please see our ILE API documentation for details. +- Information about the turntables (giant grey rotating cogs): + - Turntables in evaluation scenes will rotate at a consistent speed of 5 degrees per action step, either clockwise or counter-clockwise. + - Objects and agents on top of a turntable (including the AI) will rotate along with the turntable. + - Turntables will be a consistent height, shape (cog), and color (grey) for all Eval 6 scenes, though their radii may change across different scenes. + - Scenes with turntables will restrict you to use only Pass actions while the turntable is rotating, which happens at the beginning of the trial, before the “exploration” phase. + +#### Shell Game + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/e0127554-36a6-4526-892c-bcc1341c2b7e + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6a5ed2f0-b8b2-410f-a744-38cdab9b9a27 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/98730a4a-a201-4cdf-8162-218188c26ec2 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/107232ca-f28a-4cc0-85ff-22d189b61daa + +Details: + +- You start in a room looking at two or three identical open containers positioned in a line near each other. After the scene begins, a placer holding the target object (soccer ball) descends from the ceiling and releases the target object into one of the containers. Then placers holding lids descend from the ceiling and release the lids, attaching one to the top of each container. Finally, a placer descends from the ceiling, attaches itself to the container holding the target object, drags the container across the floor to a new location, and releases the container. This dragging motion always moves the container toward you, then sideways, then away from you, which sometimes occludes your view of the other container(s). You must determine which container holds the target object, walk up to that container, open it, and pick up the target object. +- When you open a container, the other containers will automatically become locked (this is a forced choice task). So if the first container you open is not the correct container, you will never be able to retrieve the target object, and will therefore fail the trial. +- In some scenes, the container will be dragged before the target object is placed into it and the containers' lids are attached. +- In some scenes, another placer will descend from the ceiling, attach itself to a second container (one that is not holding the target object), drag it across the floor to a new location, and release it. This means that two of the containers will have moved since the beginning of the scene. + +Notes: + +- You will be restricted to only using Pass actions until the lids are attached to their respective containers. While “frozen”, you will be able to clearly see all of the containers and the target object as it is placed into a container. +- In Eval 6, the containers and lids in these scenes are always the same size, shape, and color. + - These containers can be opened using the OpenObject action, just like other containers. The lid will always open on the opposite side from where you are standing. + - These containers will be a consistent shape (cuboid) and color (green) for all Eval 6 scenes, which we hope will simplify the training of your systems. New shapes or colors may be introduced in Eval 7. + - Scenes with these containers will restrict you to use only Pass actions before the lid is placed onto the container, which happens at the beginning of the trial, before the “exploration” phase. + - Your teams are able to use the ILE Scene Generator to make scenes with these containers (either with the lid on them from the start of the scene, or with the lid placed on them by a placer during the course of the scene) – please see our ILE API documentation for details. + +#### Spatial Reference + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/862044cd-7c33-4174-8677-f3aaacf691a6 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/31d8d9a4-7f22-4a21-bc0a-b5788ad88f2f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6400a0a9-e26e-4c64-9878-5f26394082f6 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/db675a03-0de2-4167-a9d7-a119d1e5a43a + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/e6d066e5-94ed-4287-bdfb-9ca796ded65d + +Details: + +- You start on a platform bisecting the room (this is a forced choice task). Each side of the room contains an identical closed container. One side of the room contains an agent who, after the scene begins, turns, walks toward, looks at, and points at the container secretly holding the target object (soccer ball). The agent keeps pointing at the container indefinitely. The other side of the room contains an unknown, faceless, blob-shaped entity (known as a “blob”) with a nose-like protrusion. The blob is positioned on a turntable (cog), and the turntable rotates so the blob’s “nose” is “pointing” at one of the containers, which may or may not be the same container at which the agent is pointing. Like our other forced choice tasks, once you “hop off” the platform onto one side of the room, you cannot reach the other side. You must determine which entity is the real agent, use the agent’s referential information (the direction of its walk, gaze, and point) to correctly identify the container holding the target object, walk up to that container, open it, and pick up the target object. +- The agent’s walk, gaze, and point will always be oriented in the same direction. This redundancy was introduced to make it easier for you to interpret the agent’s referential information. +- The container holding the target object will sometimes be on the side of the room with the agent, and other times be on the side of the room across from the agent. +- In some scenes, the agent will move and point before the turntable below the blob begins to rotate; in other scenes, the turntable will rotate fully before the agent begins to move. +- Some scenes will not have a blob – just an agent. +- For consistency, there is always a second turntable positioned underneath the agent, but it never rotates. Agents move on their own accord, but blobs cannot move by themselves. (This is another indication of agency.) + +Notes: + +- You will be restricted to only using Pass actions until the agent and turntable have stopped moving/rotating. While “frozen”, you will be able to clearly see the two containers, the agent, the blob, and the two turntables. +- Since the blobs are unknown entities by design, training scenes containing blobs will not be available. We have provided an example YAML configuration file for the ILE Scene Generator which uses everyday objects (like toy cars or wooden animals) in place of blobs. + +#### Spatial Reorientation + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/97fb77f4-9f35-41ee-9a7b-2efb649b8362 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/cf3e2b27-a4e0-4e1d-a165-425d9f1fc84b + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/27cfab0a-2b83-4fb5-b9af-665c1f05ed89 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a49184c7-211d-4c8d-870e-b0d286f7a4db + +Details: + +- You start on a platform bisecting the room (this is a forced choice task). Two identical open-topped containers are positioned in mirrored locations on each side of the room (the left and right). A placer holding the target (soccer ball) descends from the ceiling over one of the containers and drops it into the container. You are then “kidnapped” and teleported to either the front or the back of the room, but still standing on the platform. Like our other forced choice tasks, once you “hop off” the platform onto one side of the room, you cannot reach the other side. You must determine which side of the room contains the target, move over to it and pick it up. +- Most scenes provide cues so you can determine whether you have been teleported to the opposite side of the room: + - Sometimes either the left or right wall is a significantly different color than the other walls. + - Sometimes the room is shaped like a trapezoid: the left and right walls are angled inward, and either the front or back wall is shorter. + - Sometimes there is a large non-structural object, like a piece of furniture, on one side of the room; TA2 calls this an “unstable landmark.” In scenes containing both a stable landmark (differently colored room walls, or trapezoidal shaped rooms) and an unstable landmark (large objects like furniture that could theoretically be moved by an adult), your system should trust the location of the stable landmark more than the unstable landmark. + - It should be impossible to see inside the containers from your position on top of the platform due to the position of the containers and a barrier on the platform that stops you from moving too far forward. + +Notes: + +- Immediately after the scene is loaded, but before the placers start moving, you will be forced to rotate in a full circle (using the RotateRight action 36 times in a row), so you can see the complete layout of the room before you are kidnapped. Then, you will be restricted to only using Pass actions until the placers are finished moving, and after you have been kidnapped. +- Kidnapping and teleporting are performed using the EndHabituation action. Like other uses of this action, you will receive a blank frame during the kidnapping step. Unlike how this action worked in Eval 4, you will not receive any information (position/rotation) about the teleport destination (this information is now tracked internally by the MCS environment). +- Whenever you are kidnapped, you we be teleported a little “off-center”, regardless of whether you remain on the same side of the room (near the “back” wall) or the opposite side (near the “front” wall). For example, if your original position is (X=0, Z=-7.5), your new position may be (X=0.1, Z=-7.6) + +#### Tools - Asymmetric and Tool Choice + +||| +|---|---| +![tool_choice_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/20668ccc-bffd-4b3d-9fdc-f775766687b3) | ![tool_hooked_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/01587ca1-3e64-4a9b-8a03-5415fd26fb5b) + +Details: + +- Asymmetric Tool + - The Asymmetric Tool task is a new variant of the Tool Use task from Eval 5. Rather than pushing a symmetric tool (a.k.a. “rectangular-shaped tool”), you must pull an asymmetric tool (a.k.a. “hooked tool” or “L-shaped tool”) to extract the target object (soccer ball) from the middle of a pool of lava (by pulling the tool so it comes into contact with the soccer ball and causes the ball to roll out from the lava to a safe, reachable area). + - The pool of lava in Asymmetric Tool scenes always extends out to three of the exterior walls of the room, so you will not be able to extract the target object by only pushing the tool – you must also learn how to pull the tool, and how to identify situations in which doing so is necessary. +- Tool Choice + - The Tool Choice task is similar to the Tool Use task from Eval 5, but in a forced choice paradigm. You start on a platform bisecting the room. Each side of the room contains a pool of lava surrounding a soccer ball. One side of the room has a tool that can be used to extract the soccer ball from the pool of lava in order to pick it up (by pushing the tool so it comes into contact with the soccer ball and causes the ball to roll out from the lava to a safe, reachable area). The soccer ball on the other side of the room is inaccessible. Like our other forced choice tasks, once you “hop off” the platform onto one side of the room, you cannot reach the other side. You must determine which side of the room contains the “useful tool”, correctly use the tool to extract the soccer ball from the pool of lava, and pick up the soccer ball. + - The other side of the room may contain: no tool; a tool that is too small and thus cannot be used to successfully extract the soccer ball from the pool of lava; a tool that is broken into multiple pieces which are too small; or a tool that is completely separated from the soccer ball by an obstruction and thus cannot reach the soccer ball. + +Notes: +- Asymmetric Tool + - To pull an object, you may use either the PullObject action, which applies a force to the object using the environment’s physics engine, or the MoveObject action, which moves the object by an exact amount (0.1 meter) in a specified direction, bypassing the physics engine completely. Both actions will be valid during the evaluation. + - Like the original Tool Use task, the asymmetric tool may need to be rotated (using the RotateObject and/or TorqueObject actions) before it can be used effectively. +- Tool Choice + - For scoring purposes, only the soccer ball on the side of the room containing the “useful tool” is considered the “target object”. + - In Eval 6, the “useful tool” in Tool Choice scenes will always be a symmetric (rectangular-shaped) tool (not an asymmetric tool). + +### Introduced in Evaluation 7 + +#### Hidden Set Rotation + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b22f8c2-6774-4cc0-a4e6-9fc0b0b3201b + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1868299b-f26a-4692-8cfd-63dafe25557a + +Details: + +- This task is setup exactly like the Eval 6 Set Rotation task, but a giant “tube occluder” descends from the ceiling to hide the turntable’s rotation. Your goal is still to find and pick up the target object. +- For scenes in which the turntable would rotate, the tube occluder goes down just before the turntable begins to rotate (after the lids are placed onto the containers). The tube occluder goes up again after enough time for the turntable to rotate 360 degrees (even if the turntable rotates less than that). +- For scenes in which you are forced to move around the turntable, the tube occluder goes down just before the forced movement (after the lids are placed onto the containers). The tube occluder goes up again after enough time for your agent to circumnavigate the turntable a full 360 degrees (even if your agent moves less than that). +- You can assume the only change hidden by the tube occluder is the turntable rotating between 0 and 360 degrees. +- When you open a container, the other containers will automatically become locked. So if the first container you open is not the correct container, you will never be able to retrieve the target object, and will therefore fail the trial. + +#### Knowledgeable Agents + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fe0e811-b53b-4171-95dc-c0496440379b + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0afc8420-f068-4767-904e-b3afc87621d9 + +Details: + +- You begin positioned in the center of the back of the room, looking forward. A platform bisects the room (this is a forced choice task), and the target object (soccer ball) starts visible on top of the platform. An open container is positioned on each side of the platform, as well as a simulation-controlled agent. Each agent is facing either toward you (and can therefore see both containers) or away from you (and cannot see either container). +- Immediately after the scene begins, the two simulation-controlled agents rotate 180 degrees, reversing their orientations, and remain in these orientations until they turn to point (after the occluder rises up to the ceiling – see below). This rotation should help you identify which way the agent is facing (i.e. the front of their head versus the back). +- After this rotation, an occluder descends from the ceiling to hide your view of the containers and the target object. The simulation-controlled agents are on the same side of the occluder as the containers and target object. Importantly, the occluder is short enough so you can always see the faces of the two agents, and therefore you always know whether each agent can see the containers (because it's facing toward you) or cannot see the containers (because it’s facing away from you). +- Then, two “placers” (blue and pink poles) descend from the ceiling, one after another, and appear to pick up the target object, carry it across to one of the containers, and release the target object into that container. One of these placers is a decoy, but you cannot see which placer actually picked up the target object, or which container it was dropped into, due to the occluder. However, any simulation-controlled agents facing toward you can see the placers, containers, and target object. +- Next, two more placers descend from the ceiling and attach lids to the containers, and the occluder rises up to the ceiling, so you can see the two closed containers. +- Finally, each simulation-controlled agent turns and points to the container they believe holds the target object. Your goal, like in all interactive tasks, is to pick up the target object. To achieve your goal, you must determine which agent is knowledgeable (based on your understanding of whether that agent could see where the target object was placed), determine which container the knowledgeable agent is pointing at, move to that container, open it, and pick up the target object. Like our other forced choice tasks, once you “hop off” the platform onto one side of the room, you cannot reach the other side. +- Sometimes the knowledgeable agent will be on the platform furthest away from you, and sometimes the knowledgeable agent will be in the pit and therefore closer to you. + +Notes: + +- You will be “frozen” (restricted to only using Pass actions) and thus unable to move until after the simulation-controlled agents point. +- Using the InteractWithAgent action on an agent while it's pointing will not provide you with any additional information. + +#### Tools - Secondary Tool Use + +TODO + +Details: + +- You begin positioned randomly in a room containing two sections of lava. The first section of lava surrounds the target object (soccer ball). The second section of lava surrounds a hooked (L-shaped) tool. There is also a rectangular tool somewhere in the room. Neither the target object nor the hooked tool are within your reach due to the lava. Your goal, like in all interactive tasks, is to pick up the target object. To achieve your goal, you must know how to use the rectangular tool to push the hooked tool out from the lava, then use the hooked tool to pull the target object out from the lava. +- The position of the target object in the room, and the amount of lava surrounding it, will make it impossible for you to use the rectangular tool alone to push the target object out from the lava (and bypass using the hooked tool). +- The rectangular tool may start in proper alignment with the hooked tool, or may require you to move and/or rotate it into alignment. +- The hooked (L-shaped) tool may have two sides with equal lengths, or two sides with different lengths. + +Notes: + +- Like in previous Evals, you can use the PushObject, PullObject, and MoveObject actions to move tools, and the TorqueObject and RotateObject actions to rotate tools. Pushing, Pulling, and Moving one tool into a second tool will cause that second tool to move along with it as you would expect (please note that some bugs for this were fixed in MCS release version 0.7.0). +- Tools may have novel colors/textures applied to them (including, but not limited to, the colors/textures used in Eval 6), but the general shape of the tools will remain the same. diff --git a/docs/source/dev.rst b/docs/source/dev.rst index ccafd733f..fa72d1d32 100644 --- a/docs/source/dev.rst +++ b/docs/source/dev.rst @@ -81,6 +81,12 @@ Sphinx Documentation - Sphinx: https://www.sphinx-doc.org/en/master/ - Sphinx's own Tutorial: https://www.sphinx-doc.org/en/master/usage/quickstart.html +To generate the Sphinx documentation locally, from the docs folder: + +.. code-block:: console + + (mcs) $ make html + Python Style Guide ------------------ @@ -151,14 +157,6 @@ team Team name identifier to prefix to scene history and video files (default: ''). -timeout -^^^^^^^ - -(int, optional) - -If the amount of time between steps exceeds the amount specified (represented in seconds), throw and error and attempt to end scene (default: 3600 (or 1 hour)). - - Handling Pull Requests From Contributors ---------------------------------------- diff --git a/docs/source/index.rst b/docs/source/index.rst index 61924f69e..c43386716 100644 --- a/docs/source/index.rst +++ b/docs/source/index.rst @@ -12,7 +12,6 @@ Machine Common Sense Documentation api scenes schema - training models containerize remotely diff --git a/docs/source/install.rst b/docs/source/install.rst index dfcb51331..bc07c4951 100644 --- a/docs/source/install.rst +++ b/docs/source/install.rst @@ -121,33 +121,33 @@ To use a specific configuration, you can either pass in a file path or dictionar Config File Properties ********************** -only_return_goal_object -^^^^^^^^^^^^^^^ +controller_timeout +^^^^^^^^^^^^^^^^^^ -(boolean, optional) +(int, optional) -If `true`, only returns the goal object from the object list output in the metadata. Metadata Tier will override `only_return_goal_object`. Default: false +Sets the time (in seconds) to allow on controller initialization before timing out. Default 600 -disable_position +disable_depth_maps ^^^^^^^^^^^^^^^ (boolean, optional) -If `true`, does not generate position information output in the metadata. Metadata Tier will override `disable_position`. Default: false +If `false`, will generate depth maps. Metadata Tier will override `disable_depth_maps`. Will only generate depth maps for Metadata tier [level1, level2, oracle]. Default: false -disable_depth_maps +disable_object_masks ^^^^^^^^^^^^^^^ (boolean, optional) -If `false`, will generate depth maps. Metadata Tier will override `disable_depth_maps`. Will only generate depth maps for Metadata tier [level1, level2, oracle]. Default: false +If `false`, will generate object masks. Metadata Tier will override `disable_depth_maps`. Will only generate object masks for Metadata tier [level2, oracle]. Default: false -disable_object_masks +disable_position ^^^^^^^^^^^^^^^ (boolean, optional) -If `false`, will generate object masks. Metadata Tier will override `disable_depth_maps`. Will only generate object masks for Metadata tier [level2, oracle]. Default: false +If `true`, does not generate position information output in the metadata. Metadata Tier will override `disable_position`. Default: false goal_reward ^^^^^^^^^^^^^^^ @@ -184,8 +184,16 @@ The `metadata` property describes what metadata will be returned by the MCS Pyth - `none`: Only returns the images (but no depth maps or object masks), camera info, and properties corresponding to the player themself (like head tilt). No information about specific objects will be included. If no metadata level is set: + - `default`: Fallback if no metadata level is specified. Only meant for use during development (evaluations will never be run this way). Includes metadata for visible and held objects in the scene, as well as camera info and properties corresponding to the player. Does not include depth maps or object masks. +only_return_goal_object +^^^^^^^^^^^^^^^ + +(boolean, optional) + +If `true`, only returns the goal object from the object list output in the metadata. Metadata Tier will override `only_return_goal_object`. Default: false + steps_allowed_in_lava ^^^^^^^^^^^^^^^ @@ -228,20 +236,6 @@ step_penalty Changes the negative penalty recieved for every step. Default: 0.001 -timeout -^^^^^^^ - -(int, optional) - -Sets the time (in seconds) to allow on a single step before timing out. Default 3600 - -controller_timeout -^^^^^^^^^^^^^^^^^^ - -(int, optional) - -Sets the time (in seconds) to allow on controller initialization before timing out. Default 600 - terminal_output ^^^^^^^^^^^^^^^ @@ -257,6 +251,13 @@ The terminal output mode controls what output metadata is logged to the terminal - `scene`: Prints metadata for the scene's room, including all structural objects. - `false` or `none`: Prints no terminal output, besides initialization, warning, and error messages. +timeout +^^^^^^^ + +(int, optional) + +Sets the time (in seconds) to allow on a single step before timing out. Default 3600 + top_down_camera ^^^^^^^^^^^^^^^ diff --git a/docs/source/remotely.rst b/docs/source/remotely.rst index 4c48cddf6..15069b6fa 100644 --- a/docs/source/remotely.rst +++ b/docs/source/remotely.rst @@ -2,8 +2,9 @@ Running Remotely ================ Requirements: -* Make sure your system has Python 3.7 or greater. -* Make sure MCS has been installed per the install instructions + +- Make sure your system has Python 3.7 or greater. +- Make sure MCS has been installed per the install instructions To run MCS on a remote GPU server, use the following steps to launch an X11 server. @@ -23,7 +24,8 @@ To run MCS on a remote GPU server, use the following steps to launch an X11 serv PCI BusID : PCI:0:30:0 # Create the Xserver configuration using the BusID - $ sudo nvidia-xconfig --use-display-device=None --virtual=600x400 --output-xconfig=/etc/X11/xorg.conf --busid=PCI:0:30:0 + # Your virtual display size should be much larger than the MCS Unity window size (default 600x400) + $ sudo nvidia-xconfig --use-display-device=None --virtual=1200x800 --output-xconfig=/etc/X11/xorg.conf --busid=PCI:0:30:0 # Launch Xserver $ sudo /usr/bin/Xorg :0 & @@ -53,7 +55,7 @@ The following code was run on an AWS p2-xlarge with the Ubuntu Deep Learning AMI .. code-block:: bash # Follow the instructions listed above to launch Xserver - $ sudo nvidia-xconfig --use-display-device=None --virtual=600x400 --output-xconfig=/etc/X11/xorg.conf --busid=PCI:0:30:0 + $ sudo nvidia-xconfig --use-display-device=None --virtual=1200x800 --output-xconfig=/etc/X11/xorg.conf --busid=PCI:0:30:0 $ sudo /usr/bin/Xorg :0 & # Download the MCS repository diff --git a/docs/source/scenes.rst b/docs/source/scenes.rst index 384360005..798e0c15c 100644 --- a/docs/source/scenes.rst +++ b/docs/source/scenes.rst @@ -1,51 +1,10 @@ Example Scenes ============== -:doc:`Documentation ` - Interactive Scenes ------------------ -Eval 5 Example Interactive Scenes -********************************* - -Relevant for the Summer 2022 evaluation (Eval 5): - -:download:`holes_eval_5_ex_1.json <./scenes/holes_eval_5_ex_1.json>` - -:download:`holes_eval_5_ex_2.json <./scenes/holes_eval_5_ex_2.json>` - -:download:`lava_eval_5_ex_1.json <./scenes/lava_eval_5_ex_1.json>` - -:download:`lava_eval_5_ex_2.json <./scenes/lava_eval_5_ex_2.json>` - -:download:`ramps_eval_5_ex_1.json <./scenes/ramps_eval_5_ex_1.json>` - -:download:`ramps_eval_5_ex_2.json <./scenes/ramps_eval_5_ex_2.json>` - -:download:`ramps_eval_5_ex_3.json <./scenes/ramps_eval_5_ex_3.json>` - -:download:`ramps_eval_5_ex_4.json <./scenes/ramps_eval_5_ex_4.json>` - -:download:`solidity_eval_5_ex_1.json <./scenes/solidity_eval_5_ex_1.json>` - -:download:`solidity_eval_5_ex_2.json <./scenes/solidity_eval_5_ex_2.json>` - -:download:`spatial_elimination_eval_5_ex_1.json <./scenes/spatial_elimination_eval_5_ex_1.json>` - -:download:`spatial_elimination_eval_5_ex_2.json <./scenes/spatial_elimination_eval_5_ex_2.json>` - -:download:`spatial_elimination_eval_5_ex_3.json <./scenes/spatial_elimination_eval_5_ex_3.json>` - -:download:`spatial_elimination_eval_5_ex_4.json <./scenes/spatial_elimination_eval_5_ex_4.json>` - -:download:`tool_use_eval_5_ex_1.json <./scenes/tool_use_eval_5_ex_1.json>` - -:download:`tool_use_eval_5_ex_2.json <./scenes/tool_use_eval_5_ex_2.json>` - -:download:`tool_use_eval_5_ex_3.json <./scenes/tool_use_eval_5_ex_3.json>` - -:download:`tool_use_eval_5_ex_4.json <./scenes/tool_use_eval_5_ex_4.json>` +For more interactive scenes, please see TODO Playroom ******** @@ -61,18 +20,14 @@ An open room containing over 40 objects for undirected exploration. Retrieval Goal ************** -Soccer ball retrieval goal for the Fall 2021 evaluation (Eval 4): +Soccer ball retrieval goal: :download:`retrieval_goal_example_with_soccer_ball.json <./scenes/retrieval_goal_example_with_soccer_ball.json>` -Silver trophy retrieval goal for the Winter 2020 evaluation (Eval 3): - -:download:`retrieval_goal_example_with_trophy.json <./scenes/retrieval_goal_example_with_trophy.json>` - Hinged Containers ***************** -Soccer ball inside hinged containers for the Fall 2021 evaluation (Eval 4): +Soccer ball hidden inside hinged containers: .. list-table:: @@ -80,273 +35,15 @@ Soccer ball inside hinged containers for the Fall 2021 evaluation (Eval 4): :download:`hinged_container_example_with_soccer_ball.json <./scenes/hinged_container_example_with_soccer_ball.json>` -Silver trophy inside hinged containers for the Winter 2020 evaluation (Eval 3): - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/hinged_container_example_with_trophy.gif - - :download:`hinged_container_example_with_trophy.json <./scenes/hinged_container_example_with_trophy.json>` - -Interactive Object Permanence and Reorientation Tasks -***************************************************** - -The room has different dimensions/bounds, and isn't necessarily square. Previously, the room's dimensions were always [-5, 5] on both the X and the Z axes. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_12_by_8.gif - - :download:`template_12_by_8.json <./scenes/template_12_by_8.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_2_by_4.gif - - :download:`template_2_by_4.json <./scenes/template_2_by_4.json>` - -The room's outer walls are individually, distinctly colored. Previously, all of the room's outer walls were always the same color. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_individually_colored_walls.gif - - :download:`template_individually_colored_walls.json <./scenes/template_individually_colored_walls.json>` - -The performer agent is positioned on top of a flat, raised platform. Moving off the edge of the platform will cause the performer agent to automatically, instantaneously fall down to the floor, and the performer agent will not be able to move back on top of the platform. - -.. list-table:: +Passive Agent Scenes +-------------------- - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_platform_independent.gif - - :download:`template_platform_independent.json <./scenes/template_platform_independent.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_platform_bisecting.gif - - :download:`template_platform_bisecting.json <./scenes/template_platform_bisecting.json>` - -The performer agent is temporarily "frozen" (can only use the Pass action) at the start and/or in the middle of an interactive scene. This is done by the same method that is used for the passive/VoE scenes (see the StepMetadata.action_list property). - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_frozen_first_10_steps.gif - - :download:`template_frozen_first_10_steps.json <./scenes/template_frozen_first_10_steps.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_frozen_after_10_steps.gif - - :download:`template_frozen_after_10_steps.json <./scenes/template_frozen_after_10_steps.json>` - -A cylindrical mechanism attached to a wall or the ceiling throws (for interactive object permanence) or drops (for reorientation) the target object (i.e. soccer ball) into the scene. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_mechanism_dropping_soccer_ball_v2.gif - - :download:`template_mechanism_dropping_soccer_ball_v2.json <./scenes/template_mechanism_dropping_soccer_ball_v2.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_mechanism_throwing_soccer_ball.gif - - :download:`template_mechanism_throwing_soccer_ball.json <./scenes/template_mechanism_throwing_soccer_ball.json>` - -The performer agent is "kidnapped" (can only call the EndHabituation action) and teleported to another position in the current room one or more times. Prior to being kidnapped, the performer agent is able to move around and explore its environment for a limited number of steps. On the kidnapped step, the returned images will be black. Prior to the final kidnapping, StepMetadata.habituation_trial will be an integer; after the final kidnapping, StepMetadata.habituation_trial will be "None" to denote the test trial. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_kidnapping.gif - - :download:`template_kidnapping.json <./scenes/template_kidnapping.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_kidnapping_then_frozen.gif - - :download:`template_kidnapping_then_frozen.json <./scenes/template_kidnapping_then_frozen.json>` - -Combination of multiple elements. For example: a platform, being frozen, and a mechanism throwing the soccer ball into the scene. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/template_interactive_object_permanence_scene.gif - - :download:`template_interactive_object_permanence_scene.json <./scenes/template_interactive_object_permanence_scene.json>` - -End-to-end scenes. VALIDATION ONLY. - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/eval_4_intobjperm_validation_01.gif - - :download:`eval_4_intobjperm_validation_01.json <./scenes/eval_4_intobjperm_validation_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/eval_4_reor_validation_01.gif - - :download:`eval_4_reor_validation_01.json <./scenes/eval_4_reor_validation_01.json>` - -Passive/Intuitive Physics Scenes --------------------------------- - -Gravity Support: Objects Falling Down -************************************* - -All of these examples are PLAUSIBLE - -.. list-table:: +For more passive agent scenes, please see TODO - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_01.gif - - :download:`gravity_support_ex_01.json <./scenes/gravity_support_ex_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_02.gif - - :download:`gravity_support_ex_02.json <./scenes/gravity_support_ex_02.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_03.gif - - :download:`gravity_support_ex_03.json <./scenes/gravity_support_ex_03.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_04.gif - - :download:`gravity_support_ex_04.json <./scenes/gravity_support_ex_04.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_05.gif - - :download:`gravity_support_ex_05.json <./scenes/gravity_support_ex_05.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_06.gif - - :download:`gravity_support_ex_06.json <./scenes/gravity_support_ex_06.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_07.gif - - :download:`gravity_support_ex_07.json <./scenes/gravity_support_ex_07.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_08.gif - - :download:`gravity_support_ex_08.json <./scenes/gravity_support_ex_08.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_09.gif - - :download:`gravity_support_ex_09.json <./scenes/gravity_support_ex_09.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_10.gif - - :download:`gravity_support_ex_10.json <./scenes/gravity_support_ex_10.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_11.gif - - :download:`gravity_support_ex_11.json <./scenes/gravity_support_ex_11.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/gravity_support_ex_12.gif - - :download:`gravity_support_ex_12.json <./scenes/gravity_support_ex_12.json>` - - -Object Permanence and Spatio-Temporal Continuity: Objects Moving on Multiple Axes Behind Occluders -************************************************************************************************** - -Relevant for the Fall 2021 evaluation (Eval 4). Objects may move on only the X axis (as in previous evaluations), on both the X and Z axes (see the "move deep" example scenes), and/or on both the X and Y axes (see the "move toss" example scenes). - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_fast_01.gif - - :download:`move_deep_fast_01.json <./scenes/move_deep_fast_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_fast_02.gif - - :download:`move_deep_fast_02.json <./scenes/move_deep_fast_02.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_fast_03.gif - - :download:`move_deep_fast_03.json <./scenes/move_deep_fast_03.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_fast_04.gif - - :download:`move_deep_fast_04.json <./scenes/move_deep_fast_04.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_toss_fast_01.gif - - :download:`move_toss_fast_01.json <./scenes/move_toss_fast_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_toss_fast_02.gif - - :download:`move_toss_fast_02.json <./scenes/move_toss_fast_02.json>` - -Object Permanence: Objects Moving on Multiple Axes and Stopping Behind Occluders -******************************************************************************** - -Relevant for the Fall 2021 evaluation (Eval 4). Objects may move across the entire screen and exit on the other side (as in previous evaluations), or come to a natural stop behind the occluder. Objects may move on only the X axis (as in previous evaluations), on both the X and Z axes (see the "move deep" example scenes), and/or on both the X and Y axes (see the "move toss" example scenes). - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_slow_01.gif - - :download:`move_slow_01.json <./scenes/move_slow_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_slow_02.gif - - :download:`move_deep_slow_01.json <./scenes/move_deep_slow_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_slow_01.gif - - :download:`move_toss_slow_01.json <./scenes/move_toss_slow_01.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_deep_slow_02.gif - - :download:`move_slow_02.json <./scenes/move_slow_02.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_toss_slow_01.gif - - :download:`move_deep_slow_02.json <./scenes/move_deep_slow_02.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/move_toss_slow_02.gif - - :download:`move_toss_slow_02.json <./scenes/move_toss_slow_02.json>` - - -Object Permanence: Objects Falling Down Behind Occluders -******************************************************** - -Relevant for the Winter 2020 evaluation (Eval 3). - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/object_permanence_plausible.gif - - :download:`object_permanence_plausible.json <./scenes/object_permanence_plausible.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/object_permanence_implausible.gif - - :download:`object_permanence_implausible.json <./scenes/object_permanence_implausible.json>` - -Spatio-Temporal Continuity: Objects Moving Across Behind Occluders -****************************************************************** - -Relevant for the Winter 2020 evaluation (Eval 3). - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/spatio_temporal_continuity_plausible.gif - - :download:`spatio_temporal_continuity_plausible.json <./scenes/spatio_temporal_continuity_plausible.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/spatio_temporal_continuity_implausible.gif - - :download:`spatio_temporal_continuity_implausible.json <./scenes/spatio_temporal_continuity_implausible.json>` - -Agents Scenes -------------- - -Agents Have Goals and Preferences -********************************* - -.. list-table:: - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/agents_preference_expected.gif - - :download:`agents_preference_expected.json <./scenes/agents_preference_expected.json>` - - * - .. figure:: https://mcs-documentation.s3.amazonaws.com/images/agents_preference_unexpected.gif - - :download:`agents_preference_unexpected.json <./scenes/agents_preference_unexpected.json>` +Passive Physics Scenes +---------------------- +For more passive physics scenes, please see TODO Simple Scenes ------------- @@ -362,7 +59,6 @@ With Objects :download:`block_close.json <./scenes/block_close.json>` - With Walls ********** diff --git a/docs/source/training.rst b/docs/source/training.rst deleted file mode 100644 index 53d28a61d..000000000 --- a/docs/source/training.rst +++ /dev/null @@ -1,78 +0,0 @@ -Training Datasets -================= - -Evaluation 4 - Fall 2021 --------------------------- - -Passive Agent -************* - -Subtasks: - -- Single object scenes (~10K), just like Eval 3 -- Object preference scenes (~10K), just like Eval 3 -- Multiple agents scenes (4K), new to Eval 4 -- Instrumental action scenes (4K), new to Eval 4 - -JSON scene configuration files: - -- https://eval-4-data.s3.amazonaws.com/eval_4_agent_training_dataset.zip - -Rendered videos: - -- https://nyu-datasets.s3.amazonaws.com/agent_instrumental_action_training_videos.zip -- https://nyu-datasets.s3.amazonaws.com/agent_multiple_agents_training_videos.zip -- https://nyu-datasets.s3.amazonaws.com/agent_object_preference_training_videos.zip -- https://nyu-datasets.s3.amazonaws.com/agent_single_object_training_videos.zip - -Passive Intuitive Physics -************************* - -Please generate your own training datasets using our Scene Generator software here: - -- https://github.com/NextCenturyCorporation/mcs-scene-generator - -Interactive -*********** - -For the container, obstacle, and occluder tasks, please generate your own training datasets using our Scene Generator software here: - -- https://github.com/NextCenturyCorporation/mcs-scene-generator - -For the new interactive object permanence and reorientation tasks, please generate your own training datasets using our example scene templates here: - -https://github.com/NextCenturyCorporation/MCS/tree/master/machine_common_sense/scenes#interactive-object-permanence-and-reorientation-tasks - -Evaluation 3 - Winter 2020 --------------------------- - -*Please use the most recent 0.3.X release version* - -Passive Agent (only expected scenes): - -- https://evaluation-training-scenes.s3.amazonaws.com/eval3/training-single-object.zip -- https://evaluation-training-scenes.s3.amazonaws.com/eval3/training-object-preference.zip - -Passive Intuitive Physics (only plausible scenes): - -- https://evaluation-training-scenes.s3.amazonaws.com/eval3/training-passive-physics.zip - -Example Scenes: -- https://github.com/NextCenturyCorporation/MCS/tree/master/machine_common_sense/scenes - -Evaluation 2 - Summer 2020 --------------------------- - -*Use a release version between 0.0.9 and 0.1.0* - -Interactive: - -https://evaluation2-training-scenes.s3.amazonaws.com/interaction-scenes.zip - -Passive IntPhys: - -https://evaluation2-training-scenes.s3.amazonaws.com/intphys-scenes.zip - -Passive IntPhys Validation Data: - -https://evaluation2-training-scenes.s3.amazonaws.com/validation-intphys-scenes.zip \ No newline at end of file From 1f4fac8142d4b15fbb153e3ccf582d043baeb9f3 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Fri, 8 Dec 2023 17:50:24 -0500 Subject: [PATCH 02/11] Update TASK_LIST.md --- TASK_LIST.md | 109 ++++++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 107 insertions(+), 2 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index b40405baf..ce1eb7f4c 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -1,6 +1,9 @@ # Task List -TODO +Table of Content: +- [Interactive Tasks](#interactive-tasks) + - [Introduced in Evaluation 3](#introduced-in-evaluation-3) + - [Retrieval - Containers](#retrieval---containers) ## Interactive Tasks @@ -405,7 +408,9 @@ Notes: #### Tools - Secondary Tool Use -TODO +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a0a00f40-e9f7-4cbd-9521-c8c7e47e129d + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/292e188a-0429-42a8-b499-1df11013b14f Details: @@ -418,3 +423,103 @@ Notes: - Like in previous Evals, you can use the PushObject, PullObject, and MoveObject actions to move tools, and the TorqueObject and RotateObject actions to rotate tools. Pushing, Pulling, and Moving one tool into a second tool will cause that second tool to move along with it as you would expect (please note that some bugs for this were fixed in MCS release version 0.7.0). - Tools may have novel colors/textures applied to them (including, but not limited to, the colors/textures used in Eval 6), but the general shape of the tools will remain the same. + +## Passive Agent Tasks + +TODO DOWNLOAD + +### Introduced in Evaluation 3 + +#### Efficient Action (Passive Agent) + +TODO + +#### Object Preference (Passive Agent) + +TODO + +### Introduced in Evaluation 4 + +#### Inaccessible Goal (Passive Agent) + +TODO + +#### Instrumental Action (Passive Agent) + +TODO + +#### Multiple Agents (Passive Agent) + +### Introduced in Evaluation 6 + +#### Agent / Non-Agent (Passive Agent) + +TODO + +#### Social Approach (Passive Agent) + +TODO + +#### Social Imitation (Passive Agent) + +TODO + +### Introduced in Evaluation 7 + +#### Helper / Hinderer (Passive Agent) + +TODO + +#### True / False Belief (Passive Agent) + +TODO + +## Passive Physics Tasks + +TODO DOWNLOAD + +### Introduced in Evaluation 3 + +#### Object Permanence (Passive Physics) + +TODO + +#### Shape Constancy (Passive Physics) + +TODO + +#### Spatio-Temporal Continuity (Passive Physics) + +TODO + +### Introduced in Evaluation 3.5 + +#### Gravity Support (Passive Physics) + +TODO + +### Introduced in Evaluation 4 + +#### Collisions (Passive Physics) + +TODO + +## Other Tasks + +TODO DOWNLOAD + +### Introduced in Evaluation 6 + +#### Seeing Leads to Knowing (Passive) + +TODO + +## Acknowledgements + +This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) and Naval Information Warfare Center, Pacific (NIWC Pacific) under Contract No. N6600119C4030. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the DARPA or NIWC Pacific. + +## Apache 2 Open Source License + +Code in this repository is made available by CACI (formerly Next Century Corporation) under the Apache 2 Open Source License. You may freely download, use, and modify, in whole or in part, the source code or release packages. Any restrictions or attribution requirements are spelled out in the license file. For more information about the Apache license, please visit the The Apache Software Foundation’s License FAQ. + +Copyright 2023 CACI (formerly Next Century Corporation) From 96c7509e5ad3d72bdc8aa06367d98832e35dacb4 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Mon, 11 Dec 2023 11:50:42 -0500 Subject: [PATCH 03/11] Update TASK_LIST.md --- TASK_LIST.md | 141 +++++++++++++++++++++++++++++++++++++++++++-------- 1 file changed, 120 insertions(+), 21 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index ce1eb7f4c..974d9e76f 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -2,34 +2,111 @@ Table of Content: - [Interactive Tasks](#interactive-tasks) - - [Introduced in Evaluation 3](#introduced-in-evaluation-3) + - [Data](#interactive-data) + - [Introduced in Evaluation 3](#interactive-tasks-introduced-in-evaluation-3) - [Retrieval - Containers](#retrieval---containers) + - [Retrieval - Obstacles](#retrieval---obstacles) + - [Retrieval - Occluders](#retrieval---occluders) + - [Introduced in Evaluation 4](#interactive-tasks-introduced-in-evaluation-4) + - [Object Permanence (Interactive)](#object-permanence-interactive) + - [Introduced in Evaluation 5](#interactive-tasks-introduced-in-evaluation-5) + - [Agent Identification](#agent-identification) + - [Moving Target Prediction](#moving-target-prediction) + - [Navigation - Holes](#navigation---holes) + - [Navigation - Lava](#navigation---lava) + - [Navigation - Ramps](#navigation---ramps) + - [Solidity](#solidity) + - [Spatial Elimination](#spatial-elimination) + - [Support Relations (Interactive Gravity Support)](#support-relations-interactive-gravity-support) + - [Tools - Symmetric](#tools---symmetric) + - [Introduced in Evaluation 6](#interactive-tasks-introduced-in-evaluation-6) + - [Introduced in Evaluation 7](#interactive-tasks-introduced-in-evaluation-7) +- [Passive Agent Tasks](#passive-agent-tasks) + - [Data](#passive-agent-data) + - [Introduced in Evaluation 3](#passive-agent-tasks-introduced-in-evaluation-3) + - [Efficient Action](#efficient-action-passive-agent) + - [Object Preference](#object-preference-passive-agent) + - [Introduced in Evaluation 4](#passive-agent-tasks-introduced-in-evaluation-4) + - [Inaccessible Goal](#inaccessible-goal-passive-agent) + - [Instrumental Action](#instrumental-action-passive-agent) + - [Multiple Agents](#multiple-agents-passive-agent) + - [Introduced in Evaluation 6](#passive-agent-tasks-introduced-in-evaluation-6) + - [Agent / Non-Agent](#agent--non-agent-passive-agent) + - [Social Approach](#social-approach-passive-agent) + - [Social Imitation](#social-imitation-passive-agent) + - [Introduced in Evaluation 7](#passive-agent-tasks-introduced-in-evaluation-7) + - [Helper / Hinderer](#helper--hinderer-passive-agent) + - [True / False Belief](#true--false-belief-passive-agent) +- [Passive Physics Tasks](#passive-physics-tasks) + - [Data](#passive-physics-data) + - [Introduced in Evaluation 3](#passive-physics-tasks-introduced-in-evaluation-3) + - [Object Permanence (Passive)](#object-permanence-passive-physics) + - [Shape Constancy](#shape-constancy-passive-physics) + - [Spatio-Temporal Continuity](#spatio-temporal-continuity-passive-physics) + - [Introduced in Evaluation 3.5](#passive-physics-tasks-introduced-in-evaluation-35) + - [Gravity Support (Passive)](#gravity-support-passive-physics) + - [Introduced in Evaluation 4](#passive-physics-tasks-introduced-in-evaluation-4) + - [Collisions (Passive)](#collisions-passive-physics) +- [Other Tasks](#other-tasks) + - [Data](#other-data) + - [Introduced in Evaluation 6](#other-tasks-introduced-in-evaluation-6) + - [Seeing Leads to Knowing (Passive)](#seeing-leads-to-knowing-passive) +- [Evaluation](#evaluation) +- [Scoring](#scoring) +- [Acknowledgements](#acknowledgements) +- [License](#license) ## Interactive Tasks +### Interactive Data + TODO DOWNLOAD -### Introduced in Evaluation 3 +### Interactive Tasks Introduced in Evaluation 3 #### Retrieval - Containers -TODO +Details: + +- You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. +- Sometimes the soccer ball will be located on the floor; other times it will be located inside a closed container. +- You can use the PickupObject action on the soccer ball to pick it up. +- You can use the OpenObject action on a closed container to open it. +- You can also try to use the OpenObject action on non-container objects, though it will fail. +- The evaluation data will have some "novel" containers which did not appear in your training data. #### Retrieval - Obstacles -TODO +Details: + +- You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. +- The soccer ball will always be located on the floor, but sometimes it will be behind obstacle furniture: large pieces of furniture which you can see through/under but cannot navigate through (like tables and chairs). +- You can use the PickupObject action on the soccer ball to pick it up. +- The evaluation data will have some "novel" obstacle furniture which did not appear in your training data. #### Retrieval - Occluders -TODO +Details: -### Introduced in Evaluation 4 +- You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. +- The soccer ball will always be located on the floor, but sometimes it will be hidden from your starting position's view behind occluding furniture: large pieces of furniture which you can neither see nor navigate through (like sofas and bookcases). +- You can use the PickupObject action on the soccer ball to pick it up. +- The evaluation data will have some "novel" occluding furniture which did not appear in your training data. + +### Interactive Tasks Introduced in Evaluation 4 #### Object Permanence (Interactive) -TODO +https://github.com/NextCenturyCorporation/MCS/assets/10994382/ce9a0b76-b565-46ef-8197-ce196395f356 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/774e9b0b-4dc5-4558-bb07-83be0d8eaad8 + +Details: -### Introduced in Evaluation 5 +- You start on a tall platform bisecting the entire room (this is a "forced choice" task). Each side of the room contains an occluder (on the floor) and throwing device (on the wall). After the scene begins, one of the throwing devices will launch a soccer ball. The soccer ball will land behind one of the occluders, hidden from your view. You will have to understand which side of the room contains the soccer ball after it is hidden from view, jump off of the platform onto that side, navigate around the occluder, and pick up the soccer ball. As a "forced choice" task, once you leave the platform, you will not be able to navigate to the other side of the room (if you've chosen incorrectly). +- After the scene begins, you will be "frozen" (forced to only use Pass actions) until the soccer ball is launched and then lands behind an occluder. + +### Interactive Tasks Introduced in Evaluation 5 #### Agent Identification @@ -116,8 +193,8 @@ Details: ||| |---|---| -![spatial_elimination_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/9152594e-ca9f-43eb-a499-7b107d7fe406) |![spatial_elimination_eval_5_ex_2](https://github.com/NextCenturyCorporation/MCS/assets/10994382/63df3f27-98df-46c0-888a-fc0887ae0708) -![spatial_elimination_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/83fa96da-fc7a-41c1-aa6a-42a4376443d8) |![spatial_elimination_eval_5_ex_4](https://github.com/NextCenturyCorporation/MCS/assets/10994382/d3897fdc-3fdf-408a-97ee-a0f6784f23eb) +![spatial_elimination_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/9152594e-ca9f-43eb-a499-7b107d7fe406) | ![spatial_elimination_eval_5_ex_2](https://github.com/NextCenturyCorporation/MCS/assets/10994382/63df3f27-98df-46c0-888a-fc0887ae0708) +![spatial_elimination_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/83fa96da-fc7a-41c1-aa6a-42a4376443d8) | ![spatial_elimination_eval_5_ex_4](https://github.com/NextCenturyCorporation/MCS/assets/10994382/d3897fdc-3fdf-408a-97ee-a0f6784f23eb) Details: @@ -156,7 +233,7 @@ Details: - See the section on the new lava task for more information about using lava. - Please note: while only Pushing tools (or Moving them forward) will be necessary in Eval 5, future evals might require Pulling tools (or Moving them backward). -### Introduced in Evaluation 6 +### Interactive Tasks Introduced in Evaluation 6 #### Arithmetic and Number Comparison @@ -369,7 +446,7 @@ Notes: - For scoring purposes, only the soccer ball on the side of the room containing the “useful tool” is considered the “target object”. - In Eval 6, the “useful tool” in Tool Choice scenes will always be a symmetric (rectangular-shaped) tool (not an asymmetric tool). -### Introduced in Evaluation 7 +### Interactive Tasks Introduced in Evaluation 7 #### Hidden Set Rotation @@ -428,7 +505,11 @@ Notes: TODO DOWNLOAD -### Introduced in Evaluation 3 +### Passive Agent Tasks Introduced in Evaluation 3 + +### Passive Agent Data + +TODO DOWNLOAD #### Efficient Action (Passive Agent) @@ -438,7 +519,7 @@ TODO TODO -### Introduced in Evaluation 4 +### Passive Agent Tasks Introduced in Evaluation 4 #### Inaccessible Goal (Passive Agent) @@ -450,7 +531,7 @@ TODO #### Multiple Agents (Passive Agent) -### Introduced in Evaluation 6 +### Passive Agent Tasks Introduced in Evaluation 6 #### Agent / Non-Agent (Passive Agent) @@ -464,7 +545,7 @@ TODO TODO -### Introduced in Evaluation 7 +### Passive Agent Tasks Introduced in Evaluation 7 #### Helper / Hinderer (Passive Agent) @@ -476,9 +557,11 @@ TODO ## Passive Physics Tasks +### Passive Physics Data + TODO DOWNLOAD -### Introduced in Evaluation 3 +### Passive Physics Tasks Introduced in Evaluation 3 #### Object Permanence (Passive Physics) @@ -492,13 +575,19 @@ TODO TODO -### Introduced in Evaluation 3.5 +### Passive Physics Tasks Introduced in Evaluation 3.5 #### Gravity Support (Passive Physics) +||||| +|---|---|---|---| +![gravity_support_ex_01](https://github.com/NextCenturyCorporation/MCS/assets/10994382/568c3ba3-f357-44af-b740-1811d3fc9d99) | ![gravity_support_ex_02](https://github.com/NextCenturyCorporation/MCS/assets/10994382/2254e21c-7e19-4076-812f-c1a4f26cb24c) | ![gravity_support_ex_03](https://github.com/NextCenturyCorporation/MCS/assets/10994382/8eef0960-6cce-4976-a819-b3e2a807668a) | ![gravity_support_ex_04](https://github.com/NextCenturyCorporation/MCS/assets/10994382/5fad4cc8-65cf-47fa-806c-64f2cada4f24) +![gravity_support_ex_05](https://github.com/NextCenturyCorporation/MCS/assets/10994382/f6b3cc0a-8368-4613-ac1d-675fcca03d42) | ![gravity_support_ex_06](https://github.com/NextCenturyCorporation/MCS/assets/10994382/6b81d66a-3b2f-473c-9afc-4e9960055be4) | ![gravity_support_ex_07](https://github.com/NextCenturyCorporation/MCS/assets/10994382/8ad20113-d922-4acb-b062-6ac360300d55) | ![gravity_support_ex_08](https://github.com/NextCenturyCorporation/MCS/assets/10994382/7336d2f3-6e1e-4b45-abfe-17fbb72d740a) +![gravity_support_ex_09](https://github.com/NextCenturyCorporation/MCS/assets/10994382/6e80e487-8c0e-4fe1-adba-c8e0d13651e5) | ![gravity_support_ex_10](https://github.com/NextCenturyCorporation/MCS/assets/10994382/3b0d6c27-71f1-4f67-b26e-64640920228f) | ![gravity_support_ex_11](https://github.com/NextCenturyCorporation/MCS/assets/10994382/135e8da0-1c23-43fd-9b8e-4e4b9e25fa5f) | ![gravity_support_ex_12](https://github.com/NextCenturyCorporation/MCS/assets/10994382/26284069-4582-4448-ba12-8a7184f10a92) + TODO -### Introduced in Evaluation 4 +### Passive Physics Tasks Introduced in Evaluation 4 #### Collisions (Passive Physics) @@ -506,19 +595,29 @@ TODO ## Other Tasks +### Other Data + TODO DOWNLOAD -### Introduced in Evaluation 6 +### Other Tasks Introduced in Evaluation 6 #### Seeing Leads to Knowing (Passive) TODO +## Evaluation + +TODO + +## Scoring + +TODO + ## Acknowledgements This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) and Naval Information Warfare Center, Pacific (NIWC Pacific) under Contract No. N6600119C4030. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the DARPA or NIWC Pacific. -## Apache 2 Open Source License +## License Code in this repository is made available by CACI (formerly Next Century Corporation) under the Apache 2 Open Source License. You may freely download, use, and modify, in whole or in part, the source code or release packages. Any restrictions or attribution requirements are spelled out in the license file. For more information about the Apache license, please visit the The Apache Software Foundation’s License FAQ. From e6000d9ecd26fc348caea7824e2dd33907d60b3c Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Mon, 11 Dec 2023 16:59:06 -0500 Subject: [PATCH 04/11] Update TASK_LIST.md --- TASK_LIST.md | 274 ++++++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 251 insertions(+), 23 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index 974d9e76f..ee8fc7d9e 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -20,9 +20,22 @@ Table of Content: - [Support Relations (Interactive Gravity Support)](#support-relations-interactive-gravity-support) - [Tools - Symmetric](#tools---symmetric) - [Introduced in Evaluation 6](#interactive-tasks-introduced-in-evaluation-6) + - [Arithmetic and Number Comparison](#arithmetic-and-number-comparison) + - [Imitation (Interactive)](#imitation-interactive) + - [Occluded Trajectory and Collisions (Interactive)](#occluded-trajectory-and-collisions-interactive) + - [Set Rotation](#set-rotation) + - [Shell Game](#shell-game) + - [Spatial Reference](#spatial-reference) + - [Spatial Reorientation](#spatial-reorientation) + - [Tools - Asymmetric and Tool Choice](#tools---asymmetric-and-tool-choice) - [Introduced in Evaluation 7](#interactive-tasks-introduced-in-evaluation-7) + - [Hidden Set Rotation](#hidden-set-rotation) + - [Knowledgeable Agents](#knowledgeable-agents) + - [Tools - Secondary Tool Use](#tools---secondary-tool-use) - [Passive Agent Tasks](#passive-agent-tasks) - [Data](#passive-agent-data) + - [Evaluation Datasets](#passive-agent-evaluation-datasets) + - [Training Datasets](#passive-agent-training-datasets) - [Introduced in Evaluation 3](#passive-agent-tasks-introduced-in-evaluation-3) - [Efficient Action](#efficient-action-passive-agent) - [Object Preference](#object-preference-passive-agent) @@ -32,8 +45,7 @@ Table of Content: - [Multiple Agents](#multiple-agents-passive-agent) - [Introduced in Evaluation 6](#passive-agent-tasks-introduced-in-evaluation-6) - [Agent / Non-Agent](#agent--non-agent-passive-agent) - - [Social Approach](#social-approach-passive-agent) - - [Social Imitation](#social-imitation-passive-agent) + - [Social and Instrumental Approach and Imitation](#social-and-instrumental-approach-and-imitation-passive-agent) - [Introduced in Evaluation 7](#passive-agent-tasks-introduced-in-evaluation-7) - [Helper / Hinderer](#helper--hinderer-passive-agent) - [True / False Belief](#true--false-belief-passive-agent) @@ -264,7 +276,7 @@ Notes: - You will not receive a reward until all of the targets are picked up. - In Arithmetic scenes, you will be restricted to only using Pass actions until the placers (and occluders) are finished moving. -#### Imitation +#### Imitation (Interactive) https://github.com/NextCenturyCorporation/MCS/assets/10994382/1536702f-b2b6-4323-9da6-fc7af4bff486 @@ -503,47 +515,239 @@ Notes: ## Passive Agent Tasks -TODO DOWNLOAD +### Passive Agent Overview -### Passive Agent Tasks Introduced in Evaluation 3 +- The Passive Agent tasks were designed by CACI's partners at NYU. For more information about these tasks, please see their website: https://www.kanishkgandhi.com/bib +- These are passive/VoE agent tasks. During the evaluation, your system is **required** to call `controller.end_scene()` at the end of each scene with a **continuous** plausibility `rating`, from `0.0` (completely unexpected/surprising) to `1.0` (completely expected/unsurprising). Your system should use the full range of values between `0.0` and `1.0`. Ratings between `0.0` and `1.0` indicate intermediate levels of expectedness/surprise. Your system is not required to also pass a `score`. For more information, please see the documentation here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.Controller.end_scene +- You begin standing on a platform in the corner of the room, looking down at the room with a three-quarter perspective, and observe a set of eight familiarization (a.k.a. habituation) trials and one test trial. Your VoE (plausibility rating) should be based on the “expectedness” (or “unexpectedness”) of the test trial, based on your system’s prior training and the familiarization trials. +- Goal objects share a common set of colors (azure, brown, chartreuse, cyan, grey, indigo, navy, olive, orange, rose, springgreen, teal, violet, yellow) and shapes (spheres, cylinders, cubes, cones, pyramids, frustums). Agent and non-agent entities share a common set of colors (blue, goldenrod, green, purple) and shapes (blobs). +- All training scenes are either "plausible/expected" or "no expectation". Training scenes also have nine trials, but they aren’t always conceptually separated into “familiarization trials” and “test trials”. Please note that some evaluation tasks have multiple different types of scenes, all of which are described below and labelled appropriately in the datasets. +- Unknown to your systems, all Passive Agent scenes are generated in pairs: an "expected" scene and an "unexpected" scene; an "expected" and a "no-expectation" scene; or an "unexpected" scene and a "no-expectation" scene. After all evaluation scenes are run, our [scoring software](#scoring) compares the ratings returned by the your systems for each pair of scenes; the pair is marked as "correct" in our performance assessment if the correct scene has a higher rating than the other scene. + - For expected/unexpected pairs, the expected scene should have a higher rating than the unexpected scene. + - For expected/no-expectation pairs, the expected scene should have a higher rating than the no-expectation scene. + - For unexpected/no-expectation pairs, the no-expectation scene should have a higher rating than the unexpected scene. ### Passive Agent Data -TODO DOWNLOAD +#### Passive Agent Evaluation Datasets + +- Eval 7 dataset (1,000 pairs of each Eval 6 and Eval 7 task): https://eval-7.s3.amazonaws.com/eval_7_passive_agents.zip +- Eval 7 extra data: https://eval-7.s3.amazonaws.com/eval_7_passive_agents_extra.zip +- Eval 6 dataset (includes some older tasks): https://eval-6.s3.amazonaws.com/eval_6_passive_agent.zip +- Eval 5 dataset (includes all tasks designed up to this point): https://eval-5.s3.amazonaws.com/eval_5_passive_agent.zip +- Debug scene files for the MCS UI: + - Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_agents_debug.zip + - Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_agent_debug.zip + - Eval 5: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_debug.zip + +#### Passive Agent Training Datasets + +The "Single Object" training data is relevant to all Passive Agent tasks. Please see the tasks listed below to find the links to one or more training datasets specific to each task. + +##### Single Object Training Data + +https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_single_object.zip + +- Each trial shows an agent (A1) approaching a goal object (O1). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. + +TODO VIDEOS + +### Passive Agent Tasks Introduced in Evaluation 3 #### Efficient Action (Passive Agent) -TODO +Summary: + +Passive Agent: Efficient Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The trials depict the agent approaching an object; in the test trial, some of the obstacles are removed. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent moves in an efficient path (agents should move efficiently). + +TODO VIDEOS + +##### Efficient Action Training Data + +- Time Control: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_efficient_action_time_training_scenes_v2.zip +- Path Control: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_efficient_action_path_training_scenes_v2.zip +- Irrational: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_efficient_action_irrational_training_scenes_v2.zip #### Object Preference (Passive Agent) -TODO +Summary: + +Passive Agent: Object Preference tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials). You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent continued to act with the same preferences it showed during the familiarization trials (approaching the same object). + +TODO VIDEOS + +##### Object Preference Training Data + +https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_object_preference.zip + +- Each trial shows an agent (A1) approaching a goal object (O1), ignoring a second goal object (O2). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. ### Passive Agent Tasks Introduced in Evaluation 4 #### Inaccessible Goal (Passive Agent) -TODO +Summary: + +Passive Agent: Inaccessible Goal tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent retrieving a red triangular "key" object; inserting that key into a "lock" in the green wall, causing the green wall to disappear; and then approaching an "goal" object that was previously blocked by the green wall, but is now accessible. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent used the "key" object when it was necessary to approach the "goal" object (if the "goal" object is not blocked by the green wall, then using the "key" object is unnecessary). + +TODO VIDEOS + +##### Inaccessible Goal Training Data + +https://eval-5.s3.amazonaws.com/eval_5_passive_agent_inaccessible_goal_training_scenes_v2.zip #### Instrumental Action (Passive Agent) -TODO +Summary: + +Passive Agent: Instrumental Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, obstacles may be moved to block a path to the preferred object. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent can successfully navigate to its preferred object (approaching a different object is unsurprising if the preferred object is blocked). + +TODO VIDEOS + +##### Instrumental Action Training Data + +- Blocking Barriers: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_instrumental_action_blocking_barriers_training_scenes_v2.zip +- Inconsequential Barriers: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_instrumental_action_inconsequential_barriers_training_scenes_v2.zip +- No Barriers: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_instrumental_action_no_barriers_training_scenes_v2.zip #### Multiple Agents (Passive Agent) +Summary: + +Passive Agent: Multiple Agents tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, either the same agent or a new agent will approach a different object. You must then determine whether the test trial is “more expected” (unsurprising) or “more unexpected” (surprising) based on whether or not the agent with a known preference approached a different object (it is unsurprising for a new agent to have a different preference). + +TODO VIDEOS + +##### Multiple Agents Training Data + +https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_multiple_agents.zip + +- Each trial shows an agent (either A1 or A2) approaching a goal object (O1). +- The same object (O1) appears in each trial, but only one of the two agents (A1, A2). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- In the evaluation data, multiple goal objects will appear in each trial, and the different agents may have different preferences. + ### Passive Agent Tasks Introduced in Evaluation 6 #### Agent / Non-Agent (Passive Agent) -TODO +Summary: -#### Social Approach (Passive Agent) +Passive Agent: Agent/Non-Agent tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an ambiguous agent-like entity (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familiarization trials depict the entity approaching a specific object (the same object in all 8 familiarization trials). The entity is either an agent or a non-agent: agents move autonomously, while non-agents are moved because they are hit by the spinning “paddle”. You must then determine whether the test trial is “more expected” (unsurprising) or “more unexpected” (surprising) based on how the entity acts: if the entity is an agent, it should continue to act with the same preferences it showed during the familiarization trials (approaching the same object); if the entity is a non-agent, then it doesn’t have preferences, because its movement is controlled by the paddle, so it’s just as likely to approach either object. -TODO +Details: -#### Social Imitation (Passive Agent) +- All of these scenes (except "Collect" training scenes) have a “paddle” (black wall, consistent height) and an “occluder” (white wall, differing height). The paddle is a mechanism that is constantly spinning and does not have agency. The occluder can be seen “out-of-the-way” for the first eight trials, but then is randomly positioned “in-the-way” for the ninth trial, partially blocking your view of what is happening. +- All of these scenes have either an “agent” or a “non-agent”. Since the agent and the non-agent share the same set of colors and “blob” models, your system must observe their behavior to differentiate them during the evaluation: specifically, agents have agency and preferences. +- If an agent shows a preference for a specific goal object during the familiarization trials (by approaching the goal object), it is expected/plausible for the agent to show the same preference (for the same goal object) during the test trial, and unexpected/implausible for the agent to show a different preference (for a different goal object). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +- If a non-agent shows a “preference” for a specific goal object during the familiarization trials (by “approaching” the goal object, after being hit by the paddle), then there is no expectation for the non-agent to show either the same preference or a different preference, because it does not have agency. For “no expectation” scenes, your system should return a plausibility / expectedness rating that’s lower than for “expected” scenes but higher than for “unexpected” scenes. -TODO +Example Evaluation Scenes: + +TODO VIDEOS + +##### Agent / Non-Agent Training Data + +https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_agent_nonagent_tasks.zip + +Agent One Goal Training Data: + +- Each trial shows an agent (A1) approaching a goal object (O1). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- The agent and the paddle do not come into contact. (The agent has agency and can move itself.) + +TODO VIDEOS + +Agent Preference Training Data: + +- Each trial shows an agent (A1) approaching a goal object (O1), ignoring a second goal object (O2). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- The agent and the paddle do not come into contact. (The agent has agency and can move itself.) + +TODO VIDEOS + +Collect Training Data: + +- Each trial shows an agent (A1) approaching a goal object (O1). Similar to the Single Object dataset (see above). +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- No paddle or occluder. + +TODO VIDEOS + +Non-Agent One Goal Training Data: + +- Each trial shows a non-agent (N1) being hit by the paddle in a realistic direction and stopping when it contacts a goal object (O1) or a wall. +- When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- While the non-agent (N1) sometimes contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. + +TODO VIDEOS + +Non-Agent "Preference" Training Data: + +- Each trial shows a non-agent (N1) being hit by the paddle in a realistic direction and stopping when it contacts a goal object (O1), ignore a second goal object (O2). +- When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- While the non-agent (N1) always contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. + +TODO VIDEOS + +#### Social and Instrumental Approach and Imitation (Passive Agent) + +Summary: + +Passive Agent: Appraoch and Imitation tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as three agents (blob shapes) move in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). + +In the Approach tasks, the familiarization trials depict an agent approaching another specific agent (the same agent in all 8 familiarization trials). You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent continued to act with the same preferences it showed during the familiarization trials (imitating the movement pattern of the other agent it approached). + +In the Imitation tasks, the familiarization trials depict the three agents moving in specific patterns, which are consistent across all 8 trials; two of the agents always have the same movement pattern. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent continued to act with the same preferences it showed during the familiarization trials (approaching the other agent who had the same movement pattern). + +Details: + +- All of these scenes have three agents with different shapes and colors: two agents move in different patterns (like an L-shape and a C-shape), and a third agent imitates one of the first two agents by moving in the same pattern as that agent. +- The “Social Approach” category shows an agent approaching another agent, and then imitating it. The “Social Imitation” category shows an agent imitating another agent, and then approaching it. If an agent shows a preference for another agent during the familiarization trials (by approaching or imitating that agent), it is expected/plausible for the agent to show the same preference (by approaching or imitating the same agent) during the test trial, and unexpected/implausible for the agent to show a different preference (by approaching or imitating a different agent). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +- The “Instrumental Approach” and “Instrumental Imitation” categories introduce a goal object that the agent contacts while imitating a movement pattern. If an agent appears to show a preference for another agent (by approaching or imitating that agent), but simultaneously contacts a goal object, then there is no expectation for that agent to show either the same preference or a different preference, because it is impossible to know whether the agent is trying to imitate another agent or contact the goal object. For “no expectation” scenes, your system should return a plausibility / expectedness rating that’s lower than for “expected” scenes but higher than for “unexpected” scenes. + +Example Evaluation Scenes: + +TODO VIDEOS + +##### Social and Instrumental Approach and Imitation Training Data + +https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_approach_imitation_tasks.zip + +Social Approach: + +- Each trial shows three agents (A1, A2, A3). +- Each familiarization trial shows agent A1 approaching agent A2, ignoring agent A3. +- The test trial shows agent A2 and agent A3 moving in a different pattern, and then agent A1 moving in the same pattern as agent A2. + +TODO VIDEOS + +Instrumental Approach: + +- Like Social Approach (see above), but when agent A1 moves during the test trial, it contacts a goal object (O1) while moving in its pattern. +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. + +TODO VIDEOS + +Social Imitation: + +- Each trial shows three agents (A1, A2, A3). +- Each familiarization trial shows either agent A1 or agent A2 moving in a different pattern, and then agent A3 moving in the same pattern as either agent A1 or agent A2. +- Agent A1’s movement pattern never changes across trials (assuming it moves during that trial). The same is true for agent A2’s and agent A3’s movement patterns. +- The test trial shows agent A3 approaching the other agent (either A1 or A2) who has the same movement pattern. + +TODO VIDEOS + +Instrumental Imitation: + +- Like Social Imitation (see above), but when agent A3 moves, it contacts a goal object (O1) while moving in its pattern. +- Unlike Social Imitation, the test trial shows agent A3 approach goal object O1 rather than another agent. +- When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +- Some trials show agent A3 contacting goal object O1 multiple times. When an agent contacts a goal object a second time, its highlight is deactivated (color changes back to original color). + +TODO VIDEOS ### Passive Agent Tasks Introduced in Evaluation 7 @@ -565,33 +769,51 @@ TODO DOWNLOAD #### Object Permanence (Passive Physics) -TODO +Summary: + +Object Permanence tasks require a common-sense understanding of object permanence. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously appear and/or disappear. + +TODO VIDEOS #### Shape Constancy (Passive Physics) -TODO +Summary: + +Shape Constancy tasks require a common-sense understanding of shape constancy. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously transform into different shapes. + +TODO VIDEOS #### Spatio-Temporal Continuity (Passive Physics) -TODO +Summary: + +Spatio-Temporal Continuity tasks require a common-sense understanding of spatial and temporal continuity. This is a “passive physics” task: you must watch objects moving a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously teleport across the room. + +TODO VIDEOS ### Passive Physics Tasks Introduced in Evaluation 3.5 #### Gravity Support (Passive Physics) +Summary: + +Passive Gravity Support tasks require a common-sense understanding of gravity. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects are properly supported. + ||||| |---|---|---|---| ![gravity_support_ex_01](https://github.com/NextCenturyCorporation/MCS/assets/10994382/568c3ba3-f357-44af-b740-1811d3fc9d99) | ![gravity_support_ex_02](https://github.com/NextCenturyCorporation/MCS/assets/10994382/2254e21c-7e19-4076-812f-c1a4f26cb24c) | ![gravity_support_ex_03](https://github.com/NextCenturyCorporation/MCS/assets/10994382/8eef0960-6cce-4976-a819-b3e2a807668a) | ![gravity_support_ex_04](https://github.com/NextCenturyCorporation/MCS/assets/10994382/5fad4cc8-65cf-47fa-806c-64f2cada4f24) ![gravity_support_ex_05](https://github.com/NextCenturyCorporation/MCS/assets/10994382/f6b3cc0a-8368-4613-ac1d-675fcca03d42) | ![gravity_support_ex_06](https://github.com/NextCenturyCorporation/MCS/assets/10994382/6b81d66a-3b2f-473c-9afc-4e9960055be4) | ![gravity_support_ex_07](https://github.com/NextCenturyCorporation/MCS/assets/10994382/8ad20113-d922-4acb-b062-6ac360300d55) | ![gravity_support_ex_08](https://github.com/NextCenturyCorporation/MCS/assets/10994382/7336d2f3-6e1e-4b45-abfe-17fbb72d740a) ![gravity_support_ex_09](https://github.com/NextCenturyCorporation/MCS/assets/10994382/6e80e487-8c0e-4fe1-adba-c8e0d13651e5) | ![gravity_support_ex_10](https://github.com/NextCenturyCorporation/MCS/assets/10994382/3b0d6c27-71f1-4f67-b26e-64640920228f) | ![gravity_support_ex_11](https://github.com/NextCenturyCorporation/MCS/assets/10994382/135e8da0-1c23-43fd-9b8e-4e4b9e25fa5f) | ![gravity_support_ex_12](https://github.com/NextCenturyCorporation/MCS/assets/10994382/26284069-4582-4448-ba12-8a7184f10a92) -TODO - ### Passive Physics Tasks Introduced in Evaluation 4 #### Collisions (Passive Physics) -TODO +Summary: + +Passive Collision tasks require a common-sense understanding of collision physics. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects properly collide with one another. + +TODO VIDEOS ## Other Tasks @@ -603,15 +825,21 @@ TODO DOWNLOAD #### Seeing Leads to Knowing (Passive) +Summary: + +Seeing Leads to Knowing tasks require a common-sense understanding of agency. This is a “passive” task: you must watch (using only Pass actions) as a soccer ball is deposited into a container and an agent approaches a container, and then determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not the agent acted with common-sense reasoning (if the agent saw the ball being deposited, it should approach the container holding the ball; otherwise it should approach one of the containers behind it, because one of those containers holds the ball). + +Details: + TODO ## Evaluation -TODO +Running of evaluation scenes is done by our `mcs-pipeline` software: https://github.com/NextCenturyCorporation/mcs-pipeline ## Scoring -TODO +Scoring of evaluation scenes is done by our `mcs-ingest` software: https://github.com/NextCenturyCorporation/mcs-ingest ## Acknowledgements From cba6a47a670ecf4d2ba5741bca9866a855b44c4c Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Mon, 11 Dec 2023 23:46:58 -0500 Subject: [PATCH 05/11] Update TASK_LIST.md --- TASK_LIST.md | 171 ++++++++++++++++++++++++++++++++++++++++++++++----- 1 file changed, 154 insertions(+), 17 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index ee8fc7d9e..596d437d9 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -12,13 +12,12 @@ Table of Content: - [Introduced in Evaluation 5](#interactive-tasks-introduced-in-evaluation-5) - [Agent Identification](#agent-identification) - [Moving Target Prediction](#moving-target-prediction) - - [Navigation - Holes](#navigation---holes) - - [Navigation - Lava](#navigation---lava) + - [Navigation - Holes and Lava](#navigation---holes-and-lava) - [Navigation - Ramps](#navigation---ramps) - [Solidity](#solidity) - [Spatial Elimination](#spatial-elimination) - [Support Relations (Interactive Gravity Support)](#support-relations-interactive-gravity-support) - - [Tools - Symmetric](#tools---symmetric) + - [Tools - Symmetric Tool Use](#tools---symmetric-tool-use) - [Introduced in Evaluation 6](#interactive-tasks-introduced-in-evaluation-6) - [Arithmetic and Number Comparison](#arithmetic-and-number-comparison) - [Imitation (Interactive)](#imitation-interactive) @@ -27,15 +26,15 @@ Table of Content: - [Shell Game](#shell-game) - [Spatial Reference](#spatial-reference) - [Spatial Reorientation](#spatial-reorientation) - - [Tools - Asymmetric and Tool Choice](#tools---asymmetric-and-tool-choice) + - [Tools - Asymmetric Tool Use and Tool Choice](#tools---asymmetric-tool-use-and-tool-choice) - [Introduced in Evaluation 7](#interactive-tasks-introduced-in-evaluation-7) - [Hidden Set Rotation](#hidden-set-rotation) - [Knowledgeable Agents](#knowledgeable-agents) - [Tools - Secondary Tool Use](#tools---secondary-tool-use) - [Passive Agent Tasks](#passive-agent-tasks) - [Data](#passive-agent-data) - - [Evaluation Datasets](#passive-agent-evaluation-datasets) - - [Training Datasets](#passive-agent-training-datasets) + - [Evaluation Datasets](#passive-agent-evaluation-datasets) + - [Training Datasets](#passive-agent-training-datasets) - [Introduced in Evaluation 3](#passive-agent-tasks-introduced-in-evaluation-3) - [Efficient Action](#efficient-action-passive-agent) - [Object Preference](#object-preference-passive-agent) @@ -65,6 +64,7 @@ Table of Content: - [Seeing Leads to Knowing (Passive)](#seeing-leads-to-knowing-passive) - [Evaluation](#evaluation) - [Scoring](#scoring) + - [Ambiguous and Control Trials](#ambiguous-and-control-trials) - [Acknowledgements](#acknowledgements) - [License](#license) @@ -78,6 +78,10 @@ TODO DOWNLOAD #### Retrieval - Containers +Summary: + +Container Retrieval tasks require a common-sense understanding of containment. You must find the soccer ball, which may or may not be hidden inside a container (use OpenObject to open a closed container), and then use PickupObject on the ball to pick it up. + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -89,6 +93,10 @@ Details: #### Retrieval - Obstacles +Summary: + +Obstacle Retrieval tasks require a common-sense understanding of occlusion. You must find the soccer ball, which may or may not be hidden behind “obstacle” furniture (furniture which you can see through, but cannot walk through), and then use PickupObject on the ball to pick it up, which completes the scenario. + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -98,6 +106,10 @@ Details: #### Retrieval - Occluders +Summary: + +Occluder Retrieval tasks require a common-sense understanding of occlusion. You must find the soccer ball, which may or may not be hidden behind occluding furniture (furniture which you can neither see through nor walk through), and then use PickupObject on the ball to pick it up, which completes the scenario. + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -109,6 +121,10 @@ Details: #### Object Permanence (Interactive) +Summary: + +Interactive Object Permanence tasks require a common-sense understanding of object permanence. You must watch (using the Pass action) as a soccer ball is tossed through the air and lands hidden behind an occluder; you must then determine which side of the room contains the ball, find it, and use PickupObject on it, which completes the scenario. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/ce9a0b76-b565-46ef-8197-ce196395f356 https://github.com/NextCenturyCorporation/MCS/assets/10994382/774e9b0b-4dc5-4558-bb07-83be0d8eaad8 @@ -122,6 +138,10 @@ Details: #### Agent Identification +Summary: + +Agent Identification tasks require a common-sense understanding of agency. You must identify the agent, approach it, use InteractWithAgent on the agent to request the soccer ball, and then use PickupObject on the ball once the agent produces it which completes the scenario. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/d9f7e054-8d46-467a-8d16-dcf126af8a81 https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b27f91e-9d74-482c-8e2f-236930c28bb0 @@ -143,6 +163,10 @@ Details: #### Moving Target Prediction +Summary: + +Moving Target Prediction tasks require a common-sense understanding of trajectory. You are in a room with lava on both sides and a “safe zone” in the center. After spinning around to see the entire room (using the RotateRight action), you watch (using the Pass action) as a soccer ball is launched across the floor, toward the “safe zone”. You must move to intercept the ball and use PickupObject on it before it rolls into the lava and out of your reach. Walking into the lava immediately ends the scene (therefore failing the scenario). + https://github.com/NextCenturyCorporation/MCS/assets/10994382/22b4c78f-7eef-44a4-8e75-82306f12dc09 https://github.com/NextCenturyCorporation/MCS/assets/10994382/8b13cb6d-7fdd-48d9-94d4-9ba95ae6b073 @@ -159,24 +183,29 @@ Details: - You will start on a platform so you can get a good view of the entire room, but can walk off the platform at any time as normal. - See “Navigation: Lava” for more information on adjusting our lava settings for training. -#### Navigation - Holes +#### Navigation - Holes and Lava -Details: +Summary: -- If you move too close to a hole, you’ll fall in, and won’t be able to get out. -- Your AI will begin on a platform so it has a good view of the entire room before moving. +Hole and Lava Navigation tasks require a common-sense understanding of navigation in a dangerous environment. You must walk through a room full of holes or lava in order to find the soccer ball, and then use PickupObject on the ball to pick it up, which completes the scenario. Walking into a hole will make it impossible to reach the ball (you fall in and cannot escape). Walking into the lava immediately ends the scene (therefore failing the scenario). Sometimes the ball is on the floor, and sometimes an agent is holding the ball instead (use InteractWithAgent on the agent to request the soccer ball). -#### Navigation - Lava +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a72a4686-f3b9-4667-972c-e1be53152c00 Details: +- Your AI will begin on a platform so it has a good view of the entire room before moving. +- If you move too close to a hole, you’ll fall in, and won’t be able to get out. - Stepping too close to the lava will force you to immediately end the scene (you will only be allowed to use the “EndScene” action if you try to call the step function, or you can call end_scene yourself). This will be what happens during the evaluation. You can override the default setting using the steps_allowed_in_lava config property: https://nextcenturycorporation.github.io/MCS/install.html#steps-allowed-in-lava - Stepping too close to the lava will give you an insurmountably large reward penalty. You will always receive this penalty, even if you must immediately end the scene due to the steps_allowed_in_lava setting (see above). You can override the default setting using the lava_penalty config property: https://nextcenturycorporation.github.io/MCS/install.html#lava-penalty -- Stepping too close to the lava will adjust the haptic_feedback and steps_in_lava properties of the StepMetadata output returned by that action step: haptic_feedback will be {"on_lava": true} and steps_in_lava will increase by one. https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.StepMetadata -- Your AI will begin on a platform so it has a good view of the entire room before moving. +- Stepping too close to the lava will adjust the haptic_feedback and steps_in_lava properties of the StepMetadata output returned by that action step: haptic_feedback will be {"on_lava": true} and steps_in_lava will increase by one. https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.StepMetadata +- Use the InteractWithAgent action to facilitates the request for the agent to produce the soccer ball. For more information about this action, please refer to the Details under the [Agent Identification](#agent-identification) task. #### Navigation - Ramps +Summary: + +Ramp Navigation tasks require a common-sense understanding of navigation in an environment with multiple stories. You must walk up and/or down one or more ramps in order to find the soccer ball, and then use PickupObject on the ball to pick it up, which completes the scenario. Sometimes the ball is on the floor, and sometimes an agent is holding the ball instead (use InteractWithAgent on the agent to request the soccer ball). + ||| |---|---| ![ramps_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/b2c87fde-ca3f-48cc-8ed4-597ceacc3d39) | ![ramps_eval_5_ex_3](https://github.com/NextCenturyCorporation/MCS/assets/10994382/33b9373a-77fd-4e9e-8050-88a9dd3a7a1c) @@ -188,6 +217,10 @@ Details: #### Solidity +Summary: + +Solidity tasks require a common-sense understanding of objects and gravity. You must watch (using the Pass action) as a soccer ball is lowered by a pole, but the ball is hidden as it goes behind a large occluding wall before you see the pole release it; you must then determine which side of the room contains the ball, find it, and use PickupObject on it to pick it up, which completes the scenario. To access a part of the room, you must open one of the doors (using the OpenObject action) in the occluding wall: the left side of the room can be accessed using the left door; the right side of the room can be accessed using the right door; and the platform can be accessed using the middle door. This is a “forced choice” task: once you open the door to one part of the room, you are unable to access the other parts of the room. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/392d5b5e-977f-4c75-a169-7a50f5752cf7 https://github.com/NextCenturyCorporation/MCS/assets/10994382/308d2d09-e4af-472b-93f4-9f626692bdde @@ -203,6 +236,10 @@ Details: #### Spatial Elimination +Summary: + +Spatial Elimination tasks require a common-sense understanding of spatial elimination. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. You must identify which side of the room has the soccer ball, find it, and then use PickupObject on the ball to pick it up, which completes the scenario. + ||| |---|---| ![spatial_elimination_eval_5_ex_1](https://github.com/NextCenturyCorporation/MCS/assets/10994382/9152594e-ca9f-43eb-a499-7b107d7fe406) | ![spatial_elimination_eval_5_ex_2](https://github.com/NextCenturyCorporation/MCS/assets/10994382/63df3f27-98df-46c0-888a-fc0887ae0708) @@ -214,6 +251,10 @@ Details: #### Support Relations (Interactive Gravity Support) +Summary: + +Interactive Gravity Support Relations tasks require a common-sense understanding of gravity. You must watch (using the Pass action) as a “container” holding a soccer ball is lowered by poles, but the container and the ball are hidden as they go behind a large occluding wall before you see the poles release them; you must then determine which side of the room contains the ball, find it, and use PickupObject on it to pick it up, which completes the scenario. The container is sometimes released fully onto the platform, fully onto the floor, or partially onto the platform, and possibly falling onto the floor. To access a part of the room, you must open one of the doors (using the OpenObject action) in the occluding wall: the left side of the room can be accessed using the left door; the right side of the room can be accessed using the right door; and the platform can be accessed using the middle door. This is a “forced choice” task: once you open the door to one part of the room, you are unable to access the other parts of the room. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/436f1c93-8043-4599-adbc-e50dac0194ad https://github.com/NextCenturyCorporation/MCS/assets/10994382/40caccb2-39d2-45ed-af55-8ed98657059b @@ -227,7 +268,11 @@ Details: - Third, you will see the placers turn blue, indicating that they have released the container, and ascend back into the ceiling. However, due to the occluder, you can’t see the final position of the container or the ball. You will then be unfrozen and must pickup the soccer ball to succeed in the trial. You will need to decide whether the container and the ball were properly supported by the platform (only accessible via the middle door) or were not supported by the platform and have therefore fallen to the ground on either the left side (only accessible via the left door) or the right side (only accessible via the right door). - A door can be opened using the OpenObject action. However, in these scenes, once you open one door, you will not be able to open another door. -#### Tools - Symmetric +#### Tools - Symmetric Tool Use + +Summary: + +Symmetric Tool Use tasks require a common-sense understanding of affordances. You must use a symmetric “tool” (a large rectangular object with wheels and a unique texture) to extract the soccer ball from the middle of a pool of lava (using PushObject or MoveObject to push the tool so it collides with the ball causing it to roll out from the lava), and then use PickupObject on the ball, which completes the scenario. ||| |---|---| @@ -249,6 +294,12 @@ Details: #### Arithmetic and Number Comparison +Summary: + +Number Comparison tasks require a common-sense understanding of numbers. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. You must identify which side of the room has the most soccer balls and use PickupObject on each of them to pick them up which completes the scenario. Sometimes the balls become occluded so you have to remember how many were originally present on each side. + +Arithmetic tasks require a common-sense understanding of addition and subtraction. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. You must watch (using the Pass action) as zero or more soccer balls are added to or subtracted from each side of the room. Then you must identify which side of the room has the most reachable soccer balls and use PickupObject on each of them to pick them up which completes the scenario. Sometimes the addition/subtraction is occluded so you have to remember how many balls were added to or subtracted from each side. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/57b6acc4-1cde-4e82-b56f-2aa23b8bced2 https://github.com/NextCenturyCorporation/MCS/assets/10994382/de4b01ea-5f48-46ac-83df-edd77776bcc0 @@ -278,6 +329,10 @@ Notes: #### Imitation (Interactive) +Summary: + +Interactive Imitation tasks require a common-sense understanding of agency. You must watch (using the Pass action) as an agent perform a series of actions (opening one or more chests in a specific order) in order to access a soccer ball; then the room is “reset” (using the EndHabituation action) and you must perform the same actions in the same order (using the OpenObject action on the correct chests). Then you will be able to reach the soccer ball, and you can use PickupObject on it to pick it up, which completes the scenario. Performing the wrong actions (opening the wrong chests, or opening them in the wrong order) automatically fails the scenario. Sometimes you or the chests are repositioned when the room is reset. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/1536702f-b2b6-4323-9da6-fc7af4bff486 https://github.com/NextCenturyCorporation/MCS/assets/10994382/cde91660-af4d-4289-91e5-689c38a59290 @@ -304,6 +359,12 @@ Notes: #### Occluded Trajectory and Collisions (Interactive) +Summary: + +Occluded Trajectory tasks require a common-sense understanding of trajectory. You must watch (using the Pass action) as a soccer ball is launched across the floor, but you do not see its entire trajectory, due to a large occluding wall which descends in front of you; you must then determine which side of the room contains the soccer ball, find it, and use PickupObject on it to pick it up, which completes the scenario. To access a side of the room, you must open one of the doors (using the OpenObject action) in the occluding wall. This is a “forced choice” task: once you open the door to one side of the room, you are unable to access the other side of the room (because it is blocked by lava). + +Interactive Collision tasks require a common-sense understanding of trajectory and collision. You must watch (using the Pass action) as a green “shooter ball” is launched across the floor toward a stationary soccer ball, but you do not see the entire trajectory (and, sometimes, even the collision itself), due to a large occluding wall which descends in front of you; you must then determine which side of the room contains the soccer ball, find it, and use PickupObject on it to pick it up, which completes the scenario. To access a side of the room, you must open one of the doors (using the OpenObject action) in the occluding wall. This is a “forced choice” task: once you open the door to one side of the room, you are unable to access the other side of the room (because it is blocked by lava). + https://github.com/NextCenturyCorporation/MCS/assets/10994382/898d48b4-0c26-4a4c-9cf2-4de22e765059 https://github.com/NextCenturyCorporation/MCS/assets/10994382/4b2a5a02-24b3-49ef-a700-43abc37d56de @@ -332,6 +393,10 @@ Notes: #### Set Rotation +Summary: + +Set Rotation tasks require a common-sense understanding of tracking objects as they move. You must watch (using the Pass action) as a soccer ball is deposited into one of the containers in the room, and lids are placed on all of the containers. Then either you will continue watching as the “turntable” (the large grey cog) rotates, or you will be forced to partially (or fully) circumnavigate the turntable using a series of Move and Rotate actions. You must identify which container holds the soccer ball, approach it, use OpenObject on it to open it, and then use PickupObject on the ball to pick it up, which completes the scenario. This is a “forced choice” task: once you open one container, you are unable to open other containers. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/b44fcc48-b7de-433a-b520-bf36371206ac https://github.com/NextCenturyCorporation/MCS/assets/10994382/c293ea74-1f77-4985-8f23-8d73ec88e00d @@ -360,6 +425,10 @@ Notes: #### Shell Game +Summary: + +Shell Game tasks require a common-sense understanding of tracking objects as they move. You must watch (using the Pass action) as a soccer ball is deposited into one of the containers in the room, and lids are placed on all of the containers; then poles will descend from the ceiling and move one or more of the containers to new locations. You must identify which container holds the soccer ball, approach it, use OpenObject on it to open it, and then use PickupObject on the ball to pick it up, which completes the scenario. This is a “forced choice” task: once you open one container, you are unable to open other containers. Please note that sometimes the containers are moved before the soccer ball is deposited. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/e0127554-36a6-4526-892c-bcc1341c2b7e https://github.com/NextCenturyCorporation/MCS/assets/10994382/6a5ed2f0-b8b2-410f-a744-38cdab9b9a27 @@ -386,6 +455,10 @@ Notes: #### Spatial Reference +Summary: + +Spatial Reference tasks require a common-sense understanding of agency. You must watch (using the Pass action) as both an agent and a “blob” move and “point” to a container on one side of the room. You must use the agent’s point (and ignore the blob) to determine which container holds the soccer ball, approach it, use OpenObject to open it, and then use PickupObject on the ball to pick it up, which completes the scenario. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. Agents can be identified by their facial features (blobs don’t have faces) and their autonomous movement (blobs “move” by rotating on turntables). + https://github.com/NextCenturyCorporation/MCS/assets/10994382/862044cd-7c33-4174-8677-f3aaacf691a6 https://github.com/NextCenturyCorporation/MCS/assets/10994382/31d8d9a4-7f22-4a21-bc0a-b5788ad88f2f @@ -412,6 +485,10 @@ Notes: #### Spatial Reorientation +Summary: + +Spatial Reorientation tasks require a common-sense understanding of spatial landmarks. After spinning around to see the entire room (using the RotateRight action), you must watch (using the Pass action) as a soccer ball is deposited into a container on one side of the room; then you are “kidnapped” (using the EndHabituation action) and either kept on the same side of the room or moved to the opposite side. You must use landmarks (sometimes the room has a trapezoidal shape, a differently-colored wall, or a piece of furniture) to identify which side of the room has the soccer ball, find it, and then use PickupObject on the ball to pick it up, which completes the scenario. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. + https://github.com/NextCenturyCorporation/MCS/assets/10994382/97fb77f4-9f35-41ee-9a7b-2efb649b8362 https://github.com/NextCenturyCorporation/MCS/assets/10994382/cf3e2b27-a4e0-4e1d-a165-425d9f1fc84b @@ -435,7 +512,13 @@ Notes: - Kidnapping and teleporting are performed using the EndHabituation action. Like other uses of this action, you will receive a blank frame during the kidnapping step. Unlike how this action worked in Eval 4, you will not receive any information (position/rotation) about the teleport destination (this information is now tracked internally by the MCS environment). - Whenever you are kidnapped, you we be teleported a little “off-center”, regardless of whether you remain on the same side of the room (near the “back” wall) or the opposite side (near the “front” wall). For example, if your original position is (X=0, Z=-7.5), your new position may be (X=0.1, Z=-7.6) -#### Tools - Asymmetric and Tool Choice +#### Tools - Asymmetric Tool Use and Tool Choice + +Summary: + +Asymmetric Tool Use tasks require a common-sense understanding of affordances. You must use an asymmetric “tool” (a large L-shaped object with wheels and a unique texture) to extract the soccer ball from the middle of a pool of lava (using PullObject or MoveObject to pull the tool so it collides with the ball causing it to roll out from the lava), and then use PickupObject on the ball, which completes the scenario. Sometimes the tool must be rotated (using RotateObject or TorqueObject) before it is pulled. + +Tool Choice tasks require a common-sense understanding of affordances. Like the Symmetric Tool Use task, you must use a symmetric “tool” (a large rectangular object with wheels and a unique texture) to extract the soccer ball from the middle of a pool of lava (using PushObject or MoveObject to push the tool so it collides with the ball causing it to roll out from the lava), and then use PickupObject on the ball and complete the scenario. Sometimes the tool must be rotated (using RotateObject or TorqueObject) before it is pushed. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. One side of the room contains a tool that can be used successfully to retrieve the soccer ball, while the other side contains a tool that is broken, inaccessible, or not a useful size. ||| |---|---| @@ -462,6 +545,10 @@ Notes: #### Hidden Set Rotation +Summary: + +TODO + https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b22f8c2-6774-4cc0-a4e6-9fc0b0b3201b https://github.com/NextCenturyCorporation/MCS/assets/10994382/1868299b-f26a-4692-8cfd-63dafe25557a @@ -476,6 +563,10 @@ Details: #### Knowledgeable Agents +Summary: + +TODO + https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fe0e811-b53b-4171-95dc-c0496440379b https://github.com/NextCenturyCorporation/MCS/assets/10994382/0afc8420-f068-4767-904e-b3afc87621d9 @@ -497,6 +588,10 @@ Notes: #### Tools - Secondary Tool Use +Summary: + +TODO + https://github.com/NextCenturyCorporation/MCS/assets/10994382/a0a00f40-e9f7-4cbd-9521-c8c7e47e129d https://github.com/NextCenturyCorporation/MCS/assets/10994382/292e188a-0429-42a8-b499-1df11013b14f @@ -535,7 +630,7 @@ Notes: - Eval 7 extra data: https://eval-7.s3.amazonaws.com/eval_7_passive_agents_extra.zip - Eval 6 dataset (includes some older tasks): https://eval-6.s3.amazonaws.com/eval_6_passive_agent.zip - Eval 5 dataset (includes all tasks designed up to this point): https://eval-5.s3.amazonaws.com/eval_5_passive_agent.zip -- Debug scene files for the MCS UI: +- Debug scene files for the MCS scoring software and evaluation UI: - Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_agents_debug.zip - Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_agent_debug.zip - Eval 5: https://eval-5.s3.amazonaws.com/eval_5_passive_agent_debug.zip @@ -821,6 +916,8 @@ TODO VIDEOS TODO DOWNLOAD +Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/ + ### Other Tasks Introduced in Evaluation 6 #### Seeing Leads to Knowing (Passive) @@ -829,18 +926,58 @@ Summary: Seeing Leads to Knowing tasks require a common-sense understanding of agency. This is a “passive” task: you must watch (using only Pass actions) as a soccer ball is deposited into a container and an agent approaches a container, and then determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not the agent acted with common-sense reasoning (if the agent saw the ball being deposited, it should approach the container holding the ball; otherwise it should approach one of the containers behind it, because one of those containers holds the ball). +Plausible: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a3c4a8b0-9c3f-4580-a9a3-7ee26fec66ce + +Plausible: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/fcdbc37f-c616-407d-b312-ff4f082d5a8c + +Implausible: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/90f065bb-3776-4112-99f3-b060bd525a36 + +Implausible: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/8a7c0e7e-275b-42a3-b2c8-6ea43ab251da + Details: -TODO +- This is a passive/VoE task. Similar to the passive physics tasks, your system is expected to return a binary plausibility rating of either "plausible" or "implausible" as well as a continuous plausibility score between 0.0 (completely implausible) and 1.0 (completely plausible). +- You start in a room looking at four identical open-topped containers. An agent immediately walks into view and stands in the middle of the room, looking at two of the containers. Then four placers simultaneously descend from the ceiling, one over each container. One placer is holding the target (soccer ball) and drops it into a container; the other three placers are not holding anything, but change color/state like the first placer. The agent then approaches the container it believes is holding the target. You must determine whether the agent's choice is plausible or implausible based on what the agent is able to see. +- If the target is dropped into one of the two containers in front of the agent (which it can see), then it is plausible for the agent to approach that specific container, and implausible for the agent to approach a different container. +- If the target is dropped into one of the two containers behind the agent (which it cannot see), then it is plausible for the agent to approach either of the two containers behind it, and implausible for the agent to approach either of the two containers in front of it. +- The containers are always in the same locations, but may vary slightly in shape, size, and color. +- The agent can enter from either the left side or the right side of your view. + +Notes: + +- Seeing Leads to Knowing scenes use the new "passive" goal category to differentiate them from other passive scenes. For more information on "passive" goals, please see our API doc here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.GoalCategory.PASSIVE +- Your system's binary plausibility rating and continuous plausibility score must be included when calling the "end_scene" function. For more information on "end_scene", please see our API doc here: https://nextcenturycorporation.github.io/MCS/api.html#machine_common_sense.Controller.end_scene +- Your starting position and viewing angle will remain consistent across all Seeing Leads to Knowing scenes. +- As with our other passive tasks, we expect that you will train your systems using only plausible Seeing Leads to Knowing data, to mimic the "training" of human babies who only experience plausible scenarios. Because of this, the ILE Scene Generator is only designed to create plausible Seeing Leads to Knowing scenes for your training. We have provided a few example implausible scenes (see above) for you to see how they will look. ## Evaluation Running of evaluation scenes is done by our `mcs-pipeline` software: https://github.com/NextCenturyCorporation/mcs-pipeline +Please note that all scenes are run during the evaluation using **metadata level 2**. + ## Scoring Scoring of evaluation scenes is done by our `mcs-ingest` software: https://github.com/NextCenturyCorporation/mcs-ingest +Please note that Interactive and Passive tasks are scored differently; see the Task sections above for more information. + +### Ambiguous and Control Trials + +Some scenes (particularly Interactive "forced choice" scenes) are intentionally ambiguous: the soccer ball can reasonably be hidden in multiple places. + +Some scenes (particularly Interactive scenes) are control trials: the trial is not actually testing the common sense concept for the task, and successfully retrieving the soccer ball requires little or no common sense reasoning. + +Your system's success in these scenes is not included in your final evaluation score. + ## Acknowledgements This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) and Naval Information Warfare Center, Pacific (NIWC Pacific) under Contract No. N6600119C4030. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the DARPA or NIWC Pacific. From d6cd396d88a687b81d34baa5a3cb86dbc2b0f3db Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Tue, 12 Dec 2023 15:56:33 -0500 Subject: [PATCH 06/11] Update TASK_LIST.md --- TASK_LIST.md | 69 +++++++++++++++++++++++++++++++++++++++++++++++++--- 1 file changed, 65 insertions(+), 4 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index 596d437d9..d2b05c666 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -2,6 +2,7 @@ Table of Content: - [Interactive Tasks](#interactive-tasks) + - [Overview](#interactive-overview) - [Data](#interactive-data) - [Introduced in Evaluation 3](#interactive-tasks-introduced-in-evaluation-3) - [Retrieval - Containers](#retrieval---containers) @@ -32,6 +33,7 @@ Table of Content: - [Knowledgeable Agents](#knowledgeable-agents) - [Tools - Secondary Tool Use](#tools---secondary-tool-use) - [Passive Agent Tasks](#passive-agent-tasks) + - [Overview](#passive-agent-overview) - [Data](#passive-agent-data) - [Evaluation Datasets](#passive-agent-evaluation-datasets) - [Training Datasets](#passive-agent-training-datasets) @@ -49,6 +51,7 @@ Table of Content: - [Helper / Hinderer](#helper--hinderer-passive-agent) - [True / False Belief](#true--false-belief-passive-agent) - [Passive Physics Tasks](#passive-physics-tasks) + - [Overview](#passive-physics-overview) - [Data](#passive-physics-data) - [Introduced in Evaluation 3](#passive-physics-tasks-introduced-in-evaluation-3) - [Object Permanence (Passive)](#object-permanence-passive-physics) @@ -65,15 +68,22 @@ Table of Content: - [Evaluation](#evaluation) - [Scoring](#scoring) - [Ambiguous and Control Trials](#ambiguous-and-control-trials) + - [Scorecard](#scorecard) - [Acknowledgements](#acknowledgements) - [License](#license) ## Interactive Tasks +### Interactive Overview + +Each trial, or "scene", for an interactive task occurs within a procedurally generated room in our 3D environment. Each interactive task requires that you use common-sense reasoning to find and pick up a goal object (soccer ball) located in the room. As requested, your system's efficiency does not prevent it from succeeding at these tasks (except for a very generous action/step limit), or impact its quantitative evaluation score, in order to allow for exploration-based approaches. Please note that the MCS python library returns a "reward" after each action/step that can be used for training, but is ignored during the evaluation. + ### Interactive Data TODO DOWNLOAD +Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/ + ### Interactive Tasks Introduced in Evaluation 3 #### Retrieval - Containers @@ -82,6 +92,10 @@ Summary: Container Retrieval tasks require a common-sense understanding of containment. You must find the soccer ball, which may or may not be hidden inside a container (use OpenObject to open a closed container), and then use PickupObject on the ball to pick it up. +||| +|---|---| +![eval_7_interactive_containers_0001_02](https://github.com/NextCenturyCorporation/MCS/assets/10994382/c869ebb6-1017-4776-b8d6-e71ffcbaf434) | ![eval_7_interactive_containers_0001_05](https://github.com/NextCenturyCorporation/MCS/assets/10994382/df79d960-d24e-4cbc-9d86-82eff653b719) + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -97,6 +111,10 @@ Summary: Obstacle Retrieval tasks require a common-sense understanding of occlusion. You must find the soccer ball, which may or may not be hidden behind “obstacle” furniture (furniture which you can see through, but cannot walk through), and then use PickupObject on the ball to pick it up, which completes the scenario. +||| +|---|---| +![eval_7_interactive_obstacles_0001_06](https://github.com/NextCenturyCorporation/MCS/assets/10994382/ccd1a72d-075d-4667-a851-022a70379dc9) | ![eval_7_interactive_obstacles_0001_02](https://github.com/NextCenturyCorporation/MCS/assets/10994382/02a68b56-505b-4343-9a22-1de82f00cde6) + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -110,6 +128,10 @@ Summary: Occluder Retrieval tasks require a common-sense understanding of occlusion. You must find the soccer ball, which may or may not be hidden behind occluding furniture (furniture which you can neither see through nor walk through), and then use PickupObject on the ball to pick it up, which completes the scenario. +||| +|---|---| +![eval_7_interactive_occluders_0001_05](https://github.com/NextCenturyCorporation/MCS/assets/10994382/88a22883-ba64-439c-af1b-510222f41d8e) | ![eval_7_interactive_occluders_0001_06](https://github.com/NextCenturyCorporation/MCS/assets/10994382/337ec563-bf15-4b0e-a33f-dac10355e5d6) + Details: - You start in a room containing many objects, including furniture and toys. Your goal is to find and pick up the soccer ball, located somewhere in the room. @@ -503,7 +525,7 @@ Details: - Most scenes provide cues so you can determine whether you have been teleported to the opposite side of the room: - Sometimes either the left or right wall is a significantly different color than the other walls. - Sometimes the room is shaped like a trapezoid: the left and right walls are angled inward, and either the front or back wall is shorter. - - Sometimes there is a large non-structural object, like a piece of furniture, on one side of the room; TA2 calls this an “unstable landmark.” In scenes containing both a stable landmark (differently colored room walls, or trapezoidal shaped rooms) and an unstable landmark (large objects like furniture that could theoretically be moved by an adult), your system should trust the location of the stable landmark more than the unstable landmark. + - Sometimes there is a large non-structural object, like a piece of furniture, on one side of the room; this is called an “unstable landmark.” In scenes containing both a stable landmark (differently colored room walls, or trapezoidal shaped rooms) and an unstable landmark (large objects like furniture that could theoretically be moved by an adult), your system should trust the location of the stable landmark more than the unstable landmark. - It should be impossible to see inside the containers from your position on top of the platform due to the position of the containers and a barrier on the platform that stops you from moving too far forward. Notes: @@ -848,18 +870,53 @@ TODO VIDEOS #### Helper / Hinderer (Passive Agent) -TODO +Details: + +- All of these trials have one inanimate object and three agents (blobs): the primary agent tries to approach the inanimate object, and the other two agents either “help” or “hinder” the primary agent attain its goal. +- Some trials include a blue occluder that is moved by the “helper” agent or “hinderer” agent: the “helper” agent moves the blue occluder to unobstruct the primary agent’s path to the object; the “hinderer” agent moves the blue occluder to obstruct the primary agent’s path to the object. +- The test trial does not show the inanimate object or blue occluder; instead, it shows the primary agent approaching one of the other two agents (indicating a preference for that agent). It is expected / plausible for the primary agent to prefer the “helper” agent (the agent who unobstructed its path during the familiarization trials), and unexpected / implausible to prefer the “hinderer” agent (the agent who obstructed its path during the familiarization trials). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). + +##### Helper / Hinderer Training Data + +https://eval-7.s3.amazonaws.com/passive_agent_training_helper_hinderer.zip + +Differences from evaluation tasks: In the training data, the primary agent starts in one of the two smaller areas, and the inanimate object starts in the bigger area; in the evaluation data, the primary agent starts in the bigger area, and the inanimate object starts in one of the two smaller areas. + +TODO VIDEOS #### True / False Belief (Passive Agent) -TODO +Details: + +All of these trials have one inanimate object and two agents (blobs): the primary agent tries to approach the inanimate object, and the secondary agent (which is only present during the test trial) moves the inanimate object. The inanimate object is always positioned behind one of the two white occluders during the test trial, and during some of the familiarization trials as well; the primary agent cannot see the inanimate object from its starting position while the object is positioned behind an occluder (though the TA1 agent may be able to see it). +- In True Belief tasks, the primary agent is present (and can see everything happen) while the secondary agent moves the inanimate object from its position hidden behind one occluder to a new position behind a second occluder. It is expected / plausible for the primary agent to approach the new position of the object, behind the second occluder (since it saw the secondary agent move the object to that position), and unexpected / implausible for the primary agent to approach the old position of the object, behind the original occluder. +- In False Belief tasks, the primary agent is NOT present (and does not see anything) while the secondary agent moves the inanimate object from its position hidden behind one occluder to a new position behind a second occluder. It is expected / plausible for the primary agent to approach the old position of the object, behind the original occluder (since it did not see the secondary agent move the object to a new position), and unexpected / implausible for the primary agent to approach the new position of the object, behind the second occluder. +- As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). + +##### True / False Belief Training Data + +- True Belief training data: https://eval-7.s3.amazonaws.com/passive_agent_training_true_belief.zip +- False Belief training data: https://eval-7.s3.amazonaws.com/passive_agent_training_false_belief.zip + +Differences from evaluation tasks: In the training data, the secondary agent moves the inanimate object to a new position behind the same occluder; in the evaluation data, the secondary agent moves the inanimate object to a new position behind the other occluder. + +TODO VIDEOS ## Passive Physics Tasks +### Passive Physics Overview + +Each trial, or "scene", for a passive physics task occurs within a procedurally generated room in our 3D environment. Each passive physics task requires that you use common-sense reasoning of the laws of physics to categorize a scene as either "plausible" or "implausible". Your system will be forced to only use "Pass" actions during the entirety of the scene, and must then return a **binary plausibility rating** and a **continuous plausibility score** to the MCS python library (see below). Even though these tasks seem different from the interactive tasks, they are run within the same 3D environment as the interactive tasks, and objects behave (roll, fall, bounce, etc.) in the same way (except for implausible events). + +- Binary plausibility ratings evaluate the event as a whole after it has concluded (either “implausible” or “plausible”). We use these binary ratings to compute sensitivity scores such as d'. We will not attempt to derive binary scores from continuous scores, because we do not want to assume where each system places the threshold for concluding a scene is implausible. +- Continuous plausibility scores evaluate the event as a whole after it has concluded, between 0 (completely implausible) and 1 (completely plausible). These scores can be used to compute ROC curves and AOCs to characterize performance on the scene. This is one of the ways that we can compare performance - not only across performers, but across conditions (e.g. scenes containing familiar objects vs. scenes containing novel objects). We anticipate that some events will not be clearly 100% plausible or implausible, even to a very high performing algorithm. The ideal outcome is for the AI system to recognize that one outcome was more expected than another. Continuous scores support that kind of comparison better than binary scores. + ### Passive Physics Data TODO DOWNLOAD +Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/ + ### Passive Physics Tasks Introduced in Evaluation 3 #### Object Permanence (Passive Physics) @@ -976,7 +1033,11 @@ Some scenes (particularly Interactive "forced choice" scenes) are intentionally Some scenes (particularly Interactive scenes) are control trials: the trial is not actually testing the common sense concept for the task, and successfully retrieving the soccer ball requires little or no common sense reasoning. -Your system's success in these scenes is not included in your final evaluation score. +Your system's success in these scenes is not factored into your quantitative evaluation score, but will be reviewed as part of our qualitative analysis of your evaluation results. + +### Scorecard + +Some behaviors are not obviously wrong, but seem to lack common-sense, and are thus noteworthy. Examples include repeatedly trying failed actions and ignoring a goal object when it is easily accessible (in sight and unobstructed). These actions are recorded as part of our "scorecard" metrics. The scorecard is not factored into your quantitative evaluation score, but will be reviewed as part of our qualitative analysis of your evaluation results. For a full list of our scorecard metrics, please see this page: https://github.com/NextCenturyCorporation/mcs-ingest/blob/master/scorecard/README.md ## Acknowledgements From 5d2c365c9429c142945e8cc60a0a996c10471ab8 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Tue, 12 Dec 2023 16:58:08 -0500 Subject: [PATCH 07/11] Update TASK_LIST.md --- TASK_LIST.md | 164 ++++++++++++++++++++++++++++++++++++++++++++------- 1 file changed, 142 insertions(+), 22 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index d2b05c666..49999ad52 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -569,7 +569,7 @@ Notes: Summary: -TODO +See [Set Rotation](#set-rotation) above. https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b22f8c2-6774-4cc0-a4e6-9fc0b0b3201b @@ -587,7 +587,7 @@ Details: Summary: -TODO +Knowledgeable Agents tasks require a common-sense understanding of agency. You must watch (using the Pass action) as a soccer ball is secretly deposited into one of two containers in the room; you do not know which container holds the soccer ball because your sight is blocked by an occluding wall at the time. Two agents stand on the other side of the room: you can see them, but they do not have their sight blocked by the occluding wall. One agent faces the two containers and thus knows which container holds the soccer ball; the other agent faces the wall and thus does not know. Both agents then turn to face and point at a different container. You must understand which agent is “knowledgeable” based on whether or not they could see the containers while the soccer ball was being deposited, determine the container at which the “knowledgeable” agent is pointing, approach it, use OpenObject to open it, and then use PickupObject on the ball to pick it up, which completes the scenario. This is a “forced choice” task: once you walk off the platform onto one side of the room, you are unable to move to the other side of the room. https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fe0e811-b53b-4171-95dc-c0496440379b @@ -612,7 +612,7 @@ Notes: Summary: -TODO +Secondary Tool Use tasks require a common-sense understanding of affordances. You must use a symmetric “tool” (a large rectangular object with wheels and a unique texture) to extract an asymmetric “tool” from the middle of a pool of lava (using PushObject or MoveObject to push the first tool so it collides with the other tool causing it to roll out from the lava), then use the asymmetric “tool” to extract a soccer ball from the middle of another pool of lava, and finally use PickupObject on the ball, which completes the scenario. https://github.com/NextCenturyCorporation/MCS/assets/10994382/a0a00f40-e9f7-4cbd-9521-c8c7e47e129d @@ -668,7 +668,9 @@ https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_single_object.zip - Each trial shows an agent (A1) approaching a goal object (O1). - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0ff74709-05db-4270-991a-cda74239cc9f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/e6cd00e1-cfaa-44bc-9750-ecc2f7a0ad83 ### Passive Agent Tasks Introduced in Evaluation 3 @@ -678,7 +680,23 @@ Summary: Passive Agent: Efficient Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The trials depict the agent approaching an object; in the test trial, some of the obstacles are removed. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent moves in an efficient path (agents should move efficiently). -TODO VIDEOS +Time Control: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/c3cc5b01-d2b1-4c4c-ad4a-40b889c3cc97 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fa709be-4425-4621-a519-8c3741a51508 + +Path Control: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/9756f5f4-0d8e-423f-b9d7-2aab08e4a3cc + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/01429379-9649-4e35-a539-fb7d684d58d7 + +Irrational: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/c9646626-e1e1-405f-9f98-896cb7be57e8 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/404e23df-0d67-4e74-83cd-037b6a16b9e6 ##### Efficient Action Training Data @@ -692,7 +710,9 @@ Summary: Passive Agent: Object Preference tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials). You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent continued to act with the same preferences it showed during the familiarization trials (approaching the same object). -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/078f0193-9645-4e9c-9a93-dbb7140d9815 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/09178b64-c484-4148-bb32-d90b8212ecb8 ##### Object Preference Training Data @@ -709,7 +729,9 @@ Summary: Passive Agent: Inaccessible Goal tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent retrieving a red triangular "key" object; inserting that key into a "lock" in the green wall, causing the green wall to disappear; and then approaching an "goal" object that was previously blocked by the green wall, but is now accessible. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent used the "key" object when it was necessary to approach the "goal" object (if the "goal" object is not blocked by the green wall, then using the "key" object is unnecessary). -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f8be701f-cd07-44e2-b149-b9dfbdd6cca3 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/af263afa-391e-49a5-b712-a0f59581dcb3 ##### Inaccessible Goal Training Data @@ -721,7 +743,23 @@ Summary: Passive Agent: Instrumental Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, obstacles may be moved to block a path to the preferred object. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent can successfully navigate to its preferred object (approaching a different object is unsurprising if the preferred object is blocked). -TODO VIDEOS +Blocking Barriers: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/04f21ac7-fd54-4992-9317-dedb20485eba + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/21828816-85c6-4720-929e-347703e934b2 + +Inconsequential Barriers: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f12e24c3-28ce-4d0b-b80c-c30c26a39117 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/b6a236a8-adfe-4bf1-a652-75a58f1db180 + +No Barriers: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/3f9f1706-0e3f-4e3f-ba67-315ab3b1b372 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/e52f2e58-4f89-4c9c-80ea-5aed1fb92061 ##### Instrumental Action Training Data @@ -735,7 +773,9 @@ Summary: Passive Agent: Multiple Agents tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, either the same agent or a new agent will approach a different object. You must then determine whether the test trial is “more expected” (unsurprising) or “more unexpected” (surprising) based on whether or not the agent with a known preference approached a different object (it is unsurprising for a new agent to have a different preference). -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/63d8bab5-5bcd-48ff-819a-bcc26f0b02f9 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/c6ffb85e-a2e5-4573-ba16-3dcbdadb5783 ##### Multiple Agents Training Data @@ -763,7 +803,19 @@ Details: Example Evaluation Scenes: -TODO VIDEOS +Expected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/710495e2-5877-4740-bc9f-1055c7173bfc + +Unexpected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/51edeb74-3b05-48c2-833a-8c0d0362c73f + +No Expectation: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/8173b95e-8c29-4c3d-b2e8-36efdfbc4bfe + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/2a0b009f-ebca-42b2-a69a-dc1c9a942cd7 ##### Agent / Non-Agent Training Data @@ -775,7 +827,9 @@ Agent One Goal Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - The agent and the paddle do not come into contact. (The agent has agency and can move itself.) -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/882b2f5b-04a4-416c-afbb-01cf6f60a0ee + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/cb6ab7a5-f5b9-40f0-b82e-cb3b9a22e0d0 Agent Preference Training Data: @@ -783,7 +837,9 @@ Agent Preference Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - The agent and the paddle do not come into contact. (The agent has agency and can move itself.) -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/efd869ab-c826-45f2-9af3-2e4705b827cb + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/cff11cf3-fe2d-4408-9a67-91c94d91d424 Collect Training Data: @@ -791,7 +847,9 @@ Collect Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - No paddle or occluder. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/4161deb0-8d66-4b40-805b-a809ffe782d6 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f763ebe2-a004-4257-945d-c42e3a880e22 Non-Agent One Goal Training Data: @@ -799,7 +857,9 @@ Non-Agent One Goal Training Data: - When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - While the non-agent (N1) sometimes contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/72ce88d9-865f-4f65-9b96-4d570cfa0fda + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/149565af-1aad-4ff3-b443-da6ae2624910 Non-Agent "Preference" Training Data: @@ -807,7 +867,9 @@ Non-Agent "Preference" Training Data: - When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - While the non-agent (N1) always contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/7ce7d892-89c8-4d0a-9dd5-3e67015e914f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1c84d011-1e8c-49e8-af32-0e4faf7c7198 #### Social and Instrumental Approach and Imitation (Passive Agent) @@ -827,7 +889,33 @@ Details: Example Evaluation Scenes: -TODO VIDEOS +Approach Expected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/872d0a21-6537-4ce1-ad01-a5c8d677a1c2 + +Approach Unexpected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/4dc81e36-dbb1-4526-8244-0a005aa67d35 + +Approach No Expectation: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/af03624a-f0ca-4284-81fa-4fce15f8d9a0 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/48cdc381-c626-4186-8f16-8f3a7113a9d0 + +Imitation Expected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/b3d95637-150d-42fc-9259-aee541d188a4 + +Imitation Unexpected: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/49741259-c543-491f-b8a6-58446fe9ec6c + +Imitation No Expectation: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/54f6d65e-9a0b-4fd9-b8b0-1fc75ea12fba + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1f028211-244c-4542-b1fd-a752bc36b861 ##### Social and Instrumental Approach and Imitation Training Data @@ -839,14 +927,18 @@ Social Approach: - Each familiarization trial shows agent A1 approaching agent A2, ignoring agent A3. - The test trial shows agent A2 and agent A3 moving in a different pattern, and then agent A1 moving in the same pattern as agent A2. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f5ad3c89-3e8a-426f-93bc-9f29d043b82e + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/235b5ba0-e0df-4c80-a4e3-13a38a292e3e Instrumental Approach: - Like Social Approach (see above), but when agent A1 moves during the test trial, it contacts a goal object (O1) while moving in its pattern. - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a0dbf6db-3cdb-48f5-88e8-d874cfff3d32 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fc983c0-6b02-497e-8335-e505c67571af Social Imitation: @@ -855,7 +947,9 @@ Social Imitation: - Agent A1’s movement pattern never changes across trials (assuming it moves during that trial). The same is true for agent A2’s and agent A3’s movement patterns. - The test trial shows agent A3 approaching the other agent (either A1 or A2) who has the same movement pattern. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/b312c121-1b68-4865-9e30-ce1025a74a3f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/73026728-2fcf-4b83-83c0-ddc701b61e00 Instrumental Imitation: @@ -864,7 +958,9 @@ Instrumental Imitation: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - Some trials show agent A3 contacting goal object O1 multiple times. When an agent contacts a goal object a second time, its highlight is deactivated (color changes back to original color). -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/44a99dee-93d5-450d-a4ea-13b62ba938ca + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/60b30b25-4028-43d8-9410-75c2de869a34 ### Passive Agent Tasks Introduced in Evaluation 7 @@ -876,13 +972,19 @@ Details: - Some trials include a blue occluder that is moved by the “helper” agent or “hinderer” agent: the “helper” agent moves the blue occluder to unobstruct the primary agent’s path to the object; the “hinderer” agent moves the blue occluder to obstruct the primary agent’s path to the object. - The test trial does not show the inanimate object or blue occluder; instead, it shows the primary agent approaching one of the other two agents (indicating a preference for that agent). It is expected / plausible for the primary agent to prefer the “helper” agent (the agent who unobstructed its path during the familiarization trials), and unexpected / implausible to prefer the “hinderer” agent (the agent who obstructed its path during the familiarization trials). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +https://github.com/NextCenturyCorporation/MCS/assets/10994382/782306b0-43b6-4ba2-a3a2-ef4bc9df8fd8 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a792d78e-49d0-469d-9e08-23569822e81f + ##### Helper / Hinderer Training Data https://eval-7.s3.amazonaws.com/passive_agent_training_helper_hinderer.zip Differences from evaluation tasks: In the training data, the primary agent starts in one of the two smaller areas, and the inanimate object starts in the bigger area; in the evaluation data, the primary agent starts in the bigger area, and the inanimate object starts in one of the two smaller areas. -TODO VIDEOS +https://github.com/NextCenturyCorporation/MCS/assets/10994382/5acc5d32-c114-450c-acec-f561e5559b1f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/6682725e-cf57-410e-a64c-bd2ff0abcc3f #### True / False Belief (Passive Agent) @@ -893,6 +995,14 @@ All of these trials have one inanimate object and two agents (blobs): the primar - In False Belief tasks, the primary agent is NOT present (and does not see anything) while the secondary agent moves the inanimate object from its position hidden behind one occluder to a new position behind a second occluder. It is expected / plausible for the primary agent to approach the old position of the object, behind the original occluder (since it did not see the secondary agent move the object to a new position), and unexpected / implausible for the primary agent to approach the new position of the object, behind the second occluder. - As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +https://github.com/NextCenturyCorporation/MCS/assets/10994382/a9fce7e9-dd57-42ba-ba84-131833edab4e + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1d86f61e-17cf-4fb8-bef9-e7e144fb80a4 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/d670c1e4-fc09-41d3-a3c7-abc59eaef941 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0ee10cb4-b4b3-42f7-bde5-beb51addfea7 + ##### True / False Belief Training Data - True Belief training data: https://eval-7.s3.amazonaws.com/passive_agent_training_true_belief.zip @@ -900,7 +1010,17 @@ All of these trials have one inanimate object and two agents (blobs): the primar Differences from evaluation tasks: In the training data, the secondary agent moves the inanimate object to a new position behind the same occluder; in the evaluation data, the secondary agent moves the inanimate object to a new position behind the other occluder. -TODO VIDEOS +True Belief: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1f2e9fe5-369a-458f-9ea9-1d4b64439137 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f7bbd86d-6bf3-4765-8839-819bea328930 + +False Belief: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/b8d1a38a-0c9b-4ee9-9851-3e2f52108088 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/65954d48-039a-4a79-ad5b-8fe76d3af2e4 ## Passive Physics Tasks From 0ace7118d2ff968cb507a9cccb6be20e1aa176a5 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Tue, 12 Dec 2023 23:50:12 -0500 Subject: [PATCH 08/11] Update TASK_LIST.md --- TASK_LIST.md | 140 +++++++++++++++++++++++++++++++++++++++------------ 1 file changed, 109 insertions(+), 31 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index 49999ad52..01619955a 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -668,6 +668,8 @@ https://eval-6.s3.amazonaws.com/eval_6_passive_agent_training_single_object.zip - Each trial shows an agent (A1) approaching a goal object (O1). - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/0ff74709-05db-4270-991a-cda74239cc9f https://github.com/NextCenturyCorporation/MCS/assets/10994382/e6cd00e1-cfaa-44bc-9750-ecc2f7a0ad83 @@ -680,19 +682,19 @@ Summary: Passive Agent: Efficient Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The trials depict the agent approaching an object; in the test trial, some of the obstacles are removed. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent moves in an efficient path (agents should move efficiently). -Time Control: +Time Control Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/c3cc5b01-d2b1-4c4c-ad4a-40b889c3cc97 https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fa709be-4425-4621-a519-8c3741a51508 -Path Control: +Path Control Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/9756f5f4-0d8e-423f-b9d7-2aab08e4a3cc https://github.com/NextCenturyCorporation/MCS/assets/10994382/01429379-9649-4e35-a539-fb7d684d58d7 -Irrational: +Irrational Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/c9646626-e1e1-405f-9f98-896cb7be57e8 @@ -710,6 +712,8 @@ Summary: Passive Agent: Object Preference tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials). You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent continued to act with the same preferences it showed during the familiarization trials (approaching the same object). +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/078f0193-9645-4e9c-9a93-dbb7140d9815 https://github.com/NextCenturyCorporation/MCS/assets/10994382/09178b64-c484-4148-bb32-d90b8212ecb8 @@ -729,6 +733,8 @@ Summary: Passive Agent: Inaccessible Goal tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent retrieving a red triangular "key" object; inserting that key into a "lock" in the green wall, causing the green wall to disappear; and then approaching an "goal" object that was previously blocked by the green wall, but is now accessible. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent used the "key" object when it was necessary to approach the "goal" object (if the "goal" object is not blocked by the green wall, then using the "key" object is unnecessary). +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/f8be701f-cd07-44e2-b149-b9dfbdd6cca3 https://github.com/NextCenturyCorporation/MCS/assets/10994382/af263afa-391e-49a5-b712-a0f59581dcb3 @@ -743,19 +749,19 @@ Summary: Passive Agent: Instrumental Action tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, obstacles may be moved to block a path to the preferred object. You must then determine whether the test trial is “expected” (unsurprising) or “unexpected” (surprising) based on whether or not the agent can successfully navigate to its preferred object (approaching a different object is unsurprising if the preferred object is blocked). -Blocking Barriers: +Blocking Barriers Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/04f21ac7-fd54-4992-9317-dedb20485eba https://github.com/NextCenturyCorporation/MCS/assets/10994382/21828816-85c6-4720-929e-347703e934b2 -Inconsequential Barriers: +Inconsequential Barriers Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/f12e24c3-28ce-4d0b-b80c-c30c26a39117 https://github.com/NextCenturyCorporation/MCS/assets/10994382/b6a236a8-adfe-4bf1-a652-75a58f1db180 -No Barriers: +No Barriers Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/3f9f1706-0e3f-4e3f-ba67-315ab3b1b372 @@ -773,6 +779,8 @@ Summary: Passive Agent: Multiple Agents tasks require a common-sense understanding of agency. This is a “passive agents” task: you must watch (using only Pass actions) as an agent (blob shape) moves in a grid world over 8 “familiarization” trials and a “test” trial (the world “resets” between each trial using the EndHabituation action). The familizarization trials depict the agent approaching a specific object (the same object in all 8 familiarization trials); in the test trial, either the same agent or a new agent will approach a different object. You must then determine whether the test trial is “more expected” (unsurprising) or “more unexpected” (surprising) based on whether or not the agent with a known preference approached a different object (it is unsurprising for a new agent to have a different preference). +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/63d8bab5-5bcd-48ff-819a-bcc26f0b02f9 https://github.com/NextCenturyCorporation/MCS/assets/10994382/c6ffb85e-a2e5-4573-ba16-3dcbdadb5783 @@ -801,17 +809,15 @@ Details: - If an agent shows a preference for a specific goal object during the familiarization trials (by approaching the goal object), it is expected/plausible for the agent to show the same preference (for the same goal object) during the test trial, and unexpected/implausible for the agent to show a different preference (for a different goal object). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). - If a non-agent shows a “preference” for a specific goal object during the familiarization trials (by “approaching” the goal object, after being hit by the paddle), then there is no expectation for the non-agent to show either the same preference or a different preference, because it does not have agency. For “no expectation” scenes, your system should return a plausibility / expectedness rating that’s lower than for “expected” scenes but higher than for “unexpected” scenes. -Example Evaluation Scenes: - -Expected: +Evaluation - Expected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/710495e2-5877-4740-bc9f-1055c7173bfc -Unexpected: +Evaluation - Unexpected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/51edeb74-3b05-48c2-833a-8c0d0362c73f -No Expectation: +Evaluation - No Expectation Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/8173b95e-8c29-4c3d-b2e8-36efdfbc4bfe @@ -827,6 +833,8 @@ Agent One Goal Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - The agent and the paddle do not come into contact. (The agent has agency and can move itself.) +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/882b2f5b-04a4-416c-afbb-01cf6f60a0ee https://github.com/NextCenturyCorporation/MCS/assets/10994382/cb6ab7a5-f5b9-40f0-b82e-cb3b9a22e0d0 @@ -837,6 +845,8 @@ Agent Preference Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - The agent and the paddle do not come into contact. (The agent has agency and can move itself.) +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/efd869ab-c826-45f2-9af3-2e4705b827cb https://github.com/NextCenturyCorporation/MCS/assets/10994382/cff11cf3-fe2d-4408-9a67-91c94d91d424 @@ -847,6 +857,8 @@ Collect Training Data: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - No paddle or occluder. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/4161deb0-8d66-4b40-805b-a809ffe782d6 https://github.com/NextCenturyCorporation/MCS/assets/10994382/f763ebe2-a004-4257-945d-c42e3a880e22 @@ -857,6 +869,8 @@ Non-Agent One Goal Training Data: - When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - While the non-agent (N1) sometimes contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/72ce88d9-865f-4f65-9b96-4d570cfa0fda https://github.com/NextCenturyCorporation/MCS/assets/10994382/149565af-1aad-4ff3-b443-da6ae2624910 @@ -867,6 +881,8 @@ Non-Agent "Preference" Training Data: - When a non-agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - While the non-agent (N1) always contacts the goal object (O1) in these trials, it cannot control its own movement, because it does not have agency. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/7ce7d892-89c8-4d0a-9dd5-3e67015e914f https://github.com/NextCenturyCorporation/MCS/assets/10994382/1c84d011-1e8c-49e8-af32-0e4faf7c7198 @@ -887,31 +903,29 @@ Details: - The “Social Approach” category shows an agent approaching another agent, and then imitating it. The “Social Imitation” category shows an agent imitating another agent, and then approaching it. If an agent shows a preference for another agent during the familiarization trials (by approaching or imitating that agent), it is expected/plausible for the agent to show the same preference (by approaching or imitating the same agent) during the test trial, and unexpected/implausible for the agent to show a different preference (by approaching or imitating a different agent). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). - The “Instrumental Approach” and “Instrumental Imitation” categories introduce a goal object that the agent contacts while imitating a movement pattern. If an agent appears to show a preference for another agent (by approaching or imitating that agent), but simultaneously contacts a goal object, then there is no expectation for that agent to show either the same preference or a different preference, because it is impossible to know whether the agent is trying to imitate another agent or contact the goal object. For “no expectation” scenes, your system should return a plausibility / expectedness rating that’s lower than for “expected” scenes but higher than for “unexpected” scenes. -Example Evaluation Scenes: - -Approach Expected: +Evaluation - Approach - Expected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/872d0a21-6537-4ce1-ad01-a5c8d677a1c2 -Approach Unexpected: +Evaluation - Approach - Unexpected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/4dc81e36-dbb1-4526-8244-0a005aa67d35 -Approach No Expectation: +Evaluation - Approach - No Expectation Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/af03624a-f0ca-4284-81fa-4fce15f8d9a0 https://github.com/NextCenturyCorporation/MCS/assets/10994382/48cdc381-c626-4186-8f16-8f3a7113a9d0 -Imitation Expected: +Evaluation - Imitation - Expected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/b3d95637-150d-42fc-9259-aee541d188a4 -Imitation Unexpected: +Evaluation - Imitation - Unexpected Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/49741259-c543-491f-b8a6-58446fe9ec6c -Imitation No Expectation: +Evaluation - Imitation - No Expectation Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/54f6d65e-9a0b-4fd9-b8b0-1fc75ea12fba @@ -927,6 +941,8 @@ Social Approach: - Each familiarization trial shows agent A1 approaching agent A2, ignoring agent A3. - The test trial shows agent A2 and agent A3 moving in a different pattern, and then agent A1 moving in the same pattern as agent A2. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/f5ad3c89-3e8a-426f-93bc-9f29d043b82e https://github.com/NextCenturyCorporation/MCS/assets/10994382/235b5ba0-e0df-4c80-a4e3-13a38a292e3e @@ -936,6 +952,8 @@ Instrumental Approach: - Like Social Approach (see above), but when agent A1 moves during the test trial, it contacts a goal object (O1) while moving in its pattern. - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/a0dbf6db-3cdb-48f5-88e8-d874cfff3d32 https://github.com/NextCenturyCorporation/MCS/assets/10994382/6fc983c0-6b02-497e-8335-e505c67571af @@ -947,6 +965,8 @@ Social Imitation: - Agent A1’s movement pattern never changes across trials (assuming it moves during that trial). The same is true for agent A2’s and agent A3’s movement patterns. - The test trial shows agent A3 approaching the other agent (either A1 or A2) who has the same movement pattern. +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/b312c121-1b68-4865-9e30-ce1025a74a3f https://github.com/NextCenturyCorporation/MCS/assets/10994382/73026728-2fcf-4b83-83c0-ddc701b61e00 @@ -958,6 +978,8 @@ Instrumental Imitation: - When an agent contacts a goal object, all goal objects are highlighted (color changes to red), as a secondary indication of the successful contact. - Some trials show agent A3 contacting goal object O1 multiple times. When an agent contacts a goal object a second time, its highlight is deactivated (color changes back to original color). +Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/44a99dee-93d5-450d-a4ea-13b62ba938ca https://github.com/NextCenturyCorporation/MCS/assets/10994382/60b30b25-4028-43d8-9410-75c2de869a34 @@ -972,6 +994,8 @@ Details: - Some trials include a blue occluder that is moved by the “helper” agent or “hinderer” agent: the “helper” agent moves the blue occluder to unobstruct the primary agent’s path to the object; the “hinderer” agent moves the blue occluder to obstruct the primary agent’s path to the object. - The test trial does not show the inanimate object or blue occluder; instead, it shows the primary agent approaching one of the other two agents (indicating a preference for that agent). It is expected / plausible for the primary agent to prefer the “helper” agent (the agent who unobstructed its path during the familiarization trials), and unexpected / implausible to prefer the “hinderer” agent (the agent who obstructed its path during the familiarization trials). As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +Evaluation Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/782306b0-43b6-4ba2-a3a2-ef4bc9df8fd8 https://github.com/NextCenturyCorporation/MCS/assets/10994382/a792d78e-49d0-469d-9e08-23569822e81f @@ -982,6 +1006,8 @@ https://eval-7.s3.amazonaws.com/passive_agent_training_helper_hinderer.zip Differences from evaluation tasks: In the training data, the primary agent starts in one of the two smaller areas, and the inanimate object starts in the bigger area; in the evaluation data, the primary agent starts in the bigger area, and the inanimate object starts in one of the two smaller areas. +Training Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/5acc5d32-c114-450c-acec-f561e5559b1f https://github.com/NextCenturyCorporation/MCS/assets/10994382/6682725e-cf57-410e-a64c-bd2ff0abcc3f @@ -995,6 +1021,8 @@ All of these trials have one inanimate object and two agents (blobs): the primar - In False Belief tasks, the primary agent is NOT present (and does not see anything) while the secondary agent moves the inanimate object from its position hidden behind one occluder to a new position behind a second occluder. It is expected / plausible for the primary agent to approach the old position of the object, behind the original occluder (since it did not see the secondary agent move the object to a new position), and unexpected / implausible for the primary agent to approach the new position of the object, behind the second occluder. - As in previous evaluations, your system should return a plausibility / expectedness rating that’s very high for “expected” scenes (1.0 = definitely expected) and very low for “unexpected” scenes (0.0 = definitely unexpected). +Evaluation Examples: + https://github.com/NextCenturyCorporation/MCS/assets/10994382/a9fce7e9-dd57-42ba-ba84-131833edab4e https://github.com/NextCenturyCorporation/MCS/assets/10994382/1d86f61e-17cf-4fb8-bef9-e7e144fb80a4 @@ -1010,13 +1038,13 @@ https://github.com/NextCenturyCorporation/MCS/assets/10994382/0ee10cb4-b4b3-42f7 Differences from evaluation tasks: In the training data, the secondary agent moves the inanimate object to a new position behind the same occluder; in the evaluation data, the secondary agent moves the inanimate object to a new position behind the other occluder. -True Belief: +True Belief Training Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/1f2e9fe5-369a-458f-9ea9-1d4b64439137 https://github.com/NextCenturyCorporation/MCS/assets/10994382/f7bbd86d-6bf3-4765-8839-819bea328930 -False Belief: +False Belief Training Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/b8d1a38a-0c9b-4ee9-9851-3e2f52108088 @@ -1045,7 +1073,29 @@ Summary: Object Permanence tasks require a common-sense understanding of object permanence. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously appear and/or disappear. -TODO VIDEOS +Plausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/7b036be5-3264-406f-a406-2be8642153d0 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/cde52399-3431-44a4-b923-b3d9df9655ea + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/fa5b36fb-e5d0-403e-a2be-2509f798a110 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/7c04fe8b-9b74-4f70-a702-6f1ba1c50ea6 + +Implausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1fef5760-9bb5-4191-ac3e-163a55d584e0 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/4e0aae11-41da-401b-b1a5-a9e273745af7 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/c7b61a51-37f0-4308-9bb9-475322833f1f + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/0b21d679-9ee4-4bd0-ad99-7c683a234433 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/dfd2f067-ea66-4008-abb4-164f72d09461 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/5f081f8d-9f89-4f7d-8cfc-f92c2a8367b3 #### Shape Constancy (Passive Physics) @@ -1053,7 +1103,13 @@ Summary: Shape Constancy tasks require a common-sense understanding of shape constancy. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously transform into different shapes. -TODO VIDEOS +Plausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/810ee604-c1c5-4dd1-96b3-aaf83f0d8e44 + +Implausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/bda22698-261e-4963-b176-ec682b5deb33 #### Spatio-Temporal Continuity (Passive Physics) @@ -1061,7 +1117,21 @@ Summary: Spatio-Temporal Continuity tasks require a common-sense understanding of spatial and temporal continuity. This is a “passive physics” task: you must watch objects moving a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects spontaneously teleport across the room. -TODO VIDEOS +Plausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/4afe4927-168b-4b0f-95c6-b0ab7a1c8525 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/28f25cd5-d826-4c18-bb55-2550ce4658a5 + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/adfe7aca-4eb0-441b-a053-fb67c453e6f3 + +Implausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/56bd0b1b-e020-4f0b-95b6-a6edc9988f0d + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/db949773-3df1-4fa5-9be0-171db7e384de + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/37b1b68d-6476-4fd1-9578-88df88cada02 ### Passive Physics Tasks Introduced in Evaluation 3.5 @@ -1071,6 +1141,8 @@ Summary: Passive Gravity Support tasks require a common-sense understanding of gravity. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects are properly supported. +Plausible Examples: + ||||| |---|---|---|---| ![gravity_support_ex_01](https://github.com/NextCenturyCorporation/MCS/assets/10994382/568c3ba3-f357-44af-b740-1811d3fc9d99) | ![gravity_support_ex_02](https://github.com/NextCenturyCorporation/MCS/assets/10994382/2254e21c-7e19-4076-812f-c1a4f26cb24c) | ![gravity_support_ex_03](https://github.com/NextCenturyCorporation/MCS/assets/10994382/8eef0960-6cce-4976-a819-b3e2a807668a) | ![gravity_support_ex_04](https://github.com/NextCenturyCorporation/MCS/assets/10994382/5fad4cc8-65cf-47fa-806c-64f2cada4f24) @@ -1085,7 +1157,17 @@ Summary: Passive Collision tasks require a common-sense understanding of collision physics. This is a “passive physics” task: you must watch objects moving in a scene (using only Pass actions) and determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not objects properly collide with one another. -TODO VIDEOS +Plausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/1539c889-e6b4-40a5-b5c6-12def9860b8d + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/9f471884-0adf-4fe7-b434-c5e88b03a626 + +Implausible Examples: + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f9d73f01-a9cb-4ad5-8c34-fcd661e1b1ac + +https://github.com/NextCenturyCorporation/MCS/assets/10994382/f310c0d4-bbc5-41f8-8e40-f480dcddc82e ## Other Tasks @@ -1103,20 +1185,16 @@ Summary: Seeing Leads to Knowing tasks require a common-sense understanding of agency. This is a “passive” task: you must watch (using only Pass actions) as a soccer ball is deposited into a container and an agent approaches a container, and then determine whether the simulation was “plausible” (realistic) or “implausible” (unrealistic) based on whether or not the agent acted with common-sense reasoning (if the agent saw the ball being deposited, it should approach the container holding the ball; otherwise it should approach one of the containers behind it, because one of those containers holds the ball). -Plausible: +Plausible Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/a3c4a8b0-9c3f-4580-a9a3-7ee26fec66ce -Plausible: - https://github.com/NextCenturyCorporation/MCS/assets/10994382/fcdbc37f-c616-407d-b312-ff4f082d5a8c -Implausible: +Implausible Examples: https://github.com/NextCenturyCorporation/MCS/assets/10994382/90f065bb-3776-4112-99f3-b060bd525a36 -Implausible: - https://github.com/NextCenturyCorporation/MCS/assets/10994382/8a7c0e7e-275b-42a3-b2c8-6ea43ab251da Details: From 54a554465f9cf6d3f4ea115496720d47749a62c0 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Wed, 13 Dec 2023 09:33:04 -0500 Subject: [PATCH 09/11] MCS-1991 Removed old example scenes. --- .../scenes/agents_preference_expected.json | 1613 ----------------- .../scenes/agents_preference_unexpected.json | 1565 ---------------- .../eval_4_intobjperm_validation_01.json | 275 --- .../scenes/eval_4_reor_validation_01.json | 308 ---- docs/source/scenes/gravity_support_ex_01.json | 155 -- docs/source/scenes/gravity_support_ex_02.json | 155 -- docs/source/scenes/gravity_support_ex_03.json | 155 -- docs/source/scenes/gravity_support_ex_04.json | 155 -- docs/source/scenes/gravity_support_ex_05.json | 155 -- docs/source/scenes/gravity_support_ex_06.json | 155 -- docs/source/scenes/gravity_support_ex_07.json | 155 -- docs/source/scenes/gravity_support_ex_08.json | 155 -- docs/source/scenes/gravity_support_ex_09.json | 155 -- docs/source/scenes/gravity_support_ex_10.json | 155 -- docs/source/scenes/gravity_support_ex_11.json | 155 -- docs/source/scenes/gravity_support_ex_12.json | 155 -- .../hinged_container_example_with_trophy.json | 316 ---- docs/source/scenes/holes_eval_5_ex_1.json | 77 - docs/source/scenes/holes_eval_5_ex_2.json | 87 - docs/source/scenes/lava_eval_5_ex_1.json | 77 - docs/source/scenes/lava_eval_5_ex_2.json | 87 - docs/source/scenes/move_deep_fast_01.json | 339 ---- docs/source/scenes/move_deep_fast_02.json | 339 ---- docs/source/scenes/move_deep_fast_03.json | 339 ---- docs/source/scenes/move_deep_fast_04.json | 339 ---- docs/source/scenes/move_deep_slow_01.json | 206 --- docs/source/scenes/move_deep_slow_02.json | 206 --- docs/source/scenes/move_slow_01.json | 206 --- docs/source/scenes/move_slow_02.json | 206 --- docs/source/scenes/move_toss_fast_01.json | 338 ---- docs/source/scenes/move_toss_fast_02.json | 338 ---- docs/source/scenes/move_toss_slow_01.json | 205 --- docs/source/scenes/move_toss_slow_02.json | 205 --- .../scenes/object_permanence_implausible.json | 371 ---- .../scenes/object_permanence_plausible.json | 366 ---- docs/source/scenes/ramps_eval_5_ex_1.json | 179 -- docs/source/scenes/ramps_eval_5_ex_2.json | 180 -- docs/source/scenes/ramps_eval_5_ex_3.json | 117 -- docs/source/scenes/ramps_eval_5_ex_4.json | 118 -- .../retrieval_goal_example_with_trophy.json | 40 - .../scenes/shape_constancy_implausible.json | 400 ---- .../scenes/shape_constancy_plausible.json | 366 ---- docs/source/scenes/solidity_eval_5_ex_1.json | 663 ------- docs/source/scenes/solidity_eval_5_ex_2.json | 663 ------- .../spatial_elimination_eval_5_ex_1.json | 153 -- .../spatial_elimination_eval_5_ex_2.json | 153 -- .../spatial_elimination_eval_5_ex_3.json | 153 -- .../spatial_elimination_eval_5_ex_4.json | 153 -- ...patio_temporal_continuity_implausible.json | 517 ------ .../spatio_temporal_continuity_plausible.json | 511 ------ docs/source/scenes/tool_use_eval_5_ex_1.json | 102 -- docs/source/scenes/tool_use_eval_5_ex_2.json | 102 -- docs/source/scenes/tool_use_eval_5_ex_3.json | 132 -- docs/source/scenes/tool_use_eval_5_ex_4.json | 132 -- 54 files changed, 15102 deletions(-) delete mode 100644 docs/source/scenes/agents_preference_expected.json delete mode 100644 docs/source/scenes/agents_preference_unexpected.json delete mode 100644 docs/source/scenes/eval_4_intobjperm_validation_01.json delete mode 100644 docs/source/scenes/eval_4_reor_validation_01.json delete mode 100644 docs/source/scenes/gravity_support_ex_01.json delete mode 100644 docs/source/scenes/gravity_support_ex_02.json delete mode 100644 docs/source/scenes/gravity_support_ex_03.json delete mode 100644 docs/source/scenes/gravity_support_ex_04.json delete mode 100644 docs/source/scenes/gravity_support_ex_05.json delete mode 100644 docs/source/scenes/gravity_support_ex_06.json delete mode 100644 docs/source/scenes/gravity_support_ex_07.json delete mode 100644 docs/source/scenes/gravity_support_ex_08.json delete mode 100644 docs/source/scenes/gravity_support_ex_09.json delete mode 100644 docs/source/scenes/gravity_support_ex_10.json delete mode 100644 docs/source/scenes/gravity_support_ex_11.json delete mode 100644 docs/source/scenes/gravity_support_ex_12.json delete mode 100644 docs/source/scenes/hinged_container_example_with_trophy.json delete mode 100644 docs/source/scenes/holes_eval_5_ex_1.json delete mode 100644 docs/source/scenes/holes_eval_5_ex_2.json delete mode 100644 docs/source/scenes/lava_eval_5_ex_1.json delete mode 100644 docs/source/scenes/lava_eval_5_ex_2.json delete mode 100644 docs/source/scenes/move_deep_fast_01.json delete mode 100644 docs/source/scenes/move_deep_fast_02.json delete mode 100644 docs/source/scenes/move_deep_fast_03.json delete mode 100644 docs/source/scenes/move_deep_fast_04.json delete mode 100644 docs/source/scenes/move_deep_slow_01.json delete mode 100644 docs/source/scenes/move_deep_slow_02.json delete mode 100644 docs/source/scenes/move_slow_01.json delete mode 100644 docs/source/scenes/move_slow_02.json delete mode 100644 docs/source/scenes/move_toss_fast_01.json delete mode 100644 docs/source/scenes/move_toss_fast_02.json delete mode 100644 docs/source/scenes/move_toss_slow_01.json delete mode 100644 docs/source/scenes/move_toss_slow_02.json delete mode 100644 docs/source/scenes/object_permanence_implausible.json delete mode 100644 docs/source/scenes/object_permanence_plausible.json delete mode 100644 docs/source/scenes/ramps_eval_5_ex_1.json delete mode 100644 docs/source/scenes/ramps_eval_5_ex_2.json delete mode 100644 docs/source/scenes/ramps_eval_5_ex_3.json delete mode 100644 docs/source/scenes/ramps_eval_5_ex_4.json delete mode 100644 docs/source/scenes/retrieval_goal_example_with_trophy.json delete mode 100644 docs/source/scenes/shape_constancy_implausible.json delete mode 100644 docs/source/scenes/shape_constancy_plausible.json delete mode 100644 docs/source/scenes/solidity_eval_5_ex_1.json delete mode 100644 docs/source/scenes/solidity_eval_5_ex_2.json delete mode 100644 docs/source/scenes/spatial_elimination_eval_5_ex_1.json delete mode 100644 docs/source/scenes/spatial_elimination_eval_5_ex_2.json delete mode 100644 docs/source/scenes/spatial_elimination_eval_5_ex_3.json delete mode 100644 docs/source/scenes/spatial_elimination_eval_5_ex_4.json delete mode 100644 docs/source/scenes/spatio_temporal_continuity_implausible.json delete mode 100644 docs/source/scenes/spatio_temporal_continuity_plausible.json delete mode 100644 docs/source/scenes/tool_use_eval_5_ex_1.json delete mode 100644 docs/source/scenes/tool_use_eval_5_ex_2.json delete mode 100644 docs/source/scenes/tool_use_eval_5_ex_3.json delete mode 100644 docs/source/scenes/tool_use_eval_5_ex_4.json diff --git a/docs/source/scenes/agents_preference_expected.json b/docs/source/scenes/agents_preference_expected.json deleted file mode 100644 index cc58f9fbe..000000000 --- a/docs/source/scenes/agents_preference_expected.json +++ /dev/null @@ -1,1613 +0,0 @@ -{ - "name": "agents_preference_expected", - "version": "2", - "isometric": true, - "ceilingMaterial": null, - "floorMaterial": "Custom/Materials/White", - "wallMaterial": "Custom/Materials/Black", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - } - }, - "objects": [ - { - "id": "agent", - "type": "cylinder", - "materials": ["Custom/Materials/Red"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 3, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 4, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 5, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 6, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 7, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 8, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 9, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 10, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 11, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 12, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 13, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 14, - "position": { - "x": -0.4750000000000001, - "y": 0.25, - "z": -0.7 - } - }, - { - "stepBegin": 18, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 21, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 22, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 23, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 24, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 25, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 26, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 27, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 28, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 29, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 30, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 31, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 32, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 33, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 38, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 41, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 42, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 43, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 44, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 45, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 46, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 47, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 48, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 49, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 50, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 51, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 52, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 53, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 54, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 55, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 56, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 61, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 64, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 65, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 66, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 67, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 68, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 69, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 70, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 71, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 72, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 73, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 74, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 75, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 76, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 77, - "position": { - "x": -0.2250000000000001, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 78, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 79, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 80, - "position": { - "x": 0.050000000000000266, - "y": 0.25, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 81, - "position": { - "x": 0.15000000000000036, - "y": 0.25, - "z": -0.875 - } - }, - { - "stepBegin": 82, - "position": { - "x": 0.20000000000000018, - "y": 0.25, - "z": -0.875 - } - }, - { - "stepBegin": 86, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 89, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 90, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 91, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 92, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 93, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 94, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 95, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 96, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 97, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 98, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 99, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 104, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 107, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 108, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 109, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 110, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 111, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 112, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 113, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 114, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 115, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 116, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 117, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 118, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 119, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 120, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 121, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 122, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 123, - "position": { - "x": 0.050000000000000266, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 124, - "position": { - "x": 0.15000000000000036, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 125, - "position": { - "x": 0.25, - "y": 0.25, - "z": -0.75 - } - }, - { - "stepBegin": 126, - "position": { - "x": 0.30000000000000027, - "y": 0.25, - "z": -0.75 - } - }, - { - "stepBegin": 130, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 133, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 134, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 135, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 136, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 137, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 138, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 139, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 140, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 141, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 142, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 143, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 144, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 145, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 146, - "position": { - "x": -0.2749999999999999, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 147, - "position": { - "x": -0.2749999999999999, - "y": 0.25, - "z": -0.8999999999999999 - } - }, - { - "stepBegin": 148, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.95 - } - }, - { - "stepBegin": 152, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 155, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 156, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 157, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 158, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 159, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 160, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 161, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 162, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 163, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 164, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 165, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 166, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 167, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 168, - "position": { - "x": -0.2250000000000001, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 169, - "position": { - "x": -0.125, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 170, - "position": { - "x": -0.02499999999999991, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 171, - "position": { - "x": 0.07500000000000018, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 176, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 179, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.19999999999999973 - } - }, - { - "stepBegin": 180, - "position": { - "x": -1.5, - "y": 0.25, - "z": -0.09999999999999964 - } - }, - { - "stepBegin": 181, - "position": { - "x": -1.4749999999999999, - "y": 0.25, - "z": 0.0 - } - }, - { - "stepBegin": 182, - "position": { - "x": -1.45, - "y": 0.25, - "z": 0.10000000000000009 - } - }, - { - "stepBegin": 183, - "position": { - "x": -1.4, - "y": 0.25, - "z": 0.20000000000000018 - } - }, - { - "stepBegin": 184, - "position": { - "x": -1.375, - "y": 0.25, - "z": 0.30000000000000027 - } - }, - { - "stepBegin": 185, - "position": { - "x": -1.3499999999999999, - "y": 0.25, - "z": 0.40000000000000036 - } - }, - { - "stepBegin": 186, - "position": { - "x": -1.325, - "y": 0.25, - "z": 0.5 - } - }, - { - "stepBegin": 187, - "position": { - "x": -1.275, - "y": 0.25, - "z": 0.6000000000000001 - } - }, - { - "stepBegin": 188, - "position": { - "x": -1.25, - "y": 0.25, - "z": 0.7000000000000002 - } - }, - { - "stepBegin": 189, - "position": { - "x": -1.2, - "y": 0.25, - "z": 0.75 - } - }, - { - "stepBegin": 190, - "position": { - "x": -1.0999999999999999, - "y": 0.25, - "z": 0.75 - } - }, - { - "stepBegin": 191, - "position": { - "x": -1.0, - "y": 0.25, - "z": 0.75 - } - }, - { - "stepBegin": 192, - "position": { - "x": -0.8999999999999999, - "y": 0.25, - "z": 0.75 - } - }, - { - "stepBegin": 193, - "position": { - "x": -0.7999999999999998, - "y": 0.25, - "z": 0.75 - } - }, - { - "stepBegin": 194, - "position": { - "x": -0.7, - "y": 0.25, - "z": 0.7750000000000004 - } - }, - { - "stepBegin": 195, - "position": { - "x": -0.6499999999999999, - "y": 0.25, - "z": 0.7750000000000004 - } - } - ] - }, - { - "id": "home", - "type": "cube", - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5499999999999998, - "y": 0.000625, - "z": -0.2250000000000001 - }, - "scale": { - "x": 0.5, - "y": 0.00125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "sphere", - "type": "sphere", - "materials": ["Custom/Materials/Lime"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.825 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 18, - "position": { - "x": -0.02499999999999991, - "y": 0.125, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 38, - "position": { - "x": 0.30000000000000027, - "y": 0.125, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 61, - "position": { - "x": 0.4750000000000001, - "y": 0.125, - "z": -0.9249999999999998 - } - }, - { - "stepBegin": 86, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.9249999999999998 - } - }, - { - "stepBegin": 104, - "position": { - "x": 0.5750000000000002, - "y": 0.125, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 130, - "position": { - "x": -0.2250000000000001, - "y": 0.125, - "z": -1.2249999999999999 - } - }, - { - "stepBegin": 152, - "position": { - "x": 0.42500000000000027, - "y": 0.125, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 176, - "position": { - "x": -0.375, - "y": 0.125, - "z": 0.7750000000000004 - } - } - ] - }, - { - "id": "cube", - "type": "cube", - "materials": ["Custom/Materials/Navy"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.375, - "y": 0.125, - "z": 0.7750000000000004 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 18, - "position": { - "x": -0.8499999999999999, - "y": 0.125, - "z": 1.6749999999999998 - } - }, - { - "stepBegin": 38, - "position": { - "x": -0.5999999999999999, - "y": 0.125, - "z": 1.0500000000000003 - } - }, - { - "stepBegin": 61, - "position": { - "x": -0.7249999999999999, - "y": 0.125, - "z": 1.4250000000000003 - } - }, - { - "stepBegin": 86, - "position": { - "x": -1.325, - "y": 0.125, - "z": 0.75 - } - }, - { - "stepBegin": 104, - "position": { - "x": -0.4750000000000001, - "y": 0.125, - "z": 1.375 - } - }, - { - "stepBegin": 130, - "position": { - "x": -0.5, - "y": 0.125, - "z": 1.7250000000000005 - } - }, - { - "stepBegin": 152, - "position": { - "x": -1.2, - "y": 0.125, - "z": 1.0750000000000002 - } - }, - { - "stepBegin": 176, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.825 - } - } - ] - }, - { - "id": "wall_6bb3002a-5517-4daa-afd6-8f66c2511051", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.75, - "y": 0.0625, - "z": 0.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_fcba4e2f-81ee-4ee7-a85c-cfe3f021c819", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.75, - "y": 0.0625, - "z": -1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_4d017086-498c-4e90-b1e5-fff351fb6edd", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_c38275de-0da4-4e1e-9c38-c2c4e0c90c8a", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.75, - "y": 0.0625, - "z": -1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_2f579a61-bd38-47cf-9d80-a2e278ebed44", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": -1.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_76eab386-3503-433a-ac3a-89059c707dad", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.75, - "y": 0.0625, - "z": 1.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_b2a2a47f-50cb-4ca8-beec-9b7e49ea0954", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 0.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_40185508-4df7-4e46-b414-ac2111c3d4dd", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 0.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - } - ], - "goal": { - "category": "agents", - "description": "", - "metadata": { - "choose": [ - "expected", - "unexpected" - ] - }, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "habituation_total": 8, - "last_step": 198 - } -} diff --git a/docs/source/scenes/agents_preference_unexpected.json b/docs/source/scenes/agents_preference_unexpected.json deleted file mode 100644 index 3903c9243..000000000 --- a/docs/source/scenes/agents_preference_unexpected.json +++ /dev/null @@ -1,1565 +0,0 @@ -{ - "name": "agents_preference_unexpected", - "version": "2", - "isometric": true, - "ceilingMaterial": null, - "floorMaterial": "Custom/Materials/White", - "wallMaterial": "Custom/Materials/Black", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - } - }, - "objects": [ - { - "id": "agent", - "type": "cylinder", - "materials": ["Custom/Materials/Red"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 3, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 4, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 5, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 6, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 7, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 8, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 9, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 10, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 11, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 12, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 13, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 14, - "position": { - "x": -0.4750000000000001, - "y": 0.25, - "z": -0.7 - } - }, - { - "stepBegin": 18, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 21, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 22, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 23, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 24, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 25, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 26, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 27, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 28, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 29, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 30, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 31, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 32, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 33, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 38, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 41, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 42, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 43, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 44, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 45, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 46, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 47, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 48, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 49, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 50, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 51, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 52, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 53, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 54, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 55, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 56, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 61, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 64, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 65, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 66, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 67, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 68, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 69, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 70, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 71, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 72, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 73, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 74, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 75, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 76, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 77, - "position": { - "x": -0.2250000000000001, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 78, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 79, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 80, - "position": { - "x": 0.050000000000000266, - "y": 0.25, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 81, - "position": { - "x": 0.15000000000000036, - "y": 0.25, - "z": -0.875 - } - }, - { - "stepBegin": 82, - "position": { - "x": 0.20000000000000018, - "y": 0.25, - "z": -0.875 - } - }, - { - "stepBegin": 86, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 89, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 90, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 91, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 92, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 93, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 94, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 95, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 96, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 97, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 98, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 99, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 104, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 107, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 108, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 109, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 110, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 111, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.4249999999999998 - } - }, - { - "stepBegin": 112, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 113, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 114, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 115, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 116, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 117, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 118, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 119, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 120, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 121, - "position": { - "x": -0.1499999999999999, - "y": 0.25, - "z": -0.7999999999999998 - } - }, - { - "stepBegin": 122, - "position": { - "x": -0.04999999999999982, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 123, - "position": { - "x": 0.050000000000000266, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 124, - "position": { - "x": 0.15000000000000036, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 125, - "position": { - "x": 0.25, - "y": 0.25, - "z": -0.75 - } - }, - { - "stepBegin": 126, - "position": { - "x": 0.30000000000000027, - "y": 0.25, - "z": -0.75 - } - }, - { - "stepBegin": 130, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 133, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 134, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 135, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 136, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 137, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 138, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 139, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 140, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 141, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 142, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 143, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - }, - { - "stepBegin": 144, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 145, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.7749999999999999 - } - }, - { - "stepBegin": 146, - "position": { - "x": -0.2749999999999999, - "y": 0.25, - "z": -0.825 - } - }, - { - "stepBegin": 147, - "position": { - "x": -0.2749999999999999, - "y": 0.25, - "z": -0.8999999999999999 - } - }, - { - "stepBegin": 148, - "position": { - "x": -0.25, - "y": 0.25, - "z": -0.95 - } - }, - { - "stepBegin": 152, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 155, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 156, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 157, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 158, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 159, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 160, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 161, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 162, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.25 - } - }, - { - "stepBegin": 163, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 164, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 165, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 166, - "position": { - "x": -0.4249999999999998, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 167, - "position": { - "x": -0.32499999999999973, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 168, - "position": { - "x": -0.2250000000000001, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 169, - "position": { - "x": -0.125, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 170, - "position": { - "x": -0.02499999999999991, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 171, - "position": { - "x": 0.07500000000000018, - "y": 0.25, - "z": -0.2999999999999998 - } - }, - { - "stepBegin": 176, - "position": { - "x": -1.5499999999999998, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 179, - "position": { - "x": -1.525, - "y": 0.25, - "z": -0.2250000000000001 - } - }, - { - "stepBegin": 180, - "position": { - "x": -1.425, - "y": 0.25, - "z": -0.2749999999999999 - } - }, - { - "stepBegin": 181, - "position": { - "x": -1.325, - "y": 0.25, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 182, - "position": { - "x": -1.2249999999999999, - "y": 0.25, - "z": -0.375 - } - }, - { - "stepBegin": 183, - "position": { - "x": -1.125, - "y": 0.25, - "z": -0.3999999999999999 - } - }, - { - "stepBegin": 184, - "position": { - "x": -1.025, - "y": 0.25, - "z": -0.44999999999999973 - } - }, - { - "stepBegin": 185, - "position": { - "x": -0.9249999999999998, - "y": 0.25, - "z": -0.5 - } - }, - { - "stepBegin": 186, - "position": { - "x": -0.825, - "y": 0.25, - "z": -0.5499999999999998 - } - }, - { - "stepBegin": 187, - "position": { - "x": -0.7249999999999999, - "y": 0.25, - "z": -0.5999999999999999 - } - }, - { - "stepBegin": 188, - "position": { - "x": -0.625, - "y": 0.25, - "z": -0.625 - } - }, - { - "stepBegin": 189, - "position": { - "x": -0.5249999999999999, - "y": 0.25, - "z": -0.6749999999999998 - } - } - ] - }, - { - "id": "home", - "type": "cube", - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5499999999999998, - "y": 0.000625, - "z": -0.2250000000000001 - }, - "scale": { - "x": 0.5, - "y": 0.00125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "sphere", - "type": "sphere", - "materials": ["Custom/Materials/Lime"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.825 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 18, - "position": { - "x": -0.02499999999999991, - "y": 0.125, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 38, - "position": { - "x": 0.30000000000000027, - "y": 0.125, - "z": -0.8499999999999999 - } - }, - { - "stepBegin": 61, - "position": { - "x": 0.4750000000000001, - "y": 0.125, - "z": -0.9249999999999998 - } - }, - { - "stepBegin": 86, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.9249999999999998 - } - }, - { - "stepBegin": 104, - "position": { - "x": 0.5750000000000002, - "y": 0.125, - "z": -0.7249999999999999 - } - }, - { - "stepBegin": 130, - "position": { - "x": -0.2250000000000001, - "y": 0.125, - "z": -1.2249999999999999 - } - }, - { - "stepBegin": 152, - "position": { - "x": 0.42500000000000027, - "y": 0.125, - "z": -0.32499999999999973 - } - }, - { - "stepBegin": 176, - "position": { - "x": -0.375, - "y": 0.125, - "z": 0.7750000000000004 - } - } - ] - }, - { - "id": "cube", - "type": "cube", - "materials": ["Custom/Materials/Navy"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.375, - "y": 0.125, - "z": 0.7750000000000004 - }, - "scale": { - "x": 0.25, - "y": 0.25, - "z": 0.25 - } - }, - { - "stepBegin": 18, - "position": { - "x": -0.8499999999999999, - "y": 0.125, - "z": 1.6749999999999998 - } - }, - { - "stepBegin": 38, - "position": { - "x": -0.5999999999999999, - "y": 0.125, - "z": 1.0500000000000003 - } - }, - { - "stepBegin": 61, - "position": { - "x": -0.7249999999999999, - "y": 0.125, - "z": 1.4250000000000003 - } - }, - { - "stepBegin": 86, - "position": { - "x": -1.325, - "y": 0.125, - "z": 0.75 - } - }, - { - "stepBegin": 104, - "position": { - "x": -0.4750000000000001, - "y": 0.125, - "z": 1.375 - } - }, - { - "stepBegin": 130, - "position": { - "x": -0.5, - "y": 0.125, - "z": 1.7250000000000005 - } - }, - { - "stepBegin": 152, - "position": { - "x": -1.2, - "y": 0.125, - "z": 1.0750000000000002 - } - }, - { - "stepBegin": 176, - "position": { - "x": -0.19999999999999973, - "y": 0.125, - "z": -0.825 - } - } - ] - }, - { - "id": "wall_6bb3002a-5517-4daa-afd6-8f66c2511051", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.75, - "y": 0.0625, - "z": 0.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_fcba4e2f-81ee-4ee7-a85c-cfe3f021c819", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.75, - "y": 0.0625, - "z": -1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_4d017086-498c-4e90-b1e5-fff351fb6edd", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_c38275de-0da4-4e1e-9c38-c2c4e0c90c8a", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.75, - "y": 0.0625, - "z": -1.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_2f579a61-bd38-47cf-9d80-a2e278ebed44", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": -1.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_76eab386-3503-433a-ac3a-89059c707dad", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.75, - "y": 0.0625, - "z": 1.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_b2a2a47f-50cb-4ca8-beec-9b7e49ea0954", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 0.75 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - }, - { - "id": "wall_40185508-4df7-4e46-b414-ac2111c3d4dd", - "type": "cube", - "materials": ["Custom/Materials/Black"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.25, - "y": 0.0625, - "z": 0.25 - }, - "scale": { - "x": 0.5, - "y": 0.125, - "z": 0.5 - } - } - ], - "kinematic": true, - "structure": true - } - ], - "goal": { - "category": "agents", - "description": "", - "metadata": { - "choose": [ - "expected", - "unexpected" - ] - }, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "habituation_total": 8, - "last_step": 193 - } -} diff --git a/docs/source/scenes/eval_4_intobjperm_validation_01.json b/docs/source/scenes/eval_4_intobjperm_validation_01.json deleted file mode 100644 index c82a67a65..000000000 --- a/docs/source/scenes/eval_4_intobjperm_validation_01.json +++ /dev/null @@ -1,275 +0,0 @@ -{ - "name": "eval_4_intobjperm_validation_01", - "version": "2", - "ceilingMaterial": "AI2-THOR/Materials/Ceramics/GREYGRANITE", - "floorMaterial": "AI2-THOR/Materials/Wood/WornWood", - "wallMaterial": "AI2-THOR/Materials/Ceramics/GREYGRANITE", - "performerStart": { - "position": { - "x": 0, - "y": 2.25, - "z": -5.5 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "objects": [ - { - "id": "target_ball", - "type": "soccer_ball", - "mass": 1, - "positionY": 0.11, - "salientMaterials": ["rubber"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 3.75, - "y": 4.4725, - "z": 3.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": -5 - }, - "stepBegin": 0, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ], - "materials": [], - "forces": [ - { - "relative": true, - "stepBegin": 19, - "stepEnd": 19, - "vector": { - "x": -650, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "throwing_device_left", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -3.75, - "y": 4.5, - "z": 3.5 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 90 - }, - "scale": { - "x": 0.55, - "y": 0.8, - "z": 0.55 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"]] - }, - { - "id": "throwing_device_right", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 3.75, - "y": 4.5, - "z": 3.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.55, - "y": 0.8, - "z": 0.55 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"]] - }, - { - "id": "occluder_front_left", - "type": "cube", - "mass": 100, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2.125, - "y": 0.125, - "z": 1.5 - }, - "scale": { - "x": 2.25, - "y": 0.25, - "z": 1 - } - } - ] - }, - { - "id": "occluder_side_left", - "type": "cube", - "mass": 50, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.125, - "y": 0.5, - "z": 3.625 - }, - "scale": { - "x": 0.25, - "y": 1, - "z": 3.25 - } - } - ] - }, - { - "id": "occluder_front_right", - "type": "cube", - "mass": 100, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.125, - "y": 0.125, - "z": 1.5 - }, - "scale": { - "x": 2.25, - "y": 0.25, - "z": 1 - } - } - ] - }, - { - "id": "occluder_side_right", - "type": "cube", - "mass": 50, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.125, - "y": 0.5, - "z": 3.625 - }, - "scale": { - "x": 0.25, - "y": 1, - "z": 3.25 - } - } - ] - }, - { - "id": "platform", - "type": "cube", - "mass": 1000, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "physics": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.5, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 1, - "z": 12 - } - } - ] - }, - { - "id": "decision_wall", - "type": "cube", - "mass": 50, - "materials": ["AI2-THOR/Materials/Plastics/WhitePlastic"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1.375, - "z": -3 - }, - "scale": { - "x": 0.5, - "y": 0.75, - "z": 0.25 - } - } - ] - } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target_ball" - } - }, - "description": "Find and pick up the small light black white rubber ball.", - "last_step": 2500, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]] - }, - "roomDimensions": { - "x": 8, - "y": 8, - "z": 12 - } -} diff --git a/docs/source/scenes/eval_4_reor_validation_01.json b/docs/source/scenes/eval_4_reor_validation_01.json deleted file mode 100644 index 8b527aec9..000000000 --- a/docs/source/scenes/eval_4_reor_validation_01.json +++ /dev/null @@ -1,308 +0,0 @@ -{ - "name": "eval_4_reor_validation_01", - "version": "2", - "ceilingMaterial": "AI2-THOR/Materials/Walls/WallDrywallGrey", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetWhite 3", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 90 - } - }, - "objects": [ - { - "id": "target_ball", - "type": "soccer_ball", - "mass": 1.0, - "salientMaterials": ["rubber"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -5.0, - "y": 2.85, - "z": -3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 501, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - } - ], - "materials": [], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 506 - } - ] - }, - { - "id": "container_front_right", - "type": "cup_2", - "mass": 20.0, - "salientMaterials": ["wood"], - "receptacle": true, - "occluder": true, - "shows": [ - { - "position": { - "x": 5.0, - "y": 0.01, - "z": 3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 4, - "y": 2.5, - "z": 4 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WornWood"] - }, - { - "id": "container_back_right", - "type": "cup_2", - "mass": 20.0, - "salientMaterials": ["wood"], - "receptacle": true, - "occluder": true, - "shows": [ - { - "position": { - "x": 5.0, - "y": 0.01, - "z": -3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 4, - "y": 2.5, - "z": 4 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WornWood"] - }, - { - "id": "container_back_left", - "type": "cup_2", - "mass": 20.0, - "salientMaterials": ["wood"], - "receptacle": true, - "occluder": true, - "shows": [ - { - "position": { - "x": -5.0, - "y": 0.01, - "z": -3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 4, - "y": 2.5, - "z": 4 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WornWood"] - }, - { - "id": "container_front_left", - "type": "cup_2", - "mass": 20.0, - "salientMaterials": ["wood"], - "receptacle": true, - "occluder": true, - "shows": [ - { - "position": { - "x": -5.0, - "y": 0.01, - "z": 3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 4, - "y": 2.5, - "z": 4 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WornWood"] - }, - { - "id": "dropping_device_front_right", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 5.0, - "y": 2.85, - "z": 3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 0.275, - "y": 0.3, - "z": 0.275 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"]] - }, - { - "id": "dropping_device_back_right", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 5.0, - "y": 2.85, - "z": -3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 0.275, - "y": 0.3, - "z": 0.275 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"]] - }, - { - "id": "dropping_device_back_left", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -5.0, - "y": 2.85, - "z": -3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 0.275, - "y": 0.3, - "z": 0.275 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"],["released"]] - }, - { - "id": "dropping_device_front_left", - "type": "tube_wide", - "mass": 10, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -5.0, - "y": 2.85, - "z": 3.0 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 0.275, - "y": 0.3, - "z": 0.275 - } - } - ], - "states": [["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"],["held"]] - } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target_ball" - } - }, - "description": "Find and pick up the small light black white rubber ball.", - "habituation_total": 2, - "action_list": [[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],["EndHabituation,xPosition=0,zPosition=0,yRotation=-120"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["EndHabituation,xPosition=0,zPosition=0,yRotation=90"]] - }, - "roomDimensions": { - "x": 12, - "y": 3, - "z": 8 - }, - "roomMaterials": { - "back": "Custom/Materials/Red", - "front": "Custom/Materials/Cyan", - "left": "Custom/Materials/Cyan", - "right": "Custom/Materials/Cyan" - } -} diff --git a/docs/source/scenes/gravity_support_ex_01.json b/docs/source/scenes/gravity_support_ex_01.json deleted file mode 100644 index 709a5a299..000000000 --- a/docs/source/scenes/gravity_support_ex_01.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/BrownDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "circle_frustum", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": -1.0, - "y": 7.255, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 1, - "scale": { - "x": 1.0, - "y": 1.0, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 2"], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 32 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 1, - "position": { - "x": -1.0, - "y": 12.755, - "z": 1.6 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 37, - "stepEnd": 62, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 32, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": -1.0, - "y": 0.125, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 1 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_02.json b/docs/source/scenes/gravity_support_ex_02.json deleted file mode 100644 index aa64e2109..000000000 --- a/docs/source/scenes/gravity_support_ex_02.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/Carpet2", - "wallMaterial": "AI2-THOR/Materials/Walls/Drywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0.5675, - "y": 7.130, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 2, - "scale": { - "x": 0.75, - "y": 0.75, - "z": 0.75 - } - } - ], - "materials": ["AI2-THOR/Materials/Metals/Brass 1"], - "moves": [ - { - "stepBegin": 2, - "stepEnd": 25, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 31 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 2, - "position": { - "x": 0.5675, - "y": 12.505, - "z": 1.6 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 2, - "stepEnd": 25, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 36, - "stepEnd": 59, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 31, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 0.0, - "y": 0.375, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.75, - "y": 0.75, - "z": 1 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/BrownMarbleFake 1"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_03.json b/docs/source/scenes/gravity_support_ex_03.json deleted file mode 100644 index 3b1eff262..000000000 --- a/docs/source/scenes/gravity_support_ex_03.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_03", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/Carpet3", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallBeige", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0.3, - "y": 7.005, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 3, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/LightWoodCounters3"], - "moves": [ - { - "stepBegin": 3, - "stepEnd": 24, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 30 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 3, - "position": { - "x": 0.3, - "y": 12.255, - "z": 1.6 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 3, - "stepEnd": 24, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 35, - "stepEnd": 56, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 30, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 1.0, - "y": 0.625, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 1.0, - "y": 1.25, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/ConcreteFloor"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_04.json b/docs/source/scenes/gravity_support_ex_04.json deleted file mode 100644 index b4aa5bd29..000000000 --- a/docs/source/scenes/gravity_support_ex_04.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_04", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/Carpet4", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cylinder", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0, - "y": 7.130, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 4, - "scale": { - "x": 0.75, - "y": 0.375, - "z": 0.75 - } - } - ], - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "moves": [ - { - "stepBegin": 4, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 32 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 4, - "position": { - "x": 0, - "y": 12.505, - "z": 2.533 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 4, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 37, - "stepEnd": 59, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 32, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": -1.25, - "y": 0.5, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 1.0, - "y": 1.0, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/GREYGRANITE"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_05.json b/docs/source/scenes/gravity_support_ex_05.json deleted file mode 100644 index 9a007fa21..000000000 --- a/docs/source/scenes/gravity_support_ex_05.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_05", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/Carpet8", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallOrange", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0.5, - "y": 6.925, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 5, - "scale": { - "x": 1.0, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "moves": [ - { - "stepBegin": 5, - "stepEnd": 25, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 31 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 5, - "position": { - "x": 0.5, - "y": 12.005, - "z": 2.533 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 5, - "stepEnd": 25, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 36, - "stepEnd": 56, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 31, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 0.5, - "y": 0.75, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.75, - "y": 1.5, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 2"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_06.json b/docs/source/scenes/gravity_support_ex_06.json deleted file mode 100644 index 67e4f7157..000000000 --- a/docs/source/scenes/gravity_support_ex_06.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_06", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetDark", - "wallMaterial": "AI2-THOR/Materials/Walls/Drywall4Tiled", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "square_frustum", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 1.75, - "y": 7.255, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 6, - "scale": { - "x": 1.0, - "y": 1.0, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 3"], - "moves": [ - { - "stepBegin": 6, - "stepEnd": 30, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 36 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 6, - "position": { - "x": 1.75, - "y": 12.755, - "z": 2.533 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 6, - "stepEnd": 30, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 41, - "stepEnd": 65, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 36, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 1.25, - "y": 0.25, - "z": 2.533 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_07.json b/docs/source/scenes/gravity_support_ex_07.json deleted file mode 100644 index 9ef086098..000000000 --- a/docs/source/scenes/gravity_support_ex_07.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_07", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetDark 1", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "square_frustum", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": -1.45, - "y": 7.005, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 7, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/LightWoodCounters4"], - "moves": [ - { - "stepBegin": 7, - "stepEnd": 28, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 34 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 7, - "position": { - "x": -1.45, - "y": 12.255, - "z": 3.466 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 7, - "stepEnd": 28, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 39, - "stepEnd": 60, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 34, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": -0.75, - "y": 0.625, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 1.0, - "y": 1.25, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/RedBrick"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_08.json b/docs/source/scenes/gravity_support_ex_08.json deleted file mode 100644 index 08e18d9fb..000000000 --- a/docs/source/scenes/gravity_support_ex_08.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_08", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetDarkGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 1.05, - "y": 7.005, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 8, - "scale": { - "x": 1.0, - "y": 0.5, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 4"], - "moves": [ - { - "stepBegin": 8, - "stepEnd": 33, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 39 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 8, - "position": { - "x": 1.05, - "y": 12.255, - "z": 3.466 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 8, - "stepEnd": 33, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 44, - "stepEnd": 69, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 39, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 0, - "y": 0.125, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 1.0, - "y": 0.25, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/TexturesCom_BrickRound0044_1_seamless_S"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_09.json b/docs/source/scenes/gravity_support_ex_09.json deleted file mode 100644 index 38201659e..000000000 --- a/docs/source/scenes/gravity_support_ex_09.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_09", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/WallDrywallGrey", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0.75, - "y": 7.130, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 9, - "scale": { - "x": 0.75, - "y": 0.75, - "z": 0.75 - } - } - ], - "materials": ["AI2-THOR/Materials/Metals/HammeredMetal_AlbedoTransparency 1"], - "moves": [ - { - "stepBegin": 9, - "stepEnd": 32, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 38 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 9, - "position": { - "x": 0.75, - "y": 12.505, - "z": 3.466 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 9, - "stepEnd": 32, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 43, - "stepEnd": 66, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 38, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 0.75, - "y": 0.375, - "z": 3.466 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.5, - "y": 0.75, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 3"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_10.json b/docs/source/scenes/gravity_support_ex_10.json deleted file mode 100644 index 85f41b556..000000000 --- a/docs/source/scenes/gravity_support_ex_10.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_10", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/HotelCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/YellowDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cylinder", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": -0.875, - "y": 7.005, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 10, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Tan"], - "moves": [ - { - "stepBegin": 10, - "stepEnd": 30, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 36 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 10, - "position": { - "x": -0.875, - "y": 12.255, - "z": 4.4 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 10, - "stepEnd": 30, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 41, - "stepEnd": 61, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 36, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": -1.5, - "y": 0.75, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 1.0, - "y": 1.5, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 4"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_11.json b/docs/source/scenes/gravity_support_ex_11.json deleted file mode 100644 index a146c419c..000000000 --- a/docs/source/scenes/gravity_support_ex_11.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_11", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/Rug6", - "wallMaterial": "AI2-THOR/Materials/Walls/BrownDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "cube", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 0.2, - "y": 7.130, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 11, - "scale": { - "x": 1.0, - "y": 0.75, - "z": 0.75 - } - } - ], - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "moves": [ - { - "stepBegin": 11, - "stepEnd": 33, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 39 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 11, - "position": { - "x": 0.2, - "y": 12.505, - "z": 4.4 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 11, - "stepEnd": 33, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 44, - "stepEnd": 66, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 39, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": -0.5, - "y": 0.5, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.5, - "y": 1.0, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Wood/WornWood"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/gravity_support_ex_12.json b/docs/source/scenes/gravity_support_ex_12.json deleted file mode 100644 index 36c8cb12f..000000000 --- a/docs/source/scenes/gravity_support_ex_12.json +++ /dev/null @@ -1,155 +0,0 @@ -{ - "name": "gravity_support_ex_12", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RugPattern224", - "wallMaterial": "AI2-THOR/Materials/Walls/Drywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "target_object", - "type": "circle_frustum", - "mass": 5, - "moveable": true, - "shows": [ - { - "position": { - "x": 2.75, - "y": 7.255, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 12, - "scale": { - "x": 1.0, - "y": 1.0, - "z": 1.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"], - "moves": [ - { - "stepBegin": 12, - "stepEnd": 36, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 42 - } - ] - }, - { - "id": "pole_object", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 12, - "position": { - "x": 2.75, - "y": 12.755, - "z": 4.4 - }, - "scale": { - "x": 0.2, - "y": 5, - "z": 0.2 - } - } - ], - "moves": [ - { - "stepBegin": 12, - "stepEnd": 36, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 47, - "stepEnd": 71, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 42, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "supporting_object", - "type": "cube", - "mass": 100, - "kinematic": true, - "structure": true, - "shows": [ - { - "position": { - "x": 1.5, - "y": 0.25, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 1.0 - } - } - ], - "materials": ["AI2-THOR/Materials/Ceramics/WhiteCountertop"] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 60, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/hinged_container_example_with_trophy.json b/docs/source/scenes/hinged_container_example_with_trophy.json deleted file mode 100644 index 95534a947..000000000 --- a/docs/source/scenes/hinged_container_example_with_trophy.json +++ /dev/null @@ -1,316 +0,0 @@ -{ - "name": "hinged_container_example_with_trophy", - "version": 2, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetWhite 3", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallBeige", - "performerStart": { - "position": { - "x": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "objects": [{ - "id": "sturdy_box_small", - "type": "chest_1", - "salientMaterials": ["plastic"], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 3"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0, - "z": -1 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 0.35, - "y": 0.35, - "z": 0.35 - } - }] - }, { - "id": "sturdy_box_med", - "type": "chest_1", - "salientMaterials": ["wood"], - "materials": ["AI2-THOR/Materials/Wood/WornWood"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - }] - }, { - "id": "sturdy_box_large", - "type": "chest_1", - "salientMaterials": ["metal"], - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 0.65, - "y": 0.65, - "z": 0.65 - } - }] - }, { - "id": "suitcase_small", - "type": "suitcase_1", - "salientMaterials": ["plastic"], - "materials": ["AI2-THOR/Materials/Plastics/BlackPlastic"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - }] - }, { - "id": "suitcase_med", - "type": "suitcase_1", - "salientMaterials": ["metal"], - "materials": ["AI2-THOR/Materials/Metals/WhiteMetal"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "scale": { - "x": 1.25, - "y": 1.25, - "z": 1.25 - } - }] - }, { - "id": "suitcase_large", - "type": "suitcase_1", - "salientMaterials": ["plastic"], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0, - "z": -1.5 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "treasure_chest_small", - "type": "chest_2", - "salientMaterials": ["metal"], - "materials": ["AI2-THOR/Materials/Metals/BrownMetal 1"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1, - "y": 0, - "z": 1.5 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 0.3, - "y": 0.3, - "z": 0.3 - } - }] - }, { - "id": "treasure_chest_med", - "type": "chest_2", - "salientMaterials": ["plastic"], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 2"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0, - "z": 1.5 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 0.7, - "y": 0.7, - "z": 0.7 - } - }] - }, { - "id": "treasure_chest_large", - "type": "chest_2", - "salientMaterials": ["wood"], - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1, - "y": 0, - "z": 1.5 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1.1, - "y": 1.1, - "z": 1.1 - } - }] - }, { - "id": "trophy_1", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0.08, - "z": -0.15 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - } - }] - }, { - "id": "trophy_2", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0.08, - "z": 0.85 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - } - }] - }, { - "id": "trophy_3", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": -0.155, - "y": 0.08, - "z": 1.5 - }, - "rotation": { - "x": 90, - "y": 90, - "z": 0 - } - }] - }, { - "id": "trophy_4", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1, - "y": 0.04, - "z": 1.5 - } - }] - }, { - "id": "trophy_5", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0.08, - "z": 0.15 - }, - "rotation": { - "x": 90, - "y": 180, - "z": 0 - } - }] - }, { - "id": "trophy_6", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0.08, - "z": -1.35 - }, - "rotation": { - "x": 90, - "y": 180, - "z": 0 - } - }] - }] -} diff --git a/docs/source/scenes/holes_eval_5_ex_1.json b/docs/source/scenes/holes_eval_5_ex_1.json deleted file mode 100644 index 539a44c95..000000000 --- a/docs/source/scenes/holes_eval_5_ex_1.json +++ /dev/null @@ -1,77 +0,0 @@ -{ - "name": "holes_eval_5_ex_1", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/MaroonWoodMCS", - "wallMaterial": "Custom/Materials/PurpleWoodMCS", - "roomDimensions": { - "x": 12, - "y": 3, - "z": 12 - }, - "holes": [ - { "x": -6, "z": -2 }, - { "x": -5, "z": -2 }, - { "x": -4, "z": -2 }, - { "x": -3, "z": -2 }, - { "x": -2, "z": -2 }, - { "x": -1, "z": -2 }, - { "x": 0, "z": -2 }, - { "x": 1, "z": -2 }, - { "x": 2, "z": -2 }, - { "x": 3, "z": -2 }, - { "x": -3, "z": 2 }, - { "x": -2, "z": 2 }, - { "x": -1, "z": 2 }, - { "x": 0, "z": 2 }, - { "x": 1, "z": 2 }, - { "x": 2, "z": 2 }, - { "x": 3, "z": 2 }, - { "x": 4, "z": 2 }, - { "x": 5, "z": 2 }, - { "x": 6, "z": 2 } - ], - "performerStart": { - "position": { - "x": 2, - "z": -5 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 5, - "y": 0.23, - "z": 5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }] -} diff --git a/docs/source/scenes/holes_eval_5_ex_2.json b/docs/source/scenes/holes_eval_5_ex_2.json deleted file mode 100644 index 49e33baa2..000000000 --- a/docs/source/scenes/holes_eval_5_ex_2.json +++ /dev/null @@ -1,87 +0,0 @@ -{ - "name": "holes_eval_5_ex_2", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/TealWoodMCS", - "wallMaterial": "Custom/Materials/GreenWoodMCS", - "roomDimensions": { - "x": 12, - "y": 3, - "z": 12 - }, - "holes": [ - { "x": 1, "z": -1 }, - { "x": 1, "z": 0 }, - { "x": 1, "z": 1 }, - { "x": 1, "z": 2 }, - { "x": 1, "z": 3 }, - { "x": 1, "z": 4 }, - { "x": 1, "z": 5 }, - { "x": 1, "z": 6 }, - { "x": 2, "z": 6 }, - { "x": 3, "z": 6 }, - { "x": 4, "z": 6 }, - { "x": 5, "z": 6 }, - { "x": 6, "z": 6 }, - { "x": 6, "z": 5 }, - { "x": 6, "z": 4 }, - { "x": 6, "z": 3 }, - { "x": 6, "z": 2 }, - { "x": 6, "z": 1 }, - { "x": 6, "z": 0 }, - { "x": 6, "z": -1 }, - { "x": 6, "z": -2 }, - { "x": 6, "z": -3 }, - { "x": 6, "z": -4 }, - { "x": 6, "z": -5 }, - { "x": 6, "z": -6 }, - { "x": 5, "z": -6 }, - { "x": 4, "z": -6 }, - { "x": 3, "z": -6 }, - { "x": 2, "z": -6 }, - { "x": 1, "z": -6 } - ], - "performerStart": { - "position": { - "x": -5, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 90 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4, - "y": 0.23, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }] -} diff --git a/docs/source/scenes/lava_eval_5_ex_1.json b/docs/source/scenes/lava_eval_5_ex_1.json deleted file mode 100644 index 8e6872216..000000000 --- a/docs/source/scenes/lava_eval_5_ex_1.json +++ /dev/null @@ -1,77 +0,0 @@ -{ - "name": "lava_eval_5_ex_1", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/GreyWoodMCS", - "wallMaterial": "Custom/Materials/TanWoodMCS", - "roomDimensions": { - "x": 12, - "y": 3, - "z": 12 - }, - "lava": [ - { "x": -6, "z": -2 }, - { "x": -5, "z": -2 }, - { "x": -4, "z": -2 }, - { "x": -3, "z": -2 }, - { "x": -2, "z": -2 }, - { "x": -1, "z": -2 }, - { "x": 0, "z": -2 }, - { "x": 1, "z": -2 }, - { "x": 2, "z": -2 }, - { "x": 3, "z": -2 }, - { "x": -3, "z": 2 }, - { "x": -2, "z": 2 }, - { "x": -1, "z": 2 }, - { "x": 0, "z": 2 }, - { "x": 1, "z": 2 }, - { "x": 2, "z": 2 }, - { "x": 3, "z": 2 }, - { "x": 4, "z": 2 }, - { "x": 5, "z": 2 }, - { "x": 6, "z": 2 } - ], - "performerStart": { - "position": { - "x": 2, - "z": -5 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 5, - "y": 0.23, - "z": 5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }] -} diff --git a/docs/source/scenes/lava_eval_5_ex_2.json b/docs/source/scenes/lava_eval_5_ex_2.json deleted file mode 100644 index 47dc5ebda..000000000 --- a/docs/source/scenes/lava_eval_5_ex_2.json +++ /dev/null @@ -1,87 +0,0 @@ -{ - "name": "lava_eval_5_ex_2", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/BrownWoodMCS", - "wallMaterial": "Custom/Materials/WhiteWoodMCS", - "roomDimensions": { - "x": 12, - "y": 3, - "z": 12 - }, - "lava": [ - { "x": 1, "z": -1 }, - { "x": 1, "z": 0 }, - { "x": 1, "z": 1 }, - { "x": 1, "z": 2 }, - { "x": 1, "z": 3 }, - { "x": 1, "z": 4 }, - { "x": 1, "z": 5 }, - { "x": 1, "z": 6 }, - { "x": 2, "z": 6 }, - { "x": 3, "z": 6 }, - { "x": 4, "z": 6 }, - { "x": 5, "z": 6 }, - { "x": 6, "z": 6 }, - { "x": 6, "z": 5 }, - { "x": 6, "z": 4 }, - { "x": 6, "z": 3 }, - { "x": 6, "z": 2 }, - { "x": 6, "z": 1 }, - { "x": 6, "z": 0 }, - { "x": 6, "z": -1 }, - { "x": 6, "z": -2 }, - { "x": 6, "z": -3 }, - { "x": 6, "z": -4 }, - { "x": 6, "z": -5 }, - { "x": 6, "z": -6 }, - { "x": 5, "z": -6 }, - { "x": 4, "z": -6 }, - { "x": 3, "z": -6 }, - { "x": 2, "z": -6 }, - { "x": 1, "z": -6 } - ], - "performerStart": { - "position": { - "x": -5, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 90 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4, - "y": 0.23, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }] -} diff --git a/docs/source/scenes/move_deep_fast_01.json b/docs/source/scenes/move_deep_fast_01.json deleted file mode 100644 index 13ade7168..000000000 --- a/docs/source/scenes/move_deep_fast_01.json +++ /dev/null @@ -1,339 +0,0 @@ -{ - "name": "move_deep_fast_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -5.84, - "y": 0.25, - "z": 4.4 - }, - "rotation": { - "x": 90, - "y": 15, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/cabinet metal"], - "forces": [ - { - "relative": true, - "stepBegin": 80, - "stepEnd": 80, - "vector": { - "x": 400.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_deep_fast_02.json b/docs/source/scenes/move_deep_fast_02.json deleted file mode 100644 index 4f958b342..000000000 --- a/docs/source/scenes/move_deep_fast_02.json +++ /dev/null @@ -1,339 +0,0 @@ -{ - "name": "move_deep_fast_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "tube_wide", - "type": "tube_wide", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -4.16, - "y": 0.25, - "z": 1.6 - }, - "rotation": { - "x": 90, - "y": -15, - "z": 0 - }, - "stepBegin": 110, - "scale": { - "x": 0.6, - "y": 0.3, - "z": 0.6 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/wood 1"], - "forces": [ - { - "relative": true, - "stepBegin": 110, - "stepEnd": 110, - "vector": { - "x": 300.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_deep_fast_03.json b/docs/source/scenes/move_deep_fast_03.json deleted file mode 100644 index e76244a68..000000000 --- a/docs/source/scenes/move_deep_fast_03.json +++ /dev/null @@ -1,339 +0,0 @@ -{ - "name": "move_deep_fast_03", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "duck_on_wheels", - "type": "duck_on_wheels", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.84, - "y": 0, - "z": 4.4 - }, - "rotation": { - "x": 0, - "y": 165, - "z": 0 - }, - "stepBegin": 90, - "scale": { - "x": 2.0, - "y": 2.0, - "z": 2.0 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 4"], - "forces": [ - { - "relative": true, - "stepBegin": 90, - "stepEnd": 90, - "vector": { - "x": 300.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_deep_fast_04.json b/docs/source/scenes/move_deep_fast_04.json deleted file mode 100644 index bbabfeffe..000000000 --- a/docs/source/scenes/move_deep_fast_04.json +++ /dev/null @@ -1,339 +0,0 @@ -{ - "name": "move_deep_fast_04", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "sedan", - "type": "car_1", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 4.16, - "y": 0, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": -75, - "z": 0 - }, - "stepBegin": 100, - "scale": { - "x": 3.5, - "y": 3.5, - "z": 3.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"], - "forces": [ - { - "relative": true, - "stepBegin": 100, - "stepEnd": 100, - "vector": { - "x": 0, - "y": 0, - "z": 400.0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_deep_slow_01.json b/docs/source/scenes/move_deep_slow_01.json deleted file mode 100644 index 99443a70e..000000000 --- a/docs/source/scenes/move_deep_slow_01.json +++ /dev/null @@ -1,206 +0,0 @@ -{ - "name": "move_deep_slow_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "tube_wide", - "type": "tube_wide", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.84, - "y": 0.25, - "z": 4.4 - }, - "rotation": { - "x": 90, - "y": 165, - "z": 0 - }, - "stepBegin": 85, - "scale": { - "x": 0.6, - "y": 0.3, - "z": 0.6 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/wood 1"], - "forces": [ - { - "relative": true, - "stepBegin": 85, - "stepEnd": 85, - "vector": { - "x": 125.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 232, - "stepEnd": 236, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_deep_slow_02.json b/docs/source/scenes/move_deep_slow_02.json deleted file mode 100644 index eaf5869fc..000000000 --- a/docs/source/scenes/move_deep_slow_02.json +++ /dev/null @@ -1,206 +0,0 @@ -{ - "name": "move_deep_slow_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RUG7", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "duck_on_wheels", - "type": "duck_on_wheels", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -4.16, - "y": 0, - "z": 1.6 - }, - "rotation": { - "x": 0, - "y": -15, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 1.5, - "y": 1.5, - "z": 1.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 4"], - "forces": [ - { - "relative": true, - "stepBegin": 80, - "stepEnd": 80, - "vector": { - "x": 225.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 3.6, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 36, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - }, - { - "stepBegin": 41, - "stepEnd": 70, - "vector": { - "x": 0, - "y": -3, - "z": 0 - } - }, - { - "stepBegin": 207, - "stepEnd": 236, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/GenericStainlessSteel"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_slow_01.json b/docs/source/scenes/move_slow_01.json deleted file mode 100644 index e560e184d..000000000 --- a/docs/source/scenes/move_slow_01.json +++ /dev/null @@ -1,206 +0,0 @@ -{ - "name": "move_slow_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.42, - "y": 0.25, - "z": 3.7 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - }, - "stepBegin": 95, - "scale": { - "x": 0.4, - "y": 0.2, - "z": 0.4 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 2"], - "forces": [ - { - "relative": true, - "stepBegin": 95, - "stepEnd": 95, - "vector": { - "x": -125.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 232, - "stepEnd": 236, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_slow_02.json b/docs/source/scenes/move_slow_02.json deleted file mode 100644 index 943592a02..000000000 --- a/docs/source/scenes/move_slow_02.json +++ /dev/null @@ -1,206 +0,0 @@ -{ - "name": "move_slow_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RUG7", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "train_1", - "type": "train_1", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -4.58, - "y": 0, - "z": 2.3 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "stepBegin": 90, - "scale": { - "x": 2.5, - "y": 2.5, - "z": 2.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 3"], - "forces": [ - { - "relative": true, - "stepBegin": 90, - "stepEnd": 90, - "vector": { - "x": 0, - "y": 0, - "z": 225.0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 3.6, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 36, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - }, - { - "stepBegin": 41, - "stepEnd": 70, - "vector": { - "x": 0, - "y": -3, - "z": 0 - } - }, - { - "stepBegin": 207, - "stepEnd": 236, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/GenericStainlessSteel"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_toss_fast_01.json b/docs/source/scenes/move_toss_fast_01.json deleted file mode 100644 index 0e7917097..000000000 --- a/docs/source/scenes/move_toss_fast_01.json +++ /dev/null @@ -1,338 +0,0 @@ -{ - "name": "move_toss_fast_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 4.58, - "y": 1.25, - "z": 2.3 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - }, - "stepBegin": 90, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/cabinet metal"], - "forces": [ - { - "stepBegin": 90, - "stepEnd": 90, - "vector": { - "x": -300.0, - "y": 150, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_toss_fast_02.json b/docs/source/scenes/move_toss_fast_02.json deleted file mode 100644 index 3a833cbf7..000000000 --- a/docs/source/scenes/move_toss_fast_02.json +++ /dev/null @@ -1,338 +0,0 @@ -{ - "name": "move_toss_fast_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "sedan", - "type": "car_1", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -5.42, - "y": 1.0, - "z": 3.7 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 3.5, - "y": 3.5, - "z": 3.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"], - "forces": [ - { - "stepBegin": 80, - "stepEnd": 80, - "vector": { - "x": 275.0, - "y": 225, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 0.8, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.8, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_toss_slow_01.json b/docs/source/scenes/move_toss_slow_01.json deleted file mode 100644 index 19f538a1f..000000000 --- a/docs/source/scenes/move_toss_slow_01.json +++ /dev/null @@ -1,205 +0,0 @@ -{ - "name": "move_toss_slow_01", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "sedan", - "type": "car_1", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.42, - "y": 1.0, - "z": 3.7 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "stepBegin": 105, - "scale": { - "x": 3.5, - "y": 3.5, - "z": 3.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"], - "forces": [ - { - "stepBegin": 105, - "stepEnd": 105, - "vector": { - "x": -125.0, - "y": 225.0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 232, - "stepEnd": 236, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 226, - "stepEnd": 231, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/move_toss_slow_02.json b/docs/source/scenes/move_toss_slow_02.json deleted file mode 100644 index 92a60db4d..000000000 --- a/docs/source/scenes/move_toss_slow_02.json +++ /dev/null @@ -1,205 +0,0 @@ -{ - "name": "move_toss_slow_02", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RUG7", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -4.58, - "y": 1.25, - "z": 2.3 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - }, - "stepBegin": 100, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/cabinet metal"], - "forces": [ - { - "stepBegin": 100, - "stepEnd": 100, - "vector": { - "x": 140.0, - "y": 150.0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 1.5, - "z": 1 - }, - "scale": { - "x": 3.6, - "y": 3.0, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 36, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - }, - { - "stepBegin": 41, - "stepEnd": 70, - "vector": { - "x": 0, - "y": -3, - "z": 0 - } - }, - { - "stepBegin": 207, - "stepEnd": 236, - "vector": { - "x": 0, - "y": 3, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/GenericStainlessSteel"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.2, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 71, - "stepEnd": 76, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 201, - "stepEnd": 206, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 240, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/object_permanence_implausible.json b/docs/source/scenes/object_permanence_implausible.json deleted file mode 100644 index 7d58b61bd..000000000 --- a/docs/source/scenes/object_permanence_implausible.json +++ /dev/null @@ -1,371 +0,0 @@ -{ - "name": "object_permanence_implausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "sphere", - "type": "sphere", - "mass": 0.5, - "salientMaterials": ["plastic"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 1.2, - "y": 5.31, - "z": 1.9 - }, - "rotation": { - "x": 90, - "y": 45, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - } - ], - "hides": [ - { - "stepBegin": 120 - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 2"] - }, - { - "id": "duck", - "type": "duck_on_wheels", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -2.55, - "y": 5.94, - "z": 4.1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 85, - "scale": { - "x": 2.5, - "y": 2.5, - "z": 2.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 4"] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/TexturesCom_BrickRound0044_1_seamless_S"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.631, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.842, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/WhiteMetal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -5.052, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.0312500000000002, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 4.53125, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 160, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/object_permanence_plausible.json b/docs/source/scenes/object_permanence_plausible.json deleted file mode 100644 index cfe7b0514..000000000 --- a/docs/source/scenes/object_permanence_plausible.json +++ /dev/null @@ -1,366 +0,0 @@ -{ - "name": "object_permanence_plausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/BedroomCarpet", - "wallMaterial": "AI2-THOR/Materials/Walls/EggshellDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "sphere", - "type": "sphere", - "mass": 0.5, - "salientMaterials": ["plastic"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 1.2, - "y": 5.31, - "z": 1.9 - }, - "rotation": { - "x": 90, - "y": 45, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 0.5, - "y": 0.5, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 2"] - }, - { - "id": "duck", - "type": "duck_on_wheels", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -2.55, - "y": 5.94, - "z": 4.1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 85, - "scale": { - "x": 2.5, - "y": 2.5, - "z": 2.5 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 4"] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/TexturesCom_BrickRound0044_1_seamless_S"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.631, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.842, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/WhiteMetal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -5.052, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/WoodGrain_Brown"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.0312500000000002, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 1.0, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/Metal"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 4.53125, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 160, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/ramps_eval_5_ex_1.json b/docs/source/scenes/ramps_eval_5_ex_1.json deleted file mode 100644 index b1ddd4a72..000000000 --- a/docs/source/scenes/ramps_eval_5_ex_1.json +++ /dev/null @@ -1,179 +0,0 @@ -{ - "name": "ramps_eval_5_ex_1", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/OliveCarpetMCS", - "wallMaterial": "Custom/Materials/MaroonDrywallMCS", - "roomDimensions": { - "x": 12, - "y": 6, - "z": 12 - }, - "performerStart": { - "position": { - "x": -4, - "z": -4 - }, - "rotation": { - "x": 0, - "y": 50 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4.5, - "y": 2.22, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "platform_lower", - "materials": ["Custom/Materials/BrownDrywallMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 1000, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "left": [{ - "low": 0.25, - "high": 0.5 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4, - "y": 0.5, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 4, - "y": 1, - "z": 8 - } - }] - }, { - "id": "ramp_lower", - "materials": ["Custom/Materials/BrownDrywallMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0.5, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 2, - "y": 1, - "z": 1 - } - }] - }, { - "id": "platform_upper", - "materials": ["Custom/Materials/GreyDrywallMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 100, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "front": [{ - "low": 0, - "high": 1 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4.5, - "y": 1.5, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }, { - "id": "ramp_upper", - "materials": ["Custom/Materials/GreyDrywallMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4.5, - "y": 1.5, - "z": 3.15 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1.732 - } - }] - }] -} diff --git a/docs/source/scenes/ramps_eval_5_ex_2.json b/docs/source/scenes/ramps_eval_5_ex_2.json deleted file mode 100644 index dd079c6a8..000000000 --- a/docs/source/scenes/ramps_eval_5_ex_2.json +++ /dev/null @@ -1,180 +0,0 @@ -{ - "name": "ramps_eval_5_ex_2", - "version": 2, - "ceilingMaterial": "Custom/Materials/BlackDrywallMCS", - "floorMaterial": "Custom/Materials/OliveCarpetMCS", - "wallMaterial": "Custom/Materials/MaroonDrywallMCS", - "roomDimensions": { - "x": 12, - "y": 6, - "z": 12 - }, - "performerStart": { - "position": { - "x": 4.5, - "y": 2, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 220 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": -4, - "y": 0.22, - "z": -4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "platform_lower", - "materials": ["Custom/Materials/BrownDrywallMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 1000, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "left": [{ - "low": 0.25, - "high": 0.5 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4, - "y": 0.5, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 4, - "y": 1, - "z": 8 - } - }] - }, { - "id": "ramp_lower", - "materials": ["Custom/Materials/BrownDrywallMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 1.5, - "y": 0.5, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 2, - "y": 1, - "z": 1 - } - }] - }, { - "id": "platform_upper", - "materials": ["Custom/Materials/GreyDrywallMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 100, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "front": [{ - "low": 0, - "high": 1 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4.5, - "y": 1.5, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }, { - "id": "ramp_upper", - "materials": ["Custom/Materials/GreyDrywallMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 4.5, - "y": 1.5, - "z": 3.15 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1.732 - } - }] - }] -} diff --git a/docs/source/scenes/ramps_eval_5_ex_3.json b/docs/source/scenes/ramps_eval_5_ex_3.json deleted file mode 100644 index f583d9dc4..000000000 --- a/docs/source/scenes/ramps_eval_5_ex_3.json +++ /dev/null @@ -1,117 +0,0 @@ -{ - "name": "ramps_eval_5_ex_3", - "version": 2, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/NavyCarpetMCS", - "wallMaterial": "Custom/Materials/TealDrywallMCS", - "roomDimensions": { - "x": 12, - "y": 6, - "z": 12 - }, - "performerStart": { - "position": { - "x": -1, - "z": 4 - }, - "rotation": { - "x": 0, - "y": 180 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0.5, - "y": 2.22, - "z": -3 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "platform", - "materials": ["Custom/Materials/WhiteWoodMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 1000, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "back": [{ - "low": 0.25, - "high": 0.75 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -3.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 3, - "y": 2, - "z": 3 - } - }] - }, { - "id": "ramp", - "materials": ["Custom/Materials/WhiteWoodMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -0.3 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 2, - "z": 3.464 - } - }] - }] -} diff --git a/docs/source/scenes/ramps_eval_5_ex_4.json b/docs/source/scenes/ramps_eval_5_ex_4.json deleted file mode 100644 index 796a4e435..000000000 --- a/docs/source/scenes/ramps_eval_5_ex_4.json +++ /dev/null @@ -1,118 +0,0 @@ -{ - "name": "ramps_eval_5_ex_4", - "version": 2, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/NavyCarpetMCS", - "wallMaterial": "Custom/Materials/TealDrywallMCS", - "roomDimensions": { - "x": 12, - "y": 6, - "z": 12 - }, - "performerStart": { - "position": { - "x": 0.5, - "y": 2, - "z": -3 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": -1, - "y": 0.22, - "z": 4 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "platform", - "materials": ["Custom/Materials/WhiteWoodMCS"], - "type": "cube", - "kinematic": "true", - "structure": "true", - "mass": 1000, - "lips": { - "front": true, - "back": true, - "left": true, - "right": true, - "gaps": { - "back": [{ - "low": 0.25, - "high": 0.75 - }] - } - }, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -3.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 3, - "y": 2, - "z": 3 - } - }] - }, { - "id": "ramp", - "materials": ["Custom/Materials/WhiteWoodMCS"], - "type": "triangle", - "kinematic": "true", - "structure": "true", - "mass": 100, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -0.3 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 2, - "z": 3.464 - } - }] - }] -} diff --git a/docs/source/scenes/retrieval_goal_example_with_trophy.json b/docs/source/scenes/retrieval_goal_example_with_trophy.json deleted file mode 100644 index 852cb00fc..000000000 --- a/docs/source/scenes/retrieval_goal_example_with_trophy.json +++ /dev/null @@ -1,40 +0,0 @@ -{ - "name": "retrieval_goal_example_with_trophy", - "version": 2, - "ceilingMaterial": "AI2-THOR/Materials/Walls/Drywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetWhite 3", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallBeige", - "performerStart": { - "position": { - "x": 0, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "objects": [{ - "id": "trophy", - "type": "trophy", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0, - "z": 2 - } - }] - }], - "goal": { - "category": "retrieval", - "description": "Find and pick up the trophy.", - "last_step": 3000, - "metadata": { - "target": { - "id": "trophy", - "image": null - } - } - } -} diff --git a/docs/source/scenes/shape_constancy_implausible.json b/docs/source/scenes/shape_constancy_implausible.json deleted file mode 100644 index ae01c8e25..000000000 --- a/docs/source/scenes/shape_constancy_implausible.json +++ /dev/null @@ -1,400 +0,0 @@ -{ - "name": "shape_constancy_implausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RUG7", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "turtle", - "type": "turtle_on_wheels", - "mass": 0.4, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 0.8, - "y": 5.54, - "z": 3.1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 1.75, - "y": 1.75, - "z": 1.75 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 3"] - }, - { - "id": "rect", - "type": "cube", - "mass": 0.4, - "salientMaterials": ["plastic"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -2.2, - "y": 5.62, - "z": 3.05 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 0.4, - "y": 0.2, - "z": 0.2 - } - } - ], - "hides": [ - { - "stepBegin": 120 - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"] - }, - { - "id": "rect", - "type": "racecar_red", - "mass": 0.4, - "salientMaterials": ["plastic"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -2.2, - "y": 0.01, - "z": 3.05 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "stepBegin": 120, - "scale": { - "x": 2.75, - "y": 2.75, - "z": 2.75 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.579, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.694, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/GenericStainlessSteel"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 3.926, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/BrownMarbleFake 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.603, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.733, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrownMetal 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -4.969, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 160, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/shape_constancy_plausible.json b/docs/source/scenes/shape_constancy_plausible.json deleted file mode 100644 index d90f2f884..000000000 --- a/docs/source/scenes/shape_constancy_plausible.json +++ /dev/null @@ -1,366 +0,0 @@ -{ - "name": "shape_constancy_plausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "floorMaterial": "AI2-THOR/Materials/Fabrics/RUG7", - "wallMaterial": "AI2-THOR/Materials/Walls/RedDrywall", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "turtle", - "type": "turtle_on_wheels", - "mass": 0.4, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 0.8, - "y": 5.54, - "z": 3.1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 1.75, - "y": 1.75, - "z": 1.75 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 3"] - }, - { - "id": "rect", - "type": "cube", - "mass": 0.4, - "salientMaterials": ["plastic"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": -2.2, - "y": 5.62, - "z": 3.05 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 0.4, - "y": 0.2, - "z": 0.2 - } - } - ], - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color 1"] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Wood/DarkWoodSmooth2"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.579, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.694, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/GenericStainlessSteel"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 3.926, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/BrownMarbleFake 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.603, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.733, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": -18, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 152, - "stepEnd": 156, - "vector": { - "x": 18, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrownMetal 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -4.969, - "y": 0.9, - "z": 1 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 90 - }, - "scale": { - "x": 0.095, - "y": 3, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": -0.25, - "y": 0, - "z": 0 - } - }, - { - "stepBegin": 146, - "stepEnd": 151, - "vector": { - "x": 0.25, - "y": 0, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 160, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/solidity_eval_5_ex_1.json b/docs/source/scenes/solidity_eval_5_ex_1.json deleted file mode 100644 index f841fd3c5..000000000 --- a/docs/source/scenes/solidity_eval_5_ex_1.json +++ /dev/null @@ -1,663 +0,0 @@ -{ - "name": "solidity_eval_5_ex_1", - "version": "2", - "restrictOpenDoors": true, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/GreenWoodMCS", - "wallMaterial": "Custom/Materials/OliveWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.5, - "z": -5.5 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 8, - "z": 12 - }, - "goal": { - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the small light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1, - "y": 7.72, - "z": 3 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 22, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 56 - } - ] - }, - { - "id": "placer", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1, - "y": 10.94, - "z": 3 - }, - "scale": { - "x": 0.1, - "y": 3, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 22, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 58, - "stepEnd": 79, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 56, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "platform_p1", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/OliveWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": false, - "right": false - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -3 - }, - "scale": { - "x": 1, - "y": 2, - "z": 6 - } - } - ] - }, - { - "id": "platform_p2", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/OliveWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": true, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 1.25 - }, - "scale": { - "x": 1, - "y": 2, - "z": 2.5 - } - } - ] - }, - { - "id": "platform_p3", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/OliveWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": true, - "right": false - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 3 - }, - "scale": { - "x": 1, - "y": 2, - "z": 1 - } - } - ] - }, - { - "id": "platform_p4", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/OliveWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": true, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 4.5 - }, - "scale": { - "x": 1, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "platform_p5", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/OliveWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": true, - "back": true, - "left": false, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1, - "y": 0.95, - "z": 3 - }, - "scale": { - "x": 1, - "y": 1.9, - "z": 1 - } - } - ] - }, - { - "id": "wall_with_top_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 12.1, - "z": 0 - }, - "scale": { - "x": 1, - "y": 0.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_top_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.46, - "y": 11, - "z": 0 - }, - "scale": { - "x": 0.08, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_top_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.46, - "y": 11, - "z": 0 - }, - "scale": { - "x": 0.08, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_top", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/BrownWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 10, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2.25, - "y": 11.1, - "z": 0 - }, - "scale": { - "x": 3.5, - "y": 2.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -3.335, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.165, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_left", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/BrownWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": -2.25, - "y": 8, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.25, - "y": 11.1, - "z": 0 - }, - "scale": { - "x": 3.5, - "y": 2.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.165, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/GreyDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 3.335, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_right", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/BrownWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 2.25, - "y": 8, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 23, - "stepEnd": 54, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - } - ] -} diff --git a/docs/source/scenes/solidity_eval_5_ex_2.json b/docs/source/scenes/solidity_eval_5_ex_2.json deleted file mode 100644 index 31f996ef8..000000000 --- a/docs/source/scenes/solidity_eval_5_ex_2.json +++ /dev/null @@ -1,663 +0,0 @@ -{ - "name": "solidity_eval_5_ex_2", - "version": "2", - "restrictOpenDoors": true, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/PurpleWoodMCS", - "wallMaterial": "Custom/Materials/NavyWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.5, - "z": -5.5 - }, - "rotation": { - "x": 0, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 8, - "z": 12 - }, - "goal": { - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the small light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 7.72, - "z": 4 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ], - "moves": [ - { - "stepBegin": 11, - "stepEnd": 32, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - } - ], - "kinematic": true, - "togglePhysics": [ - { - "stepBegin": 66 - } - ] - }, - { - "id": "placer", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 50, - "materials": ["Custom/Materials/Magenta"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 10.94, - "z": 4 - }, - "scale": { - "x": 0.1, - "y": 3, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 11, - "stepEnd": 32, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 68, - "stepEnd": 89, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "changeMaterials": [ - { - "stepBegin": 66, - "materials": [ - "Custom/Materials/Cyan" - ] - } - ] - }, - { - "id": "platform_p1", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/NavyWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": false, - "right": false - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": -3 - }, - "scale": { - "x": 1, - "y": 2, - "z": 6 - } - } - ] - }, - { - "id": "platform_p2", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/NavyWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": true, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 1.75 - }, - "scale": { - "x": 1, - "y": 2, - "z": 3.5 - } - } - ] - }, - { - "id": "platform_p3", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/NavyWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": false, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 4 - }, - "scale": { - "x": 1, - "y": 2, - "z": 1 - } - } - ] - }, - { - "id": "platform_p4", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/NavyWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": false, - "back": false, - "left": true, - "right": true - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1, - "z": 5.5 - }, - "scale": { - "x": 1, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "platform_p5", - "type": "cube", - "mass": 200, - "materials": ["Custom/Materials/NavyWoodMCS"], - "kinematic": true, - "structure": true, - "lips": { - "front": true, - "back": true, - "left": true, - "right": false - }, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.5, - "y": 0.95, - "z": 4 - }, - "scale": { - "x": 2, - "y": 1.9, - "z": 1 - } - } - ] - }, - { - "id": "wall_with_top_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 12.1, - "z": 0 - }, - "scale": { - "x": 1, - "y": 0.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_top_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -0.46, - "y": 11, - "z": 0 - }, - "scale": { - "x": 0.08, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_top_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.46, - "y": 11, - "z": 0 - }, - "scale": { - "x": 0.08, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_top", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/WhiteWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 10, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2.25, - "y": 11.1, - "z": 0 - }, - "scale": { - "x": 3.5, - "y": 2.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -3.335, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_left_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.165, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_left", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/WhiteWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": -2.25, - "y": 8, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p1", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.25, - "y": 11.1, - "z": 0 - }, - "scale": { - "x": 3.5, - "y": 2.2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p2", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 1.165, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "wall_with_right_door_p3", - "type": "cube", - "mass": 10, - "materials": ["Custom/Materials/BrownDrywallMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 3.335, - "y": 9, - "z": 0 - }, - "scale": { - "x": 1.33, - "y": 2, - "z": 0.1 - } - } - ], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - }, - { - "id": "door_right", - "type": "door_4", - "mass": 1, - "materials": ["Custom/Materials/WhiteWoodMCS"], - "openable": true, - "kinematic": true, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 2.25, - "y": 8, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 180, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }], - "moves": [{ - "stepBegin": 33, - "stepEnd": 64, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }] - } - ] -} diff --git a/docs/source/scenes/spatial_elimination_eval_5_ex_1.json b/docs/source/scenes/spatial_elimination_eval_5_ex_1.json deleted file mode 100644 index 12818aa57..000000000 --- a/docs/source/scenes/spatial_elimination_eval_5_ex_1.json +++ /dev/null @@ -1,153 +0,0 @@ -{ - "name": "spatial_elimination_eval_5_ex_1", - "version": "2", - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/RoseWoodMCS", - "wallMaterial": "Custom/Materials/AzureWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.25, - "z": -5.5 - }, - "rotation": { - "x": 10, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 3, - "z": 12 - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "position": { - "x": 2.1, - "y": 0.22, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "occluder_left", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/BrownWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2, - "y": 0.9, - "z": 1.5 - }, - "scale": { - "x": 0.2, - "y": 1.8, - "z": 0.2 - } - } - ] - }, - { - "id": "occluder_right", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/BrownWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2, - "y": 0.3, - "z": 1.5 - }, - "scale": { - "x": 0.6, - "y": 0.6, - "z": 0.2 - } - } - ] - }, - { - "id": "platform", - "type": "cube", - "mass": 1000, - "materials": ["Custom/Materials/AzureWoodMCS"], - "kinematic": true, - "physics": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.5, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 1, - "z": 12 - } - } - ] - }, - { - "id": "decision_wall", - "type": "cube", - "mass": 50, - "materials": ["Custom/Materials/Black"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1.125, - "z": -4 - }, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.25 - } - } - ] - } - ] -} diff --git a/docs/source/scenes/spatial_elimination_eval_5_ex_2.json b/docs/source/scenes/spatial_elimination_eval_5_ex_2.json deleted file mode 100644 index 9dde09cae..000000000 --- a/docs/source/scenes/spatial_elimination_eval_5_ex_2.json +++ /dev/null @@ -1,153 +0,0 @@ -{ - "name": "spatial_elimination_eval_5_ex_2", - "version": "2", - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/RoseWoodMCS", - "wallMaterial": "Custom/Materials/AzureWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.25, - "z": -5.5 - }, - "rotation": { - "x": 10, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 3, - "z": 12 - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "position": { - "x": -2.1, - "y": 0.22, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "occluder_left", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/BrownWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2, - "y": 0.9, - "z": 1.5 - }, - "scale": { - "x": 0.2, - "y": 1.8, - "z": 0.2 - } - } - ] - }, - { - "id": "occluder_right", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/BrownWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2, - "y": 0.3, - "z": 1.5 - }, - "scale": { - "x": 0.6, - "y": 0.6, - "z": 0.2 - } - } - ] - }, - { - "id": "platform", - "type": "cube", - "mass": 1000, - "materials": ["Custom/Materials/AzureWoodMCS"], - "kinematic": true, - "physics": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.5, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 1, - "z": 12 - } - } - ] - }, - { - "id": "decision_wall", - "type": "cube", - "mass": 50, - "materials": ["Custom/Materials/Black"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1.125, - "z": -4 - }, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.25 - } - } - ] - } - ] -} diff --git a/docs/source/scenes/spatial_elimination_eval_5_ex_3.json b/docs/source/scenes/spatial_elimination_eval_5_ex_3.json deleted file mode 100644 index 0acf1b1b1..000000000 --- a/docs/source/scenes/spatial_elimination_eval_5_ex_3.json +++ /dev/null @@ -1,153 +0,0 @@ -{ - "name": "spatial_elimination_eval_5_ex_3", - "version": "2", - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/OrangeWoodMCS", - "wallMaterial": "Custom/Materials/SpringGreenWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.25, - "z": -5.5 - }, - "rotation": { - "x": 10, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 3, - "z": 12 - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "position": { - "x": -2.6, - "y": 0.22, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "occluder_right", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/GreyWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.5, - "y": 0.9, - "z": 4 - }, - "scale": { - "x": 0.2, - "y": 1.8, - "z": 0.2 - } - } - ] - }, - { - "id": "occluder_left", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/GreyWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2.5, - "y": 0.3, - "z": 4 - }, - "scale": { - "x": 0.6, - "y": 0.6, - "z": 0.2 - } - } - ] - }, - { - "id": "platform", - "type": "cube", - "mass": 1000, - "materials": ["Custom/Materials/SpringGreenWoodMCS"], - "kinematic": true, - "physics": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.5, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 1, - "z": 12 - } - } - ] - }, - { - "id": "decision_wall", - "type": "cube", - "mass": 50, - "materials": ["Custom/Materials/Black"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1.125, - "z": -4 - }, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.25 - } - } - ] - } - ] -} diff --git a/docs/source/scenes/spatial_elimination_eval_5_ex_4.json b/docs/source/scenes/spatial_elimination_eval_5_ex_4.json deleted file mode 100644 index 38095ff27..000000000 --- a/docs/source/scenes/spatial_elimination_eval_5_ex_4.json +++ /dev/null @@ -1,153 +0,0 @@ -{ - "name": "spatial_elimination_eval_5_ex_4", - "version": "2", - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/OrangeWoodMCS", - "wallMaterial": "Custom/Materials/SpringGreenWoodMCS", - "performerStart": { - "position": { - "x": 0, - "y": 2.25, - "z": -5.5 - }, - "rotation": { - "x": 10, - "y": 0 - } - }, - "roomDimensions": { - "x": 8, - "y": 3, - "z": 12 - }, - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [ - { - "id": "target", - "type": "soccer_ball", - "mass": 2, - "shows": [ - { - "position": { - "x": 2.6, - "y": 0.22, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "stepBegin": 0, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - } - ] - }, - { - "id": "occluder_right", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/GreyWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.5, - "y": 0.9, - "z": 4 - }, - "scale": { - "x": 0.2, - "y": 1.8, - "z": 0.2 - } - } - ] - }, - { - "id": "occluder_left", - "type": "cube", - "mass": 100, - "materials": ["Custom/Materials/GreyWoodMCS"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -2.5, - "y": 0.3, - "z": 4 - }, - "scale": { - "x": 0.6, - "y": 0.6, - "z": 0.2 - } - } - ] - }, - { - "id": "platform", - "type": "cube", - "mass": 1000, - "materials": ["Custom/Materials/SpringGreenWoodMCS"], - "kinematic": true, - "physics": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.5, - "z": 0 - }, - "scale": { - "x": 0.5, - "y": 1, - "z": 12 - } - } - ] - }, - { - "id": "decision_wall", - "type": "cube", - "mass": 50, - "materials": ["Custom/Materials/Black"], - "kinematic": true, - "structure": true, - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0, - "y": 1.125, - "z": -4 - }, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.25 - } - } - ] - } - ] -} diff --git a/docs/source/scenes/spatio_temporal_continuity_implausible.json b/docs/source/scenes/spatio_temporal_continuity_implausible.json deleted file mode 100644 index 7b92e216a..000000000 --- a/docs/source/scenes/spatio_temporal_continuity_implausible.json +++ /dev/null @@ -1,517 +0,0 @@ -{ - "name": "spatio_temporal_continuity_implausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.69, - "y": 0.25, - "z": 4.15 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - }, - "stepBegin": 100, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/cabinet metal"], - "forces": [ - { - "stepBegin": 100, - "stepEnd": 100, - "vector": { - "x": -350.0, - "y": 0, - "z": 0 - } - } - ], - "shrouds": [ - { - "stepBegin": 105, - "stepEnd": 117 - } - ] - }, - { - "id": "sedan", - "type": "car_1", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 4.73, - "y": 0.01, - "z": 2.55 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 3.5, - "y": 3.5, - "z": 3.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/wood 1"], - "forces": [ - { - "stepBegin": 80, - "stepEnd": 80, - "vector": { - "x": -330.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.069, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.942, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.069, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/RedBrick"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.536, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.992, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.536, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_3", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.4, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.9, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 191, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_3", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/HammeredMetal_AlbedoTransparency 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.4, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/spatio_temporal_continuity_plausible.json b/docs/source/scenes/spatio_temporal_continuity_plausible.json deleted file mode 100644 index 3469d443a..000000000 --- a/docs/source/scenes/spatio_temporal_continuity_plausible.json +++ /dev/null @@ -1,511 +0,0 @@ -{ - "name": "spatio_temporal_continuity_plausible", - "version": "2", - "intuitivePhysics": true, - "ceilingMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "floorMaterial": "AI2-THOR/Materials/Fabrics/CarpetGreen", - "wallMaterial": "AI2-THOR/Materials/Walls/DrywallGreen", - "performerStart": { - "position": { - "x": 0, - "y": 0, - "z": -4.5 - }, - "rotation": { - "y": 0 - } - }, - "objects": [ - { - "id": "cylinder", - "type": "cylinder", - "mass": 0.5, - "salientMaterials": ["metal"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 5.69, - "y": 0.25, - "z": 4.15 - }, - "rotation": { - "x": 90, - "y": 0, - "z": 0 - }, - "stepBegin": 100, - "scale": { - "x": 0.5, - "y": 0.25, - "z": 0.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/cabinet metal"], - "forces": [ - { - "stepBegin": 100, - "stepEnd": 100, - "vector": { - "x": -350.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "sedan", - "type": "car_1", - "mass": 0.5, - "salientMaterials": ["wood"], - "moveable": true, - "pickupable": true, - "shows": [ - { - "position": { - "x": 4.73, - "y": 0.01, - "z": 2.55 - }, - "rotation": { - "x": 0, - "y": 270, - "z": 0 - }, - "stepBegin": 80, - "scale": { - "x": 3.5, - "y": 3.5, - "z": 3.5 - } - } - ], - "materials": ["UnityAssetStore/Baby_Room/Models/Materials/wood 1"], - "forces": [ - { - "stepBegin": 80, - "stepEnd": 80, - "vector": { - "x": -330.0, - "y": 0, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_1", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Walls/DrywallOrange"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.069, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.942, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_1", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedAluminum_Blue"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 0.069, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_2", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Ceramics/RedBrick"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.536, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.992, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 192, - "stepEnd": 196, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_2", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/BrushedIron_AlbedoTransparency"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": -1.536, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - }, - { - "id": "occluder_wall_3", - "type": "cube", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["UnityAssetStore/Kindergarten_Interior/Models/Materials/color wood 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.4, - "y": 0.9, - "z": 1 - }, - "scale": { - "x": 0.9, - "y": 1.8, - "z": 0.1 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ], - "rotates": [ - { - "stepBegin": 7, - "stepEnd": 11, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - }, - { - "stepBegin": 16, - "stepEnd": 20, - "vector": { - "x": 0, - "y": 18, - "z": 0 - } - }, - { - "stepBegin": 191, - "stepEnd": 196, - "vector": { - "x": 0, - "y": -18, - "z": 0 - } - } - ] - }, - { - "id": "occluder_pole_3", - "type": "cylinder", - "kinematic": true, - "structure": true, - "mass": 100, - "materials": ["AI2-THOR/Materials/Metals/HammeredMetal_AlbedoTransparency 1"], - "shows": [ - { - "stepBegin": 0, - "position": { - "x": 2.4, - "y": 3.25, - "z": 1 - }, - "scale": { - "x": 0.095, - "y": 2, - "z": 0.095 - } - } - ], - "moves": [ - { - "stepBegin": 1, - "stepEnd": 6, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - }, - { - "stepBegin": 21, - "stepEnd": 26, - "vector": { - "x": 0, - "y": -0.25, - "z": 0 - } - }, - { - "stepBegin": 186, - "stepEnd": 191, - "vector": { - "x": 0, - "y": 0.25, - "z": 0 - } - } - ] - } - ], - "goal": { - "category": "intuitive physics", - "last_step": 200, - "action_list": [["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"],["Pass"]], - "description": "", - "metadata": { - "choose": [ - "plausible", - "implausible" - ] - } - } -} diff --git a/docs/source/scenes/tool_use_eval_5_ex_1.json b/docs/source/scenes/tool_use_eval_5_ex_1.json deleted file mode 100644 index 674347df9..000000000 --- a/docs/source/scenes/tool_use_eval_5_ex_1.json +++ /dev/null @@ -1,102 +0,0 @@ -{ - "name": "tool_use_eval_5_ex_1", - "version": 2, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/RoseWoodMCS", - "wallMaterial": "Custom/Materials/OrangeWoodMCS", - "roomDimensions": { - "x": 14, - "y": 3, - "z": 14 - }, - "performerStart": { - "position": { - "x": -6.5, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 70 - } - }, - "lava": [ - { "x": 4, "z": 4 }, - { "x": 3, "z": 4 }, - { "x": 2, "z": 4 }, - { "x": 1, "z": 4 }, - { "x": 0, "z": 4 }, - { "x": 4, "z": 3 }, - { "x": 3, "z": 3 }, - { "x": 2, "z": 3 }, - { "x": 1, "z": 3 }, - { "x": 0, "z": 3 }, - { "x": 4, "z": 2 }, - { "x": 3, "z": 2 }, - { "x": 1, "z": 2 }, - { "x": 0, "z": 2 }, - { "x": 4, "z": 1 }, - { "x": 3, "z": 1 }, - { "x": 2, "z": 1 }, - { "x": 1, "z": 1 }, - { "x": 0, "z": 1 }, - { "x": 4, "z": 0 }, - { "x": 3, "z": 0 }, - { "x": 2, "z": 0 }, - { "x": 1, "z": 0 }, - { "x": 0, "z": 0 } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 2, - "y": 0.22, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "tool", - "type": "tool_rect_0_50_x_5_00", - "shows": [{ - "stepBegin": 0, - "position": { - "x": -3.5, - "y": 0.15, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }] -} diff --git a/docs/source/scenes/tool_use_eval_5_ex_2.json b/docs/source/scenes/tool_use_eval_5_ex_2.json deleted file mode 100644 index 76d408bd1..000000000 --- a/docs/source/scenes/tool_use_eval_5_ex_2.json +++ /dev/null @@ -1,102 +0,0 @@ -{ - "name": "tool_use_eval_5_ex_2", - "version": 2, - "ceilingMaterial": "Custom/Materials/GreyDrywallMCS", - "floorMaterial": "Custom/Materials/RoseWoodMCS", - "wallMaterial": "Custom/Materials/OrangeWoodMCS", - "roomDimensions": { - "x": 14, - "y": 3, - "z": 14 - }, - "performerStart": { - "position": { - "x": -6.5, - "z": 0 - }, - "rotation": { - "x": 0, - "y": 70 - } - }, - "lava": [ - { "x": 4, "z": 4 }, - { "x": 3, "z": 4 }, - { "x": 2, "z": 4 }, - { "x": 1, "z": 4 }, - { "x": 0, "z": 4 }, - { "x": 4, "z": 3 }, - { "x": 3, "z": 3 }, - { "x": 2, "z": 3 }, - { "x": 1, "z": 3 }, - { "x": 0, "z": 3 }, - { "x": 4, "z": 2 }, - { "x": 3, "z": 2 }, - { "x": 1, "z": 2 }, - { "x": 0, "z": 2 }, - { "x": 4, "z": 1 }, - { "x": 3, "z": 1 }, - { "x": 2, "z": 1 }, - { "x": 1, "z": 1 }, - { "x": 0, "z": 1 }, - { "x": 4, "z": 0 }, - { "x": 3, "z": 0 }, - { "x": 2, "z": 0 }, - { "x": 1, "z": 0 }, - { "x": 0, "z": 0 } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 2, - "y": 0.22, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "tool", - "type": "tool_rect_0_50_x_5_00", - "shows": [{ - "stepBegin": 0, - "position": { - "x": -3.5, - "y": 0.15, - "z": 2 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }] -} diff --git a/docs/source/scenes/tool_use_eval_5_ex_3.json b/docs/source/scenes/tool_use_eval_5_ex_3.json deleted file mode 100644 index a8334c4cc..000000000 --- a/docs/source/scenes/tool_use_eval_5_ex_3.json +++ /dev/null @@ -1,132 +0,0 @@ -{ - "name": "tool_use_eval_5_ex_3", - "version": 2, - "ceilingMaterial": "Custom/Materials/WhiteDrywallMCS", - "floorMaterial": "Custom/Materials/SpringGreenDrywallMCS", - "wallMaterial": "Custom/Materials/VioletDrywallMCS", - "roomDimensions": { - "x": 24, - "y": 3, - "z": 24 - }, - "performerStart": { - "position": { - "x": -2, - "z": 10 - }, - "rotation": { - "x": 0, - "y": 170 - } - }, - "lava": [ - { "x": -3, "z": -1 }, - { "x": -2, "z": -1 }, - { "x": -1, "z": -1 }, - { "x": 0, "z": -1 }, - { "x": 1, "z": -1 }, - { "x": 2, "z": -1 }, - { "x": 3, "z": -1 }, - { "x": -3, "z": -2 }, - { "x": -2, "z": -2 }, - { "x": -1, "z": -2 }, - { "x": 0, "z": -2 }, - { "x": 1, "z": -2 }, - { "x": 2, "z": -2 }, - { "x": 3, "z": -2 }, - { "x": -3, "z": -3 }, - { "x": -2, "z": -3 }, - { "x": -1, "z": -3 }, - { "x": 0, "z": -3 }, - { "x": 1, "z": -3 }, - { "x": 2, "z": -3 }, - { "x": 3, "z": -3 }, - { "x": -3, "z": -4 }, - { "x": -2, "z": -4 }, - { "x": 2, "z": -4 }, - { "x": 3, "z": -4 }, - { "x": -3, "z": -5 }, - { "x": -2, "z": -5 }, - { "x": 2, "z": -5 }, - { "x": 3, "z": -5 }, - { "x": -3, "z": -6 }, - { "x": -2, "z": -6 }, - { "x": 2, "z": -6 }, - { "x": 3, "z": -6 }, - { "x": -3, "z": -7 }, - { "x": -2, "z": -7 }, - { "x": -1, "z": -7 }, - { "x": 0, "z": -7 }, - { "x": 1, "z": -7 }, - { "x": 2, "z": -7 }, - { "x": 3, "z": -7 }, - { "x": -3, "z": -8 }, - { "x": -2, "z": -8 }, - { "x": -1, "z": -8 }, - { "x": 0, "z": -8 }, - { "x": 1, "z": -8 }, - { "x": 2, "z": -8 }, - { "x": 3, "z": -8 }, - { "x": -3, "z": -9 }, - { "x": -2, "z": -9 }, - { "x": -1, "z": -9 }, - { "x": 0, "z": -9 }, - { "x": 1, "z": -9 }, - { "x": 2, "z": -9 }, - { "x": 3, "z": -9 } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.22, - "z": -5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "tool", - "type": "tool_rect_1_00_x_9_00", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.15, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }] -} diff --git a/docs/source/scenes/tool_use_eval_5_ex_4.json b/docs/source/scenes/tool_use_eval_5_ex_4.json deleted file mode 100644 index c3f4389eb..000000000 --- a/docs/source/scenes/tool_use_eval_5_ex_4.json +++ /dev/null @@ -1,132 +0,0 @@ -{ - "name": "tool_use_eval_5_ex_4", - "version": 2, - "ceilingMaterial": "Custom/Materials/WhiteDrywallMCS", - "floorMaterial": "Custom/Materials/SpringGreenDrywallMCS", - "wallMaterial": "Custom/Materials/VioletDrywallMCS", - "roomDimensions": { - "x": 24, - "y": 3, - "z": 24 - }, - "performerStart": { - "position": { - "x": -2, - "z": 10 - }, - "rotation": { - "x": 0, - "y": 170 - } - }, - "lava": [ - { "x": -3, "z": -1 }, - { "x": -2, "z": -1 }, - { "x": -1, "z": -1 }, - { "x": 0, "z": -1 }, - { "x": 1, "z": -1 }, - { "x": 2, "z": -1 }, - { "x": 3, "z": -1 }, - { "x": -3, "z": -2 }, - { "x": -2, "z": -2 }, - { "x": -1, "z": -2 }, - { "x": 0, "z": -2 }, - { "x": 1, "z": -2 }, - { "x": 2, "z": -2 }, - { "x": 3, "z": -2 }, - { "x": -3, "z": -3 }, - { "x": -2, "z": -3 }, - { "x": -1, "z": -3 }, - { "x": 0, "z": -3 }, - { "x": 1, "z": -3 }, - { "x": 2, "z": -3 }, - { "x": 3, "z": -3 }, - { "x": -3, "z": -4 }, - { "x": -2, "z": -4 }, - { "x": 2, "z": -4 }, - { "x": 3, "z": -4 }, - { "x": -3, "z": -5 }, - { "x": -2, "z": -5 }, - { "x": 2, "z": -5 }, - { "x": 3, "z": -5 }, - { "x": -3, "z": -6 }, - { "x": -2, "z": -6 }, - { "x": 2, "z": -6 }, - { "x": 3, "z": -6 }, - { "x": -3, "z": -7 }, - { "x": -2, "z": -7 }, - { "x": -1, "z": -7 }, - { "x": 0, "z": -7 }, - { "x": 1, "z": -7 }, - { "x": 2, "z": -7 }, - { "x": 3, "z": -7 }, - { "x": -3, "z": -8 }, - { "x": -2, "z": -8 }, - { "x": -1, "z": -8 }, - { "x": 0, "z": -8 }, - { "x": 1, "z": -8 }, - { "x": 2, "z": -8 }, - { "x": 3, "z": -8 }, - { "x": -3, "z": -9 }, - { "x": -2, "z": -9 }, - { "x": -1, "z": -9 }, - { "x": 0, "z": -9 }, - { "x": 1, "z": -9 }, - { "x": 2, "z": -9 }, - { "x": 3, "z": -9 } - ], - "goal": { - "category": "retrieval", - "metadata": { - "target": { - "id": "target" - } - }, - "description": "Find and pick up the tiny light black white rubber ball.", - "last_step": 2500 - }, - "objects": [{ - "id": "target", - "type": "soccer_ball", - "mass": 1, - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.22, - "z": -5 - }, - "rotation": { - "x": 0, - "y": 0, - "z": 0 - }, - "scale": { - "x": 2, - "y": 2, - "z": 2 - } - }] - }, { - "id": "tool", - "type": "tool_rect_1_00_x_9_00", - "shows": [{ - "stepBegin": 0, - "position": { - "x": 0, - "y": 0.15, - "z": 4.5 - }, - "rotation": { - "x": 0, - "y": 90, - "z": 0 - }, - "scale": { - "x": 1, - "y": 1, - "z": 1 - } - }] - }] -} From 4702f38701e2706e672a8a0467ae6ca115c2ffc2 Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Wed, 13 Dec 2023 09:33:44 -0500 Subject: [PATCH 10/11] MCS-1991 Added links in our sphinx docs to the new task list page. --- docs/source/scenes.rst | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/docs/source/scenes.rst b/docs/source/scenes.rst index 798e0c15c..6eb5e28ba 100644 --- a/docs/source/scenes.rst +++ b/docs/source/scenes.rst @@ -4,7 +4,7 @@ Example Scenes Interactive Scenes ------------------ -For more interactive scenes, please see TODO +For more example interactive scenes, please see our `task list `_ page. Playroom ******** @@ -38,12 +38,12 @@ Soccer ball hidden inside hinged containers: Passive Agent Scenes -------------------- -For more passive agent scenes, please see TODO +For more example passive agent scenes, please see our `task list `_ page. Passive Physics Scenes ---------------------- -For more passive physics scenes, please see TODO +For more example passive physics scenes, please see our `task list `_ page. Simple Scenes ------------- From 4726450b02a2ce6f833e2a6d0930aa1b069c4f3c Mon Sep 17 00:00:00 2001 From: Thomas Schellenberg Date: Thu, 14 Dec 2023 11:48:05 -0500 Subject: [PATCH 11/11] Update TASK_LIST.md --- TASK_LIST.md | 18 +++++++++++++++--- 1 file changed, 15 insertions(+), 3 deletions(-) diff --git a/TASK_LIST.md b/TASK_LIST.md index 01619955a..71b5949b4 100644 --- a/TASK_LIST.md +++ b/TASK_LIST.md @@ -80,7 +80,11 @@ Each trial, or "scene", for an interactive task occurs within a procedurally gen ### Interactive Data -TODO DOWNLOAD +- Eval 7: https://eval-7.s3.amazonaws.com/eval_7_interactive.zip +- Eval 6: https://eval-6.s3.amazonaws.com/eval_6_interactive_all.zip +- Debug scene files for the MCS scoring software and evaluation UI: + - Eval 7: https://eval-7.s3.amazonaws.com/eval_7_interactive_debug.zip + - Eval 6: https://eval-6.s3.amazonaws.com/eval_6_interactive_debug_all.zip Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/ @@ -1061,7 +1065,11 @@ Each trial, or "scene", for a passive physics task occurs within a procedurally ### Passive Physics Data -TODO DOWNLOAD +- Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_physics.zip +- Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_physics.zip +- Debug scene files for the MCS scoring software and evaluation UI: + - Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_physics_debug.zip + - Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_physics_debug.zip Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/ @@ -1173,7 +1181,11 @@ https://github.com/NextCenturyCorporation/MCS/assets/10994382/f310c0d4-bbc5-41f8 ### Other Data -TODO DOWNLOAD +- Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_other.zip +- Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_other.zip +- Debug scene files for the MCS scoring software and evaluation UI: + - Eval 7: https://eval-7.s3.amazonaws.com/eval_7_passive_other_debug.zip + - Eval 6: https://eval-6.s3.amazonaws.com/eval_6_passive_other_debug.zip Training scenes for the following tasks can be made using the ILE Scene Generator: https://github.com/NextCenturyCorporation/mcs-scene-generator/