Every valid task receives partial credit from 0 to 1.
Each task divides one reward point across its active categories. The page groups repetitive atomic checks into a smaller set of parent criteria for readability; expanding a parent reveals the original checks and exact allocated credit.
Neon Last Mile
Evaluation input
# Neon Last Mile Create a rainy neon alley at night. A compact autonomous courier drives from the alley entrance, steers around two construction barriers, and stops beneath a DELIVERY sign. Its cargo hatch opens at the destination. The scene must include a wet road, modular facades on both sides, visible utility pipes, neon signs, the courier, two barriers, a route curve, and hero/side/top cameras. Animate frames 1-180: travel during 1-140 and hatch opening during 145-175. Deliver `output/final.blend`, `output/final.glb`, four renders, and `output/validation.json`. Use only Blender built-ins and procedural geometry.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure25% of total · 0.250 / 0.250
| Result | Verifier check | Earned / max | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Required scene entitiesTask contract | 0.056 / 0.056 | ||||||||||||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| ||||||||||||||||||||||||||
| CREDIT | Semantic organization and coverageTask contract | 0.097 / 0.097 | ||||||||||||||||||||||||
View 7 atomic checks · 7/7 receiving credit
| ||||||||||||||||||||||||||
| CREDIT | Scene metadata and camera setupTask contract | 0.028 / 0.028 | ||||||||||||||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||||||||||||||
| CREDIT | Object types, hierarchy, and materialsBehavior rubric | 0.069 / 0.069 | ||||||||||||||||||||||||
View 5 atomic checks · 5/5 receiving credit
| ||||||||||||||||||||||||||
Spatial relationships20% of total · 0.200 / 0.200
| Result | Verifier check | Earned / max |
|---|---|---|
| CREDIT | Key spatial outcomesBehavior rubric | 0.200 / 0.200 |
Animation behavior25% of total · 0.200 / 0.250
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Timeline coverageTask contract | 0.050 / 0.050 | |||||||||||||||
| PARTIAL | Requested animation sequenceBehavior rubric | 0.150 / 0.200 | |||||||||||||||
View 4 atomic checks · 3/4 receiving credit
| |||||||||||||||||
Deliverable integrity15% of total · 0.150 / 0.150
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | External asset resolutionDelivery contract | 0.030 / 0.030 | |||||||||
| CREDIT | Required deliverable filesDelivery contract | 0.060 / 0.060 | |||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||
| CREDIT | Exported asset integrityDelivery contract | 0.060 / 0.060 | |||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||
Rendered evidence15% of total · 0.120 / 0.150
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Required rendered view setDelivery contract | 0.090 / 0.120 | |||||||||||||||
View 4 atomic checks · 3/4 receiving credit
| |||||||||||||||||
| CREDIT | Independent verifier renderDelivery contract | 0.030 / 0.030 | |||||||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "01-neon-last-mile",
"required_collections": ["ENVIRONMENT", "COURIER", "LIGHTING"],
"required_objects": ["ROAD_Wet", "COURIER_Body", "COURIER_Hatch", "ROUTE_Courier"],
"object_counts": [
{"pattern": "FACADE_*", "min": 6},
{"pattern": "SIGN_Neon_*", "min": 8},
{"pattern": "PIPE_*", "min": 6},
{"pattern": "BARRIER_*", "min": 2, "max": 2}
],
"animated_objects": [{"pattern": "COURIER_*", "min": 2}],
"min_cameras": 3,
"min_frame_end": 180,
"scene_properties": {"showcase_case_id": "01-neon-last-mile"}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Orbital Repair Bay
Evaluation input
# Orbital Repair Bay Build a cinematic orbital maintenance bay around a damaged communications satellite. Two articulated repair arms coordinate a repair: one stabilizes the satellite while the other removes a damaged panel and installs a replacement. Include Earth as a curved background, bay trusses, work lights, warning beacons, and drifting particles. Animate frames 1-240 with a readable approach, grasp, panel swap, and inspection sequence. All arm joints must have explicit hierarchy or constraints. Deliver an editable Blend, GLB, hero/wide/top renders, and validation JSON.
Text-only task · no source image supplied

Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure30% of total · 0.000 / 0.300
| Result | Verifier check | Earned / max | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required scene entitiesTask contract | 0.000 / 0.071 | |||||||||||||||||||||||||||
View 4 atomic checks · 0/4 receiving credit
| |||||||||||||||||||||||||||||
| NOT EVALUABLE | Semantic organization and coverageTask contract | 0.000 / 0.141 | |||||||||||||||||||||||||||
View 8 atomic checks · 0/8 receiving credit
| |||||||||||||||||||||||||||||
| NOT EVALUABLE | Scene metadata and camera setupTask contract | 0.000 / 0.035 | |||||||||||||||||||||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||||||||||||||||||||
| NOT EVALUABLE | Object types, hierarchy, and materialsBehavior rubric | 0.000 / 0.053 | |||||||||||||||||||||||||||
View 3 atomic checks · 0/3 receiving credit
| |||||||||||||||||||||||||||||
Spatial relationships20% of total · 0.000 / 0.200
| Result | Verifier check | Earned / max | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Key spatial outcomesBehavior rubric | 0.000 / 0.200 | ||||||||||||
View 3 atomic checks · 0/3 receiving credit
| ||||||||||||||
Animation behavior25% of total · 0.000 / 0.250
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Timeline coverageTask contract | 0.000 / 0.050 | |||||||||||||||
| NOT EVALUABLE | Requested animation sequenceBehavior rubric | 0.000 / 0.200 | |||||||||||||||
View 4 atomic checks · 0/4 receiving credit
| |||||||||||||||||
Deliverable integrity15% of total · 0.000 / 0.150
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | External asset resolutionDelivery contract | 0.000 / 0.030 | |||||||||
| NO CREDIT | Required deliverable filesDelivery contract | 0.000 / 0.060 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
| NOT EVALUABLE | Exported asset integrityDelivery contract | 0.000 / 0.060 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
Rendered evidence10% of total · 0.000 / 0.100
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required rendered view setDelivery contract | 0.000 / 0.080 | |||||||||||||||
View 4 atomic checks · 0/4 receiving credit
| |||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.020 | |||||||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "02-orbital-repair-bay",
"required_collections": ["BAY", "SATELLITE", "ARM_A", "ARM_B"],
"required_objects": ["SATELLITE_Core", "PANEL_Damaged", "PANEL_Replacement", "EARTH_Backdrop"],
"object_counts": [
{"pattern": "ARM_A_Joint_*", "min": 4},
{"pattern": "ARM_B_Joint_*", "min": 4},
{"pattern": "TRUSS_*", "min": 6},
{"pattern": "BEACON_*", "min": 4}
],
"animated_objects": [{"pattern": "ARM_*", "min": 4}, {"pattern": "PANEL_*", "min": 1}],
"min_cameras": 3,
"min_frame_end": 240,
"scene_properties": {"showcase_case_id": "02-orbital-repair-bay"}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Kinetic Watch
Evaluation input
# Kinetic Watch Create a premium skeleton watch with a readable case, crystal, dial ring, hands, crown, movement plates, balance wheel, and at least eight gears. Produce an exploded animation that separates the assembly along its depth axis and returns every part to its original transform without intersection. Frames 1-60 show the assembled watch, 61-150 explode it, 151-240 hold and orbit the camera, and 241-330 reassemble it. The balance wheel and gear train continue moving. Deliver macro hero, exploded, side, and top renders plus Blend, GLB, and validation.
Text-only task · no source image supplied
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure25% of total · 0.000 / 0.294
| Result | Verifier check | Earned / max | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required scene entitiesTask contract | 0.000 / 0.088 | ||||||||||||||||||||||||
View 6 atomic checks · 0/6 receiving credit
| ||||||||||||||||||||||||||
| NOT EVALUABLE | Semantic organization and coverageTask contract | 0.000 / 0.103 | ||||||||||||||||||||||||
View 7 atomic checks · 0/7 receiving credit
| ||||||||||||||||||||||||||
| NOT EVALUABLE | Scene metadata and camera setupTask contract | 0.000 / 0.029 | ||||||||||||||||||||||||
View 2 atomic checks · 0/2 receiving credit
| ||||||||||||||||||||||||||
| NOT EVALUABLE | Object types, hierarchy, and materialsBehavior rubric | 0.000 / 0.074 | ||||||||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||||||||
Animation behavior30% of total · 0.000 / 0.353
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Timeline coverageTask contract | 0.000 / 0.059 | ||||||||||||||||||
| NOT EVALUABLE | Requested animation sequenceBehavior rubric | 0.000 / 0.294 | ||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||
Deliverable integrity15% of total · 0.000 / 0.176
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | External asset resolutionDelivery contract | 0.000 / 0.035 | |||||||||
| NO CREDIT | Required deliverable filesDelivery contract | 0.000 / 0.071 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
| NOT EVALUABLE | Exported asset integrityDelivery contract | 0.000 / 0.071 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
Rendered evidence15% of total · 0.000 / 0.176
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NO CREDIT | Required rendered view setDelivery contract | 0.000 / 0.147 | ||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.029 | ||||||||||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "03-kinetic-watch",
"required_collections": ["CASE", "MOVEMENT", "HANDS", "CAMERAS"],
"required_objects": ["WATCH_Case", "WATCH_Crystal", "WATCH_Crown", "Balance_Wheel", "Hand_Hour", "Hand_Minute"],
"object_counts": [
{"pattern": "Gear_*", "min": 8},
{"pattern": "Screw_*", "min": 6},
{"pattern": "Movement_Plate_*", "min": 2}
],
"animated_objects": [{"pattern": "Gear_*", "min": 4}, {"pattern": "WATCH_*", "min": 2}],
"min_cameras": 3,
"min_frame_end": 330,
"scene_properties": {"showcase_case_id": "03-kinetic-watch"}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Deployable Rescue Drone
Evaluation input
# Deployable Rescue Drone Design a compact quadcopter carried as a rectangular backpack module. Four folded arms deploy symmetrically, rotor blades unfold, landing feet extend, and a winch lowers a medical package onto a marked landing zone in a storm-damaged street. Animate frames 1-220: arm deployment, rotor startup, short flight, hover, winch drop, and stable package placement. Show folded and deployed dimensions with measurement objects. Deliver Blend, GLB, four views, and validation JSON.
Text-only task · no source image supplied

Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure25% of total · 0.000 / 0.250
| Result | Verifier check | Earned / max | ||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required scene entitiesTask contract | 0.000 / 0.045 | ||||||||||||||||||||||||||||||
View 4 atomic checks · 0/4 receiving credit
| ||||||||||||||||||||||||||||||||
| NOT EVALUABLE | Semantic organization and coverageTask contract | 0.000 / 0.080 | ||||||||||||||||||||||||||||||
View 7 atomic checks · 0/7 receiving credit
| ||||||||||||||||||||||||||||||||
| NOT EVALUABLE | Scene metadata and camera setupTask contract | 0.000 / 0.023 | ||||||||||||||||||||||||||||||
View 2 atomic checks · 0/2 receiving credit
| ||||||||||||||||||||||||||||||||
| NOT EVALUABLE | Object types, hierarchy, and materialsBehavior rubric | 0.000 / 0.102 | ||||||||||||||||||||||||||||||
View 9 atomic checks · 0/9 receiving credit
| ||||||||||||||||||||||||||||||||
Spatial relationships20% of total · 0.000 / 0.200
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Key spatial outcomesBehavior rubric | 0.000 / 0.200 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
Animation behavior30% of total · 0.000 / 0.300
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Timeline coverageTask contract | 0.000 / 0.050 | ||||||||||||||||||
| NOT EVALUABLE | Requested animation sequenceBehavior rubric | 0.000 / 0.250 | ||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||
Deliverable integrity15% of total · 0.000 / 0.150
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | External asset resolutionDelivery contract | 0.000 / 0.030 | |||||||||
| NO CREDIT | Required deliverable filesDelivery contract | 0.000 / 0.060 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
| NOT EVALUABLE | Exported asset integrityDelivery contract | 0.000 / 0.060 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
Rendered evidence10% of total · 0.000 / 0.100
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required rendered view setDelivery contract | 0.000 / 0.083 | ||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.017 | ||||||||||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "04-rescue-drone",
"required_collections": ["DRONE", "PAYLOAD", "RESCUE_SITE"],
"required_objects": ["DRONE_Core", "WINCH_Cable", "PAYLOAD_Medical", "LANDING_Target"],
"object_counts": [
{"pattern": "ARM_*", "min": 4, "max": 4},
{"pattern": "ROTOR_*", "min": 4, "max": 4},
{"pattern": "FOOT_*", "min": 4},
{"pattern": "RUBBLE_*", "min": 8}
],
"animated_objects": [{"pattern": "ARM_*", "min": 4}, {"pattern": "ROTOR_*", "min": 4}, {"pattern": "PAYLOAD_*", "min": 1}],
"min_cameras": 3,
"min_frame_end": 220,
"scene_properties": {"showcase_case_id": "04-rescue-drone"}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
48 sqm, Three Lives
Evaluation input
# 48 sqm, Three Lives Build one 8 m by 6 m apartment shell and furnish three mutually exclusive versions: SOLO for a remote developer, FAMILY for two adults and one child, and ACCESSIBLE for an older resident using a walker. The shell, doors, windows, cameras, and lighting must remain identical so the three layouts can be compared directly. Each layout needs sleeping, cooking, dining, working, storage, and bathroom functions. Keep a continuous entrance-to-bed circulation path and add named clearance proxy objects: 0.8 m minimum for SOLO/FAMILY and 1.0 m for ACCESSIBLE. Deliver three matched hero renders, one top comparison, Blend, GLB, and validation.
Text-only task · no source image supplied

Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure40% of total · 0.000 / 0.400
| Result | Verifier check | Earned / max | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | Required scene entitiesTask contract | 0.000 / 0.064 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
View 4 atomic checks · 0/4 receiving credit
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| NOT EVALUABLE | Semantic organization and coverageTask and delivery contract | 0.000 / 0.288 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
View 18 atomic checks · 0/18 receiving credit
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| NOT EVALUABLE | Scene metadata and camera setupTask contract | 0.000 / 0.048 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
View 3 atomic checks · 0/3 receiving credit
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Spatial relationships15% of total · 0.000 / 0.150
| Result | Verifier check | Earned / max |
|---|---|---|
| NOT EVALUABLE | Key spatial outcomesBehavior rubric | 0.000 / 0.150 |
Animation behavior0% of total · 0.000 / 0.000
| Result | Verifier check | Earned / max |
|---|---|---|
| INFORMATIONAL | Timeline coverageTask contract | 0.000 / 0.000 |
Deliverable integrity20% of total · 0.000 / 0.200
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT EVALUABLE | External asset resolutionDelivery contract | 0.000 / 0.040 | |||||||||
| NO CREDIT | Required deliverable filesDelivery contract | 0.000 / 0.080 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
| NOT EVALUABLE | Exported asset integrityDelivery contract | 0.000 / 0.080 | |||||||||
View 2 atomic checks · 0/2 receiving credit
| |||||||||||
Rendered evidence25% of total · 0.000 / 0.250
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NO CREDIT | Required rendered view setDelivery contract | 0.000 / 0.208 | ||||||||||||||||||
View 5 atomic checks · 0/5 receiving credit
| ||||||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.042 | ||||||||||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "05-micro-apartment",
"required_collections": ["SHELL_SHARED", "LAYOUT_SOLO", "LAYOUT_FAMILY", "LAYOUT_ACCESSIBLE"],
"required_objects": ["SHELL_Floor_8x6", "DOOR_Entrance", "CAM_Hero", "CAM_Top"],
"object_counts": [
{"pattern": "SOLO_Furniture_*", "min": 8},
{"pattern": "FAMILY_Furniture_*", "min": 10},
{"pattern": "ACCESSIBLE_Furniture_*", "min": 8},
{"pattern": "CLEARANCE_*", "min": 3}
],
"min_cameras": 2,
"min_frame_end": 1,
"scene_properties": {"showcase_case_id": "05-micro-apartment", "floor_area_sqm": 48}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Autonomous Warehouse: The Last Box
Evaluation input
# Autonomous Warehouse: The Last Box Create a compact fulfillment cell with three rack aisles. An AMR starts at charging, navigates around a temporary blocked aisle, receives a box from a pick station, and delivers it to a palletizing robot arm. The arm places the box on a pallet and both machines return to a safe idle state. Animate frames 1-300. Include a visible planned route, blocked zone, safety perimeter, fork sensors, pick station, pallet, and status lights. No moving machine may cross the safety perimeter while the other is active. Deliver Blend, GLB, four views, and a validation report.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure25% of total · 0.224 / 0.250
| Result | Verifier check | Earned / max | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Required scene entitiesTask contract | 0.079 / 0.079 | |||||||||||||||||||||||||||
View 6 atomic checks · 6/6 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Semantic organization and coverageTask contract | 0.105 / 0.105 | |||||||||||||||||||||||||||
View 8 atomic checks · 8/8 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Scene metadata and camera setupTask contract | 0.026 / 0.026 | |||||||||||||||||||||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||||||||||||||||||||
| PARTIAL | Object types, hierarchy, and materialsBehavior rubric | 0.013 / 0.039 | |||||||||||||||||||||||||||
View 3 atomic checks · 1/3 receiving credit
| |||||||||||||||||||||||||||||
Spatial relationships25% of total · 0.188 / 0.250
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Key spatial outcomesBehavior rubric | 0.188 / 0.250 | |||||||||||||||
View 4 atomic checks · 3/4 receiving credit
| |||||||||||||||||
Animation behavior25% of total · 0.250 / 0.250
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Timeline coverageTask contract | 0.042 / 0.042 | ||||||||||||||||||
| CREDIT | Requested animation sequenceBehavior rubric | 0.208 / 0.208 | ||||||||||||||||||
View 5 atomic checks · 5/5 receiving credit
| ||||||||||||||||||||
Deliverable integrity10% of total · 0.083 / 0.100
| Result | Verifier check | Earned / max | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | External asset resolutionDelivery contract | 0.017 / 0.017 | ||||||||||||
| PARTIAL | Required deliverable filesDelivery contract | 0.033 / 0.050 | ||||||||||||
View 3 atomic checks · 2/3 receiving credit
| ||||||||||||||
| CREDIT | Exported asset integrityDelivery contract | 0.033 / 0.033 | ||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||
Rendered evidence10% of total · 0.050 / 0.100
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Required rendered view setDelivery contract | 0.050 / 0.083 | ||||||||||||||||||
View 5 atomic checks · 3/5 receiving credit
| ||||||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.017 | ||||||||||||||||||
Structured reports5% of total · 0.000 / 0.050
| Result | Verifier check | Earned / max |
|---|---|---|
| NO CREDIT | Structured report validityDelivery contract | 0.000 / 0.050 |
Rollout trajectory timeline
Task structural contract
{
"case_id": "06-autonomous-warehouse",
"required_collections": ["WAREHOUSE", "AMR", "ROBOT_ARM", "SAFETY"],
"required_objects": ["AMR_Body", "ROUTE_AMR", "ZONE_Blocked", "ZONE_Safety", "BOX_Last", "PALLET_Target"],
"object_counts": [
{"pattern": "RACK_*", "min": 9},
{"pattern": "ARM_Joint_*", "min": 4},
{"pattern": "ROUTE_Waypoint_*", "min": 6},
{"pattern": "STATUS_Light_*", "min": 3}
],
"animated_objects": [{"pattern": "AMR_*", "min": 1}, {"pattern": "ARM_*", "min": 3}, {"pattern": "BOX_*", "min": 1}],
"min_cameras": 3,
"min_frame_end": 300,
"scene_properties": {"showcase_case_id": "06-autonomous-warehouse"}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Boss Room: 15 FPS to 60 FPS
Evaluation input
# Boss Room: 15 FPS to 60 FPS Create a ruined cathedral boss arena and preserve two comparable collections: BASELINE_HIGH and DELIVERY_OPTIMIZED. The optimized version must retain the hero-camera silhouette and material identity while using instancing for repeated architecture, three LOD levels for hero assets, simple collision proxies, and consolidated materials. The final report must record triangle counts for both versions, optimized-to-baseline ratio, unique mesh count, material count, and GLB size. Target at most 35% of baseline triangles and no more than 24 optimized materials. Deliver matched before/after renders, top view, Blend, optimized GLB, and validation JSON.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure45% of total · 0.447 / 0.474
| Result | Verifier check | Earned / max | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Required scene entitiesTask contract | 0.079 / 0.079 | |||||||||||||||||||||||||||
View 3 atomic checks · 3/3 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Semantic organization and coverageTask contract | 0.211 / 0.211 | |||||||||||||||||||||||||||
View 8 atomic checks · 8/8 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Scene metadata and camera setupTask contract | 0.079 / 0.079 | |||||||||||||||||||||||||||
View 3 atomic checks · 3/3 receiving credit
| |||||||||||||||||||||||||||||
| PARTIAL | Object types, hierarchy, and materialsBehavior rubric | 0.079 / 0.105 | |||||||||||||||||||||||||||
View 4 atomic checks · 3/4 receiving credit
| |||||||||||||||||||||||||||||
Animation behavior0% of total · 0.000 / 0.000
| Result | Verifier check | Earned / max |
|---|---|---|
| INFORMATIONAL | Timeline coverageTask contract | 0.000 / 0.000 |
Deliverable integrity25% of total · 0.263 / 0.263
| Result | Verifier check | Earned / max | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | External asset resolutionDelivery contract | 0.044 / 0.044 | ||||||||||||
| CREDIT | Required deliverable filesDelivery contract | 0.132 / 0.132 | ||||||||||||
View 3 atomic checks · 3/3 receiving credit
| ||||||||||||||
| CREDIT | Exported asset integrityDelivery contract | 0.088 / 0.088 | ||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||
Rendered evidence15% of total · 0.095 / 0.158
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Required rendered view setDelivery contract | 0.063 / 0.126 | |||||||||||||||
View 4 atomic checks · 2/4 receiving credit
| |||||||||||||||||
| CREDIT | Independent verifier renderDelivery contract | 0.032 / 0.032 | |||||||||||||||
Structured reports10% of total · 0.000 / 0.105
| Result | Verifier check | Earned / max |
|---|---|---|
| NO CREDIT | Structured report validityDelivery contract | 0.000 / 0.105 |
Rollout trajectory timeline
Task structural contract
{
"case_id": "07-boss-room-optimization",
"required_collections": ["BASELINE_HIGH", "DELIVERY_OPTIMIZED", "COLLISION"],
"required_objects": ["ARENA_Floor", "BOSS_Altar", "CAM_Comparison"],
"object_counts": [
{"pattern": "OPT_Column_*", "min": 12},
{"pattern": "LOD0_*", "min": 3},
{"pattern": "LOD1_*", "min": 3},
{"pattern": "LOD2_*", "min": 3},
{"pattern": "UCX_*", "min": 8}
],
"min_cameras": 3,
"min_frame_end": 1,
"scene_properties": {"showcase_case_id": "07-boss-room-optimization", "optimization_report_present": true}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Save the Friday Build
Evaluation input
# Save the Friday Build Repair the supplied broken product-launch scene without rebuilding it from scratch. The scene contains twelve seeded defects spanning missing material links, inverted normals, wrong scale, broken parenting, an offset camera target, disabled lights, intersections, duplicate objects, a detached mechanical joint, invalid frame range, missing export collection membership, and an incorrect output color transform. First create `output/diagnosis.json` listing each suspected defect and affected object. Then repair the scene with minimal edits, preserving unaffected object transforms and names. Deliver repaired Blend and GLB, four renders, `output/change_log.json`, and validation. Do not delete the `FAULT_MANIFEST` text block.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Input validityvalidation gate · N/A
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| INVALID | Canonical task inputInput contract | gate | |||||||||
View 2 atomic checks · 0/2 checks valid
| |||||||||||
Scene structure25% of total · 0.278 / 0.278
| Result | Verifier check | Earned / max | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT SCORED | Required scene entitiesTask contract | N/A / 0.088 | ||||||||||||||||||||||||
View 6 atomic checks · 6/6 receiving credit
| ||||||||||||||||||||||||||
| NOT SCORED | Semantic organization and coverageTask and delivery contract | N/A / 0.102 | ||||||||||||||||||||||||
View 7 atomic checks · 7/7 receiving credit
| ||||||||||||||||||||||||||
| NOT SCORED | Scene metadata and camera setupTask contract | N/A / 0.058 | ||||||||||||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| ||||||||||||||||||||||||||
| NOT SCORED | Object types, hierarchy, and materialsBehavior rubric | N/A / 0.029 | ||||||||||||||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||||||||||||||
Animation behavior15% of total · 0.167 / 0.167
| Result | Verifier check | Earned / max |
|---|---|---|
| NOT SCORED | Timeline coverageTask contract | N/A / 0.083 |
| NOT SCORED | Requested animation sequenceBehavior rubric | N/A / 0.083 |
Deliverable integrity20% of total · 0.222 / 0.222
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT SCORED | External asset resolutionDelivery contract | N/A / 0.032 | |||||||||||||||
| NOT SCORED | Required deliverable filesDelivery contract | N/A / 0.127 | |||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| |||||||||||||||||
| NOT SCORED | Exported asset integrityDelivery contract | N/A / 0.063 | |||||||||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||||||||
Rendered evidence10% of total · 0.089 / 0.111
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT SCORED | Required rendered view setDelivery contract | N/A / 0.089 | |||||||||||||||
View 4 atomic checks · 3/4 receiving credit
| |||||||||||||||||
| NOT SCORED | Independent verifier renderDelivery contract | N/A / 0.022 | |||||||||||||||
Structured reports20% of total · 0.222 / 0.222
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| NOT SCORED | Structured report validityDelivery contract | N/A / 0.222 | |||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||
Rollout trajectory timeline
Task structural contract
{
"case_id": "08-friday-scene-rescue",
"required_collections": ["PRODUCT", "STAGE", "EXPORT"],
"required_objects": ["PRODUCT_Core", "PRODUCT_Joint", "CAM_Hero", "TARGET_Hero", "LIGHT_Key", "LIGHT_Rim"],
"object_counts": [
{"pattern": "FAULT_FIXED_*", "min": 12, "max": 12},
{"pattern": "PRODUCT_*", "min": 6},
{"pattern": "STAGE_*", "min": 4}
],
"animated_objects": [{"pattern": "PRODUCT_Joint", "min": 1}],
"min_cameras": 3,
"min_frame_end": 120,
"scene_properties": {"showcase_case_id": "08-friday-scene-rescue", "diagnosis_present": true, "change_log_present": true}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Guardian from Fragments
Evaluation input
# Guardian from Fragments Create an archaeological reconstruction showcase for a damaged stone guardian statue. Preserve two comparable collections: SOURCE_FRAGMENTS contains the discovered scan-like pieces in their catalogued positions, while RECONSTRUCTED contains the assembled interpretation. Keep uncertain or invented surfaces visibly distinct from confirmed stone without weakening the hero silhouette. Animate frames 1-240 as at least eight fragments move from an exploded survey layout into the reconstructed guardian. Include alignment pins, reference planes, gap markers, scale bars, and a color-coded uncertainty map. Write `output/reconstruction_report.json` with fragment counts, confirmed-versus-inferred surface estimates, unresolved gaps, and the reconstruction assumptions. Deliver matched source/reconstructed renders, exploded and top views, Blend, GLB, and validation JSON.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure35% of total · 0.368 / 0.389
| Result | Verifier check | Earned / max | ||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Required scene entitiesTask contract | 0.082 / 0.082 | ||||||||||||||||||||||||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| ||||||||||||||||||||||||||||||||||||||
| PARTIAL | Semantic organization and coverageTask and delivery contract | 0.205 / 0.225 | ||||||||||||||||||||||||||||||||||||
View 11 atomic checks · 10/11 receiving credit
| ||||||||||||||||||||||||||||||||||||||
| CREDIT | Scene metadata and camera setupTask contract | 0.061 / 0.061 | ||||||||||||||||||||||||||||||||||||
View 3 atomic checks · 3/3 receiving credit
| ||||||||||||||||||||||||||||||||||||||
| CREDIT | Object types, hierarchy, and materialsBehavior rubric | 0.020 / 0.020 | ||||||||||||||||||||||||||||||||||||
Animation behavior20% of total · 0.222 / 0.222
| Result | Verifier check | Earned / max | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Timeline coverageTask contract | 0.074 / 0.074 | |||||||||
| CREDIT | Requested animation sequenceBehavior rubric | 0.148 / 0.148 | |||||||||
View 2 atomic checks · 2/2 receiving credit
| |||||||||||
Deliverable integrity15% of total · 0.167 / 0.167
| Result | Verifier check | Earned / max | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | External asset resolutionDelivery contract | 0.028 / 0.028 | ||||||||||||
| CREDIT | Required deliverable filesDelivery contract | 0.083 / 0.083 | ||||||||||||
View 3 atomic checks · 3/3 receiving credit
| ||||||||||||||
| CREDIT | Exported asset integrityDelivery contract | 0.056 / 0.056 | ||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||
Rendered evidence10% of total · 0.037 / 0.111
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Required rendered view setDelivery contract | 0.019 / 0.093 | ||||||||||||||||||
View 5 atomic checks · 1/5 receiving credit
| ||||||||||||||||||||
| CREDIT | Independent verifier renderDelivery contract | 0.019 / 0.019 | ||||||||||||||||||
Structured reports10% of total · 0.000 / 0.111
| Result | Verifier check | Earned / max |
|---|---|---|
| NO CREDIT | Structured report validityDelivery contract | 0.000 / 0.111 |
Rollout trajectory timeline
Task structural contract
{
"case_id": "09-guardian-reconstruction",
"required_collections": [
"SOURCE_FRAGMENTS",
"RECONSTRUCTED",
"DOCUMENTATION"
],
"required_objects": [
"GUARDIAN_Core",
"RECON_Guardian",
"MAP_Uncertainty",
"CAM_Comparison"
],
"object_counts": [
{
"pattern": "FRAG_*",
"min": 16
},
{
"pattern": "ALIGN_Pin_*",
"min": 6
},
{
"pattern": "GAP_Uncertain_*",
"min": 4
},
{
"pattern": "REF_Plane_*",
"min": 3
}
],
"animated_objects": [
{
"pattern": "FRAG_*",
"min": 8
}
],
"min_cameras": 3,
"min_frame_end": 240,
"scene_properties": {
"showcase_case_id": "09-guardian-reconstruction",
"reconstruction_report_present": true
}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.
Stormwall: 90-Second Response
Evaluation input
# Stormwall: 90-Second Response Create a compact canal-district digital twin that responds to a fast storm surge. Show a normal public waterfront, rising water, sensor alerts, evacuation routing, and a modular flood barrier deploying before the surge reaches the protected plaza. The scene must communicate both the civic environment and the control-system logic. Animate frames 1-300. Include at least twelve independently named barrier modules, water-level sensors, warning beacons, protected and flood-risk zones, evacuation waypoints, and a visible control station. Barrier modules must deploy in a coordinated sequence and the protected zone must remain dry after full deployment. Write `output/emergency_plan.json` with the alert threshold, deployment sequence, evacuation route, sampled safety checks, and any remaining risk. Deliver calm/storm hero renders, side and top views, Blend, animated GLB, and validation JSON.
Text-only task · no source image supplied

Evaluated output asset · drag to orbit · scroll to zoom
Scannable criteria, complete checks
Parent criteria are shown first. Expand a grouped criterion to inspect every atomic check and its allocated credit. Exact numeric tolerances and internal observed values remain hidden.
Scene structure25% of total · 0.278 / 0.278
| Result | Verifier check | Earned / max | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Required scene entitiesTask contract | 0.069 / 0.069 | |||||||||||||||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Semantic organization and coverageTask contract | 0.139 / 0.139 | |||||||||||||||||||||||||||
View 8 atomic checks · 8/8 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Scene metadata and camera setupTask contract | 0.052 / 0.052 | |||||||||||||||||||||||||||
View 3 atomic checks · 3/3 receiving credit
| |||||||||||||||||||||||||||||
| CREDIT | Object types, hierarchy, and materialsBehavior rubric | 0.017 / 0.017 | |||||||||||||||||||||||||||
Animation behavior30% of total · 0.333 / 0.333
| Result | Verifier check | Earned / max | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | Timeline coverageTask contract | 0.067 / 0.067 | |||||||||||||||
| CREDIT | Requested animation sequenceBehavior rubric | 0.267 / 0.267 | |||||||||||||||
View 4 atomic checks · 4/4 receiving credit
| |||||||||||||||||
Deliverable integrity15% of total · 0.167 / 0.167
| Result | Verifier check | Earned / max | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CREDIT | External asset resolutionDelivery contract | 0.028 / 0.028 | ||||||||||||
| CREDIT | Required deliverable filesDelivery contract | 0.083 / 0.083 | ||||||||||||
View 3 atomic checks · 3/3 receiving credit
| ||||||||||||||
| CREDIT | Exported asset integrityDelivery contract | 0.056 / 0.056 | ||||||||||||
View 2 atomic checks · 2/2 receiving credit
| ||||||||||||||
Rendered evidence10% of total · 0.037 / 0.111
| Result | Verifier check | Earned / max | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PARTIAL | Required rendered view setDelivery contract | 0.037 / 0.093 | ||||||||||||||||||
View 5 atomic checks · 2/5 receiving credit
| ||||||||||||||||||||
| NO CREDIT | Independent verifier renderDelivery contract | 0.000 / 0.019 | ||||||||||||||||||
Structured reports10% of total · 0.000 / 0.111
| Result | Verifier check | Earned / max |
|---|---|---|
| NO CREDIT | Structured report validityDelivery contract | 0.000 / 0.111 |
Rollout trajectory timeline
Task structural contract
{
"case_id": "10-stormwall-response",
"required_collections": [
"CITY",
"WATER",
"BARRIER_SYSTEM",
"EVACUATION"
],
"required_objects": [
"WATER_Surge",
"BARRIER_Control",
"ZONE_Protected",
"ROUTE_Evacuation"
],
"object_counts": [
{
"pattern": "BARRIER_Module_*",
"min": 12
},
{
"pattern": "SENSOR_Water_*",
"min": 6
},
{
"pattern": "BUILDING_*",
"min": 6
},
{
"pattern": "ROUTE_Waypoint_*",
"min": 8
}
],
"animated_objects": [
{
"pattern": "BARRIER_Module_*",
"min": 8
},
{
"pattern": "WATER_*",
"min": 1
}
],
"min_cameras": 3,
"min_frame_end": 300,
"scene_properties": {
"showcase_case_id": "10-stormwall-response",
"emergency_plan_present": true
}
}
Sanitized rollout trajectory JSON
Available in the downloadable offline audit bundle.