Anates Labs

Physics-IQ Verified

Dataset-fix visual overview

Visual examples of the applied fixes behind Physics-IQ Verified.

Prompt audit

Prompt Quality

Factually Incorrect

The original prompt states something that does not match the recorded setup or event.

12 cases
0179Two balls pass
Original
Original prompt

A light-colored wooden tabletop with two pipes at the edges. A blue and yellow tennis ball roll out of the pipes and towards eachother. Static shot with no camera movement.

Switch frame
Original video
Problem

Ball color is incorrect:

... A blue and yellow tennis ball ...
... towards eachother ...

Consequence: The model spawns additional blue and yellow tennis balls.

Consequence
Verified
Verified prompt

A light-colored wooden tabletop with two pipes at the edges. A grey and a brown tennis ball roll fast out of the pipes. Static shot with no camera movement.

Outcome: No more blue and yellow tennis ball spawns.

Outcome
0170Basket lifts from ball
Original
Original prompt

A woven basket is hanging from a rope with a strong magnet attached to the bottom. An orange tennis ball is placed on a table beneath it. The basket is lowered and covers the ball and then the basket starts to lift again. Static shot with no camera movement.

Switch frame
Original video
Problem

Opposite action is described:

... The basket is lowered and covers the ball ...

Consequence: The model can generate a basket moving down to hide the ball, although the verified event is the lift.

Consequence
Verified
Verified prompt

A woven basket is hanging from an orange cord with a strong magnet attached to the bottom. An orange tennis ball is placed on a table beneath it. The basket is lifted to the top of the frame. Static shot with no camera movement.

Outcome: The action is anchored to the visible lift: basket rises to the top of the frame.

Outcome

Temporally Imprecise

The prompt describes the event timing incorrectly for image-to-video generation from the switch frame.

12 cases
0004Ball behind rotating paper
Original
Original prompt

A grabber arm is holding a tennis ball above a piece of cardstock propped up on a rotating platform sitting on a table that rotates clockwise. The grabber lowers the ball and places is on the table as the cardstock rotates. Static shot with no camera movement.

Switch frame
Original video
Problem

This already happened in the past

... is holding a tennis ball above ...

Consequence: The model may spawn additional grabbers from the top, or move the grabber upward and back down before releasing the ball.

Consequence
Verified
Verified prompt

A blue-black grabber tool is holding an orange tennis ball behind a piece of cardstock propped up on a black rotating platform sitting on a table. The platform rotates clockwise while the grabber releases the ball and places it on the table as the cardstock rotates. Static shot with no camera movement.

Outcome
0137Paper in water
Original
Original prompt

A small piece of crumpled white paper is being lowered into a tall glass containing blue liquid with a green band showing the water level. The crumpled paper is released into the glass. Static shot with no camera movement.

Switch frame
Original video
Problem

The switch frame already shows the release moment.

Consequence: Grabbers tend to spawn and move downward inside the glass.

Consequence
Verified
Verified prompt

A blue-black grabber tool is holding a small piece of crumpled white paper at the inner rim of a tall glass containing blue liquid with a green band marking the water level. The grabber then releases the paper into the glass. Static shot with no camera movement.

Outcome

Omitted Information

The prompt leaves out object identity, color, direction, or the key causal event needed to interpret the video.

54 cases
0125Mug break
Original
Original prompt

A yellow mug is held by a grabber tool in front of a white projection screen with a concrete brick positioned beneath it. The grabber releases the mug. Static shot with no camera movement.

Switch frame
Original video
Problem

What’s the material?

... A yellow mug ...

Consequence: It remains unclear if the mug does not break because of poor model generation or missing material information.

Consequence
Verified
Verified prompt

A yellow ceramic mug is held by a grabber tool in front of a white projection screen with a concrete brick positioned beneath it. The grabber releases the mug. Static shot with no camera movement.

Outcome
0019Ball ramp
Original
Original prompt

A simple ramp made of cardboard propped up by a blue block on a light-colored wooden table. There's a black pipe to the left of the frame and a yellow tennis ball rolls out of the pipe towards the ramp. Static shot with no camera movement.

Switch frame
Original video
Problem

The fix specifies that the ball rolls onto the ramp, not merely toward it.

Consequence
Verified
Verified prompt

A simple ramp made of cardboard propped up by a blue block on a light-colored wooden table. There's a black pipe to the left of the frame and a yellow tennis ball rolls out of the pipe onto the ramp. Static shot with no camera movement.

Outcome

Vague Language

The prompt uses language that can be interpreted in multiple physical ways.

9 cases
0172Stable blocks
Original
Original prompt

A pink block is being lowered towards a simple structure made of colorful blocks resembling a gate. Static shot with no camera movement.

Switch frame
Original video
Problem

What will the grabber do afterwards or do next?

... A pink block is being lowered ...
Consequence
Verified
Verified prompt

A blue-black grabber tool is holding a pink block above a simple structure made of colorful blocks resembling a gate. The grabber releases the block carefully and then retracts upward. Static shot with no camera movement.

Outcome

Mask audit

Artifact Removal

An artifact is a metric activation caused by a visual event that is not part of the physical effect under observation. We distinguish artifacts by predictability.

0057 / 0051

Deterministic Artifacts

Specifiable from the prompt or experimental setup, but attributable to apparatus motion rather than the physical phenomenon of interest. Here the rotator is the activator, but the metric should follow the caused physical event.

12 cases
0057Duck and dominos
Switch frame
Original video
Verified video
Verified prompt

A yellow rubber duck has been positioned in the middle of a line of black and white dominoes on a wooden table. The wooden stick attached to the black platform rotates clockwise and knocks the first domino block. Then the rotation stops.

Original accumulated heatmap
Verified accumulated heatmap
0051Dominos with space
Switch frame
Original video
Verified video
Verified prompt

Two rows of alternating black and white dominoes have been set up on a wooden table with a gap between the two rows. The wooden stick attached to the black platform rotates clockwise and knocks the first domino. Then the rotation stops.

Original accumulated heatmap
Verified accumulated heatmap
0002 / 0016 / 0047

Non-deterministic Artifacts

Chance recording events that are absent from any prompt or experimental specification. These create metric activation that a model should not need to reproduce.

47 cases
0002Ball and block fall
Switch frame
Original video
Verified video
Prompt

Two pillows are on a table, and two grabber tools, one orange-black and one blue-black, are positioned above them. The blue-black grabber is holding a brown tennis ball, and the orange-black grabber is holding an orange block. Both grabbers then release their objects. Static shot with no camera movement.

Original accumulated heatmap
Verified accumulated heatmap
0016Ball in sand
Switch frame
Original video
Verified video
Prompt

A blue-black grabber tool is holding a blue tennis ball above a pile of green kinetic sand on a wooden table. The grabber then releases the ball. Static shot with no camera movement.

Original accumulated heatmap
Verified accumulated heatmap
0047Domino in juice
Switch frame
Original video
Verified video
Prompt

A blue-black grabber tool is holding a white ceramic domino above a blue mug filled with dark-colored liquid on a wooden surface. The grabber then releases the domino into the mug. Static shot with no camera movement.

Original accumulated heatmap
Verified accumulated heatmap