SLEEC Scene Evaluation

Tell us about yourself before you begin.

Before you begin

Instructions

You will be given a case study describing an agent interacting with humans and its environment, along with a set of normative rules that prescribe the agent's expected behaviour.

The rules presented together are related to a common context. They may concern:

  • the same environmental conditions or situation,
  • concurrent or alternative responses expected from the agent, or
  • the same behaviour viewed from different perspectives or constraints.

You will then be shown a series of scenarios illustrating situations in which these rules may apply. For each scenario, you will be asked to assess:

  • Whether the scenario aligns with your interpretation of the rules.
  • Whether the scenario helps you identify limitations, ambiguities, missing information, inconsistencies, or other issues in the current set of rules.
  • If so, please explain why and describe any concerns or improvements you would suggest.

The study consists of four use cases, each containing five scenarios.

You will begin with the first use case. The interface and process are illustrated in the screenshot below.

Screenshot placeholder — replace with an <img> when available.

Thank you for your participation. You may now begin.

Case 1 of 4

—

Extracted Context

Background

—

Generated Scenes

Evaluation

Analysis:

Selected Rules

Raw LEGOs Trace


            

Annotated Trace


            

Evaluation submitted

Thank you. Your evaluations have been saved.