Print version

MAGIC 2010: Super-smart robots wanted for international challenge

Further Information

MAGIC Guidelines - 14.0 Evaluation of Initial Submissions

The following equally weighted factors will be used in evaluating the initial submissions:

  • Completeness of application and conformity to the Guidelines for Submissions outlined in this document.
  • Demonstration of a strong grasp of the problems associated with the challenge and an articulation of a clear, credible and complete approach to overcoming them.
  • Demonstration of a deep quantitative understanding of the key design points relating to autonomous multi-UVS cooperatives and presentation of a reasoned, optimised design based on preliminary results.
  • Description of a testing methodology that will be used to demonstrate the performance of the proposed multi-UVS cooperative.
  • Team composition, resources, facilities and experience capable of addressing the multiple and interdependent human, technology and systems integration problems posed by this challenge.

The papers will be evaluated by multiple reviewers, who will provide a quantitative score for each evaluation factor using the following scale:

  • 4 Points – No weaknesses; all elements are presented clearly and convincingly.
  • 3 Points – Minor weaknesses or shortfalls; all of the required elements are covered, but theory or justification is not entirely clear or complete.
  • 2 Points – Modest weaknesses or multiple minor shortfalls; the required elements
    are substantially covered, but there are a number of theories or justifications that
    are not entirely clear or complete.
  • 1 Point – Major weaknesses or multiple serious shortfalls; the submission is not
    complete and does not fully explain or justify several assertions.
  • 0 Points – Sections are entirely missing; technical assertions are not supported.

The reviewer’s score for each submission is computed as the total score for each of the five criteria (i.e.  maximum value 20 points). The composite score is the average of the reviewer’s scores.

The Technical Assessment Panel will then meet to review, compare and adjudicate the relative experience of the teams and the technical merits of the most successful proposals relative to the challenge goals.

** Please note: Neutralise - does not imply weaponise