Model Completion: Recompiling the Metrics

The raw metrics used in the ASWEC 2010 paper Non-Montonic Model Completion in Web Application Engineering can be recompiled from source code. In order to obtain correct results, you should follow these instructions below.

Before trying to recreate these metrics, you should make sure that you can checkout and compile a normal installation of the IAML project.

1. Check out the 2009-12-aswec branch of IAML, and import this into Eclipse 3.5.
2. Check out revision 122 or newer of iacleaner, and import this into Eclipse 3.5.
3. Close all of the diagramming projects (*.diagram*) - these aren't necessary for generating the metrics.
4. Re-generate the org.openiaml.model.edit project from org.openiaml.model/model/iaml.genmodel.
5. Delete any *.csv or *.log files in the org.openiaml.model.tests project.
6. Run AllTests.java in org.openiaml.model.tests as a JUnit Plugin Test
7. Once completed, the following files will be created in the org.openiaml.model.tests:
   • inference-properties.csv, containing the metrics of each test model
   • inference-*-*.log, recording the execution of the insertion cache
8. Use join.php to concatenate the inference .log files together
9. Remove the following empty, duplicate or invalid test models from both of these results (not removed from the raw metrics):
   • org.openiaml.model.tests.codegen.TestExceptionHandling
   • org.openiaml.model.tests.codegen.TestIncludeLibraries
   • org.openiaml.model.tests.inference.Requirement4DynamicSources (duplicates only)
   • org.openiaml.model.tests.codegen.oaw.ChecksTest
   • org.openiaml.model.tests.codegen.runtime.client.*
   • org.openiaml.model.tests.codegen.runtime.server.*
10. You should now be able to obtain metrics results identical to those published.

Versions

This guide was developed for the following versions of these software components. It may or may not work in any older or newer versions.

• Eclipse 3.5.0
• EMF 2.5.0
• openArchitectureWare 4.3.1
• JBoss Drools 4.0.7
• XPath support for EMF 2.0.1
• iacleaner 0.3

Contact Details

• Jevon Wright: j.m.wright@massey.ac.nz

License

This content uses the IAML project and thus licensed under the Eclipse Public Licence 1.0.

Copyright Notice

This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.