Org.simantics.db.tests

Introduction

This package provides small set of tests for testing DB subsystem. Testing is divided into suites for different purposes as follows:

• Regression: This suite is designed to verify the main functionality of the system. It should be run as often as possible when something changes.

• Performance: This suite is designed to benchmark the solution.

• Stress: This suite is designed to ensure long-term functionality of the solution. These tests are demanding and can only be run at selected times.

Requirements

• Individual tests and test suites can be run automatically or manually.

• Handling of global paramters. These are among others:
  • running against virtual graph or server graph
  • transaction policy
  • java vm size
  • etc

• Reporting of test results.
  • for individual tests and suites
    • performance time
    • configuration
  • history of previous tests

Running tests manually

Automated tests are run as ant script by hudson. The script is build.xml file in org.simantics.db.tests directory. The tests expect the same environment as the development environment for the db client i.e. org.simantics.db.build, etc.

The script needs to know where the target directory is. Target directory is the directory containing those dependent plugins that are not part of db client code, e.g. org.simantics.databord, etc. The default target directory is "${user.home}/target/1.1". If this is not correct give the correct path with "-Dtarget.dir=<correct-path>".

• Command "ant basic" runs the regression tests.
• Command "ant quality" runs the performance tests.
• Command "ant large" runs the stress tests.

Running tests in Eclipse

Set up the test environment by running "ant build-env". After this you can launch the tests from org.simantics.db.tests.launch directory in eclipse.

Running tests in Hudson

The automated tests are run by Hudson. See [1]. The automated tests are run every night and the test environment is reloaded if there are any changes in the source plugins. See svn-externals properties [2] which is used by hudson to load tests environment. The target platform directory svn:target/branches/1.1 is not currently loaded automatically.

Download

Version	SVN Source Tag
1.1.0	svn:db/tags/1.1.0/

Change Log

1.2

• ...

Roadmap

1.2

• Initial stab at regression test suite.
• Initial stab virtual graph, transaction policy and vm parametrizations.