Testing

From Dryad wiki
Revision as of 12:41, 18 December 2013 by Ryan Scherle (talk | contribs) (Selenium WebDriver)

Jump to: navigation, search

Smoke Tests

These are the basic tests to ensure all components of Dryad are working. These tests are not covered by the Selenium tests. Once something is moved into Selenium, it should be removed from here.

Users:

  • A new user account can be registered (email works, clicking on the emailed token works)

Pages:

  • DSpace home page
  • About page
  • Partners page

Item search:

  • Simple searches work.
  • browses work
  • faceting works
  • "view more" on the facets works

Item view:

  • Item view pages display correctly.
  • Bitstreams can be downloaded.
  • Statistics appear correctly.
  • Handles resolve properly.

Journal submit:

  • Does the journal URL work properly?

Basic submit:

  • Submit a test dataset, with at least one file to upload.
  • Make sure a proper Handle is assigned.
  • Make sure the item is searchable.
  • View the item summary page.
  • Remove the item.

"In Review" submit:

  • Submit a test dataset for an item with the status "in review" (need to set up a dummy journal, so real editors don't get the email)
  • Make sure the item is viewable when using the review URL.
  • Make sure the item is not viewable to normal users when not using the review URL.
  • Remove the item.

Treebase submission:

  • Create a new data package with a nexus file, and forward the file to Treebase. Ensure it arrives correctly.

Selenium

Dryad maintains a set of selenium tests at http://dryad.googlecode.com/svn/trunk/selenium

These tests can be checked out and run (with "mvn package"). Since they work through a web browser, they do not need any Dryad code present on the testing machine.

Selenium IDE

  • Firefox plugin for automating tasks within firefox.
  • It internally stores scripts as HTML, but it can export scripts in Java/Ruby/Python code suitable for use with WebDriver/RC.
  • can record script through web page actions and then replay to test
  • can export script in variety of formats (JUnit, Ruby, C#)
  • Exported scripts are relatively brittle and must be modified for general use, but are a great starting point.

Selenium WebDriver

  • Tool that can launch a browser, execute a test script, and report results of the test.
  • Can be used with JUnit or other testing frameworks.
  • Rather than using JavaScript, it works directly with each browser's API for greater control of the browser.
  • Doesn't require running a separate server.
  • The "future" of Selenium.

Configuring Firefox: This is no problem on a desktop/laptop with Firefox installed. It will work automatically. On a server, you must:

  • ensure firefox is installed
  • in the root account, run "Xvfb :99"
  • the the account that is running selenium, "export DISPLAY=:99"

Best practices:

  • Create initial tests with IDE, then export to your target language/format and edit.
  • Use the HtmlUnitDriver instead of the default FirefoxDriver if possible -- it is faster, and runs without modification on more systems.
  • When creating a test in the IDE, use "assert" statements for all tests, because "verify" statements don't export properly to the code.
  • When modifying the testing code, use "verify" statements for any non-fatal errors. Use "assert" statements for errors that will cause the rest of the test to be meaningless.

Checklist for exporting a test from the IDE to Webdriver:

  1. Ensure the test has a name ending in Test (for JUnit compatability)
  2. Perform the export.
  3. Make the test extend JUnit's TestCase class.
  4. Modify the test to use HtmlUnitDriver.
  5. Modify all assertions/verifications (these will appear as comments with an error message) to use the existing webdriver api
  6. Ensure that a base URL is set.
  7. Add it to any appropriate test suites.

Relation to DSpace

Dryad uses the standard DSpace unit tests and integration tests. See DSpace Testing.