TPTP-Test-Tools-20080331

Attendees

• Present:
  • Paul Slauenwhite
  • DuWayne Morris
  • Tony Wang

• Absent:
  • Jerome Bozier

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 30, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are in I6 TP2 (target: April 4).

Testing

• Tony:
  • /org.eclipse.tptp.test.tools.api.tests/manual/Recorder/Test.UI.APIRecorder.Windows_IA32.testsuite
  • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM142_JUnitRunner.testsuite
  • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.IBM15_JUnitRunner.testsuite
  • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun142_JUnitRunner.testsuite
  • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.Sun15_JUnitRunner.testsuite
  • /org.eclipse.hyades.test.java.tests/autoui/Test.Execution.JUnitRunner.Bug186196.testsuite
  • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.CodeSynchronizationTest.testsuite
  • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestGeneration.testsuite
  • /org.eclipse.hyades.test.java.tests/junit/Test.JUnit.JUnitTestSuiteFacadeTest.testsuite
  • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_editing.testsuite
  • /org.eclipse.hyades.test.ui.datapool.tests/manual/datapool/Test.UI.DatapoolEditor_importExport.testsuite
  • /org.eclipse.hyades.test.ui.datapool.tests/gui/Test.UI.EncryptedDatapoolEditor.testsuite
  • /org.eclipse.hyades.test.ui.logViewer.tests/manual/Test.UI.FrameworkEditors_logViewer_linux.testsuite

• Duwayne:
  • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Windows.testsuite
  • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.UI.URLTest.Linux.testsuite
  • /org.eclipse.hyades.test.URLTest.tests/manual/basic_tests/Test.Execution.URLRunner.Remote.testsuite

• Paul:
  • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
  • /org.eclipse.hyades.test.java.tests/manual/regressionTests/Test.Execution.JUnitPluginRunner.testsuite

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Test Project include:
    • Paul:
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Content missing in Tabular Report
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • ANT importExistingProjects throws Exception

Enhancements

• Queries.
• Schedule.

• Xin Ying Huang:
  • Encrypted datapool variable support: Paul reviewed and integrated the final patch, test cases, and documentation. Delivered!

• Duwayne:
  • Test execution should support parallel execution of tests: Paul reviewed the final patch. Duwayne integrated the final patch and test cases, as well as updating the hours worked. Delivered!

• Jerome:
  • Move, Copy, Delete, Rename and Import/Export test assets: Paul reviewed and integrated the final patch. Jerome is continuing on the test cases and documentation.

• Paul:
  • Generic Recorder Wizard enhancement to filter the list of recorders: Paul completed the dependent defects (bug 137591, bug 139589, bug 206078, bug 217440, and bug 221861) and integrated the final patch, test cases, and documentation. Delivered!.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. Paul has reviewed the patch and is proceeding with AG/PMC approval before opening a Contribution Questionnaire (CQ) for the contribution.

Defects

• Queries.

• Schedule.

• Bugzilla Prefix Legend:
  • [Product]: Defects required by consuming products.
  • [APAR]: Defects required by consuming products for customer support.

• A list of candidate P1 defects/enhancements to be deferred to I7 and future will be discussed on today's AG call.

• [APAR]:
  • (APAR) Test Infrastructure doesn't work in firewalled environment: Transfered to the Platform Project for completion in I6.
  • (APAR) Repeated launch through Automated Services Framework eventually fails: Transfered to the Platform Project for completion in I6.
  • (APAR) UI allows to launch non-profilable tests in profile mode.

• [Product]:
  • Duwayne:
    • (Product) Consumming Product: ASF Throws Modal Dialog Box.
    • (Product) Cannot remove a test invocation to a removed HTTP request.
    • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0
    • (Product) Recorder launch wizard does not allow spaces
    • (Product) (Usability) HTTP tests do not automatically generate JUnit Java code like JUnit tests.
  • Jerome:
    • (Product) copy/paste of a simple folder does not work in Test Navigator view
    • (Product) Usability - adding existing artifacts/locations to deployment should select by name (not filename)
    • (Product) Test assets' editors (locations, datapools etc) allow save with empty internal names
  • Paul:
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.

editors when content doesn't all fit in a page]

• • • (Product) (Usability) creating TPTP test but you need to have parent project created first.
    • (Product) doc updates for section Creating a test deployment
    • (Product) what does the synchronous option mean for an invocation behavior in a JUnit Test Suite?
    • (Product) Time Frame Historical Report view does not have tabs and is missing info
    • (Product) variables are listed twice in the "EquivalenceClass" pane of Datapool
    • (Product) Context sensitive help requires refactoring and new content.
    • (Product) Unmovable rows in Datapool Editor
  • Tony:
    • (Product) Accessibility-Need shortcuts for all Test Navigator pulldowns

Round-table

Paul

• Last Week:
  • Vacation: 2 days
  • 4.5 I6 TP1
  • Resolved defects:
    • InactiveProcessException when launching AGR tests using the Agent Controller.
    • InactiveProcessException when launching JUnit Plug-in tests using the Agent Controller.

• This Week:
  • 4.5 I6 TP2
    • (APAR) UI allows to launch non-profilable tests in profile mode.
    • (Product) Generate Report: Test Navigator does not refresh to show new report
    • (Product) scroll bars not appearing when needed in test suite editor and other Hyades
    • (Product) Test Log Viewer: Link to deployment is displayed when using temp deploy not named 'default'
    • (Product) Location does not contain port number.

editors when content doesn't all fit in a page]

Duwayne

• Last Week:
  • Vacation: 1 day
  • 4.5 I6 TP1
  • Triaged InactiveProcessException when launching AGR tests using the Agent Controller..

• This Week:
  • 4.5 I6 TP2
  • (Product) Consumming Product: ASF Throws Modal Dialog Box.
  • (Product) Cannot remove a test invocation to a removed HTTP request.
  • (Product) HTTP recording does not work with Internet Explorer 7 and Firefox 2.0

Jerome

• Last Week:
  • n/a

• This Week:
  • n/a

Tony

• Last Week:
  • 4.5 I6 TP1

• This Week:
  • 4.5 I6 TP2

Action items

• None.

Notes

• The slides for all TPTP sessions at EclipseCon 2008 are available on the TPTP web site.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.