TPTP-Test-Tools-20080526

Attendees

• Present:
  • Paul Slauenwhite
  • Tony Wang
  • Jerome Bozier

• Absent:
  • DuWayne Morris (Holiday)

4.5

Release Information

• 4.5 will ship with the Ganymede Simultaneous Release (target release date: June 25, 2008).

• Detailed Schedule.

• Defect queries.

• Download.

• Test reports.

Where are we at?

• We are currently in 'must-fix' mode, fixing any blocking issues from I8 TP1 this week (target: May 30).
  • All defects require patch reviews, Stop Ship Template, and Project/PMC approval.

• RC1 was delivered on Tuesday, May 20.

• RC2 is scheduled for Tuesday, May 27.

• RC3 is scheduled for Tuesday, June 3.

• RC4 is scheduled for Friday, June 6.

Defect Verification

• A note has been sent to the originators of all resolved defects reminding them to verify/close these defects before Ganymede releases.

• Please verify/close your resolved defects this week:
  • Paul.
  • Tony.
  • Duwayne.
  • Jerome.

Testing

• Please use the [1] candidate driver.

• Please use the TPTP all-in-one package and install dependent/As-Is/Technology Preview components in the <Eclipse installation directory>/eclipse/dropins directory.
  • Note: When testing in a Java 1.4.x environment, do NOT use the TPTP all-in-one package since it requires Java 1.5.x+.

• Outstanding I8 TP1 test suites (target: May 26):
  • Manual:
    • Tony:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Datapools.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Deployment.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.General.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.JUnit_Plugin.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Manual.technical_review.Windows_IA32.testsuite
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.Test_Log_Viewer.technical_review.Windows_IA32.testsuite
    • Paul:
      • /org.eclipse.tptp.test.doc.user/manual/Doc/Test.Doc.smoke.testsuite
  • JUnit:
    • Duwayne:
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun16_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.IBM15_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun142_TestServices.testsuite
      • /org.eclipse.tptp.test.testservices.tests/junit/Test.Sun15_TestServices.testsuite

News Group

• The following news group posts require an IMMEDIATE reply:
  • Duwayne:
    • Re: Using wait command in AGR script (March 11, 2008 2:07 PM)
    • Re: HTTP Recording stops immediately after start-up (FireFox) or never records data (IE) (March 25, 2008 1:15 PM)
    • tptp execuation task issue (April 2, 2008 3:12 PM)
    • Multi-Language tests with AGR (April 7, 2008 3:11 PM)
    • Testing an application with Custom component (April 8, 2008 11:03 AM)
    • Re: NoClassDefFoundError: org.eclipse.hyades.test.common...? (April 10, 2008 5:33 PM)
    • Re: Multiple instances for Verification Class (April 28, 2008 3:11 PM)
    • Re: Reusable Thread Error in standard mode (April 29, 2008 6:12 PM)

Test Automation Initiative

• Paul and the Release Engineering Team are working on consolidating our testing process and automation infrastructure:
  • For more information, see the WIKI page.
  • To see the BVT results for a specific build, open the Build Reports page for a specific build and select BVT Results.
  • Outstanding defect against the Platform Project include:
    • Execution of any testsuite fails using the IAC - InactiveProcessException
  • Outstanding defect against the Test Project include:
    • Paul:
      • JUnit Plug-in runner incorrectly modifies deployed plugin.xml files.
      • AGR Tests require absolute path to Equinox JAR
      • Clear remote workspace launch does not work for remote test execution
      • AGR Tests cannot be run with start ACServer
      • Remove XMLUnit dependency and convert reporting tests to TPTP tests
      • Test Execution Tabular Report contains empty or incorrect child reports.
      • Connection property does not deploy all dependencies
      • Connection property does not allow JUnit Plug-in Tests to be executed
    • Duwayne:
      • ASF marshalling return value between service and client adapter does not have support for failures / exceptions
      • Confusing exceptions when running automated services.
      • ASF Test Execution Service races with AutoBuildJob -- can lead to unexpected test results
      • ANT test results property requires trailing slash to specify location
      • Exceptions when running ASF tasks.
      • Only the name of the execution result is used from the results property.

Enhancements

• Queries.
• Schedule.

• Alexander Nyßen:
  • Providing the ability to record user's interactions with GEF objects in a GEF editor: Alexander (TPTP user and contributor) has contributed a patch and documentation for basic GEF/Draw2D support in the AGR. AG/PMC approved and Contribution Questionnaire (CQ) approved. Paul did not complete the integration, testing, and check-in during I8. Since the AGR is an As-Is component, Paul will complete this integration this week once all of the I8 TP1 AGR tests have been completed.

Defects

• Queries.

• Schedule.

• Defects require a reply:
  • Duwayne:
    • jdt.ui bundle activator assumes PlatformUI.getWorkbench(), causing autobuild failure when running headless
    • Cannot remove a test invocation to a removed HTTP request.

• Defects require a sizing:
  • Duwayne:
    • Test Execution fails when project defined incorrectly - ResourceException
  • Jerome:
    • Test assets are allowed to have same, non-unique IDs
    • Rename error in java perspective
    • Unable to delete a test or a project

• Platform Project impacting the Test Project:
  • Critical/Blocker:
    • Random intermitten errors while launching a test against remote agents: Scheduled for this week.
    • command line and runtime workbench unsatisfied link error: Scheduled for this week.
    • The edit option is not working properly in probe targets: Scheduled for this week.
    • Cannot add method entry fragment data items [regression]: Scheduled for this week.
    • Probekit context menu is disabled.Probekit context menu is periodically disabled.
  • Major/Normal:
    • Execution of any testsuite fails using the IAC - InactiveProcessException: Scheduled for this week.
  • Resolved:
    • NullPointerException when opening Eclipse with an opened editor.: Could not reproduce and returned as WORLKSFORME.

• Defects deferred to Future.

• Remaining I8 Bugzillas:
  • Paul:
    • profiling trace generated from running a java app instrumented with api recording probe does not contain information: Reopened from I8 TP1 testing since work-around did not resolve the symptom.
    • Datapools cannot be created/opened without JCA.: Possible issue with the Guid.java classes. Requires triage.
    • Technical review of Test Project documentation before 4.5 release.: Tony is completing a technical review of the documentation. Changes will be required for this defect based on his review.
    • Fix spelling/broken links/accessibility errors in JUnit Plugin/Manual Test/BIRT Reports plug-ins.: Required this week.
    • Documentation smoke test failures.: Required this week.
    • Adding to new deployment wizard has duplicate shortcuts: Accessibility issue. Required this week.
    • Test editor is too wide for users to read: Usability issue. Required this week.
    • Providing the ability to record user's interactions with GEF objects in a GEF editor: Required this week. Paul will complete this integration this week once all of the I8 TP1 AGR tests have been completed.
    • Automated Test Execution Harness Tests: Test automation to be completed during TP2.
    • All external APIs should have JUnit tests: Test automation to be completed during TP2.
  • Duwayne:
    • Parallel agent startup errors, InactiveProcessException: Required by a consuming product.
    • Cannot remove a test invocation to a removed HTTP request.: Proposed patch not stable. Required by a consuming product.
    • Test Execution fails when project defined incorrectly - ResourceException
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
  • Jerome:
    • Test assets are allowed to have same, non-unique IDs: Required this week. Required by a consuming product.
    • Unable to delete a test or a project: Required this week.
    • Rename error in java perspective: Required this week.
    • (Test Automation) Automate manual test suites using the Automated GUI Recorder.: Test automation to be completed during TP2.
  • Tony:
    • (Linux) AGR test suite does not run.: Test automation to be completed during TP2.

Round-table

Paul

• Last Week:
  • Out of office: 1 day
  • Assisted consuming product triage several symptoms/issues found during their testing.
  • Prepared TPTP 4.5.0 Release Review slides.
  • Verified resolved defects.
  • Resolved defects:
    • TVT34:TCT476: TPTP Test Perspective crashes initializing Test Navigator View
    • NullPointerException when running Test.UI.EncryptedDatapool_Running.testsuite

• This Week:
  • Complete testing.
  • Work on remaining I8 defects.

Duwayne

• Last Week:
  • n/a

• This Week:
  • Out of office: 1 day
  • Complete testing.
  • Work on remaining I8 defects.

Jerome

• Last Week:
  • Resolved defects:
    • rename does not call create update change on client proxies?
    • Unable to create proxy for testsuite
    • Test Navigator link to editor doesnt work when multiple editors open on file mapping to same proxy node.
    • exception raised when moving an element without selecting a destination
    • save is not allowed when changing elements inside wizard
    • Rename problems for 'Ok' button in test perspective

• This Week:
  • Work on remaining I8 defects.

Tony

• Last Week:
  • Out of office: 1 day
  • Completed I8 TP1.

• This Week:
  • Complete testing.
  • Work on remaining I8 defects.

Action items

• None.

Notes

• None.

Reminders

Lead Committers

• Continually review copyright reports and ensure files will missing copyright or incorrect copyright year are corrected.
• Add the Original Estimate (PH) when triaging a new defect.
• Update the Hours Worked (PH) when completing a defect.
• Test their components or review/track testing contributed by other committers/resources.
• Monitor the TPTP news group and answer posts specific to their Test Project components.
• Verify that all API changes (modifications, additions, and removals) do not breech the TPTP API Contract.
• Use the MyFoundation Portal for committer elections.