IEEE D&MC SCC20 Meeting 04-D Minutes: Hyatt Regency Hotel, San Antonio, TX

Contents:
Daily Minutes
Meeting Agenda
Enclosure 1: Action Item Summary
Enclosure 2: Recent Log Items
Enclosure 3 Open Issues
Enclosure 4: Meeting Attendees List

Daily Minutes

Day 1: Thursday, 23 September 2004

Attendees are shown in enclosure 4.

1.0 Call to Order

Co-Chair Mark Kaufman called the meeting to order at 1:50 pm.

1.1 Agenda Review

The 04D agenda was reviewed and accepted as modified.

1.2 Chair's Report

Mark reported that 1522 was approved by REVCOM and the Standards Board for publication as a trial use standard. The next step is coordinating with the editorial staff to get the document ready for publication. In addition, 1232 has been selected for publication under IEEE/IEC dual logo.

1.3 Secretary's Report

The minutes from the 04-C meeting were reviewed and accepted without dissent.

1.4 Action Items and Open Issues

Action Items(enclosure 1) and Open Issues (enclosure 3) were reviewed and updated.

1.5 Liaison Reports

John Sheppard reported that the CS SAB voted on the revised SCC20 scope and approved it without dissent. In addition, John pointed out that DASC advised the SAB that the IEEE 1029.1 (WAVES) standard was withdrawn.

1.6 Project Discussions

1.6.1 AI-ESTATE Amendment Discussion

A 1232 Amendment working group was formed to organize the development of the amendment. Pat Kalgren was appointed as the working group chair. Initial members of the working group include: Pat Kalgren, John Sheppard, Tim Davis, John Ralph, Tim Wilmering, Bill Gerstein, and Tom Gaudette.

The contents of the amendment was discussed. A motion was made by John Shepppard to limit the contents of the amendment to the following items: 1) model corrections focusing on failure rate information (cf. EXTEND schema in 1522 standard), 2) addition of Bayesian model, and 3) XML schemata for all models defined in the current 1232-2002 standard as well as the Bayesian model. It was seconded by Tim Wilmering. The motion passed without dissent.

It was pointed out that discussion needs to take place to nail down definitions of “test,” “test group,” and “test sequence” within the context of AI-ESTATE. Tim said, “A test sequence is equivalent to a single test iff the sequence produces one and only one outcome to be used in the diagnostic process. Otherwise (i.e., if it produces multiple outcomes to be used for diagnosis), it can be represented as a fault tree. Given that a test group is defined to be simply a collection of related tests, a sequence is, by definition, a test group.” This statement with further description/suport, should be added to the amendment.

Tim Davis raised the point that in defining the XML schemata, a known weakness will be fixed by using key/keyref constructs. He and John Ralph understand what this means. For those reviewing the schemata, it would be wise to start with the CEM.

1.6.2 SIMICA Discussion

A SIMICA working group was formed to organize the development of the P1636 standard. Tim Wilmering was appointed as the working group chair. Initial members of the working group include: Tim Wilmering, Joe, Stanco, John Sheppard, John Ralph, Andre Bos, Bill Gerstein, and Mukund Modi.

1.6.3 TeRM Discussion

Given the current state of P1598 and the inability for the DMC to support further development of TeRM at this time, a motion was made to table the work of TeRM in case there may be future benefit of the work and to withdraw the PAR for P1598. (Motion by John Sheppard and seconded by Joe Stanco.) It was passed without dissent.

Day 2: Friday, 24 September 2004

2.1 Bayes Model Discussion

The Bayesian model was reviewed again to assist John Ralph understand what needs to be done to create the corresponding XML Schema. A discussion on constraints raised the issue of how to represent more complex constraints in the XML definition. It was decided that the EXPRESS language will be incorporated as annotation in the schema definition.

2.2 Services Discussion

Use of Web Services Description Language (WSDL) discussed. Tim Wilmering pointed out that WSDL description of the services should map directly from the IEEE 1232 definitions. John Ralph has looked at 1232 and extracted preliminary services to map to WSDL.

The amendment will include a mapping between EXPRESS and ATML based on style. Specifically, the EXPRESS models utilize underscore while ATML uses camelback notation. In addition, the amendment should include the graphical descriptions of the XML.

2.3 XML Schemata Presentation

Tim Davis presented the XML schemata for the DIM and EDIM. He walked through the DIM to explain how to review the schema. The issue of style for schema development was raised, and it was indicated that specific style issues are being incorporated into the ATML style guide to ensure consistency. The DCM was also reviewed.

2.4 Next Meeting

It was agreed that the next meeting will be at Lockheed-Martin in Orlando in January 2005.

2.5 Adjournment

The meeting adjourned at 10:56 am.

Committee Roadmap

DMC 04-D Meeting Agenda: September 23-24, 2004, IEEE SA AUTOTESTCON, San Antonio, TX

Day 1: Thursday

• Call to Order

• Approval of Agenda

• Reports

  • Chair's Report

  • Secretary's Report

  • Liaison Reports

• AI-ESTATE Amendment

  • Bayesian Model Discussion

  • Work on Initial Draft

  • Model Corrections

  • XML Schema Review/Development

  • XML Service-Related Discussion

• SIMICA Discussions

  • Data Element/Data Source Review

Day 2: Friday

• P1598 Status Discussion

• Final Discussions on All Topics

• Review Old Action Items

• Review New Action Items

• Set Time and Location of 05-A Meeting

• Set Agenda for 05-A Meeting

• Adjourn

Enclosure 1 Action Item Summary

Old Action Items

Action Item 03C-2: Bill Gerstein will update his presentation on the flow of information through the diagnostic process and the role of diagnostic/diagnosability standards in that process (see 2.1 from the 03C minutes).

Status: OPEN, complete but to be presented at 05-A meeting.

Action Item 04A-3: Eric Gould will explore issues of representing constraints in XML Schema and will provide a presentation on findings with a recommendation at the 04-B meeting. This review will include a closer look at the advantages and disadvantages of Part 28 for this task.

Status: OPEN

Action Item 04A-4: Mark Kaufman will put together a formal presentation on the missile diagnostic maturation use case that he presented informally at the 04-A meeting.

Status: OPEN

Action Item 04A-7: Eric Bukata will incorporate the changes from the P1598 ballot resolution and prepare the redline standard, clean revised standard, and comment resolution matrix for submission to the committee for approval. The package will then undergo a QA review by Bill Gerstein. Following QA, the package will be submitted to the IEEE for recirculation.

Status: CLOSED. TeRM is dead.

Action Item 04B-4: Mike Bodkin to enumerate data elements to be collected relative to observations/symptoms and maintenance metrics. See 1.8 of 04-B minutes. Due to Tim Wilmering: 5/17/04

Status: OPEN

Action 04C-1: Tim Davis assigned action to extract data elements from NALCOMIS to determine overlap with the SIMICA data dictionary. (Provide to Tim Wilmering)

Status: OPEN, reassigned to Mukund Modi

Action 04C-2: T. Wilmering to get MOQS/NALDA data dictionary or glossary.

Status: OPEN

Action 04C-3: Joe Stanco assigned to work with Tim Wilmering in compiling SIMICA data dictionary. This needs to be completed by November 1, 2004.

Status: OPEN

Action 04C-4: Mike Seavey to obtain G-ARMY data dictionary. (Provide to Tim Wilmering)

Status: OPEN

Action 04C-5: John Ralph to develop a presentation on a possible WSDL implementation of the AI-ESTATE Services definition.

Status: OPEN

Action 04C-6: Les Orlidge, Tim Wilmering and John Sheppard to develop contingency plan for disposition of TeRM should document not be complete by September meeting.

Status: CLOSED, TeRM is dead.

Action 04C-7: Refer to Issue 04A-1. Assigned to Tim Wilmering.

Status: CLOSED, OBE

New Action Items

Action 04D-1: Pat Kalgren will create an initial draft of the 1232 amendment.

Status: OPEN

Action 04D-2: Joe Stanco will provide information/guidance to Pat Kalgren on format for IEEE Standard Amendments.

Status: OPEN

Action 04D-3: Mark Kaufman will provide a copy of the recirculation version of P1522 to Pat Kalgren and John Sheppard. John will make sure that version is posted to the private area of the web site.

Status: OPEN

Action 04D-4: Pat Kalgren to add language concerning the distinction between tests, test groups, and test sequences in the amendment. Draft language can be found in 1.6.1 in the 04-D minutes.

Status: OPEN

Action 04D-5: John Sheppard will contact QSI about them providing a prototype implementation of either the DIM or EDIM (i.e., an instance document walking through a real but small example). This example should be in XML using the XML schema generated by the committee.

Status: OPEN

Enclosure 2 Recent Log Items

Items Logged at 04A

#352 AI-ESTATE Semantics, XML Representation Issues, T. Wilmering

#353 Draft 0 Common Element Model XML Schema, T. Davis

#354 Why Diagnostic Maturation is Hard, T. Wilmering

#355 Diagnostic Maturation Usage Scenario, J. Sheppard

#356 Draft 0 Diagnostic Inference Model XML Schema, T. Davis

#357 Draft 0 Enhanced Diagnostic Inference Model XML Schema, T. Davis

Items Logged at 04B

#358 ATML Use Cases Presentation, M. Bodkin

#359 Use Case Representation of the Environment where ATML will be utilized, M. Bodkin

#360 Diagnostics and Prognostics Report, Alabama A&M University, T. Nunn and C. Pendleton

#361 DMC Standards Roadmap, W. Gerstein

#362 AI-ESTATE XML Schema Presentation, J. Ralph

#363 Notes on Developing CEM XML Schema, J. Ralph

#364 Draft 1 of Common Element Model XML Schema, J. Ralph

#365 Draft 0.1 P1232a Amendment, DMC

Items Logged at 04C

#366 Tony Alwardt (Boeing) Services presentation.

#367 Draft 2 of Common Element Model XML Schema, J. Ralph

#368 Draft 1 of Fault Tree Model XML Schema, I. Neag

#369 Steve Cmiel SIMICA Data Element Submittal

#370 Brit Frank SIMICA Data Element Submittal

#371 Bill Gerstein SIMICA Data Element Submittal

#372 Tim Wilmering SIMICA Data Element Submittal (FRACAS)

#373 SIMICA Master Data Element List

#374 SIMICA Combined Data Element List

#375 1232 Bayesian Model Proposal

Items Logged at 04D

#376 Revised CEM XML Schema

#377 Revised DCM XML Schema

#378 Revised DIM XML Schema

#379 Revised EDIM XML Schema

#380 Revised FTM XML Schema

Enclosure 3 Open Issues

Current Issues

Issue 00B-1: There are no higher order services currently defined with respect to the static models. To aid in manipulation, analysis etc., of these models higher order services may be beneficial. For example the following service has been proposed by Qualtech. get_test_outcome_from_diagnosis(diagnosis, set of test) Qualtech: Allows user to get the test outcomes predicted from the seeding of a particular diagnosis (fault). This corresponds to a lookup of the fault in the test-diagnosis (D-matrix) matrix. Additional Notes from 00C: The question has to be addressed as to the general applicability of the services from a standardization perspective. It would be of value to consider these services in the context of the 1522. In particular an annex to 1522 of AI-ESTATE services providing analyses and calculation of metrics might be of value.

The issue of where to address this needs to be decided.

Status: OPEN Medium Priority

Issue 01C-1: Testability metrics based on maintenance philosophy, such as Fault Resolution, can provide a means of validating predictive measures. At this point, the information models used to support definition of metrics in P1522 are insufficient to address maintenance philosophy – it is hoped that this deficiency can be addressed in the future through the creation of the SIMICA information model.
Moved to SIMICA,

Status: OPEN Medium Priority.

Issue 02A-1: Log # 335 – a draft version of the False Alarm Appendix (Annex) submittal contains several section enumerating metrics for False Alarm and Assurance Tolerance. These metrics are to be considered for later inclusion in the standard – after we have formalized the definitions of False Alarm metrics.
Moved to SIMICA,

Status: OPEN Medium Priority

Issue 03A-1: Several issues have been identified that need to be addressed, possibly in an amendment to 1232. These issues will all be collected in this section.

• The failure rate entity in the CEM lacks any way to record a value for failure rate. Three options have been suggested: 1) restore the construct from 1232.1-1997, 2) create an attribute of failure rate tied to non-time-cost, or 3) create an attribute of failure rate tied to frequency.

• Change the action_count attribute of frequency to event_count.

• Although failure rate is an attribute of diagnosis (and therefore fault and failure), and we can get to repair item through fault and failure (via func), there is no explicit relationship between a repair item's failure rate (which is not specifiable in the model) and a diagnosis's failure rate (which is). A repair item's failure rate should be an aggregate of the failure rates of its constituent faults XOR failures.

• Examine viability of either replacing or supplementing exchange format with an XML DTD/Schema.

• Revisit all definitions within the information models.

• Add Bayesian model.

Status: OPEN High Priority

Issue 03C-1: Committee will investigate ISO STEP work in the area of using XML as an exchange format based on EXPRESS information models.

Status: OPEN High Priority

Issue 03C-2: Committee will examine STEP standards to determine if/how part identification is modeled relative to system indenture identification.

Status: OPEN Medium Priority

Issue 04A-1: Create a publicity document for dissemination on the DMC website and possible circulation that discusses the committee approach to standards for diagnostic maturation.

Status: OPEN High Priority

New Issues

Issue 04C-1: TBD

Status: OPEN XXX Priority

Enclosure 4: Meeting Attendees List

DMC 05-A Draft Meeting Agenda: Orlando, FL, January 2005

Day 1: Tuesday

• Call to Order

• Approval of Agenda

• Reports

  • Chair's Report

  • Secretary's Report

  • Liaison Reports

• AI-ESTATE Amendment

  • Bayesian Model Discussion

  • Work on Initial Draft

  • Model Corrections

  • XML Schema Review/Development

  • XML Service-Related Discussion

Day 2: Wednesday

• SIMICA Discussions

  • Data Element/Data Source Review

  • Review False Alarm Annex

  • Work on Information Model

• Test Results Schema

  • Discuss Use Cases

  • Information Model

  • Role of Common

  • Role Relative to SIMICA

  • Prepare for Ballot as Trial Use Standard

Day 3: Thursday

• Final Discussions on All Topics

• Review Old Action Items

• Review New Action Items

• Set Time and Location of 05-B Meeting

• Set Agenda for 05-B Meeting

• Adjourn