Day 1: Tuesday 1 August, 2000: Convened at 9:00 AM

Attendees are shown in enclosure 4.

1.0 Call to Order

Co-Chair Mark Kaufman called the meeting to order.

1.1 Agenda Review

The 00C agenda was reviewed and accepted.

1.2 Chair's Report by Mark Kaufman

• The next SCC20 meeting will be held in Portsmouth England from October 30 to November 3. The registration fee is $650.

Amanda Giarla reports that the she is working on the reflector lists.  The issue of the membership validity on the members-only list was discussed. A verification of membership is required at this time. (see action item 00C-1).

1.3.1 00B Minutes

Minutes of the 00B meeting in San Diego California were reviewed and approved with no changes.

1.4 Action Items and Open Issues

Action Items (enclosure 1) and Open Issues (enclosure 3) were reviewed and updated.

1.5 Liaison Reports

1.5.1 Computer Society Report

John Sheppard gave us a briefing regarding the IEEE plan to indemnify those on the members-only list (see action item 00C-1).

1.6 Working Groups Reports

Nothing to report.

1.8 Presentations

1.8.1 Lee Shombert
Lee provided a Power Point presentation (log item 319) of the Test Requirements Model (TeRM).  The primary goal of TeRM is to provide enough specification information to construct "product oriented" tests. A discussion followed regarding TeRM's relationship to AI-ESTATE. See section 3.3 below for further discussion.

1.8.2 Tim Wilmering, OSA/CBM
Tim presented his current work with Open System Architecture/ Condition Based Monitoring (OSA/CBM).  Tim has been advising the group on how to write a UML version of the EXPRESS based AI-ESTATE models. There was not an associated document to log.

1.9 Review of the 1232 Unification Issues

1.9.1 Unification Overview
John gave a short overview of the new document arrangement.

1.9.2 Review of Services
Looking at the collection of services it was noted that several sections needed descriptions. The following was suggested as an alternative to the usual organization regarding primitives, higher order services, and utilities.

Overview
Reasoner Manipulation Services

control
analysis
explain
state accessor
inference
learn

Model Management Services

count
existence
indexing
list
set

1.9.2.1 Review of Control Services
While reviewing the control services Amanda Giarla brought up issues regarding the concept and use of the "knowledge base."  After a long discussion the following was decided.

1. No knowledge entity.
2. Information Model specifies one diagnostic model.
3. DCM (and services) can load/attach/detach diagnostic models.
4. Reasoner manages multiple models based on name space and context, need to modify "corresponds to" for plurality.
5. Rather than just add "mode" to CEM, need to add parallel structure for "context" to CEM. This includes "mode."
6. Merging models is an editor function, not a reasoner function.
7. Note: Uniqueness of entity_ids within state space. Uniqueness of entity name within model.

Day 2: Wednesday 2 August, 2000: Convened at 8:00 AM

2.1 Continuation of Control Service Review
Service review was conducted from 8 am until 3:15pm.  Each of the services listed in sections 6.1.1 to 6.2.6 were reviewed and some services were revised, some were removed and a few were added.  John and Mark will integrate the changes in the Unified document (see action item 00C_4). The results will be posted on the protected web page.

2.1.1 High Level Execution Model
The following high level execution model (state machine) was suggested to handle the order or sequence of services.
.
 

2.1.2 Service Precedence Matrix
After finishing the service reviews a "Service-Precedence Matrix" was constructed to help refine the issues regarding sequence order, see log item 321.

2.2 John Sheppard's Presentation.
John Sheppard gave a presentation on TMIMS, (Standard for the Management of Test and Maintenance Information) see log item 322.

Day 3: Thursday 3 August, 2000: Convened at 8:00 AM

3.1 Conformance Section
The conformance section was discussed and it was decided that the current section is adequate and would go to ballot as is.

3.2 Binding Strategy
It was determined that figure 16 (see log item 320) should be changed and moved to section 4.  Other changes will be listed in the next posting of the Unified Document.  Sudipto was given Action Item 00C_3 to review the binding strategy after the revised unified document is posted.  The following drawing was rendered to illustrate the placement of Service Interfaces in the relationship between an application and a diagnostic reasoner.
 

3.3 TeRM Discussion

Lee Shombert opened the issue of adding TeRM as a standard to be completed by the D&MC committee.  More review of log item 319 was conducted along with examples. The committee's primary concern regarded use of committee resources. Lee Shombert and Eric Bukata expressed their commitment to execute 95% of the development work.  Lee and Eric stated that they would like to have the standard ready by 1st quarter 2001. Lee and Eric will provide a proposal, PAR and Requirements documents by the 00D meeting.

3.4 P1522 Work
Mark gave a P1522 background review for new committee members.

3.4.1 Basis for Approach
Reviewed the basis for the approach to computing metrics. In particular the discussion centered around fault isolation metrics. The discussion concluded that the only way to compute "those" metrics based on the models was to use the DIM and the CEM because the DIM provides the means to relate tests and faults in an order independent fashion.

3.4.2 Defining Primitive Functions
Committee Consensus: 1522 primitive functions (for example number of detectable faults) will be defined through EXPRESS functions based on the information Model. Computation on the primitives will be expressed in standard mathematical notation.  1522 primitive functions are those functions defined directly in terms of the model elements.  Mark Kaufman was assigned Action Item 00C-5 to create a list of 1522 primitives and circulate the list among the members of the general interest group.

3.5 Final Meeting Notes

3.5.1 The Action Items and Open Issues Review
The Action Items and Open Issues were reviewed and updated.  Previously closed items were removed.

3.5.2 00D Meeting
The committee tentatively scheduled the next meeting for 13 November at ARINC rather than attending the SCC20 meeting in Portsmouth England, see section 1.2.

3.5.3 00D Agenda
No agenda was set.

3.5 Adjournment
The 00C meeting adjourned at 5pm on Thursday August 3rd, 2000.

Action Item 99B-8: Eric Gould to provide a proposal based on DSI's approach to computing metrics under multi-outcome assumptions, for the purpose of assisting in defining model-based metrics for P1522.
Status: OPEN.

Action Item 99C-14: Amanda G. will author sections 4.1.1 and 4.1.2 of P1522.
Status: OPEN

Action Item 99C-15: Greg Bowman will author section 4.1.4, and all of section 4.4 of P1522.
Status: OPEN

Action Item 99C-19: Hugh Pritchett will brainstorm on the metric primitives listed in minute's item 2.5.8
Status: Closed due to in activity

Action Item 99C-21: Greg Bowman will create new banner for DMC web page.
Status: OPEN

Action Item 00A-1: Refer to action item 99C-8. Eric Gould will identify additional services for 1232.
Status: OPEN close

Action Item 00A-4: Refer to action item 99D-3. Reassignment of a Tim Bearse action item. Tim Wilmering will write the specifications for Utility Services, counting, existence, and indexing.
Status: Closed

Action Item 00A-5: Refer to issue 98D-1, Mark will verify that language has been included in the 1232 document to cover the exchange format for the DCM.  If language not included he will add it.
Status: Closed

Action Item 00A-12: Mark will review and change attach_model service to remove path argument and elaborate on usage within initialization sequence.
Status: Closed

Action Item 00B-2: Amanda Giarla will provide a component based architecture for section 4 of the preamble.
Status: Closed

Action Item 00B-3: Tim Wilmering will create HOS services parallel to apply_test_outcome and apply_test_batch for this proposed HOS.
Status: Closed

Action Item 00B-4: Tim Wilmering will specify a HOS for change_test_availability and change_resource availability.  Sets the "availablilty" attrribute to "false."
Status: Closed

Action Item 00B-5: John Sheppard will, within the DCM, move the occurs_within attribute from the session entity to the step entity and include in the description the fact that a given context will persist from one step to the next until changed. Change the name from session_context to step_context and move the attribute starts_history from session_context to session.
Status: Closed

Action item 00B-6: John Sheppard will correct the currency type to remove french franks and deuchmarks and add euro's.
Status: Closed

Action Item 00B-7: John Sheppard will ensure there are comments explaining all functions within the information model.
Status: Closed

Action Item 00B-8: John Sheppard to make action.frequency (DCM) an optional attribute of action and clarify semantics of frequency. Add attributes "how many," "unit," and "how often".
Status: Closed

Action Item 00B-9:  John Sheppard will create "exception entity " off of step to house staus_code and a descriptive string.
Status: Closed

Action Item 00B-10:  Tim Wilmering will create accessor services for "exception entity."  See action item 00B-9.
Status: Closed

Action Item: 00B-11: John Sheppard will change names "unit" and "standard_unit" to be different for different types.  This resolves type ambiguity among attributes and clarifies service definitions.
Status: Closed

Action ITem 00B-12: Bill Simerly will propose clause for the binding strategy and services including definition of an entity_id and provide to Mark for incorporation into the standard.
Status: Closed

New Action Items

Action Item 00C-1: Amanda Giarla will coordinate with Greg Bowman to obtain the IEEE "official roster" of AI-ESTATE members, match the official list against the members-only reflector list and verify all those on the members-only list have filled out "blue sheet" membership forms.
Status: Open

Action Item 00C-2: John Sheppard will add "mode of operation" to hierarchical_element in the CEM.
Status: Open

Action Item 00C-3:  Sudipto will review the binding strategy after the revised Unified document is posted.
Status: Open

Action Item 00C-4: John Sheppard and Mark Kaufman will work together to incorporate 00C review changes to the Unified document.
Status: Open

Action Item 00C-5: Mark Kaufman will create a list of primitives and circulate among the members of the general interest group.
Status: Open

Action Item 00C-6: Amanda will scan log318 and send it to John.
Status: Open

#285  99A AI-ESTATE Meeting Minutes, February 1999, Monterey, CA (4/27/99)

#286  TDC Trip Report (4/27/99)

#287  Draft Unified Common Element Model  (4/27/99)

#288  GKS Model for Counting/Existence Services (4/27/99)

#289 'Setup' Entity and Array Passing: Counting/Existence Services (4/27/99)

#290  Rev'ing Up AI-ESTATE: Counting/Existence/Test Availability Services (4/27/99)

#291  STRIPS Model Proposal (4/27/99)

#292  FFD Testability Metric (4/28/99)

#293 99B AI-ESTATE Meeting Minutes, April 1999, Alexandria, VA (7/27/99)

#294 ISO/TC184/SC4 Product Life Cycle Support document

#295 IEEE 1232 PAR, IEEE 1232 Requirements Document Version 6,  IEEE 1522 Requirements Document Version 2

#296 P1522 Straw Man (Mark's file name P1522-SM).

#297 The updated 1232 information model, 7/28/99.

Items logged at 99D.

#298 1232 Requirements document, version 6 dated 10/13/99  (10/14/99)

#299 1522 Requirements document, version 2 dated 10/13/99  (10/14/99)

#300 Current AI-ESTATE Models as of 10/14/99

#301 Proposal for Testability and Diagnosability Characteristics and Metrics, False Alarms (P1522) as required by action item (10/14/99)

#302 Proposal for Testability and Diagnosability Characteristics and Metrics, Section 4.3 (P1522) as required by (10/14/99)

#303 Initial merged list of previously considered services from previous drafts going back to 2.1.

Items logged at 00A

#304 Bill Simerly's proposal to restructure service name formats and parameters, a power point slide set.

#305 John Sheppard example service restructure specification template in support of log item 304.

#306 John Sheppard proposal for the "extend schema" based on the Bayesian Networks.

#307 Duane Allen's work regarding 1522 false alarm entitled "Enhancement of P1522 Draft Material Dated October 1999" dated December 27 1999.  Introduced by Karm Kaufman.

Items logged at 00B

#308 Qualtech's proposal for higher order services.

#309 Qualtech's proposal for CEM Exception Handling

#310 Qualtech's 15 minute presentation entitled "Tele-Diagnosis."

#311 Jonh Sheppard's 1st proposal on conformance.

#312 John Sheppard's  2nd proposal on conformance.

#313 Larry Howard's 15 minute presentation on "Timed Failure Propagation Graph."

#314 Hamilton Software's April proposal for primitive services.  See log item 305 for the service pattern as specified by John Sheppard.

#315 Hamilton Software's "Presentation to DMC Committee," including primitive services, binding strategy, higher order services, in word format.

#316 Hamilton Software's "Presentation to DMC Committee," including primitive services, binding strategy, higher order services, in power point  format.

#317 Tim Wilmering's 15 minute presentation entitled "OSA/CBM Architecture."

#318 DCM's "Target Extension Request Form" for the 1232 PAR.

Items logged at 00C

#319 Lee Shombert's presentation on Test Requirements Model (TeRM).

#320 ReasonerState/Accessor/Status

#321 Service-Precedence Matrix.

#322 TMIMS presentation

#323 The July 27th draft version of the Unified document.
 
 
 
 

Issue 98C-5 (From the 1232.2 Recirculation comments)  Section 7 is also loosely worded and ambiguous. It allows implementations claiming to be standards compliant to have stubs that return the "Service_not_available" status code, while insisting subset compliance is not permitted. As stated in the original response, "We appreciate the concern as regards a baseline expected behavior. We hope to address this concern, perhaps in the development of one or more AI-ESTATE Recommended Practices in the future." Concerning the suggestion for a state diagram, an early version of 1232.2 had such a diagram and found all services allowable in all cases (at least for now). Concerning clause 7, we felt that requiring implementation of all services beyond stubs was potentially too demanding; however, we did not want to open the door to sub setting until we knew which subsets made sense.  This is an issue we expect to resolve when moving to full use.
Status: OPEN  Review 'Service not Available' status codes after next draft of document is available.   CLOSE

Issue 98B-8: Should a standard or recommended practice be generated to represent a baseline expected behavior of a diagnostic reasoner? In the 00C meeting a consensus was achieved that behavior is specified for an interface not the underlying reasoner behavior.  The primitive services are less of an issue than the HOS.  The committee currently does have plans to develop a User's Guide or Recommended Practice.
Status: CLOSE

New Issues

Issue 00B-1: There are no higher order services currently defined with respect to the static models.  To aide in manipulation, analysis etc., of these models higher order services may be beneficial.  For example the following service has been proposed by Qualtech. get_test_outcome_from_diagnosis(diagnosis, set of test) Qualtech:  Allows user to get the test outcomes predicted from the seeding of a particular diagnosis (fault). This corresponds to a lookup of the corresponding column of the test-diagnosis (D-matrix) matrix.  Additional Notes from 00C: The question has to be addressed as to the general applicability of the services from a standardization perspective. It would be of value to consider these services in the context of the 1522. In particular an annex to 1522 of AI-ESTATE services providing analyses and calculation of metrics might be of value.
Status: OPEN Low Priority

Issue 00B-2: Qualtech would also like to see a "mode of operation" entity added to the CEM that indicated, among other things, what entities and resources, etc. were available in that mode, see Action Item 00C-2.
Status: Closed

Tuesday, 1 August 2000
I. Call To Order

II. Approval of Agenda

III. Reports

A. Chair
B. Secretary
C. Liaison
D. Working Group Reports

OSA/CBM (Tim Wilmering)
TeRM (Lee Shombert)
TMIMS Information Model (John Sheppard)

Primitive Services
High Order Services
Conformance
Open Issues
Finalize Draft for Ballot

Draft Status Review
False Alarms/Nondetections
Section Work
Metrics Issues

Test Requirements Model (TeRM)
Test and Maintenance Information Management Model (TMIMS)

9. New Action Item Review

10. Time and Location of 00-D

11. Set Agenda for 00-D