Day 1: Tuesday 11 April, 2000: Convened at 9:00 AM

Attendees are shown in enclosure 4.

1.0 Call to Order

Co-Chair Mark Kaufman called the meeting to order.

1.1 Agenda Review

The 00B agenda was reviewed and ammended with details of the 15 minute presentations and proposals (see enclosure 5). The ammended agenda was approved.

1.2 Chair's Report by Mark Kaufman

• PAR 1232 as revised has been approved by NESCOM and is valid through December 2000.
• John Sheppard has submitted a full 2 year extension on 1232 PAR.
• There is an administrative conflict in the 5 year Standard REVCOM period for 1232 and the 2 year REVCOM extension on the PAR.  A plan for resolution has been discussed with the SCC20 chair.

• The next SCC20 meeting is expected to be held in Portsmouth or Cambridge England.
• The web site needs to be moved/updated to reflect D&MC.
• The reflector lists also need updating.

Amanda Giarla reports that the hard copy logged items have been given to John Sheppard to be scanned in.

1.3.1 00A Minutes

Minutes of the 00A meeting in Corona California were reviewed and approved with no changes.

1.4 Action Items and Open Issues

Action items (enclosure 1) and open issues (enclosure 3) were reviewed and updated.

1.5 Liaison Reports

1.5.1 Computer Society Report

John Sheppard stated that there was nothing to report at this time.

1.5.2 Liaisons to Other Groups

Tim Wilmering asked the committee if he should be appointed to act as DMC liaison to the industry consortium Open System Architecture/ Condition Based Monitoring (OSA/CBM).  The OSA/CBM is attempting to standardize information, content and interfaces to numerous layers of applications for conditioned based monitoring, prognostics and diagnostics.  The issue of a DMC liaison to OSA/CBM consortium was defered until after Tim Wilmering's presentation, see log item 317.

Dave Kleinman suggested that we keep informed regarding other groups such as the SAE (Socitey of Automotive Engineers).

1.6 1232 Unification Issues

1.6.1 Work to be done before going to ballot by 00C.

The following table was established at the 00A meeting in Corona California.
 

Areas of Work	Show Stopper	Expected Completion by
Models	Yes	Completed
Accessory (primitive) Services	Yes	00A
Higher Order Services	Yes	Identified 00A Defined 00B
Utility Services	Yes	00B
Conformance/Extensibility	Yes	00B
Bindings	No	00B
Preamble	No	00B
IEEE Style	Yes	Preliminary 00B Final 00C

The above table was reviewed and the following estimations were made.

• John Sheppard suggested that the model comments should be reviewed for accuracy and consistency.
• The accessory (primative) services are expected be completed by the end of this meeting. Waiting for a proposal to be presented by Hamilton Software on Thursday.
• The high order services are expected to be completed by the end of this meeting.
• The utility services are expected to be completed by the end of this meeting.
• The conformance and extensibility work are expected to be completed by the end of this meeting.
• Hamilton Software will be proposing a bindings strategy for C++ on Thursday. If this work can not be completed by ballot then a "guide to bindings" may be published as an informal annex or published as a "real" guide. The idea of including IDL in the bindings section was suggested.
• It is not expected to complete the preamble section but the end of this meeting.  It is expected that the preamble be worked on via electronic meetings and e-mail.
• The IEEE Style is not required to be compeleted before the document is sent to ballot.  Thus the "Show Stopper" status was changed from yes to no.

1.6.2 Quality Assurance of Unification Document

Jack Taylor accepted the job of assuring the quality of unified 1232.  John Sheppard stated that Tony Bartolini would be the second QA reader.

1.7 Testability 1522

The issue of working on the 1522 was discussed, it was clear that 1232 must be finished before resources could be placed on further development of 1522.

1.8 Working on 1232 Conformance

The following possible conformace matrix was established at 00A meeting in Corona California.
 

	CEM	FTM	DIM	EDIM	DCM
Read Full Elements of Model
Write Full Elements of Model
Reads Required Elements of Model
Writes Required Elements of Model
Accessor
Utility
Required Higher Order Service
Optional Higher Order Service

Full means all required elements plus optional elements.

Required is defined by the information model less the optional elements in the information models.

Tim Wilmering questioned the usability of the conformance matrix.  Tim stated that in his opinion there would be too many levels of conformance if the matrix approach were used.  Tim stated that he would prefer an expression of conformance related to job or application description such as testability or diagnostics.  John Sheppard stated that the purpose of the matrix is to allow vendors to be able to display what parts of the standard they are in conformance with.  Amanda Giarla argued that vendors might want to produce various configurations of the cells in the matrix to provide for various job oriented products with various prices.  The issue of having Reads and Writes listed as separate items was discussed at length.  John offered the following alternative matrix as point of discussion.
 

	CEM	FTM	DIM	EDIM	DCM
R/W Full Model Elements
R/W Required Model Elements
Accessor/Utility Full Model Elements
Accessor/Utility Required Elements
Core Higher Order Services
Enhanced Higher Order Services

A rather long disucssion insued regarding conformance, the use of a matrix at all and alternatives to a matrix.  John Sheppard volunteered to take a cut at writing a conformance section and presenting it later in the meeting.  Action Item 00B-1.

1.9 Reviewing the Unified Preamble

1.9.1 Contribution and Circulation Lists

The contributors list was discussed and the following resulted.  Contributors shall include all those on the old 1232.1 and 1232.2 list plus any contributors since then.  The ballot cirulation list would start with the contributors list.  Active memebers will add to the list by suggesting others known to be interested in the subject.

1.9.2 Section 1

There were numerous small changes requested, discussed and noted by Mark Kaufman the 1232 document keeper, editor, and handler. The client server architectual view (figure 3), was discussed and it was decided that it should be moved to section 4.  Amanda Giarla volunteered to provide a component based architectural view to be included in section 4, see action item 00B-2.

Adjourned at 5pm.

Day 2: Wednesday 12 April, 2000: Convened at 8:45 AM

2.1 Presentation by Sudipto Ghoshal of Qualtech

Sudipto Ghoshal of Qualtech gave a 15 minute presentation entitled "Tele-Diagnosis," the presentation covered remote and distributed real time diagnosis, see log item 310.

2.2 Conformance

John Sheppard handed out his proposal on conformance as per action item 00B-1, see log item 311.  Tim continued his arguments against the use of the conformance matrix as being too complex. Numerous strategies were suggested and debated extensively.

2.3 Next SCC20 Meeting

Both the location and the cost of SCC20 meetings were discussed.  Some members expressed that they would not be able to attend the SCC20 meeting if held in England.  Others stated they were unsure if they would be able to attend because of costs, time or travel permissions.  The issue of registration fees was also discussed.  Jack Taylor made a motion that the D&MC subcommittee attend the next SCC20 meeting in the fall of 2000 which is scheduled to be held in England.  John Sheppard seconded the motion. Discussion followed.  A vote was held, 2 yes, 5 no, 2 abstain. It was decided that the co-chairs write a memorandum regarding the vote and deliver the memo to SCC20 at the steering meeting on Thursday evening.

2.4 Presentation by Larry Howard

Larry Howard of The Institutue of Software Integrated Systems at Vanderbuilt University gave a 15 minute presentation entitled "TFPG Diagnosis" (Time Failure Propagation Graph), see log item 313 A demonstration of TFPG was given on Larry's laptop.

Adjourned at 5pm.

Day 3: Thursday, 13 April, 2000: Convened at  8:45 AM

3.1 Cost Memorandum

As per committee request the co-chair's John Sheppard and Mark Kaufman composed a memorandum regarding the location, travel and cost issues sec section 2.3 above.  The memo was read to the committee.  There was short discussion. The letter was scheduled to be presented at the evening steering committee meeting on April 13.

3.2 Conformance, a second copy
John Sheppard provided a revision of his conformance section, see log item 312.  There was not enough time to review the revised proposal.

3.3 Higher Order Services

3.3.1 Qualtech's Proposal

The following services were proposed by Sudipto Ghoshal of Qualtech.  see log item 308. Each service was discussed and responded to by the committee.

Higher Order Services

cannot_perform_active_test (current_test : active_test)
Qualtech: Allows user to indicate inability to perform the active test currently suggested by the reasoner. The reasoner will suggest an alternative/next-best test to be performed.
DMC: This is subsumed by change_test_availability below.

change_current_diagnosis_outcome (set of diagnosis, set of diagnosis_outcome)
Qualtech: Allows user to declare the diagnosis_value (component status) of any diagnosis (component) at any time during the diagnostic session.
DMC: Action Item 00B-3: Tim Wilmering will create HOS services parallel to apply_test_outcome and apply_test_batch for this proposed HOS.

change_resource_availability (set of resource, set of avail_type)
Qualtech: Allows user to change the availability status of any resource at any time during the diagnostic session.
DMC: See change_test_availability below.

change_test_availability (set of inferred_test, set of avail_type)
Qualtech: Allows user to change the availability status of any test at any time during the diagnostic session. (Question : Is inferred_test the right entity to use in this context ?)
DMC: Action Item 00B-4: Tim Wilmering will specify a HOS for change_test_availability and change_resource availability.  Sets the "availablilty" attrribute to "false."

change_test_outcome (set of test, set of test_outcomes)
Qualtech: Allows user to change the outcome of any test at any time during the diagnostic session.
DMC: Already coverd by apply_test_outcome and apply_test_batch.

change_mode_of_operation (set of mode_of_operation, set of mode_value)
Qualtech: This requires mode_of_operation to be a CEM entity (instead of a DCM entity) with the additional attribute of mode_value which is a BOOLEAN type indicating whether the mode is set or not.
DMC: Action Item 00B-5: Johnn Sheppard will, within the DCM, move the occurs_within attribute from the session entity to the step entity and include in the description the fact that a given context will persist from one step to the next until changed. Change the name from session_context to step_context and move the attribute starts_history from session_context to session.

get_test_outcome_from_diagnosis(diagnosis, set of test)
Qualtech:  Allows user to get the test outcomes predicted from the seeding of a particular diagnosis (fault). This corresponds to a lookup of the corresponding column of the test-diagnosis (D-matrix) matrix.
DMC:  Listed open issue 00B-1.

get_mode_of_operation (set of mode_of_operation, set of mode_value)
Open issue... add mode to static models

Action item 00B-6: John Sheppard will correct the currency type to remove french franks and deuchmarks and add euro's.

Action Item 00B-7: John Sheppard will ensure there are comments explaining all functions within the information model.

Action Item 00B-8: John Sheppard to make action.frequency (DCM) an optional attribute of action and clarify semantics of frequency- add attributes "how many," "unit," and "how often".
 

3.4 Next Interim Meeting

Mark opened the subject of the time and location for the next interim meeting - The first week of August seems to be the initial preference - Tim Wilmering offered to host the meeting in St. Louis.  Dave Kleinman offered Qualtech as a location. The consensus of the committee was to hold the next interim meeting in August at the Qualtech facility in Conneticuit.

Larry Howard offered to host the February interim meeting in Nashville at Vanderbilt University.

Lunch Break

3.5 Qualtech Exception Handling

Handle the Qualtech "miscellaneous issues" via email (either electronic meeting or privately with John if committee consensus not required)

Action Item 00B-9  John Sheppard to create "exception entity " off of step to house staus_code and a descriptive string...

Action Item 00B-10  Tim Wilmering to create accessor services for same...

3.6 Tim Wilmering's Presentation on OSA/CBM

Tim Wilmering gave a presentation on the OSA/CBM initiative. Further discsion regarding a DMC liasion resulted in the following.  Because OSA/CBM is not an official stadards organizartion we decided that the appointmet of a liason was not appropriate.

Primitive Services

As per John Sheppard's request (see action item 00A-13 and log items 305 & 314) Bill Simerly filled in the primitive services specification based on the pattern presented in log item 305.  Bill then rewrote the specification a second time to include strong typing in the specification see section 1 of log item 314.

Bill presented in a binding strategy in section 2 of log item 314.

Bill proposed the following higher order services be included in the standard.

insert_in_list
append_to_list
remove_from_list
add_to_set
remove_from_set
attach_knowledge
load_knowledge

Action Item: 00B-11 John Sheppard will change names "unit" and "standard_unit" to be different for different types.  This resolves type ambiguity among attributes and clarifies service definitions.

Action ITem 00B-12 Bill Simerly will propose clause for the binding strategy and services including definition of an entity_id and provide to Mark for incorporation into the standard.

3.8 Motion to withdraw IEEE 1232-1995 Standard

John Sheppard made a motion to withdraw the IEEE 1232-1995 standard.  The motion was seconded by Greg Bowman. There was call for discussion however, no discussion was required.  The motion was carried by a unanimous vote.

NOTES: greg - Introduce models a method to capture the design of the aviontics especially of BIT      and develop test strategies for the TPS.  It was consider that this item should be closed Mark

Action Item 99B-7: Dave Kleinman to provide a proposal based on Qualtech's approach to computing metrics under multi-outcome assumptions, for the purpose of assisting in defining model-based metrics for P1522.
Status: OPEN

Action Item 99B-8: Eric Gould to provide a proposal based on DSI's approach to computing metrics under multi-outcome assumptions, for the purpose of assisting in defining model-based metrics for P1522.
Status: OPEN.

Action Item 99C-14: Amanda G. will author sections 4.1.1 and 4.1.2 of P1522.
Status: OPEN

Action Item 99C-15: Greg Bowman will author section 4.1.4, and all of section 4.4 of P1522.
Status: OPEN

Action Item 99C-19: Hugh Pritchett will brainstorm on the metric primitives listed in minute's item 2.5.8
Status: OPEN

Action Item 99C-21: Greg Bowman will create new banner for DMC web page.
Status: OPEN

Greg commented on possible banners, brain + model  ideas

Action Item 99C-28: Amanda Giarla will acquire the 99C model changes from the web and enter then as logged items.
Status: Closed

Action Item 99D-3: Tim Bearse will write the specifications for Utility Services, counting, existence, and indexing.
Status: Closed - REASSIGN to Tim Wilmering, see action item 00A-4.

Action Item 00A-1: Refer to action item 99C-8. Eric Gould will identify additional services for 1232.
Status: OPEN

Action Item 00A-2: Refer to action item 99C-9.  Dave Kleinman will identify additional services for 1232.
Status: Closed

Action Item 00A-3: Amanda Giarla will identify additional services for 1232.
Status: Closed

Action Item 00A-4: Refer to action item 99D-3. Reassignment of a Tim Bearse action item. Tim Wilmering will write the specifications for Utility Services, counting, existence, and indexing.
Status: Closed

Action Item 00A-5: Refer to issue 98D-1, Mark will verify that language has been included in the 1232 document to cover the exchange format for the DCM.  If language not included he will add it.
Status: OPEN

Action Item 00A-6:Refer to action item 99C-1. Reassignment of a Tim Bearse action item. John Sheppard will request from Tim Bearse an editable electronic copy of the 2165 Mil-Handbook for subcommittee use (FTP area).
Status: Closed

Action Item 00A-7:Refer to action item 99C-4. Reassignment of a Tim Bearse action item. Amanda Giarla (via Bill Simerly) will write up a strategy for creation of bindings for the unified standard.
Status: Closed

Action Item 00A-8: Refer to Tony Bartolini will create a PERL script to parse EXPRESS to form a table of entities, atrributes, and type relations.
Status: Closed

Action Item 00A-9: John Sheppard to correct the DCM to reflect lists of active_actions off of the active_tests and active_repairs rather than sets.
Status: Closed

Action Item 00A-11: Mark will include a notation in Standard regarding two items. (1) Indicate in the header of the exchange file (SPFF) the version of the standard the file is associated with.  (2) Due to a deficiency in Part-21, AI-ESTATE will treat INVERSE attributes like ordinary attributes.
Status: Closed

Action Item 00A-12: Mark will review and change attach_model service to remove path argument and elaborate on usage within initialization sequence.
Status: Open

Action Item 00A-13: Amanda (via Bill Simerly) will create a new specification for the 4 primitive service types "create, delete, get, put" encoded in BNF, EXPRESS and text.
Status: Closed

Action Item 00A-14: John Sheppard will add two attributes to the "step" entity of the DCM - optimized_by_cost going to CEM.cost and optimzed_by_failure_rate going to a defined type of type boolean.
Status: Closed

Action Item 00A-15: John Sheppard will modify the hypothesis attirbute of the "step" entity to read "reasoner_hypothesis" and then add a new attribute to "step" corresponding to "user_hypothesis".
Status: Closed

Action Item 00A-16: John Sheppard will add an attribute of the "step" entity of the DCM - "active_hypothesis" going to an enumerated type of "user" or "reasoner".
Status: Closed

Action Item 00A-17: John Sheppard will modify the information models to make the model attributes optional (see section 3.3 above)
Status: Closed

Action Item 00A-18:John Sheppard will ask Greg Bowman about posting the paper "Formal data Models for SGML and HyTime" regarding the harmonization of SGML and STEP on the web page.
Status: Closed

New Action Items

Action Item 00B-1: John Sheppard will write a conformance section for review and approval.
Status: Closed

Action Item 00B-2: Amanda Giarla will provide a component based architecture for section 4 of the preamble.
Status: Open

Action Item 00B-3: Tim Wilmering will create HOS services parallel to apply_test_outcome and apply_test_batch for this proposed HOS.
Status: Open

Action Item 00B-4: Tim Wilmering will specify a HOS for change_test_availability and change_resource availability.  Sets the "availablilty" attrribute to "false."
Status: Open

Action Item 00B-5: Johnn Sheppard will, within the DCM, move the occurs_within attribute from the session entity to the step entity and include in the description the fact that a given context will persist from one step to the next until changed. Change the name from session_context to step_context and move the attribute starts_history from session_context to session.
Status: Open

Action item 00B-6: John Sheppard will correct the currency type to remove french franks and deuchmarks and add euro's.
Status: Open

Action Item 00B-7: John Sheppard will ensure there are comments explaining all functions within the information model.
Status: Open

Action Item 00B-8: John Sheppard to make action.frequency (DCM) an optional attribute of action and clarify semantics of frequency. Add attributes "how many," "unit," and "how often".
Status: Open

Action Item 00B-9:  John Sheppard will create "exception entity " off of step to house staus_code and a descriptive string.
Status: Open

Action Item 00B-10:  Tim Wilmering will create accessor services for "exception entity."  See action item 00B-9.
Status: Open

Action Item: 00B-11: John Sheppard will change names "unit" and "standard_unit" to be different for different types.  This resolves type ambiguity among attributes and clarifies service definitions.
Status: Open

Action ITem 00B-12: Bill Simerly will propose clause for the binding strategy and services including definition of an entity_id and provide to Mark for incorporation into the standard.
Status: Open

#285  99A AI-ESTATE Meeting Minutes, February 1999, Monterey, CA (4/27/99)

#286  TDC Trip Report (4/27/99)

#287  Draft Unified Common Element Model  (4/27/99)

#288  GKS Model for Counting/Existence Services (4/27/99)

#289  'Setup' Entity and Array Passing: Counting/Existence Services (4/27/99)

#290  Rev'ing Up AI-ESTATE: Counting/Existence/Test Availability Services (4/27/99)

#291  STRIPS Model Proposal (4/27/99)

#292  FFD Testability Metric (4/28/99)

#293 99B AI-ESTATE Meeting Minutes, April 1999, Alexandria, VA (7/27/99)

#294 ISO/TC184/SC4 Product Life Cycle Support document

#295 IEEE 1232 PAR, IEEE 1232 Requirements Document Version 6,  IEEE 1522 Requirements Document Version 2

#296 P1522 Straw Man (Mark's file name P1522-SM).

#297 The updated 1232 information model, 7/28/99.

Items logged at 99D.

#298 1232 Requirements document, version 6 dated 10/13/99  (10/14/99)

#299 1522 Requirements document, version 2 dated 10/13/99  (10/14/99)

#300 Current AI-ESTATE Models as of 10/14/99

#301 Proposal for Testability and Diagnosability Characteristics and Metrics, False Alarms (P1522) as required by action item (10/14/99)

#302 Proposal for Testability and Diagnosability Characteristics and Metrics, Section 4.3 (P1522) as required by (10/14/99)

#303 Initial merged list of previously considered services from previous drafts going back to 2.1.

Items logged at 00A

#304 Bill Simerly's proposal to restructure service name formats and parameters, a power point slide set.

#305 John Sheppard example service restruture specification template in support of log item 304.

#306 John Sheppard proposal for the "extend schema" based on the Bayesian Networks.

#307 Duane Allen's work regarding 1522 false alarm entitled "Enhancement of P1522 Draft Material Dated October 1999" dated December 27 1999.  Introduced by Karm Kaufman.

Items logged at 00B

#308 Qualtech's proposal for higher order services.

#309 Qualtech's proposal for CEM Exception Handling

#310 Qualtech's 15 minute presentation entitled "Tele-Diagnosis."

#311 Jonh Sheppard's 1st proposal on conformance.

#312 John Sheppard's  2nd proposal on cinformance.

#313 Larry Howard's 15 minute presentation on "Timed Failure Propagation Graph."

#314 Hamilton Software's April proposal for primative services.  See log item 305 for the service pattern as specified by John Sheppard.

#315 Hamilton Software's "Presentation to DMC Committee," including primative services, binding strategy, higher order services, in word format.

#316 Hamilton Software's "Presentation to DMC Committee," including primative services, binding strategy, higher order services, in powerpoint  format.

#317 Tim Wilmering's 15 minute presentation entitled "OSA/CBM Architecture."

#318 DCM's "Target Extension Request Form" for the 1232 PAR.
 
 

Issue 98C-5 (From the 1232.2 Recirculation comments)  Section 7 is also loosely worded and ambiguous. It allows implementations claiming to be standards compliant to have stubs that return the "Service_not_available" status code, while insisting subset compliance is not permitted. As stated in the original response, "We appreciate the concern as regards a baseline expected behavior. We hope to address this concern, perhaps in the development of one or more AI-ESTATE Recommended Practices in the future." Concerning the suggestion for a state diagram, an early version of 1232.2 had such a diagram and found all services allowable in all cases (at least for now). Concerning clause 7, we felt that requiring implementation of all services beyond stubs was potentially too demanding; however, we did not want to open the door to sub setting until we knew which subsets made sense.  This is an issue we expect to resolve when moving to full use.
Status: OPEN  Review 'Service not Available' status codes after next draft of document is available.

Issue 98B-8: Should a standard or recommended practice be generated to represent a baseline expected behavior of a diagnostic reasoner?
Status: OPEN - Low Priority

Issue 99D-1: Address the following higher-order services: Explain Choice of Test, Explain Hypothesis and Learn. This item was closed due to group consensus.  Learn is beyond the scope of the standard beyond anything other than a trival case (primative services).   Explain was considered beyond the scope of this revision and thus left to implemetors to implement explaination and propose for addition to the standard through the extensibility feature.
Status: Closed
 

New Issues

Issue 00B-1: There are no higher order services currently defined with respect to the static models.  To aide in manipulation, analysis etc., of these models higher order services may be beneficial.  For example the following service has been proposed by Qualtech. get_test_outcome_from_diagnosis(diagnosis, set of test) Qualtech:  Allows user to get the test outcomes predicted from the seeding of a particular diagnosis (fault). This corresponds to a lookup of the corresponding column of the test-diagnosis (D-matrix) matrix.
Qualtech would also like to see a "mode of operation" entity added to the CEM that indicated, among other things, what entities and resources, etc. were available in that mode.
Status: Open

I. Call To Order

II. Approval of Agenda

III.Reports

A. Chair
B. Secretary
C. Liaison
D. Working Group Reports

V. P1232 Unification Issues

A. High Order Services
B. Proposals
        Hamsoft Primative Services
C. Open Issues
D. Finalize Draft for Ballot

A. Draft Review
B. Proposals
D. Open Issues
C. Metrics Issues
D. Section Work

VIII. New Action Item Review

IX. Time and Location of 00-C

X. Set Agenda for 00-C

XI. Adjourn
 

I. Call To Order

II. Approval of Agenda

III.Reports

A. Chair
B. Secretary
C. Liaison
D. Working Group Reports

V. P1232 Unification Issues

A. High Order Services
B. Proposals
        Hamsoft Primative Services
C. Open Issues
D. Finalize Draft for Ballot

A. Draft Review
B. Proposals
D. Open Issues
C. Metrics Issues
D. Section Work

VIII. New Action Item Review

IX. Time and Location of 00-D

X. Set Agenda for 00-D

XI. Adjourn