Day 1: Tuesday February 1: Convened at 9:00 AM

Attendees are shown in enclosure 4.

1.0 Call to Order

Co-Chair Mark Kaufman called the meeting to order.

1.1 Agenda Review

The 00A agenda was reviewed and approved with minor modifications (see enclosure 5).

1.2 Chair's Report

Mark Kaufman, reported the following.

• Regarding 1522 false alarm work, Duane Allen of NWAS is currently working on the false alarm issue as a Masters Thesis and so may be an asset to our 1522 committee work.
• The new 1522 and 1232 document sets are up on the web in the password protected area.
• There is a new User-ID and password for the password protected area.

Amanda Giarla reports that the transition of the secretary's duties from the outgoing secretary Greg Bowman to the incoming secretary Amanda Giarla is still in motion.

Minutes from the 99D meeting held in Piscataway NJ were reviewed.  Minor changes were made.  The minutes with changes were approved.

1.4 Action Items and Open Issues

Action items (enclosure 1) and open issues (enclosure 3) were reviewed and updated.  It was noted that Tim Bearse would no longer attend DMC meetings. Open action items assigned to Tim will be reassigned.

1.5 IEC WG7/TC93 Liaison Report

John was "fired" from the IEC for refusing to comply with dues requirements.   At this time DMC has no representation in the IEC to support making the 1232 standard an international standard.  John states that he will not be attending any future IEC meetings.

1.6 Computer Society Report

Steve Diamond VP of standards for the computer society re appointed John Sheppard as liaison.

1.7 1232 Unification Issues

1.7.1 Work to be done before going to ballot by 00C.

The following table lists areas of work that are completed and areas requiring further work before the unified version can be submitted for ballot.
 

Areas of Work	Show Stopper	Expected Completion by
Models	Yes	Completed
Accessory (primitive) Services	Yes	00A
Higher Order Services	Yes	Identified 00A Defined 00B
Utility Services	Yes	00B
Conformance/Extensibility	Yes	00B
Bindings	No	00B
Preamble	No	00B
IEEE Style	Yes	Preliminary 00B Final 00C

It was suggested that Jack Taylor and Tony Bartolini act as the 1232 unification QA Team.

1.8  John Sheppard's "Extend Schema"

John Sheppard discussed his ideas for a proposed "extend schema" dealing with Bayesian Networks.  It was noted that inclusion of this model at this time would cause a significant delay in submitting the unified 1232 for ballot.

1.9 Higher Order Services

Tim Wilmering's log item 303 which enumerates an extensive list of possible higher order services was discussed and the process of removing redundant services and annotating new high order services was started.
 

Day 2: Wednesday 2 February, 1999: Convened at 8:45 AM

2.1 Higher Order Services

Worked continued on removing and annotating the higher order services (see log item 303).

An issue was raised regarding higher order service names. It was noted that "get" was currently used in both primitive and higher order service names. It was decided that "get" would be used in primitive names while another name would be used in higher order service names.  The name "request" were suggested. (see log item 303).

2.2 Proposal to Restructure Service Name Formats and Parameters

Bill Simerly of Hamilton Software delivered a proposal that significantly reduces the number of service names (see log item 304).  The discussion that followed resulted in the following action items.

• Create a table of entities, attributes and type relations (see action item 00A-8).
• Create a new specification consisting of 4 service types "create, delete, get, put" encoded in BNF, EXPRESS and text (see action item 00A-13).

2.3 EXPRESS Models and SPFF Formatted Exchange Files

Amanda Giarla and Bill Simerly opened a discussion regarding EXPRESS models and SPFF formatted exchange files.  The ordering of attributes in SPFF formated files reflect the order of attributes in EXPRESS models.  Hence, changes in future models will create changes in the order of attributes in the future SPFF formted exchnage files.  Over time the upgraded models will not match older versions of exchange files. It was decided to place a model version number in the header of the SPFF exchange file (see action item 00A-11).  Also during this discussion the issue of how INVERSE attributes are to be handled was discussed.  It was decided that due to a deficiency in ISO 10303, Part-21, AI-ESTATE will treat INVERSE attributes like ordinary attributes (see action item 00A-11).

2.4 Initialization Sequencing

Bill Simerly opened a discussion regarding the expected initialization sequence.  Conversation did not yield a specific initialization sequence.  Bill noted that models were loaded then attached and so the attach_model service argument "path" was not needed.  Action item 00A-12 was assigned to Mark Kaufman to change the service and elaborate on its usage within an initialization sequence.

2.5 Extended Schema Proposal

John Sheppard presented his proposal for the "extend schema" based on the Bayesian Networks (see log item 306).  The presentation included how to upgrade the extend schema to a proposal for revising the standard.  This proposal was presented for information only.  No action item was generated.

2.6 "Thinking Beyond the Group Size Fetish: Towards New Testability"

Eric Gould led a lively, informed, and insightful conversation on the theories and principles discussed in his recent Autotestcon99 paper, "Thinking Beyond the Group Size Fetish: Towards New Testability."

2.7 Higher Order Services

The rest of the day was consumed by the higher order service review, reduction and annotation.
 

Day 3: Thursday 3 February, 1999: Convened at  8:45 AM

3.1 Continuation of Higher Order Service Review, Reduction and Annotation

See log item 303.

The following lists the results of the reduction activity.  Log item 303, contains a fully annotated list with notes.

ReasonerState/Accessor/Status

request_diagnosis_probability
request_resources_needed

Diagnostic Control

backtrack
set_checkpoint
restore_checkpoint
select_model(s)
    load_model
    attach_model
initialize_diagnostic_process
attach_reasoner
detach_reasoner
attach_knowledge
detach_knowledge
override_test

Inference Services

apply_test_outcome
apply_test_batch
update_state
get_most_likely_diagnoses

Explanation Services

show_session_trace

Learning/Knowledge Acquisition Services

NONE

Analysis Services

estimated_cost_to_isolate
estimated_cost_to_repair
estimated_resources_to_isolate
estimated_resources_to_repair
request_hypothesis_probability

Utility Services

counting services
existence services
indexing services
request_model_type

Mark Kaufman provided a copy of Duane Allen's work regarding 1522 false alarm entitled "Enhancement of P1522 Draft Material Dated October 1999" dated December 27 1999.  (see log item 307).

3.3 Conformance Discussion

The conformance section shall be re-organized to reflect a conformance matrix. Conformance requirements will not be imposed within the standard beyond those entries identified within the matrix. For conformance on model exchange, the "columns" of the matrix will reflect each of the models (CEM, FTM, DIM, EDIM, and DCM). The rows of the matrix will correspond to "reads all", "reads required", "writes all", and "writes required". The "reads/writes required" is intended to cover attributes within the models that are required. The "reads/writes all" is intended to cover attributes within the models, including the required AND optional attributes.

John Sheppard was assigend the action to modify the information models to make the following attributes optional.

CEM

diagnostic_model.orders_steps
action.required_resource
heirarchical_element.at_indenture_level
outcome.confidence
cost.cost_element

DIM (also delete attribute diagnostic_inference.for_diagnosis)

Inference.confidence

EDIM (also delete attribute diagnostic_inference.for_diagnosis)

Inference.confidence

FTM

None

DCM

session.occures_within
inferred_diagnosis.confidence (change confidence to inferred_confidence)

3.4  Extensibility Discussion

It was determined that extensibility mechanisms are required for both the models and the services. Previous versions of the standard only provided extensibility of the models. For the unified standard, the extend schema will continue to be used to support extensibility of the models.

To address extensibility for the services, two aspects of extensibility must be addressed: extensions based on extended models (i.e., accessors and utilities for extend schemas) and extensions of higher-order services. For the higher order services, these services must process elements either in current models or extend schema models. The service names will be prepended with "extend_" (to be consistent with the formalism for the extend schema). For accessor services, create and delete are covered as is since the form would be "create_<extend_entity_name" and "delete_<extend_entity_name." For get and put services, since the names are based on attribute labels (which do not include "extend_"), the forms of the service names would be "get_extend_<attribute_name" and "put_extend_<attribute_name".

Action Item 99B-7: Dave Kleinman to provide a proposal based on Qualtech's approach to computing metrics under multi-outcome assumptions, for the purpose of assisting in defining model-based metrics for P1522.
Status: OPEN

Action Item 99B-8: Eric Gould to provide a proposal based on DSI's approach to computing metrics under multi-outcome assumptions, for the purpose of assisting in defining model-based metrics for P1522.
Status: OPEN.

Action Item 99C-1: Tim Bearse to provide an editable electronic copy of the 2165 Mil-Handbook to John Sheppard for subcommittee use (FTP area).
Status: Closed 00A - REASSIGNED to John Sheppard, see action item 00A-6.

Action Item 99C-2: John Sheppard and Greg Bowman will work to get logged items onto the website.
Status: Closed 00A

Action Item 99C-4: Tim Bearse will write up a strategy for creation of bindings for the unified standard.
Status: Closed 00A - REASSIGNED to Amanda Giarla, see action item 00A-7.

Action Item 99C-5: Tim Wilmering will develop a naming convention for specifying the accessor services of 1232. This will be used to facilitate the generation of binding strategies.  Exam current services to see if convention already exists.
Status: Closed 00A

Action Item 99C-7:Mark Kaufman will compile the new 1232 document, affectionately known as "Little Shamu".
Status: Closed 00A

Action Item 99C-8:Mark Kaufman will solicit identification of 1232 services from (DSI) Detex Systems, Inc. CHANGED
Status: Closed 00A

Action Item 99C-9: Dave Kleinman will solicit identification of 1232 services from Qualtech Systems, Inc. CHANGED
Status: Closed 00A

Action Item 99C-10: Greg Bowman will post the paper "Formal data Models for SGML and HyTime" regarding the harmonization of SGML and STEP on the web page.
Status: Closed 00A - Reassigned to John Sheppard

Action Item 99C-12: Mark Kaufman will rewrite the Introduction to P1522.
Status: Closed 00A

Action Item 99C-13: John Sheppard will author section 1 (all) and section 4.1.3 of P1522.
Status: Closed 00A

Action Item 99C-14: Amanda G. will author sections 4.1.1 and 4.1.2 of P1522.
Status: OPEN

Action Item 99C-15: Greg Bowman will author section 4.1.4, and all of section 4.4 of P1522.
Status: OPEN

Action Item 99C-17:John Sheppard will set up public web site for developmental work of P1522 section 4. CHANGED
Status: Closed 00A

Action Item 99C-18: Mark Kaufman will reform the P1522 and re-send.
Status: Closed 00a

Action Item 99C-19: Hugh Pritchett will brainstorm on the metric primitives listed in minute's item 2.5.8
Status: OPEN

Action Item 99C-20: John Sheppard will put RMS Partnership URL on DMC web site.
Status: Closed 00A

Action Item 99C-21: Greg Bowman will create new banner for DMC web page.
Status: OPEN

Action Item 99C-22: Greg Bowman will provide descriptions of the candidate higher order services based on previous documentation.
Status: Closed 00A

Action Item 99C-24: Greg Bowman will distribute TC-184 (PLCS) Product Life Cycle Support (log item 294) to members-only reflector.
Status: Closed 00A

Action Item 99C-28: Amanda Giarla will acquire the 99C model changes from the web and enter then as logged items.
Status: OPEN

Action Item 99D-2: Mark Kaufman will change part-12 to part-21 in the exchange format portion of the unified standard.
Status: Closed 00A

Action Item 99D-3: Tim Bearse will write the specifications for Utility Services, counting, existence, and indexing.
Status: Open - REASSIGN to Tim Wilmering, see action item 00A-4.

Action Item 99D-4: Tim Wilmering will analyze the list of previously considered services for services that already exist, services to be implemented in the next release, and services to be deferred.  The resultant list will be placed on the reflector for discussion.
Status: Closed 00A

Action Item 99D-5: Mark Kaufman will take current proposals from Randy Simpson (#301 & #302) and fold them into the 1522 draft.
Status: Closed 00A

 New Action Items

Action Item 00A-1: Refer to action item 99C-8. Eric Gould will identify additional services for 1232.
Status: OPEN

Action Item 00A-2: Refer to action item 99C-9.  Dave Kleinman will identify additional services for 1232.
Status: OPEN

Action Item 00A-3: Amanda Giarla will identify additional services for 1232.
Status: OPEN

Action Item 00A-4: Refer to action item 99D-3. Reassignment of a Tim Bearse action item. Tim Wilmering will write the specifications for Utility Services, counting, existence, and indexing.
Status: OPEN

Action Item 00A-5: Refer to issue 98D-1, Mark will verify that language has been included in the 1232 document to cover the exchange format for the DCM.  If language not included he will add it.
Status: OPEN

Action Item 00A-6:Refer to action item 99C-1. Reassignment of a Tim Bearse action item. John Sheppard will request from Tim Bearse an editable electronic copy of the 2165 Mil-Handbook for subcommittee use (FTP area).
Status: OPEN

Action Item 00A-7:Refer to action item 99C-4. Reassignment of a Tim Bearse action item. Amanda Giarla (via Bill Simerly) will write up a strategy for creation of bindings for the unified standard.
Status: OPEN

Action Item 00A-8: Refer to Tony Bartolini will create a PERL script to parse EXPRESS to form a table of entities, atrributes, and type relations.
Status: OPEN

Action Item 00A-9: John Sheppard to correct the DCM to reflect lists of active_actions off of the active_tests and active_repairs rather than sets.
Status: Open

Action Item 00A-11: Mark will include a notation in Standard regarding two items. (1) Indicate in the header of the exchange file (SPFF) the version of the standard the file is associated with.  (2) Due to a deficiency in Part-21, AI-ESTATE will treat INVERSE attributes like ordinary attributes.
Status: Open

Action Item 00A-12: Mark will review and change attach_model service to remove path argument and elaborate on usage within initialization sequence.
Status: Open

Action Item 00A-13: Amanda (via Bill Simerly) will create a new specification for the 4 primitive service types "create, delete, get, put" encoded in BNF, EXPRESS and text.
Status: Open

Action Item 00A-14: John Sheppard will add two attributes to the "step" entity of the DCM - optimized_by_cost going to CEM.cost and optimzed_by_failure_rate going to a defined type of type boolean.
Status: Open

Action Item 00A-15: John Sheppard will modify the hypothesis attirbute of the "step" entity to read "reasoner_hypothesis" and then add a new attribute to "step" corresponding to "user_hypothesis".
Status: Open

Action Item 00A-16: John Sheppard will add an attribute of the "step" entity of the DCM - "active_hypothesis" going to an enumerated type of "user" or "reasoner".
Status: Open

Action Item 00A-17: John Sheppard will modify the information models to make the model attributes optional (see section 3.3 above)
Status: Open

Action Item 00A-18:John Sheppard will ask Greg Bowman about posting the paper "Formal data Models for SGML and HyTime" regarding the harmonization of SGML and STEP on the web page.
Status: OPEN
 

#285  99A AI-ESTATE Meeting Minutes, February 1999, Monterey, CA (4/27/99)

#286  TDC Trip Report (4/27/99)

#287  Draft Unified Common Element Model  (4/27/99)

#288  GKS Model for Counting/Existence Services (4/27/99)

#289  'Setup' Entity and Array Passing: Counting/Existence Services (4/27/99)

#290  Rev'ing Up AI-ESTATE: Counting/Existence/Test Availability Services (4/27/99)

#291  STRIPS Model Proposal (4/27/99)

#292  FFD Testability Metric (4/28/99)

#293 99B AI-ESTATE Meeting Minutes, April 1999, Alexandria, VA (7/27/99)

#294 ISO/TC184/SC4 Product Life Cycle Support document

#295 IEEE 1232 PAR, IEEE 1232 Requirements Document Version 6,  IEEE 1522 Requirements Document Version 2

#296 P1522 Straw Man (Mark's file name P1522-SM).

#297 The updated 1232 information model, 7/28/99.

Items logged at 99D.

#298 1232 Requirements document, version 6 dated 10/13/99  (10/14/99)

#299 1522 Requirements document, version 2 dated 10/13/99  (10/14/99)

#300 Current AI-ESTATE Models as of 10/14/99

#301 Proposal for Testability and Diagnosability Characteristics and Metrics, False Alarms (P1522) as required by action item (10/14/99)

#302 Proposal for Testability and Diagnosability Characteristics and Metrics, Section 4.3 (P1522) as required by (10/14/99)

#303 Initial merged list of previously considered services from previous drafts going back to 2.1.

Items logged at 00A

#304 Bill Simerly's proposal to restructure service name formats and parameters, a power point slide set.

#305 John Sheppard example service restruture specification template in support of log item 304.

#306 John Sheppard proposal for the "extend schema" based on the Bayesian Networks.

#307 Duane Allen's work regarding 1522 false alarm entitled "Enhancement of P1522 Draft Material Dated October 1999" dated December 27 1999.  Introduced by Karm Kaufman.
 

Issue 98C-5 (From the 1232.2 Recirculation comments)  Section 7 is also loosely worded and ambiguous. It allows implementations claiming to be standards compliant to have stubs that return the "Service_not_available" status code, while insisting subset compliance is not permitted. As stated in the original response, "We appreciate the concern as regards a baseline expected behavior. We hope to address this concern, perhaps in the development of one or more AI-ESTATE Recommended Practices in the future." Concerning the suggestion for a state diagram, an early version of 1232.2 had such a diagram and found all services allowable in all cases (at least for now). Concerning clause 7, we felt that requiring implementation of all services beyond stubs was potentially too demanding; however, we did not want to open the door to sub setting until we knew which subsets made sense.  This is an issue we expect to resolve when moving to full use.
Status: OPEN  Review 'Service not Available' status codes after next draft of document is available.

Issue 98B-8: Should a standard or recommended practice be generated to represent a baseline expected behavior of a diagnostic reasoner?
Status: OPEN - Low Priority

Issue 98D-1: Is an interchange format needed for the Dynamic Context Model, perhaps to deal with TMIMS-related issues and/or case based reasoning?
Status: CLOSED -Low Priority(High priority for 99-D meeting) - Hold until 00B, see action item 00A-5.
 

New Issues

Issue 99D-1: Address the following higher-order services: Explain Choice of Test, Explain Hypothesis and Learn.
Status:OPEN

I. Call To Order

II. Approval of Agenda

III.Reports

A. Chair
B. Secretary
C. Liaison
D. Working Group Reports

None

A. High Order Services
B. Draft Review
C. Proposals
      Bill Simerly, Proposed Changes to the Service Interfaces
D. Model Review
E. Open Issues
F. Section Work

A. Draft Review
B. Proposals
     False Alarm Proposal
C. Model Issues
D. Open Issues
E. Metrics Issues
F. Section Work

VIII. New Action Item Review

IX. Time and Location of 00-B

X. Set Agenda for 00-B

XI. Adjourn

I. Call To Order

II. Approval of Agenda

III.Reports

A. Chair
B. Secretary
C. Liaison
D. Working Group Reports

V. P1232 Unification Issues

A. High Order Services
B. Proposals
C. Open Issues
D. Finalize Draft for Ballot

A. Draft Review
B. Proposals
D. Open Issues
C. Metrics Issues
D. Section Work

VIII. New Action Item Review

IX. Time and Location of 00-C

X. Set Agenda for 00-C

XI. Adjourn