No products
View larger
ASME B89.4.10-2021
M00049978
New product
ASME B89.4.10-2021 Methods for Performance Evaluation of Coordinate Measuring System Software
standard by ASME International, 10/22/2021
Full Description
A critical issue in industrial coordinate metrology is the measurement of a work piece to assure compliance with its dimensional requirements. When using a computerized Coordinate Measurement System (CMS), the usual practice is to correlate computer calculated outputs with the dimensional requirements of the work piece. This correlation is performed by various computer routines that process dimensional coordinate data sets consisting of measurement samples of the object being evaluated. The purpose of this document is to provide guidelines for evaluating the quality of solutions generated by CMS software and to define minimal documentation requirements for software providers. This Standard is concerned with testing the behavior of algorithm implementation, not the testing of algorithms themselves. It is not the intent of this document to endorse or rate any computational method or system. Software performance evaluation is useful because it:
(a) Allows objective validation of software;
(b) Reduces the possibility of error in software application; and
(c) Defines a method of comparing CMS software. This document covers the following areas: input data, feature construction, software documentation, performance characterization, and test methodologies.
In stock
More info
Methods for Performance Evaluation of Coordinate Measuring System Software
AN A MERICAN NA TIONAL S T AND ARD
ASME B89.4.10-2021
[Revision of ASME B89.4.10-2000 (R2011)]
ASME B89.4.10-2021
[Revision of ASME B89.4.10-2000 (R2011)]
Methods for Performance Evaluation of Coordinate Measuring System Software
AN AMERICAN NATIONAL STANDARD
Two Park Avenue • New York, NY • 10016 USA
Date of Issuance: October 22, 2021
This Standard will be revised when the Society approves the issuance of a new edition.
ASME issues written replies to inquiries concerning interpretations of technical aspects of this Standard. Interpretations are published on the Committee web page and under https://go.asme.org/InterpsDatabase. Periodically certain actions of the ASME B89 Committee may be published as Cases. Cases are published on the ASME website under the B89 Committee Page at https://go.asme.org/B89committee as they are issued.
Errata to codes and standards may be posted on the ASME website under the Committee Pages to provide corrections to incorrectly published items, or to correct typographical or grammatical errors in codes and standards. Such errata shall be used on the date posted.
The B89 Committee Pages can be found at https://go.asme.org/B89committee. There is an option available to automatically receive an e-mail notification when errata are posted to a particular code or standard. This option can be found on the appropriate Committee Page after selecting “Errata” in the “Publication Information” section.
ASME is the registered trademark of The American Society of Mechanical Engineers.
This code or standard was developed under procedures accredited as meeting the criteria for American National Standards. The Standards Committee that approved the code or standard was balanced to assure that individuals from competent and concerned interests have had an opportunity to participate. The proposed code or standard was made available for public review and comment that provides an opportunity for additional public input from industry, academia, regulatory agencies, and the public-at-large.
ASME does not “approve,” “rate,” or “endorse” any item, construction, proprietary device, or activity.
ASME does not take any position with respect to the validity of any patent rights asserted in connection with any items mentioned in this Standard, and does not undertake to insure anyone utilizing a standard against liability for infringement of any applicable letters patent, nor assume any such liability. Users of a code or standard are expressly advised that determination of the validity of any such patent rights, and the risk of infringement of such rights, is entirely their own responsibility.
Participation by federal agency representative(s) or person(s) affiliated with industry is not to be interpreted as government or industry endorsement of this code or standard.
ASME accepts responsibility for only those interpretations of this Standard issued in accordance with the established ASME procedures and policies, which precludes the issuance of interpretations by individuals.
No part of this Standard may be reproduced in any form, in an electronic retrieval system or otherwise,
without the prior written permission of the publisher.
The American Society of Mechanical Engineers Two Park Avenue, New York, NY 10016-5990
Copyright © 2021
by THE AMERICAN SOCIETY OF MECHANICAL ENGINEERS
All Rights Reserved Printed in U.S.A.
CONTENTS
Foreword . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv
Committee Roster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v
Correspondence With the B89 Committee . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vi
Summary of Changes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . viii
1 Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
2 Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
3 Software Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
4 Performance Characterization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
5 Test Methodologies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
6 Software Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
Mandatory Appendix
I Mathematical Descriptions of Form Errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
Nonmandatory Appendices
A | Factors That Influence the Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 17 |
B | Example Documentation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 18 |
C | Substitute Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 21 |
D | Functional Gage Simulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 25 |
E | References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 27 |
Figures 4.1.1-1 | Example of Fit Bounding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 3 |
4.1.2.1-1 | Line Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 3 |
4.1.2.2-1 | Circle Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 4 |
4.1.2.3-1 | Plane Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 5 |
4.1.2.4-1 | Sphere Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 5 |
4.1.2.5-1 | Cylinder Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 6 |
4.1.2.6-1 | Cone Bounding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 6 |
4.1.2.6-2 | Cone Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 7 |
5.2-1 | Major Components of a Software Testing System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 9 |
B-5.3-1 | Flatness Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 19 |
Tables | ||
4.1.2.2-1 | Circle Fit Types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 4 |
4.1.2.7-1 | Evaluation Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 7 |
5.5.6-1 | Number of Required Form Errors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . | 12 |
FOREWORD
Coordinate measuring systems (CMSs) rely upon software that processes coordinate data; often, this software computes fits of geometric elements to such data. The performance of these fits can vary among software packages, and in some cases can be a significant contributor to the overall uncertainty of measurement.
The purpose of this Standard is to provide guidelines for evaluating the quality of solutions generated by CMS software and to define minimal documentation requirements for software providers. This Standard is concerned with testing the behavior of algorithm implementation, not the testing of algorithms themselves. It is not the intent of this Standard to endorse or rate any computational method or system. A mechanism for generating collections of test data sets is specified. While a specific, static collection of standardized test data sets is not defined, the generating mechanism can produce several collections of similar character.
ASME B89.4.10-2021 was approved by the American National Standards Institute on July 22, 2021.
ASME B89 COMMITTEE
Dimensional Metrology
(The following is the roster of the Committee at the time of approval of this Standard.)
STANDARDS COMMITTEE OFFICERS
E. Morse, Chair
J. Cassamassino, Secretary
STANDARDS COMMITTEE PERSONNEL
J. Cassamassino, The American Society of Mechanical Engineers
T. Charlton, Jr., Charlton Associates
J. Drescher, Pratt and Whitney
M. L. Fink, Retired
E. Gesner, Quality Vision International, Inc.
G. A. Hetland, International Institute of GD&T
M. Liebers, Professional Instruments Co.
R. Long, ANSI National Accreditation Board
E. Morse, UNC Charlotte
B. Parry, Consultant
P. Pereira, Caterpillar, Inc.
B. S. Pippenger, Rolls-Royce
J. Salsbury, Mitutoyo America Corp.
D. Sawyer, National Institute of Standards and Technology
J. R. Schmidl, Optical Gaging Products, Inc.
C. M. Shakarji, National Institute of Standards and Technology
R. L. Thompson, U.S. Air Force
K. L. Skinner, Alternate, Air Force Metrology and Calibration
B. Crowe, Contributing Member, CDI
T. E. Carpenter, Honorary Member, U.S. Air Force
D. J. Christy, Honorary Member, Mahr Federal, Inc.
R. J. Hocken, Honorary Member, UNC Charlotte
M. P. Krystek, Honorary Member, Physikalisch-Technische Bundesanstalt
B. R. Taylor, Honorary Member, Renishaw PLC
SUBCOMMITTEE 4 — COORDINATE MEASURING TECHNOLOGY
E. Morse, Chair, UNC Charlotte
T. E. Carpenter, U.S. Air Force
T. Charlton, Jr., Charlton Associates
J. Davies, Honeywell FM&T
J. Drescher, Pratt and Whitney
E. Gesner, Quality Vision International, Inc.
R. Long, ANSI National Accreditation Board
B. Parry, Consultant
P. Pereira, Caterpillar, Inc.
B. S. Pippenger, Rolls-Royce
J. B. Ross, GE Aircraft Engines
J. Salsbury, Mitutoyo America Corp.
J. Schlecht, North Star Imaging
J. R. Schmidl, Optical Gaging Products, Inc.
C. M. Shakarji, National Institute of Standards and Technology
R. L. Thompson, U.S. Air Force
WORKING GROUP B89.4.10 — SOFTWARE EVALUATION
C. M. Shakarji, Chair, National Institute of Standards and Technology
E. Gesner, Quality Vision International, Inc.
G. A. Hetland, International Institute of GD&T
E. Morse, UNC Charlotte
B. S. Pippenger, Rolls-Royce
J. Salsbury, Mitutoyo America Corp.
J. R. Schmidl, Optical Gaging Products, Inc.
CORRESPONDENCE WITH THE B89 COMMITTEE
General. ASME Standards are developed and maintained with the intent to represent the consensus of concerned interests. As such, users of this Standard may interact with the Committee by requesting interpretations, proposing revisions or a case, and attending Committee meetings. Correspondence should be addressed to:
Secretary, B89 Standards Committee
The American Society of Mechanical Engineers Two Park Avenue
New York, NY 10016-5990
https://go.asme.org/Inquiry
Proposing Revisions. Revisions are made periodically to the Standard to incorporate changes that appear necessary or desirable, as demonstrated by the experience gained from the application of the Standard. Approved revisions will be published periodically.
The Committee welcomes proposals for revisions to this Standard. Such proposals should be as specific as possible, citing the paragraph number(s), the proposed wording, and a detailed description of the reasons for the proposal, including any pertinent documentation.
Proposing a Case. Cases may be issued to provide alternative rules when justified, to permit early implementation of an approved revision when the need is urgent, or to provide rules not covered by existing provisions. Cases are effective immediately upon ASME approval and shall be posted on the ASME Committee web page.
Requests for Cases shall provide a Statement of Need and Background Information. The request should identify the Standard and the paragraph, figure, or table number(s), and be written as a Question and Reply in the same format as existing Cases. Requests for Cases should also indicate the applicable edition(s) of the Standard to which the proposed Case applies.
Interpretations. Upon request, the B89 Standards Committee will render an interpretation of any requirement of the Standard. Interpretations can only be rendered in response to a written request sent to the Secretary of the B89 Standards Committee.
Requests for interpretation should preferably be submitted through the online Interpretation Submittal Form. The form is accessible at https://go.asme.org/InterpretationRequest. Upon submittal of the form, the Inquirer will receive an automatic e-mail confirming receipt.
If the Inquirer is unable to use the online form, he/she may mail the request to the Secretary of the B89 Standards Committee at the above address. The request for an interpretation should be clear and unambiguous. It is further rec- ommended that the Inquirer submit his/her request in the following format:
Subject: Cite the applicable paragraph number(s) and the topic of the inquiry in one or two words. Edition: Cite the applicable edition of the Standard for which the interpretation is being requested.
Question: Phrase the question as a request for an interpretation of a specific requirement suitable for general understanding and use, not as a request for an approval of a proprietary design or situation. Please provide a condensed and precise question, composed in such a way that a “yes” or “no” reply is acceptable.
Proposed Reply(ies): Provide a proposed reply(ies) in the form of “Yes” or “No,” with explanation as needed. If entering replies to more than one question, please number the questions and replies.
Background Information: Provide the Committee with any background information that will assist the Committee in understanding the inquiry. The Inquirer may also include any plans or drawings that are necessary to explain the question; however, they should not contain proprietary names or information.
Requests that are not in the format described above may be rewritten in the appropriate format by the Committee prior to being answered, which may inadvertently change the intent of the original request.
Moreover, ASME does not act as a consultant for specific engineering problems or for the general application or understanding of the Standard requirements. If, based on the inquiry information submitted, it is the opinion of the Committee that the Inquirer should seek assistance, the inquiry will be returned with the recommendation that such assistance be obtained.
ASME procedures provide for reconsideration of any interpretation when or if additional information that might affect an interpretation is available. Further, persons aggrieved by an interpretation may appeal to the cognizant ASME Committee or Subcommittee. ASME does not “approve,” “certify,” “rate,” or “endorse” any item, construction, proprietary device, or activity.
Attending Committee Meetings. The B89 Standards Committee regularly holds meetings and/or telephone confer- ences that are open to the public. Persons wishing to attend any meeting and/or telephone conference should contact the Secretary of the B89 Standards Committee. Future Committee meeting dates and locations can be found on the Committee Page at https://go.asme.org/B89committee.
ASME B89.4.10-2021 SUMMARY OF CHANGES
Following approval by the ASME B89 Committee and ASME, and after public review, ASME B89.4.10-2021 was approved by the American National Standards Institute on July 22, 2021.
In ASME B89.4.10-2021, the figures and tables have been redesignated based on their parent paragraph. ASME B89.4.10-2021 includes the following additional changes identified by a margin note, (21).
Page 1 | Location 1 | Change Second paragraph revised |
1 | 1.1 | Subparagraph (a) revised |
1 | 1.3 | Updated |
1 | 2 | (1) Definitions of datum and least-squares fit feature revised |
(2) Definition of datum reference frame (DRF) deleted | ||
2 | 3 | Revised |
3 | 4.1.2.1 | Subparagraph (a) revised |
3 | 4.1.2.2 | (1) Subparagraphs editorially redesignated |
(2) Subparagraph (b) added | ||
5 | 4.1.2.7 | First paragraph editorially revised, and last two paragraphs |
added | ||
7 | Table 4.1.2.7-1 | General Note added |
8 | 5.2.1.2 | Subparagraph (c) revised |
10 | 5.4.6 | Revised |
10 | 5.4.7 | Revised |
10 | 5.5.1 | First sentence and last paragraph revised |
11 | 5.5.2 | Revised |
11 | 5.5.4 | Penultimate sentence and last row value in the in-text table |
revised | ||
11 | 5.5.5 | (1) First paragraph of 5.5.5.1 revised |
(2) Last paragraph of 5.5.5.2 added | ||
12 | 5.5.6 | Revised |
13 | 5.7 | Last sentence deleted |
13 | 5.8 | First sentence in last paragraph deleted |
13 | 5.10 | Revised |
14 | 6.3.4.4 | Revised |
14 | 6.3.6.4 | Revised |
15 | 6.3.8 | Revised |
17 | A-1 | Subparagraph (b) revised |
17 | A-2 | (1) Subparagraph (a) added, and subsequent subparagraphs |
redesignated
(2) First paragraph and subpara. (b) [formerly (a)] revised
Page | Location | Change |
18 | Nonmandatory Appendix B | Former Nonmandatory Appendix B deleted, and subsequent |
appendices redesignated
18 B-1 (1) Designator and title added, and subsequent paragraphs redesignated
(2) In paragraph after Disclaimer, “0.010 in.” revised to “0.010 mm”
18 | B-5.4 | Subparagraph (c) deleted |
19 | B-6.1 | “0.025 in.” revised to “0.025 mm” |
19 | B-6.4 | Former para. C-5.4 deleted, and former para. C-5.5 redesignated |
as B-6.4 | ||
19 | B-7 | In first and second paragraphs, “βlatness” revised to “flatness” |
19 | B-7.3 | Former para. C-6.3 deleted, and former para. C-6.4 redesignated |
as B-7.3 | ||
20 | B-8 | (a) Subparagraphs editorially resdesignated |
(b) In subpara. (b), “99” revised to “9 999” | ||
20 | B-9 | Revised |
21 | C-1 | (1) Designator and title added, and subsequent paragraphs |
redesignated | ||
(2) Last sentence in third paragraph deleted | ||
21 | C-2 | Equation revised |
22 | C-2.2 | First sentence and equation revised |
22 | C-3 | Added |
23 | C-3.2 | (1) Last sentence of first paragraph revised |
(2) Last two equations and paragraphs deleted | ||
23 | C-4.1 | Second equation revised |
23 | C-4.2 | Second equation revised |
25 | Nonmandatory Appendix D | Former Nonmandatory Appendix E deleted, and subsequent |
appendices redesignated
25 D-1 Designator and title added, and subsequent paragraphs redesignated