5001.001.002.006 Development of Test Artifacts for the Characterization of AM In-Situ Process Monitoring System

Problem

In-situ process monitoring (ISPM) systems, such as  melt pool monitoring (MPM) WP ACF-VC Bridge, can enhance quality assurance and help overcome barriers to widespread adoption of additive manufacturing (AM). Reliable detection of quality issues, however, is a major challenge for these systems. The problem is exacerbated by the lack of systematic approaches to comprehensive and objective performance evaluation of commercial systems which use a variety of sensor types and processing techniques. As a result, users spend significant time and effort using trial and error to gain an understanding of the functional limitations of these systems.

Objective

The objective of this project was to develop test  artifacts and protocols for characterization of MPM system performance for laser powder bed fusion (LPBF). The developed approach was anticipated to enable a best practice or standard method for:

• AM machine vendors to present results from their process monitoring systems from a recognized, standard artifact
• Process monitoring system designers to quantitatively assess the sensitivity, resolution, and indication range of their
• AM users to assess repeatability and reproducibility of their AM and process monitoring

Technical Approach

A holistic approach that probes the MPM system  response under a comprehensive set of strategically designed anomalous conditions was developed. The approach involved four types of tests:

• The full plate weld (FPW) test prints a few layers on the entire build plate with strategically varying conditions (e.g. power and speed) within and across layers. This provides a simple and robust evaluation of essential aspects such as position dependency, noise, and sensitivity.
• The designed defects test introduces small features that appear as defects in computed tomography (CT) scans of the printed This test verifies the ability of MPM systems to detect extreme cases of defects.
• The geometric features test is an advanced test that evaluates the system on a challenging ability to detect a category of defects known as shrink
• The induced defects test is another advanced test that builds specimens with variations in process parameters to induce defects such as keyholing, balling, and lack of fusion. It also probes the MPM system’s ability to detect those

The tests were categorized into two levels of complexity. Level I tests involved printing artifacts, while Level II tests required extra steps such as CT scanning. For each test the MPM measurements were compared against appropriate benchmarks to evaluate the system performance.

Accomplishments

This project successfully developed and demonstrated four types of tests spanning two levels of complexity, all consolidated on a single build plate, to enable evaluation of 12 basic and advanced aspects of MPM systems against suitable references or “ground truths.” The concise yet comprehensive tests reduced the evaluation time by a factor of 6 to 10.

The tests incorporated geometric features as well as non- geometric parameter variations representative of the intended use of the system under realistic process conditions. The FPW and designed defects tests probed key aspects of the system  that are necessary for typical production settings today where benchmark builds are used to define normal behavior. The novel shrink line test and induced defects test challenged the state-of-the-art in defect detection and, considering the longer-term industry outlook, could be crucial for low volume production, first part qualification, and parameter development. Level I tests were conducted on two different commercial MPM systems, each using a different material, demonstrating the system agnostic capability of the approach for ease of adoption.

The detailed project report and data package described the purpose of each test, provided procedures to conduct the tests, and demonstrated analysis and interpretation of the test results. Simple yet elegant analysis techniques were provided to interpret the test data, enabling qualitative and quantitative evaluation of system performance.

Project Participants

Project Principal

Public Participants

• U.S. Department of Defense
• National Institute of Standards and Technology