Introduction

This paper describes the experiment design and measurement results of melt pool geometry (length, width, and depth), as well as cooling rate measurements for comparison to numerical process simulations pertaining to bare metal scans. These tests were part of several types of benchmark tests and measurements for the 2018 Additive Manufacturing Benchmark Tests (AM Bench) and given the indicator AMB2018-02 on the AM-Bench website [1]. Single-track experiments were chosen to reduce the number of experiment variables and ensure broad utility among modelers. Additionally, these tests are conducted on bare substrates without powder to further reduce the number of variables (e.g., powder size distribution or powder layer height) and reduce potential variability due to secondary physical phenomena (e.g., powder denudation or track instability), though it has been shown that melt pools formed on bare plate and single layers of powder share similar lengths and cooling rates [2]. The experiments were conducted on two different LPBF systems; the Additive Manufacturing Metrology Testbed (AMMT) [3] and an EOS M270Footnote 1 commercial build machine (CBM).

Experiment Setup

Sample Preparation and Test Parameters

Nickel-based superalloy 625 (IN625) substrates are used in this study. They measure 24.5 mm × 4.5 mm and 3.2 mm thick. The substrate surface is prepared with 320 grit random orientation polishing to create a flat, optically diffuse surface with surface features much smaller than the melt pool scale (approximately 10′s of μm). Substrates were held in the AMMT and CBM systems by four pins in a fixture. Figure 1 presents an illustration of the fixturing method. This setup was introduced in prior work [4] and designed to ensure minimal contact is made on the substrate, which minimizes conductive heat loss. The fixture and pins are made of aluminum alloy.

Fig. 1
figure 1

Illustration of the substrate as it is held in the fixture inside the CBM. AMMT had a similar holding system

Surface roughness of the substrates was measured using laser confocal microscope on three sample areas between the laser scan tracks (approximately 0.3 mm × 1.5 mm, avoiding any scan track topography). Arithmetic mean height areal parameter values ranged from Sa = 0.44–0.53 μm and root mean square height parameter values from Sq = 0.64–0.73 μm.

Scan parameters (laser power and scan speed) are identified by ‘Case,’ with the following parameter values: Case A laser power and speed are 150 W and 400 mm/s, Case B are 195 W and 800 mm/s, and Case C are 195 W and 1200 mm/s. Figure 2 shows the track numbering and scan parameter case. Initial AMMT thermal imaging was collected at an integration time of 100 μs (here referred to as AMMT-100 μs). Due to the potential effect of motion blur on the 100 μs thermal images described in "Melt Pool Imaging Thermography Systems" section, a second, limited set of tests were conducted at an integration time of 20 μs (AMMT-20 μs) and compared to the AMMT-100 μs scans to ensure that they were executed under nominally similar conditions.

Fig. 2
figure 2

Track numbering and layout for each set of measurements: a CBM, b AMMT-100 μs, and c AMMT-20 μs. Laser power values indicated are the applied laser power

Laser spot size is set through different mechanisms on the CBM and AMMT. The CBM uses an f-theta lens to create a flat scanning field and an adjustable defocusing lens after the laser collimator to adjust spot size. The AMMT uses a dynamic linear translating z-lens (LTZ) to perform a flat-field correction [3]. This LTZ is mounted and aligned on a second linear stage, which adjusts the static laser focus position and spot size. CBM spot size was presumed to be set based on the manufacturers specifications, and AMMT spot size was measured in situ by attenuating the laser beam after the laser collimator and directly scanning on a charge-coupled device (CCD) array. For the AMMT, 4-sigma diameter (D4σ) was 170 μm (full-width half max (FWHM) of 100 μm) and the CBM laser spot (D4σ) was 100 μm (FWHM of 59 μm). Spot size and additional machine parameters pertinent to the conditions inside the build chamber are provided in Table 1.

Table 1 Machine parameters for the CBM and AMMT systems

Melt Pool Imaging Thermography Systems

The thermography setup for in situ measurements on the CBM and AMMT varied in several significant ways. However, both systems incorporate a staring configuration that views the melt pool as it scans through the camera field of view. Also, the essential method for calibration, measurement, and analysis of the resulting melt pool images proceeded using similar methods. Figure 3 shows both thermography experiment setups, with description of pertinent components. Table 2 provides a comparison of pertinent technical parameters for both imaging systems.

Fig. 3
figure 3

Thermography setup for each machine: a CBM, using a mounting bracket to angle the camera and look through a custom door with viewport, b AMMT, using a long distance microscope and angled first-surface mirror mounted in an argon purge box

Table 2 Infrared thermography specifications for the CBM and AMMT systems

Since the cameras view their respective surfaces at an angle, the projected pixel size on the build surface (or instantaneous field of view, iFoV) is different in the horizontal and vertical direction in camera image. That is, while each of the camera pixels are square, the true dimensions on the build surface are different in the horizontal and vertical directions. Equivalent iFoV in the vertical image direction is scaled by r/cos(θ), with r being the horizontal scale in μm per pixel, and θ being the viewing angle the camera makes with respect to the build surface normal.

The CBM camera is calibrated using a commercial spherical cavity, variable temperature blackbody source, with a circular foil aperture slightly larger than the field of view to avoid stray light which can erroneously increase the signal. The AMMT camera is calibrated using a custom, light emitting diode (LED)-driven integrating sphere, with interchangeable apertures. Both have calibrations tied to the primary standards at NIST. Figure 4 shows the calibration ranges for each of the three samples shown in Fig. 2.

Fig. 4
figure 4

Thermal calibration points (with linear interpolated lines for clarity) for the CBM and AMMT thermal cameras. Error bars indicate ± 1σ standard deviation

Note that the calibration ranges shown in Fig. 4 do not equate to the true measurable temperature ranges. Since the emittance of the physical surface shifts the measurable range of the true temperature [5], each of the calibration ranges indicated in Fig. 4 does in fact enable observation of the melt pool solidification boundary assumed to be 1290 °C in this paper. The calibration procedure essentially maps digital signals measured by the camera (Smeas) to the set point temperature of the calibration blackbody source (Tbb), by fitting a nonlinear function F to Smeas = F(Tbb). The Sakuma–Hattori equation [6] is used and described in the next section and closely approximates a spectrally integrated Planckian radiation function, but is invertible in closed form. The contribution of the calibration on measurement uncertainty is discussed in "Measurement Uncertainty" section.

AMMT-100 μs thermal images were collected at 8-bit digital dynamic range (256 DL), whereas the 20 μs thermal imaging (AMMT-20 μs) was collected at 12-bit digital dynamic range (4096 DL). Thermal calibrations for the AMMT camera were conducted at 12-bit dynamic range setting; therefore, the AMMT-100 μs data had to be upconverted by multiplying the signal value by 24 = 16. The contribution of the digital sampling and digital upconversion AMMT-100 μs to measurement uncertainty is discussed in "Measurement Uncertainty" section. CBM images were collected at 14-bit digital dynamic range (16 384 DL).

Calculation of Melt Pool Length and Cooling Rate

Once thermal images of the melt pool are collected, several processing steps are conducted to convert the camera signal to a temperature that corresponds to the solidification temperature and measure the melt pool length and cooling rate from the profile line taken from the center of the melt pool. First, this section will provide some detail on the difference between radiance temperature (or, apparent temperature), true temperature, and emissivity to provide background on how the line profile data are obtained. Similar publications from the authors provide more detail [4, 5]. In addition, description of the image analysis for extracting melt pool length is provided.

The relationship between measured signal from the camera (Smeas), measured in DL, radiance temperature (Trad), true temperature (Ttrue), and emissivity (ε), is defined by the measurement equation:

$$ S_{\text{meas}} = F\left( {T_{\text{rad}} } \right) = \varepsilon F\left( {T_{\text{true}} } \right) . $$
(1)

Radiance temperature is equivalent to a true temperature if ε = 1 (which is approximated when conducting a thermal calibration of the camera against a blackbody calibration source). F is the Sakuma–Hattori calibration function as mentioned before, which relates measured signal [DL] to radiance temperature [°C] or [K]. Often, a (1 − ε) term representing reflected ambient temperature sources is added to the measurement equation [5]. However, this factor has minimal consequences to measurement of temperatures vastly higher than the ambient surroundings, such as in LPBF melt pool thermographic measurements. The Sakuma–Hattori equation and its inverse are is given in Eqs. (2) and (3):

$$ F\left( T \right) = \frac{C}{{\exp \left( {\frac{{{\text{c}}_{ 2} }}{AT + B}} \right) - 1}} $$
(2)
$$ F^{ - 1} \left( S \right) = \frac{{c_{2} }}{{A\ln \left( {\frac{C}{S} + 1} \right)}} - \frac{B}{A}. $$
(3)

The term c2 is the second radiation constant (14,388 μm/K), and the coefficients A, B, and C are fit coefficients determined through least-squares regression. For thermographic measurements of laser-induced melt pools, a solidification boundary of the melt pool (freezing point) may be distinguished by a discontinuity or inflection point in the temperature versus time (T(t)) data or temperature versus length (T(x)) profile, assuming laser scan speed is constant. This freezing point is identified by the minimum of the second derivative of T(x), as demonstrated in [4]. This definition follows similar methods used in fixed-point thermometry, in which the solidification point is defined as the inflection point between the solidus and liquidus regions of a melting curve [7].

If the freezing point (nominally the solidus) temperature is known or well approximated, the effective emittance of that point can be extracted from Eq. (1) using Eq. (4) as mentioned in the AMB2018-02 test description [1]. We assume this value, Tfreeze, is 1290 °C for IN625.

$$ \varepsilon_{\text{freeze}} = \frac{{S_{\text{meas}} }}{{F\left( {T_{\text{freeze}} } \right)}}. $$
(4)

Although 1290 °C is an assumed value, it will be shown that this has minimal effect on the melt pool length measurement but does affect the cooling rate measurement. In reality, the solidification temperature is likely affected by undercooling due to the high cooling rates and nonequilibrium solidification [8].

Once calculated, εfreeze can then be used to convert the measured camera signal or radiance temperature in Eq. (1) into ‘true’ temperature using Eq. (5). Essentially, this scales the measured radiance temperature field (nonlinearly) such that the detected solidification boundary in the thermal images equates to the assumed solidification temperature of 1290 °C. Although this is valid for the solidification point, it is assumed that εfreeze is applicable at temperatures above and below the solidification point, or over the range that cooling rate is measured.

$$ T_{\text{true}} = F^{ - 1} \left( {\frac{{S_{\text{meas}} }}{{\varepsilon_{\text{freeze}} }}} \right). $$
(5)

Laser scans for experiments described here are essentially horizontal within the field of view of the camera; therefore, melt pool temperature profiles may be extracted by selecting a horizontal row of pixels at the melt pool center. In the case of non-horizontal scans (not described in this paper), this method is inadequate; therefore, we developed a more universal algorithm for extracting the melt pool temperature profile along its length.

First, an approximate melt pool shape is determined by locating an approximate solidification boundary. The principle axis of this shape, determined from the second central moment, then defines the profile line T(x) along which further melt pool length and cooling rates are calculated. The following algorithm is used to define melt pool profile data. Steps 1–4 describe the method for identifying the estimated melt pool boundary and extraction of the length profile line T(x) for melt pools that are not horizontally aligned in the thermographic image. Steps 5–9 use the T(x) to calculate the melt pool length and cooling rate:

  1. 1.

    Determine the approximate solidification point by selecting a line of pixels (horizontal, diagonal, or otherwise) along the approximate centerline of the melt pool, creating a profile line, and locating the solidification inflection point (in S(x)) on the profile line determined by minimum the second derivative.

  2. 2.

    Calculate the solidification approximate emittance using the assumed freezing temperature (1290 °C for IN625) and Eq. (4).

  3. 3.

    Find the approximate melt pool shape by thresholding (binarizing) the image to values within ± 5 DL of the approximate solidification point.

  4. 4.

    For this binarized melt pool shape, calculate the centroid and major and minor axis orientations based on the shape central moments.

  5. 5.

    Use the major axis to define the melt pool profile line (signal vs. x, or S(x))

  6. 6.

    Convert the profile line signal values to radiance temperature versus x (Trad(x)) using Eq. (1).

  7. 7.

    Determine the solidification point Tfreeze using the minimum of the second derivative of Trad(x).

  8. 8.

    Determine effective emittance of this point, εfreeze, from Eq. (4), and the true temperature profile Ttrue(x) from the right hand side of Eq. (1).

  9. 9.

    Calculate the front of the melt pool as the intersection of xfront = T−1(Tfreeze) and the lower cooling rate point xlow = T−1(Tlow), from the true temperature profile Ttrue(x).

Figure 5 demonstrates an example measurement of one video frame from the CBM and AMMT-20 μs measurements, respectively. Note that although the color bars and resultant radiance temperature make the CBM melt pool apparently much larger than the AMMT melt pool, this is largely due to the different calibration ranges, where the CBM camera is capable of measuring and displaying lower temperatures. Additionally, note that the calculated solidus emittance differs between the two figures. Although this calculated emittance is not a robust metrological value, it does have physical relationship to the normal spectral emittance of the metals, which are known to have higher normal spectral emittance at the near-infrared (such as the AMMT camera) compared to the short-wave infrared (such as the CBM camera) [9, 10]. However, when scaled via the calculated solidus emittance, the solidification points in the melt pool temperature profiles match the assigned solidus temperature of 1290 °C. Also note that the CBM had smaller laser spot size compared to the AMMT, therefore higher volumetric laser energy density, which can explain the greater measured melt pool length shown in Fig. 5, and measured depth described in the next section.

Fig. 5
figure 5

Example radiance temperature thermal video frames for a CBM and b AMMT-20 μs. Example temperature profiles for, c CBM, d AMMT-20 μs

Melt pool length and cooling rates are calculated from the ‘true’ temperature profiles in the spatial domain Ttrue(x). Melt pool length, Lx, is determined by locating the solidification inflection point via the minimum of the second derivative of the T(x) profile line [4], resulting in the point xfreeze, and measuring the length to the front of the melt pool at the intersection of T(x) = Tfreeze (determined using linear interpolation between points) resulting in the point xfront. This provides for the length measurement Lx, where the subscript x indicates measurement in the spatial domain:

$$ L_{x} = \left| {x_{\text{front}} - x_{\text{freeze}} } \right|. $$
(6)

Cooling rate measurements, as described in Sect. 3.1.2 of the AMB2018-02 test description website [1], are in units [°C/s] and measured as the difference between assumed solidus point (Tfreeze = 1290 °C) and a selected lower temperature Tlow and its respective spatial point xlow. The time-rate change is then calculated using the known constant scan speed v = Δxt.

$$ \dot{T}_{x} = \frac{{v\left( {T_{\text{freeze}} - T_{\text{low}} } \right)}}{{\left| {x_{\text{freeze}} - x_{\text{low}} } \right|}}. $$
(7)

A cooling rate temperature range of 1290–1190 °C was selected for the two thermal imaging systems. Due to the different calibration ranges of the CBM camera, which can measure lower temperatures, broader range of 1290–1000 °C is also provided for comparison.

It should also be mentioned that that the location of the solidification point, based on the 2nd derivative of T(x), minimally differs between the Trad and Ttrue curves in Fig. 5, indicating that the accuracy of the assumption in Tfreeze = 1290 °C has minimal effect on the length measurement. However, it can also be seen in Fig. 5 that the slopes of the Ttrue(x) and Trad(x) profiles do differ. This indicates that the cooling rate measurement depends on the scaling from Trad(x) to Ttrue(x), which in turn depends on Tfreeze and the assumption that it is applicable at temperatures below the solidification point. Additionally, Tfreeze depends on the assumed value of Tfreeze = 1290 °C. For these and other reasons, cooling rate measurements are only provided for comparison, but not recommended for reference or calibration of AM models, as described in "Results" section.

Melt Pool Transverse Cross Section Measurements

Each of the three samples in Fig. 2 was cross-sectioned through the middle of the laser traces, mounted, and polished using typical metallurgical sample preparation procedures. The samples were etched with aqua regia for 2–30 s and then examined and photographed with a Zeiss LSM8001 confocal laser scanning microscope. The measurement mode of the microscope software was used to draw a bounding rectangle at the melt pool depth and width boundaries.

The measurement results for melt pool width and depth presented on the AM-Bench measurement results website were made from the AMMT-100 μs sample [11]. Similar measurements were later taken on the CBM sample, as detailed here. Melt pool depth and width measurements of all 10 traces on the AMMT-100 μs sample and CBM sample were acquired using three different imaging conditions: (1) 50× objective, bright field (BF), Z-stack, (2) 50× objective, reflected light dark field mode (DF), Z-stack, and (3) 50× Objective, DF, photograph at autofocus position. An enhanced depth of focus image (EDF) was compiled from each of the image stacks (ZStk) and saved as tagged image file format (TIFF) files as well as the native file format of the microscope. Example BF, Z-stack measurements for the CBM and AMMT-100 μs samples of each scan Case (A, B, and C) are shown in Fig. 6. The AMMT cases all demonstrated conduction mode track formation. The CBM-generated tracks exhibited slight keyhole or keyhole transition shape in Cases B and C, likely due to the smaller laser spot size compared to the AMMT. Additionally, the CBM Case A cross sections showed relatively elevated humping, likely due to more dynamic fluid flow within the melt pool, and again caused by the smaller laser spot size and increased laser energy density.

Fig. 6
figure 6

Example bright field, ×50, Z-stack melt pool cross section on the CBM and AMMT-100 μs representing Cases A, B, and C. Original images are 263 μm × 176 μm, and 0.062 μm per pixel

Melt pool cross section geometry results were later obtained for the AMMT-20 μs samples, although they utilized only one imaging technique. These were all measured using 50× objective, reflected light bright field mode, although images were collected with a 3 pixel × 3 pixel binning mode, which resulted in image scaling per pixel of 0.186 μm.

Results

Table 3 provides a compilation of process parameters and measurement results for each scan track of each sample in Fig. 2. For thermography-based measurements (effective emittance, melt pool length, and cooling rate), the sample population N is the number of video frames in Table 3. For microscopy-based measurements (cross section width and depth), this is the number of measurements per track (N = 3). The ± 1σ indicated is the standard deviation of the measurements for each individual track, whether it is number of video frames or number of microscopy measurements. Note that this does not imply a standard uncertainty, but an indication of the variance about the average values presented. These individual track measurements are compiled into a summary, later in this section in Table 4.

Table 3 Test conditions and melt pool measurement results for CBM and AMMT cases A, B, and C used for AM-Bench reference values
Table 4 Compiled summary results for melt pool geometry and cooling rate measurements on CBM and AMMT

Melt pool cross section geometry measurements, topography, grain shapes, dendritic microstructure, etc. presented elsewhere in this special issue [12,13,14] were all made on the AMMT-100 μs tracks listed in Table 3. To ensure the physical scan tracks for the AMMT-20 μs and AMMT-100 μs cases were created under the same conditions (namely, laser power, scan speed, and laser spot size), melt pool cross section geometry for these two samples is compared in Fig. 7. The similar resultant cross section geometry indicates these were indeed created under the same conditions.

Fig. 7
figure 7

Comparison of tracks made on the AMMT at different thermal camera integration times (20 μs and 100 μs). Similar results indicate the scan tracks were made under similar conditions (specifically, laser power and laser spot size)

Since scan conditions were similar for the AMMT-100 μs and AMMT-20 μs cases, melt pool depth and width measurements made from cross section microscopy could be combined for these two datasets. The melt pool geometry measurement results are compiled to give unified reference values for each scan condition case (A, B, C), and each machine (CBM or AMMT) and are presented in Table 4 and plotted in Fig. 8.

Fig. 8
figure 8

Compiled summary results for melt pool geometry measurements on CBM and AMMT. Note that laser spot size was different for CBM and AMMT. Error bars indicate ± 1σ of the standard uncertainty of the mean, umean. A complete uncertainty analysis is provided in "Measurement Uncertainty" section

Since the values in Table 4 are based on mean values, it also provides the uncertainty of the mean, umean. The sample population (N) for melt pool length measurements was based on the total number of thermal video frames of all videos taken for that class. Similarly, the class mean for melt pool length defined as the average of all combined video frames for that class (e.g., the class mean for CBM Case A lengths is the average of N = 53 + 27 + 49 total measurements) and standard uncertainty of the mean taken as umean = σ/√(N). For any measurements where N < 30, umean = z·σ/√(N), where z is taken from the student’s t table for a confidence interval of 68.3%. Error bars in Fig. 8 represent ± umean.

Melt pool cooling rate measurements were significantly different for the CBM and AMMT cases, although the trends comparing the A, B, and C cases were similar for both machines. For the AMMT-100 μs cases, the measurements at the lower temperature point, Tlow in Eq. (6), are likely affected by motion blur from the longer 100 μs integration time. The effect of this motion blur on the temperature profile T(x) is not as simple as calculating a blur length based on integration time and scan speed, Δxblur = (100 μs)·v. This has a minimal effect on the melt pool length measurement, but does affect Tlow; therefore, cooling rate values for the AMMT-100 μs cases should not be referred to and are noted as such in Table 3. In addition, the limited calibration range of the AMMT-20 μs measurements may have resulted in the lower temperature point, Tlow, occurring where the calibration curve in Fig. 4 is insensitive and may be affected by sensor nonlinearity. For these reasons, cooling rate measurements are only given as exemplar measurement results, but not recommended for reference or calibration of AM models.

Still, the CBM and AMMT-20 μs cooling rate values cases are an order of magnitude different or more, primarily stemming from the different D4σ laser spot sizes of 100 μm and 170 μm, respectively. The melt pool lengths of the CBM sample were significantly longer than for the AMMT-20 μs sample, which coincide with the deeper melt pool depths shown in Fig. 6 and Table 4, and the longer lengths are indicative of lower cooling rates.

Measurement Uncertainty

Unit Conversions

A preliminary compilation of the components of measurement uncertainty for melt pool length is described here. Nevertheless, the following analysis and compiled uncertainty budget in Table 5 compare different factors in measurement uncertainty for the AMMT and CBM systems.

Table 5 Uncertainty budget for melt pool length measurements

To combine the individual contributing components of measurement uncertainty, they must be converted to the same unit as the measurand (unit of length [μm] for melt pool length). Components of uncertainty given in terms of signal, u(S) in units of [DL], such as digitization errors, camera noise, etc. are converted to temperature u(T) in [°C] by taking the partial derivative of the inverse calibration equation F−1(S) from Eq. 3.

$$ u\left( T \right) = \frac{{\partial F^{ - 1} \left( S \right)}}{\partial S}u\left( S \right). $$
(8)

The differential term is determined by partial differentiation of the inverse calibration Eq. (3), with respect to S:

$$ \frac{{\partial F^{ - 1} \left( S \right)}}{\partial S} = \frac{{c_{2} C}}{{AS\left( {C + S} \right)\ln^{2} \left( {\frac{C + S}{S}} \right)}}. $$
(9)

For melt pool length, this is evaluated at the solidification point. Furthermore, components of uncertainty defined in temperature units u(T), such as calibration uncertainty, or those converted from signal u(S), are converted to units of length u(x) in [μm] utilizing reciprocal of the partial derivative of the true temperature profile T(x):

$$ u\left( x \right) = \left( {\frac{\partial T\left( x \right)}{\partial x}} \right)^{ - 1} u\left( T \right). $$
(10)

Values for dT/dx are based on the first derivative, in the spatial domain, of the true temperature profile T(x), evaluated at the freezing point (e.g., dTtrue(xfreeze)/dx). If components of uncertainty defined in units of length are defined in pixels, these are converted to units of [μm] using the iFoV in Table 2.

Measurement Uncertainty: Melt Pool Length

Equation (6) described the measurement of melt pool length from the thermal profile T(x). Since the profile line is relatively steep at the front of the melt pool (dT/dx is relatively high), the intersection of the length measurement at xfront is more precise than determining the location of xfreeze. Additionally, uncertainties in temperature u(T), converted to uncertainty in length u(x) via Eq. (10), are reduced with higher dT/dx. Therefore, it is assumed that u(xfront) → 0, and uncertainty in the melt pool length measurement is solely derived at the freezing point xfreeze:

$$ u\left( {L_{x} } \right) = u\left( {x_{\text{freeze}} } \right). $$
(11)

The following lists those components of uncertainty that are accounted for in the uncertainty budget. Components of uncertainty due to thermal camera calibration, u1(T), stem from the curve fit procedure (in units of °C) and defined here as the root mean square error (RMSE) of the curve fit. The calibration uncertainty for the AMMT-100 μs was 0.34 °C, for AMMT-20 μs was 2.2 °C, and for CBM was 8.1 °C.

The component of uncertainty due to signal digitization, u2(S), is assumed to be ± 1 DL with uniform probability distribution, resulting in a standard uncertainty of 1/√3 = 0.58 DL.

The AMMT-100 μs case was originally collected at 8-bit (256 DL) dynamic range and was upconverted to 12-bit (4096 DL) digital range, resulting in a 16x loss in precision (± 8 DL). An added component of uncertainty is provided assuming uniform probability distribution, of u3(S) = 8/√3 [DL].

Signal noise or the temporal noise of flicker of the thermal camera pixels for both AMMT and CBM was typically ± 1 DL. Assuming uniform probability distribution results in u4(S) = 1/√3 = 0.58 DL

Uncertainty due to spatial pixilation is assumed to be ± 1 pixel, with uniform probability. This is converted to [μm] using the iFoV in Table 2, resulting in u5(x) = iFoV/√3 μm.

Motion blur and optical blur are mathematically complicated, and their incorporation into measurement uncertainty in thermal or other imaging-based metrology is not standardized. Optical blur stems from the inherent resolution limits of optical system, which depend on many factors, but primarily depend on the measured wavelength and numerical aperture (i.e., the Airy disk diameter or diffraction limit [15]). Motion blur depends on the relative speed of an object or scene with respect to the integration time or shutter speed. Mathematically, both optical blur and spatial blur affect a ‘perfect’ image through convolution of a 2D spatial filter. How this convolution affects the image depends on the convolution filter kernel, as well as the specific image or scene. In other words, the measurement uncertainty stemming from blur will depend on the ‘perfect’ image being measured. As yet, no closed form or simple formulation is known to exist that can be generally applied to determine the contribution of blur to a dimensional measurement on a varying set of images or video.

A conservative, Type B estimate is provided here for motion blur (u6(x)) and optical blur (u7(x)). Uncertainty in length measurement due to motion blur is assumed to be equal to 2× the blur length, calculated as δx = 2 v·tint where v is the scan speed and tint is the integration time. The measured point is assumed to exist within δx with uniform probability, resulting in u6(x) = v·tint/√3. Optical blur is estimated as u7(x) = 2σ width of an assumed rotationally symmetric gaussian point spread function, measured using knife edge technique described in ISO-12233 [16, 17]. Optical blur is assumed to have a normal distribution.

Standard uncertainty of the mean was described prior to Table 4. The class mean for melt pool length defined as the average of all combined video frames for that class (e.g., the class mean for CBM Case A lengths is the average of N = 53 + 27 + 49 total measurements), and standard uncertainty of the mean taken as u8(x) = σ/√(N). The sample population (N) for melt pool length measurements was based on the total number of thermal video frames of all videos taken for that class. For any measurements where N < 30, u8(x) = z·σ/√(N), where z is taken from the student’s t table for a confidence interval of 68.3%.

The ISO Guide to the Expression of Uncertainty in Measurement [18] gives the formula for combining uncertainties in the absence of correlations for the combined standard uncertainty, uc. This requires that each component of uncertainty by converted to standard uncertainty with equivalent normal probability distribution. For those components that are given with a rectangular probability distribution of the range ± a (in units of that component of uncertainty), these are converted to their equivalent standard uncertainty by a factor of 2a/√12 or a/√3 prior to unit conversion. Each component of standard uncertainty is converted to length units using Eqs. (8)–(10), then added in quadrature:

$$ u_{c}^{2} \left( x \right) = \mathop \sum \limits_{n} \left( {\frac{\partial T\left( x \right)}{\partial x}} \right)^{ - 2} u_{n}^{2} \left( T \right) + \mathop \sum \limits_{m} \left( {\frac{\partial T\left( x \right)}{\partial x}} \right)^{ - 2} \left( {\frac{{\partial F^{ - 1} \left( S \right)}}{\partial S}} \right)^{2} u_{m}^{2} \left( S \right) + \mathop \sum \limits_{l} u_{l}^{2} \left( x \right). $$
(12)

\( u_{n}^{2} \left( T \right) \) are the squares of those components defined in units of temperature [°C] (n = 1), \( u_{m}^{2} \left( S \right) \) are the squares of those components defined in units of signal [DL] (m = 2 to 4), and \( u_{l}^{2} \left( x \right) \) are the squares of those components defined in units of length [μm] (l = 5–8).

Table 1 lists each component of standard uncertainty, the unit conversion factors, and the components converted to length units. Finally, the combined standard uncertainty is provided calculated using Eq. (12) and expanded uncertainty assuming coverage factor k = 2 [19].

Some components of uncertainty are assumed negligible. Variability in scan speed and resulting effects are neglected. The high speed cameras have very precise timing clocks (> 1 MHz) and precise frame rates. Cursory observation of the transit of the melt pool across image frames for both the CBM and AMMT cameras demonstrated that the scan speed, measured as the distance moved between frames divided by frame period, resulted in variability far less than one pixel width. Variability in integration time and resulting effects on measurement is similarly neglected due to the precise timing of the camera clocks.

Measurement Uncertainty: Cross Section Width and Depth

Uncertainty due to optical resolution limits in the microscope images is accounted for based on the Rayleigh criterion and illumination wavelength of the microscope. This was estimated to be 0.5 μm (Type B).

Uncertainty due to variability along the track stems from the fact that these measurements are based on a subset of transverse metallographic cross sections, whereas the actual geometries of the track can vary in the longitudinal direction. This effect is minimized when performing laser scans on relatively smooth, bare metal surfaces when compared to single layers of metal powder. Ricker et al. [13] provide topological measurements in the longitudinal direction of the tracks. However, melt pool width or depth was not measured along the longitudinal direction. For width, Fox et al. [20] measured variability along a track width on a 17–4 stainless steel plate, resulting in a 1σ variation of 1.8%. This was conducted on ‘as-received’ surface, which is rougher than those used in this paper, likely contributing to a relatively more variation in track width. Based on this, a conservative estimate of 2% uncertainty in variability track width is accounted for (Type B).

Similarly, variability in track depth is not measured since longitudinal cross sections along the track length were not obtained. However, the authors believe this effect to vary less than 5%, with greatest variation for CBM track A since the cross sections in Fig. 6 demonstrate it to have occurred near or at keyholing regime. King et al. [21] created longitudinal cross sections and noted a 15% variability in depth along 316L stainless steel scan tracks. However, an example track in King et al. had significantly higher volumetric energy density, defined as E = P/V/A [J/mm3], where P is laser power [W], V is scan speed [mm/s], and A is the area of the laser spot based on D4σ diameter [mm2]. This indicates that King et al. utilized E = 124 J/mm3, whereas CBM Case A utilized 48 J/mm3. Although track depth fluctuations likely do not scale directly with energy density, and materials in AM-Bench and King et al. were different, this indicates track depth variability for CBM case A is likely much less than 15% in [21]. Conservative estimates of 5% of mean depth are assumed for all AMMT and CBM cases (Type B).

User variability in the track boundary selection in the microscopic images had an approximate ± 6 pixel repeatability for the 0.062 μm/pixel resolution images, and ± 2 pixel repeatability for the 0.186 μm/pixel images, resulting in user variability uncertainty of ± 0.372 μm (Type A) for all measurements.

The total number of measurements, N, and the experimental standard uncertainty of the mean, umean, are provided in Table 4. Since the number of measurements made of the microscope images was N < 30, umean is scaled based on Student t distribution to represent a 68.3% (1σ) confidence interval as described in the text prior to Table 4.

Since each component of uncertainty is already defined in units of length, no unit conversions are necessary, and the combined standard uncertainty of the width uc(w) or length uc(d), without correlations, is given as the sum of uncertainty components in quadrature:

$$ u_{\text{c}}^{2} \left( w \right) = \mathop \sum \limits_{i} u_{i}^{2} \left( w \right). $$
(13)

Expanded uncertainty, U, utilizes coverage factor k = 2 [19]. Tables 6 and 7 provide the uncertainty budgets for melt pool width and depth, respectively.

Table 6 Uncertainty budget for the melt pool width for the AMMT and CBM cases compiled in Table 4
Table 7 Uncertainty budget for the melt pool depth for the AMMT and CBM cases compiled in Table 4

Discussion and Conclusions

This paper described the experiment setup and measurement results for the AMB2018-02 measurement challenges for melt pool geometry. These experiments consisted of LPBF tracks scanned on bare IN625 plates, in situ melt pool length and cooling rate measurements via thermography and ex situ transverse cross section geometry (width and depth) via optical microscopy. A summary of compiled results is provided in Table 4, and preliminary measurement uncertainty analysis is provided in Tables 5, 6 and 7. Cooling rates are provided, but to be considered as exemplar data, but not reference data.

Melt pool cross section measurements, such as width and depth, as well as microstructural measurements (grain shapes and dendritic microstructure) provided for the 2018 AM-Bench challenges [1] were from the AMMT-100 μs tracks given in Table 4 [12, 13]. However, due to motion blur in the thermographic system, melt pool length measurements should be taken from AMMT-20 μs tracks or the CBM tracks. It was found that cooling rate measurements were significantly different for the AMMT and CBM systems, likely stemming from differences in the imaging systems that affect temperature values much below the solidification point. It was shown in Fig. 7 that the AMMT-100 μs and AMMT-20 μs tracks were fabricated under comparable conditions (laser power, scan speed, and laser spot size).

Melt pool length measurements using thermography have larger uncertainty than cross section width or depth measurements taken via optical microscopy, primarily due to differences in spatial resolution. However, with thermography, greater number of measurements or image frames can be taken, which can elucidate transient variations. Variability in melt pool depth along the track is based on review of external publication [21] and likely depends on the melt pool formation mode (conduction or keyhole).

Further work is necessary to better identify this variability, potentially with new methods for longitudinal track cross sections, and how the measured variability may contribute to melt pool depth measurement uncertainty from more easily obtained transverse cross sections.