Uncertainty evalutation through data modelling for dimensional nanoscale measurements
J. P\'etry, B. De Boeck, N. Sebaihi, M. Coenegrachts, T. Caebergs, M., Dobre

TL;DR
This paper introduces a Bayesian data modelling approach to evaluate measurement uncertainty in nanoparticle dimensional measurements, enabling comprehensive uncertainty quantification without relying on detailed physical models.
Contribution
It proposes a novel statistical method for uncertainty evaluation in nanoparticle measurements using Bayesian modelling and calibration curves, applicable when physical models are incomplete.
Findings
Generated a probability density function for nanoparticle dimensions.
Successfully applied the method to AFM measurements with nano-gratings.
Provided a comprehensive uncertainty quantification framework for nanoscale measurements.
Abstract
A major bottleneck in nanoparticle measurements is the lack of comparability. Comparability of measurement results is obtained by metrological traceability, which is obtained by calibration. In the present work the calibration of dimensional nanoparticle measurements is performed through the construction of a calibration curve by comparison of measured reference standards to their certified value. Subsequently, a general approach is proposed to perform a measurement uncertainty evaluation for a measured quantity when no comprehensive physical model is available, by statistically modelling appropriately selected measurement data. The experimental data is collected so that the influence of relevant parameters can be assessed by fitting a mixed model to the data. Furthermore, this model allows to generate a probability density function (PDF) for the concerned measured quantity. Applying…
| fixed effects | number of levels |
|---|---|
| probe | 3 |
| tapping force | 4 |
| scan speed | 3 |
| operator | 3 |
| image analyst | 3 |
| effect (parameter) | for S[1] | for S[2] | for S[3] | for S[4] |
|---|---|---|---|---|
| day () | 0.0075 | 0.0001 | 0.5439 | 1.0923 |
| position () | 0.0149 | 0.0016 | 0.1623 | 0.6170 |
| image repeat. () | 0.0000 | 0.0003 | 0.0002 | 0.0018 |
| within im. var. () | 0.0309 | 0.0455 | 0.0105 | 1.4797 |
| standard uncertainty ()[] | |
| S[1] | 0,11 |
| S[2] | . |
| S[3] | 0,25 |
| S[4] | . |
| grating S[r] | [] | [] | [] | [] |
|---|---|---|---|---|
| parameter | SD | |
|---|---|---|
| effect | parameter | |
|---|---|---|
| day | ||
| position | ||
| image repeatability | ||
| within image variability |
| effect | |
|---|---|
| probe | |
| amplitude ratio | |
| scan speed | |
| operator | . |
| analyst | . |
| [] | [] | [] | [] |
|---|---|---|---|
| [] | [] | [] | [] |
|---|---|---|---|
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsScientific Measurement and Uncertainty Evaluation · Advanced Statistical Methods and Models · Advanced Statistical Process Monitoring
Uncertainty evalutation through data modelling for dimensional nanoscale measurements
J. Pétry, B. De Boeck, N. Sebaïhi, M. Coenegrachts, T. Caebergs, M. Dobre
National Standards, FPS Economy, 16 Boulevard du Roi Albert II, B-1000 Brussels, Belgium
Abstract
A major bottleneck in nanoparticle measurements is the lack of comparability. Comparability of measurement results is obtained by metrological traceability, which is obtained by calibration. In the present work the calibration of dimensional nanoparticle measurements is performed through the construction of a calibration curve by comparison of measured reference standards to their certified value. Subsequently, a general approach is proposed to perform a measurement uncertainty evaluation for a measured quantity when no comprehensive physical model is available, by statistically modelling appropriately selected measurement data. The experimental data is collected so that the influence of relevant parameters can be assessed by fitting a mixed model to the data. Furthermore, this model allows to generate a probability density function (PDF) for the concerned measured quantity. Applying this methodology to dimensional nanoparticle measurements leads to a PDF for a measured dimensional quantity of the nanoparticles. A PDF for the measurand, which is the certified counterpart of that measured dimensional quantity, can then be extracted by reporting a PDF for the measured dimensional quantity on the calibration curve. The PDF for the measurand grasps its total measurement uncertainty. Working in a fully Bayesian framework is natural due to the instrinsic caracter of the quantity of interest: the distribution of size rather than the size of one single particle. The developed methodology is applied to the particular case where dimensional nanoparticle measurements are performed using an atomic force microscope (AFM). The reference standards used to build a calibration curve are nano-gratings with step heights covering the application range of the calibration curve.
1 Introduction
Measurements of nanoparticles can be performed with many different instruments, from microscopy to light scattering techniques, each having its own measurand. In order to compare data from a given technique or from different techniques, it is needed to evaluate realistically the measurement uncertainty. In the absence of a physical model of the measurement itself, classical approach of uncertainty calculation as described in the Guide of Uncertainty Measurement leads to uncertainty underestimation [6]. At the nanometer scale, we are often in this case. Hence, to establish realistic traceability at the nanometer scale, innovative methods need to be developed. The present paper proposes a method for the uncertainty evaluation of isolated single particle diameter and mean particle diameter measured by microscopy. Although the particular case of Atomic Force Microscopy (AFM) is taken, the method can be applied to different microcopy techniques, such as Transmission Electron Microscopy.
2 State-of-the-art
There are currently two commonly accepted approaches to perform an uncertainty evaluation : the modelling approach and the empirical approach, which are covered by the ISO 5725 standard [1] and the Guide of Uncertainty Measurement (GUM) [6]. In the GUM, the uncertainty evaluation is performed by propagating the various sources of uncertainty through a measurement equation. While in ISO 5725, the variability of the measurand is captured in a statistical model and a classical analysis of variance is performed to evaluate the variability of the different components. In [9], the two approaches are extensively compared.
Concerning the particular case of uncertainty calculation in Atomic Force Microscopy, the uncertainty of the nanoparticles diameter has been evaluated so far with the classical GUM approach although no global physical model of the measurement exists ([5], [13]). In [8], the ISO 5725 approach has been used for TEM measurements and in [4] for light scattering techniques.
In the following, we further develop the ISO 5725 approach. Instead of using a stepwise approach to determine the influential parameters separately, we design an extensive experiment and statistically analyze the measurement data to quantify the different sources of variability. A more general methodology of mixed models replaces the clasical ANOVA approach and the mixed model is fitted to the experimental data using Bayesian inference.
3 Experimental framework
In this contribution, nanoparticle diameters are measured with Atomic Force Microscope. Among the different AFM measurands that describe nanoparticles diameter, we use the nanoparticle height of isolated particles deposited on flat surface, as defined in ([10]). The nanoparticles are gold particles RM8012 with nominal diameter of 30 nm.
Step height standards are used for the instrument calibration, with step heights covering the range of interest for the nanoparticles measurements. Standards S*[1]* have a nominal step height of 18 nm, S*[2]* of 44 nm, S*[3]* of 100 nm and S*[4]* of 180 nm.
The uncertainty is calculated under intermediate precision conditions. Intermediate precision, also called within-lab reproducibility, is the precision obtained within a single laboratory over a long period of time. It takes into account more changes than repeatability but less than reproductibility. In the present case, various operators measure on different days, at various positions on the sample, with varying AFM critical parameters: the probe, the tapping force and the scan speed. Experiments have been designed to identify the significant parameters that contribute to the uncertainty and to quantify these individual contributions.
4 Methods
4.1 Traceability route and uncertainty evaluation
The metrological traceability to the SI units is obtained by comparison with step-height standards. A multiple points calibration curve is built by comparing the calibrated step-height of a series of reference standards with their measured value. The reference standards are certified nano-gratings. In the particular case of nanoparticles measured by AFM, stepheight standards are nano-gratings and the measured quantity to be adjusted is the height of a single particle, , and the mean height of the nanoparticle sample, . Nevertheless the methodology presented hereafter is valid for an arbitrary dimensional quantity.
4.2 Mixed model instead of measurement equation
In absence of a measurement equation, the variability of the measured quantity is modelled by an equation containing the main inluencing influencing factors. This model is chosen to be linear and contains fixed and random effects, it is a linear mixed model. Factors are considered fixed when the same value can be repeated in a subsequent experiment and random when the experimenter randomly samples the values of the factor from a population.
The different factors that could influence the measurand have been a priori included in the model. After running a designed experiment, the significant factors have been identified and quantified, both for the measured stepheight standards and the measured nanoparticles height.
4.3 Design Of Experiment
The random factors under intermediate precision conditions in microscopy are typically measurement day, measurement position and recorded image. As the levels of the different factors are not changing independently, the design is nested as depicted in figure 1 [Montomery]. The effect of ambient conditions is minimized by working under clean and controlled laboratory conditions (stable temperature and relative humidity level, vibration damping and acoustic enclosure) and in absence of a drift effect, the deviations in ambient conditions merely result in normally distributed residual z-noise.
Considering the fixed effects, the sources of fluctuations are the operator-related settings (e.g. imaging force, scan range, scan speed, electronic feedback controller parameters, …) and the image analysis characteristics (e.g. software used, parameter choice in used algorithms).
Among the operator parameters, a priori important parameters are the microscope probe, the tapping force and the scan speed. Three different types of commercial probes classically used in tapping-mode AFM have been used. The tapping force has been varied in a range corresponding to soft tapping. At last, scan speed has been varied a in range of classical use. The operator effect that may be caused by the remaining subjective choices or by any physical instrument manipulations is assessed by three operators.
Regarding the image analysis, the software SPIP has been selected for post-processing and analysis [2]. This first consists in levelling the image, globally and subsequently line by line. The zero-level is fixed as the mean height of the image excluding the nanoparticules features. In a second step, in the case of nano-gratings, the ISO standard 5436-1 algorithm for step heights is applied [3]. In the case of nanoparticles, the maximum -value with respect to the zero-level for the isolated nanoparticles are reported. All parameter choices for these image post-processing and analysis steps are written down in a procedure, strongly decreasing the subjective choices to be made by the image analyst. Nevertheless, the possibly remaining image analyst effect is investigated as well for three analysts. In summary, the fixed effects under considerations are : the probe, the tapping force, the scan speed, the operator and the image analyst.
Table 1 summarizes the different fixed effects and the number of levels considered in the design.
4.4 Probability Density Function
Rather than the dimension of one single nanoparticle, the quantity of interest is the distribution of the nanoparticle height. Moreover, the variability intrinsic to measurement is best described by associating a random variable with the measured quantity so that its measurement result is presented by a probability density function (PDF). Such a PDF contains all available information about the measured quantity, in particular its mean, mode or median, and its standard deviation or another measure for its uncertainty. By such, the uncertainty of the measured quantity is obtained from the PDF of its associated random variable.
4.5 Mixed model
The variability of the measured quantity as a function of the main influencing fixed factors and the random effects can be described by a linear mixed model with the following equation:
[TABLE]
where refers to the independent days, stands for the measurement positions on a given day, refers to the repeated images for a given combination of day and position, and stands for the different measurements on image taken at position on day . The realization of is thus the -th observed value in the -th image taken at position on the -th day of the sample [r]. The random effects , , and are mutually independent for all , , and . The variance expresses day-to-day variability, the variance between positions, the variance between repeated images, and the within image variability captures the residual variance of the observed quantity within an image. The intercept of the model represents the measured mean quantity when the fixed factors in the model have all value [math].
The fixed effects are noted , where and is the number of fixed effects. Fixed effects are categorical variables and effects-type coding is used. In this case, the intercept will represent the mean response for the average value of all factors. The obtained PDF for therefore represents our knowledge about the measured mean diameter when the fixed factors are averaged out, or when there are no fixed effects present in the model (1). Every possible level combination of the fixed factors (; m=1, …M) provides an opinion about the measured mean diameter ():
[TABLE]
Instead of using the opinion for the average fixed factors, we make the conservative choice of combining all opinions corresponding to the different fixed factor combinations, through a linear opinion pool as in [7]. Assuming that all opinions are equally reliable, this means we state to be the mean of all concerning PDFs.
The estimation of the model is made with the Restricted Maximum Likelyhood method as it allows to estimate separatly the random and the fixed effects ([11] and [12]). Fixed effects that are not significant at the level of significance are dropped from the model.
4.6 Bayesian approach
The measured quantity is considered as a ditribution rather than a single value, hence the approach to fit the model (1) is chosen to be Bayesian. In such framework, a fitted model can be updated by adding new data. We can repeat the above approach by performing new measurements and use the posterior PDFs for the parameters in the model (1) as prior knowledge for the Bayesian inference of the new measurement data, taking profit from the accumulation of knowledge. The model fitting is performed by using an Hamiltonian Monte Carlo algorithm (RStan package in R software; see [Stan15] and [Stan17]).
5 Application
In the following, the method described above is applied to the step heights in a first instance to build the calibration curve, and in a second step to the nanoparticles. Finally, the calibration is curve is applied to the distribution of the measured nanoparticle height.
5.1 Step height standards
5.1.1 Experiment under intermediate precision conditions
The calibration curve is constructed by fitting the measured mean step heights to the certified mean step heights . The PDF of the measured mean step height is obtained for each standard through the fitting of the measurement data obtained in a designed experiment to a linear mixed model such as described by (1). From this fitting, the contribution of the different random and fixed effects to the variability is extracted. The estimated variance of the respective random effects, , are shown in Table 2 for the 4 standards.
Clearly, the image repeatability does not bring any variability. For all the standards, the largest contribution comes from the within image variability, but contribution from day and position cannot be discarded.
Regarding the fixed effects, only the probe effect is significant and strangely enough, only for gratings S*[1]* and S*[3], but not for gratings S[2]* and S*[4]*.
When there is no fixed effect influence, the measured mean step height coincides with the intercept from model (1). Since the experiment was designed to be balanced, the standard uncertainty of , defined as , is given by: :
[TABLE]
where is the total number of observations.
In the case of the standards for which the probe does have an effect, the measured mean step height is given by . The corresponding standard uncertainty is given by :
[TABLE]
The PDF for the certified step heights (r=1..4) are obtained assuming a normal distribution with mean and standard deviation as given in the certificate. Table 4 summarizes the expected values and standard uncertainty of the measured mean step height for the 4 reference gratings under consideration and the corresponding certified values.
5.1.2 Construction of the calibration curve
[TABLE]
Having the 4 calibration points , the calibration curve is obtained by fitting the quadratic regression equation:
[TABLE]
The parameter is a normal deviation from the quadratic model. In the Bayesian framework, these parameters are expressed by probabilities and the PDFs for , , and display the variability present in the calibration points and the model uncertainty. The joint PDF for is approximated by sampling a sufficient amount of times from its distribution through the following procedure:
- •
take samples (for ) from the 4 calibration points
- •
calculate for the estimated coefficients , and , and the mean squared error by performing times an Ordinary Least Squares quadratic regression with regression data for
- •
simulate a random value from (for )
- •
collect the sample
The joint distribution of is approximated by merging the samples for . Table 5 shows the results obtained for the parameters with .
5.2 Nanoparticles
5.2.1 Intermediate precision experiment
Similarly, an intermediate precision experiment is performed for the nanoparticles, following an appropiate design of experiment. Regarding the effects of operation, we proceed as follows. To obtain a sufficient amount of particles on a single image a scan range of is chosen. The height of a nanoparticle is measured more accurately if the pixel size is smaller. In general, a larger pixel size will lead to a larger underestimation of the real particle height. Nevertheless, practical restrictions make it infeasible to keep augmenting the number of pixels. We have therefore chosen to perform measurements with pixels, leading to a relatively small pixel size of about . The pixel size factor is thus fixed in the experiment. The effect of scan speed in the scanning direction is assessed by considering 3 different levels (i.e. , and ). Also 4 levels of amplitude ratios are tested (i.e. , , and ). The electronic feedback controller parameters are chosen to obtain a good tracking of the topography. The level of these parameters is a subjective choice going into the operator effect discussed above.
Executing the experiments and fitting the linear mixed model (1) as described previously, leads to the results shown in Tables 6 and 7 for the random and fixed effects.
Similarly to the step height measurements, the image repeatability is good and does not bring significant variability, while the largest contribution from random effects comes from the within image variability.
The fixed factors image analyst and operator have no significant effect on the nanoparticle height measurements. Nevertheless, the levels of the fixed factors probe, amplitude ratio and scan speed do have a certain effect on the nanoparticle height measurements. The different levels of the parameters is expressed by a posterior PDFs. The average of these posterior PDFs is considered to calculate the respective standard uncertainties, as the standard deviation of these average PDFs, shown in Table 7. The main effects of the fixed factors are given in this table, although also interaction terms (amplitude ratioscan speed and probescan speed) are included in the model (1). The respective main effects , and of the fixed factors probe, amplitude ratio and scan speed are obtained as it was done for step height standards. The standard deviations of , and are given in Table 7 by , and , which are the main standard uncertainties caused by the respective factors.
Using the posterior PDFs for all these parameters enables us to determine a PDF for the measured mean height of the nanoparticles sample, but also for the measured height of a single nanoparticle from that sample. The expected value and the corresponding standard uncertainty for the measured mean height , and and for the measured height of a single particle, are given in Table 8. Each level combination of the fixed factors leads to another opinion about the measured mean height , but also about a future observed measured height of a single particle. These opinions are averaged out with equal weights by taking their mean PDF to obtain a PDF for (), and one for , which is used to derive the results in Table 8.
5.2.2 Calibration curve
The regression model (2) expresses the relation between the measured and the certified mean step height of the reference standards, so adopting this relation to obtain a calibration curve leads to :
[TABLE]
where is the certified quantity’s random variable and is the measured quantity’s random variable. To extract a PDF for the measurand by reporting a PDF for on the calibration curve, we use Monte Carlo simulation.
5.2.3 Uncertainties
The PDFs for certified quantities and are obtained by using the calibration curve once with and , and once with and . The PDFs main parameters are summarized in Table 9, although the most complete measurement results are the PDFs themselves.
6 Conclusions
Traceable measurement of nanoparticles is obtained through comparison to standards. In the range of interest, a calibration curve is built on the measured and certified data of the standards. A complete measurement uncertainty evaluation of the measured dimensional quantities of the reference standards and the nanoparticles is performed. It consists in determining a PDF for the measured dimensional quantity by statistically modelling appropriately selected experimental measurement data.
To illustrate our methodology we have applied the entire approach on the AFM measurement procedure we execute in our laboratory to obtain PDFs for the certified height of a single particle from a sample of golden particles and the certified mean height of that sample.
The experimental data is collected via a designed experiment performed under intermediate precision conditions. The influence of all relevant parameters is assessed by fitting a Bayesian mixed model to the data. The random effects of the model are measurement day, position and image repeatability. For this sample of nanoparticles it has been demonstrated that the fixed factors scanning speed, amplitude ratio and the type of probe all have a significant effect on the nanoparticle height measurements. The relevant random effects express day-to-day variability, variability between measurement positions, between image variability and within image variability.
After calibration of the measured dimensional quantity of the nanoparticles, the resulting PDF for the measurand comprises the expected value of the measurand and the associated standard uncertainty.
7 References
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] ISO 5725:2004 Accuracy (trueness and precision) of measurement methods and results. Technical report.
- 2[2] SPIP.
- 3[3] ISO 5436 Geometrical Product Specifications, Surface texture: Profile method; Measurement standards Part 2: Software measurement standards. Technical report, 2001.
- 4[4] A.Braun, O.Couteau, K.Franks, V.Kestens, G.Roebben, A.Lamberty, and T.P.J.Linsinger. Validation of dynamic light scattering and centrifugal liquid sedimentation methods for nanoparticle characterisation. Adv. Powder Technol. , 2(6):766–770, 20112.
- 5[5] A.Delvallée, N.Feltin, S.Ducourtiuex, M.Trabelsi, and J.F.Hochepied. Toward an uncertainty budget for measuring nanoparticles by AFM. Metrologia , 53:41–50, 2016.
- 6[6] BIPM, IEC, IFCC, ILAC, ISO, IUPAC, IUPAP, and OIML. Evaluation of measurement data - Guide to the expression of uncertainty in measurement . 2008.
- 7[7] Robert T Clemen and Robert L Winkler. Combining Probability Distributions From Experts in Risk Analysis. Risk Anal. , 19(2):187–203, 1999.
- 8[8] Pieter-Jan De Temmerman, Eveline Verleysen, Jeroen Lammetryn, and Jan Mast. Size measurement uncertainties of near-monodisperse , near- spherical nanoparticles using transmission electron microscopy and particle-tracking analysis. J Nanopart Res , 16:2628, 2014.
