research papers
Background modelling of diffraction data in the presence of ice rings
aDiamond Light Source Ltd, Harwell Science and Innovation Campus, Didcot OX11 0DE, England, bLaboratory of Molecular Biology, Francis Crick Avenue, Cambridge CB2 0QH, England, cHamburg Centre for Ultrafast Imaging, Universität Hamburg, Luruper Chaussee 149, 22761 Hamburg, Germany, dSTFC Rutherford Appleton Laboratory, Didcot OX11 0FA, England, and eCCP4, Research Complex at Harwell, Rutherford Appleton Laboratory, Didcot OX11 0FA, England
*Correspondence e-mail: garib@mrc-lmb.cam.ac.uk, gwyndaf.evans@diamond.ac.uk
An algorithm for modelling the background for each Bragg reflection in a series of X-ray diffraction images containing Debye–Scherrer diffraction from ice in the sample is presented. The method involves the use of a global background model which is generated from the complete X-ray diffraction data set. Fitting of this model to the background pixels is then performed for each reflection independently. The algorithm uses a static background model that does not vary over the course of the scan. The greatest improvement can be expected for data where ice rings are present throughout the data set and the local background shape at the size of a spot on the detector does not exhibit large time-dependent variation. However, the algorithm has been applied to data sets whose background showed large pixel variations (variance/mean > 2) and has been shown to improve the results of processing for these data sets. It is shown that the use of a simple flat-background model as in traditional integration programs causes systematic bias in the background determination at ice-ring resolutions, resulting in an overestimation of reflection intensities at the peaks of the ice rings and an underestimation of reflection intensities either side of the ice ring. The new global background-model algorithm presented here corrects for this bias, resulting in a noticeable improvement in R factors following refinement.
Keywords: protein structure; refinement; X-ray crystallography; ice rings; data processing; data analysis; X-ray diffraction; data quality; AUSPEX; DIALS.
1. Introduction
In macromolecular crystallography (MX), for data collected using the rotation method, a data set is typically composed of a sequence of X-ray diffraction images (Arndt & Wonacott, 1977); each image covers a fixed oscillation and, as the crystal is rotated, individual reflections enter and subsequently exit the diffracting condition. Integration programs, such as MOSFLM (Leslie, 1999), XDS (Kabsch, 2010), d*TREK (Pflugrath, 1999), HKL-2000/DENZO (Otwinowski & Minor, 1997) and DIALS (Waterman et al., 2013), are used to predict where each Bragg reflection will appear on the detector and then to provide an estimate of the intensity of each reflection. The simplest method for computing the reflection intensities is via summation integration; most integration programs provide an implementation and, whilst the details may differ, the procedure is generally the same.
|
Traditionally, in most integration programs simple background models have been employed; a major reason for this is the necessity of having a computationally efficient implementation since the background needs to be estimated for a large number of reflections in each data set. Furthermore, the best way to model the general reflection background is not always obvious since the background varies considerably between data sets. As such, the background under each reflection peak is often assumed to be a constant value (Kabsch, 2010) or a plane with a small gradient (Rossmann, 1979; Otwinowski & Minor, 1997; Leslie, 1999). In DIALS, either a constant or planar background can be used (Parkhurst et al., 2016). In a typical MX X-ray diffraction data set, individual reflections extend over a small number of pixels; therefore, this assumption often holds true – the local background is fairly flat – and these simple models have been employed with great success for many years (Diamond, 1969; Otwinowski & Minor, 1997; Leslie, 1999; Kabsch, 2010).
Whilst such a simple background model may be appropriate in the majority of cases, particularly for well measured data, it is not applicable where the background changes significantly over the extent of a single reflection peak. In such cases a flat or planar background model is likely to provide an inaccurate estimate of the background in the reflection-peak region. Large variation in the background counts can be the result of various effects such as scattering from the cryostream nozzle or, in serial crystallography, from the linear jet that transports crystals into the beam, which creates a streak of diffraction perpendicular to the jet direction. Large variation is also often seen around the backstop; however, these reflections are usually omitted from processing owing to their large Lorentz factor. Perhaps the most common pathology seen in diffraction images resulting in a large variation in background counts is the presence of water ice rings (Mitchell & Garman, 1994). A detailed description of the theoretical manifestation of cubic and hexagonal ice, the most common forms, in diffraction images can be found in Thorn et al. (2017). In practice, when cubic ice diffraction is observed, hexagonal ice diffraction is also observed (Fuentes-Landete et al., 2015).
If the background is assumed to be locally flat, but ice rings are present, the reflection intensities will be systematically biased. The effect on the background estimation caused by the presence of ice rings can be readily seen by plotting the scaled reflection intensities as a function of resolution, as shown in Fig. 1. This plot shows a large spike in the reflection intensities at ice-ring resolutions, with a drop in the reflection intensities either side of the ice ring; i.e. the presence of ice rings causes both systematic overestimation and underestimation of the reflection intensities at characteristic resolutions. Indeed, at high resolution, where the true reflection intensities are very small, the positive systematic bias in the background estimate causes the average reflection intensity to be less than zero at resolutions immediately either side of the ice rings.
The cause of this effect can be understood by considering the application of a simple background model to a reflection positioned close to an ice ring, as illustrated in Fig. 2. As the ice ring intrudes into the background region of the reflection shoebox, the background level in the reflection-peak region is overestimated owing to the higher valued counts from the ice ring. When the reflection foreground covers the peak of the ice ring, then the background region of the reflection shoebox contains pixels with fewer counts than should be modelled in the reflection peak. Consequently, the background in the reflection peak will be underestimated and the reflection intensity will be overestimated. This leads to many reflections being rejected as outliers during data reduction, resulting in a loss of information. This effect is more pronounced for sharper ice rings; however, on average, fewer reflections will be affected than in the case of more diffuse ice rings which cover a larger resolution range.
In most integration programs, the handling of ice rings and other complex background features is problematic, and proper modelling is rarely attempted. However, some programs, such as MOSFLM and XDS, do provide parameters to exclude reflections within a user-specified resolution range. Therefore, in these programs reflections falling on ice rings can be easily excluded from the processing if desired, which usually results in a loss of otherwise potentially useful information. In d*TREK and HKL-2000/DENZO (Otwinowski & Minor, 1997) parameters are provided to remove reflections whose background counts vary excessively; however, again, this will result in information loss. It is often the case that the reflections recorded on ice rings are handled during scaling rather than integration. This is particularly the case at higher resolution where ice rings may not be immediately visible on single detector images. Scaling programs such as AIMLESS (Evans & Murshudov, 2013) have outlier-handling routines that exclude intensity measurements that are not consistent between symmetry-equivalent reflections; additionally, a resolution range can be set to exclude reflections from the scaling. Programs such as CTRUNCATE (Winn et al., 2011), phenix.xtriage (Zwart et al., 2005) and AUSPEX (Thorn et al., 2017) can be used to automatically determine, from the scaled reflection data, whether the data have been contaminated by ice rings.
An attempt to handle ice rings external to the integration program is described by Chapman & Somasundaram (2010). They describe a method to subtract the ice-ring intensity from the raw image data as a pre-processing step before integration. However, this approach is not ideal since the statistics of the data will be altered. Furthermore, the shape of the ice rings is assumed to be radially Gaussian with resolution and perfectly circular, which may not be the case in practice. The data as recorded by a photon-counting detector are `count data', which are well modelled by a The is discrete and only valid for positive pixel counts. Subtracting the background prior to the integration will result in the data no longer being Poisson-distributed; some pixels may contain negative counts and others may contain a non-integer number of counts. This will render assumptions about the statistical properties of the data in the integration program invalid and will have an impact on the estimation of the errors in the intensities. For this reason, the ice-ring background should be modelled explicitly during the reflection-integration step.
2. Algorithm
We describe a new algorithm for modelling the X-ray diffraction background in the presence of ice rings. The algorithm consists of two distinct steps: firstly a global model of the background at each image pixel is generated, and the model is then fitted locally and independently for each predicted reflection in the data set. The implementation of the algorithm and program usage in DIALS is given in Appendix A.
2.1. Global background model
In the current implementation in DIALS (Waterman et al., 2013), we restrict ourselves to considering a static model that is applied to reflections over the entire rotation scan. For the static background-model algorithm, we assume that the shape of the background model remains fairly stable across all of the images in the data set. We assert that in the case where the background is contaminated with ice rings, an approximate model should perform better than a flat background model; this therefore represents an improvement in the handling of data with a complex background.
The global background model is calculated as the mean value at each pixel averaged over all images in the data set. This method for generating the global background model is computationally efficient and simple to compute; care needs to be taken to ensure that the inclusion of outlier pixels does not cause the background model to be distorted. In this context, outlier pixels are considered to be pixels which contain intensity from predicted reflections as well as unmodelled intensity, which may come from reflections whose extent is badly predicted, zingers (random spikes in intensity from, for example, cosmic rays) or other sources.
Intensity from predicted reflections is handled by generating a mask for each image delineating the foreground and background for each reflection, and then using only background pixels for the global background model. The mask contains True where the pixels are predicted to only contain background counts and False where they are predicted to contain intensity from predicted reflections. Once the process concludes and a mean value is computed at each pixel, the number of images contributing to the mean for each pixel is calculated. A second pixel mask is then generated containing True where the number of contributed images is greater than some user-specified value (by default ten) and False otherwise. In this way, pixels where only a small number of images have contributed are excluded. Where the number of images in the data set is less than ten, the minimum number of required images is reduced; however, the method is most effective where a larger number of images is available.
In order to ensure that the model is not affected by outliers caused by unmodelled intensity, a number of filters are applied to the mean image to produce the final background model as follows.
2.2. fitting for each reflection
The background is fitted to each reflection locally and independently by simply scaling the background model to fit the counts in the background region of the reflection in question. The pixel counts are assumed to be drawn from a i in the reflection background, consisting of N pixels, the probability of observing ci counts, given the background model bi scaled by the parameter B, is
For each pixelThe value of the parameter B is then estimated via by considering the joint probability distribution over the N pixels,
Using the log likelihood and taking derivatives with respect to the scale parameter, ∂log(L)/∂B = 0, results in a very simple and computationally efficient equation for the scale factor B for each reflection, which is simply
However, this equation for the scale factor is not resistant to pixel outliers in the reflection background, which must be handled to ensure that the background estimates are reliable. Since the data are Poisson-distributed, a principled approach to the modelling of the background in the presence of pixel outliers would be to use a robust generalized linear model (GLM) algorithm (Parkhurst et al., 2016); however, whereas the robust GLM algorithm can be made computationally efficient for the case of a flat background model, the algorithm proved to be difficult to optimize in the case of more complex models. Computational efficiency is a requirement of any background-modelling algorithm in integration since the background needs to be estimated for a large number of reflections in each data set. Therefore, a simpler approach was taken in this case. The approach used here was to use the Anscombe variance-stabilizing transform for a (Anscombe, 1948) given by y = 2(x + 3/8)1/2. This transforms the Poisson-distributed data such that they are approximately normally distributed with a variance of 1. This transformation is biased where the Poisson scale parameter is very small (<4); however, in the case of data where the background is contaminated with ice rings the background is generally much larger and this approximation may be used. The robust estimation is then performed using the Huber weighting function (Huber, 1964) such that for a pixel i, with transformed value yi, predicted value μi, variance vi and residual ri = (yi − μi)/vi1/2, the pixel weighting wi will be given by
This weighting function has the effect of damping values outside a range defined by the tuning constant c, whose default value is 3 (i.e. transformed pixel values greater than three standard deviations from the mean are damped). The quasi-likelihood equation implementing this robust algorithm is then solved using iteratively reweighted least squares, as described in Appendix B.
3. Analysis
3.1. Experimental data
In order to evaluate the effect on the quality of processed data when there are prominent ice rings in the X-ray background, some data sets were selected from the Joint Centre for Structural Genomics (JCSG; Gabanyi et al., 2011). Whilst the method is also applicable to data collected using other detectors, only data sets collected using a Dectris PILATUS detector (Henrich et al., 2009) were considered for analysis. Data sets were chosen manually by inspecting a plot of the intensity versus resolution using AUSPEX (Thorn et al., 2017); those data sets showing a noticeable systematic bias at ice-ring resolutions were used (see Fig. 6). Two data sets (PDB entries 4mjg and 4puc) were identified in which reflections in entire resolution ranges corresponding to ice rings had been discarded in deposition; in the following analysis, the data were processed without omission. 13 data sets that showed ice-ring pathologies and which were successfully processed using DIALS inside the xia2 (Winter, 2010) automatic processing pipeline were used in the analysis. Table 1 shows the data sets used in more detail, giving the known and resolution. Details of the data processing, data reduction and are given in Appendix C.
|
3.2. results
The Rwork and Rfree statistics reported by REFMAC5 (Murshudov, 2011) for each data set as processed with both the default background algorithm and the global background algorithm are shown in Table 1; additionally, Rfree for each data set is shown in Fig. 3. The improvement in Rwork and Rfree is shown for both summation-integrated data and profile-fitted data. It can be seen that in each case both Rwork and Rfree are reduced by the use of the global background-model algorithm over the default background algorithm. An improvement is seen when the data are processed using both summation integration and profile fitting. In some cases (for example PDB entries 4kw2 and 4opm) the improvement is minor; however, in others, such as PDB entry 4puc, the improvement in the R factors is dramatic, with Rfree being reduced by 4.9%. In the case of PDB entry 4puc, as previously reported, reflections from entire resolution ranges around ice rings were omitted in the deposited data (the completeness of the deposited data was 78.1%; the completeness of the data processed here is 99.3%). In general, most data sets see a moderate improvement in the Rfree; the mean improvement in Rfree across all data sets was 2.0% when using summation integration and 1.1% when using profile fitting. Profile fitting also consistently results in lower Rwork and Rfree values than summation integration, and the improvement in Rwork and Rfree when using the new global background model algorithm is slightly lower than the improvement observed with data processed using summation integration.
3.3. Case studies
Of the 13 JCSG data sets processed above, three were selected for more detailed analysis. The first image and the average background versus resolution for each of the data sets is shown in Fig. 4. The data sets were chosen as follows.
|
3.4. Pixel statistics
During the creation of the global background model, the mean, variance and index of dispersion (variance/mean) are calculated independently for each pixel across all images in the rotation scan. Note that pixels predicted to contain intensity from reflections are not used in the calculation of these images. The mean and index of dispersion are shown for each data set in Fig. 5. From a qualitative inspection, the mean background image visually resembles a smoothed version of the raw image data shown in Fig. 4. The dispersion images, however, indicate that the variation in the background is not uniform across the detector surface. In particular, background pixels not containing ice rings appear to vary very little across the rotation scan, as indicated by the index of dispersion being close to 1.0. By contrast, pixels containing ice rings appear to show much greater variation across the scan, with an index of dispersion of greater than 2.0 in some cases. This appears to indicate that the intensity of the ice-ring background varies much more than the general background counts.
3.5. Intensity versus resolution
Fig. 6 shows the intensity plotted against resolution for all reflections in each data set with the default background algorithm and the new global background-model algorithm. In each case, for the default background algorithm it can be seen that the reflection intensities at ice-ring resolutions suffer from systematic bias. This is shown as spikes in the intensity at ice-ring resolutions. These spikes are owing to the background of reflections lying at ice-ring resolutions being underestimated. Thus, the reflection intensity is overestimated. Small dips in intensity can be seen either side of the ice rings, showing how the background is overestimated as the ice ring intrudes into the background region of the reflection shoeboxes, thereby causing the reflection intensities to be underestimated. This is particularly noticeable for data set 4puc, where the shift is dramatic. Data set 4ef1 shows a moderate increase in reflection intensities at the ice-ring resolutions; data set 4kw2 only shows a fairly minor shift visible in the ice ring at 3.7 Å.
For the new global background-model algorithm, the intensity estimates appear to be greatly improved. For the 4ef1 and 4kw2 data sets, the spikes at ice-ring resolutions are completely absent, indicating that the systematic bias in the intensity estimates has been reduced relative to the bias for the default background algorithm. For the 4puc data set, which was the most challenging data set, there is some improvement; however, peaks are still present at some ice-ring resolutions. This is owing to the ice-ring background being sharp and irregular with time-dependent variation throughout the data set. Taken together, these conditions provide a difficult modelling challenge. The algorithm computes the global background model over a number of images; therefore, the algorithm will tend to perform worse where there are large time-dependent variations in the background shape. Nevertheless, 4puc showed the best improvement in R factors, as shown in Table 1.
3.6. Moments of E and Rfree versus resolution
The left panel in Fig. 7 shows the fourth acentric moments of E, the normalized structure factors, for each data set processed with both the default background algorithm and the new global background-model algorithm as produced by CTRUNCATE (Winn et al., 2011). For error-free data, the fourth moment takes on a value of 2 for untwinned data and 1.5 for perfectly twinned data (Stein, 2007). When the variances on the intensities are taken into account, the value of the moments is inflated by σ(I)2/〈I〉2, as described in Appendix D; this is shown by the theoretical curve in Fig. 7, which was generated by the Phaser program (McCoy et al., 2007). The right panel in Fig. 7 shows Rfree versus resolution as reported by REFMAC5 (Murshudov et al., 2011).
The moment plots seem to mirror those seen in the intensity versus resolution plots. Data set 4puc shows large deviations from the expected value of 2 at ice-ring resolutions with the default background algorithm. After application of the new global background-model algorithm the moments, whilst better behaved, still show the effect of the ice rings. For 4ef1, the moments differ at ice-ring resolutions for data processed with the default background algorithm and data processed with the new global background algorithm. However, the variation is small relative to the noise. For 4kw2, which showed little improvement after application of the global background-model algorithm, the ice rings seem to have very little effect on the moments. For data processed with both the default background algorithm and the new global background-model algorithm, the moments follow the expected theoretical curve. It is clear that the moments are not always a clear indicator of ice rings in the data. In particular, a mild pathology may not alter the moments such that the effect is visible through the noise; however, the effect may be visible for more prominant ice-ring cases, such as for data set 4puc.
A plot of Rfree against resolution provides a better indication of the effect of ice rings on the data; however, it is only available after For data sets 4puc and 4ef1 the effect of applying the new global background-model algorithm is immediately clear: the Rfree at ice-ring resolutions is drastically decreased relative to the Rfree using the default background algorithm. As also shown in the previous analysis, the difference observed in the Rfree for data set 4kw2 is negligable. Inspecting this plot may give some indication as to the effect of ice rings on the data, particularly for data containing very prominant ice rings, such as data set 4puc.
3.7. Application to data with no ice rings
As a control, a weak thaumatin data set collected on beamline I04 at Diamond Light Source and known to contain no visible ice-ring pathologies (Winter & Hall, 2014) was processed to ensure that the new global background-model algorithm gives good results in the case of well collected data. The average background over all resolution ranges is less than one count per pixel; there is also a low incidence of outliers in the background pixels. The data set was processed to a resolution of 1.2 Å using the same procedure as described in Appendix C.
It was found that the use of the global background-model algorithm for this data set resulted in no difference in the R factors. with REFMAC5 resulted in the same Rfree for data processed with both the default background algorithm and the new global background-model algorithm. When summation integration was used the Rfree was 18.1% in each case and when profile fitting was used the Rfree was 17.4% in each case, thereby further illustrating the trend seen previously, where a reduction is Rfree is observed when using profile fitting over summation integration. Furthermore, plots of the moments with resolution and the Rfree with resolution showed no difference between data processed using the default background algorithm and the global background-model algorithm.
4. Conclusion
The use of a new global background-model algorithm for the processing of X-ray diffraction data in the presence of ice rings is presented. Traditional approaches to background modelling as implemented in current integration programs do not adequately cope with the task of modelling reflection background that is not well described by either a constant or a plane with a small slope. Consequently, these methods introduce systematic bias into the background estimation for reflections whose integration shoeboxes overlap with ice rings. This bias renders the majority of reflection intensities at certain resolutions unreliable if the data set is contaminated by ice diffraction. At the peak of an ice ring, reflection intensities tend to be overestimated owing to an underestimation of the reflection background. To either side of the ice ring, reflection intensities tend to be underestimated owing to an overestimation of the reflection background. The use of a simple global background-model algorithm has been shown to correct for these issues. Modelling the background in the presence of ice rings is challenging; however, correct modelling can have a noticeable effect on the downstream data processing. Finally, it is important to note that whilst it is possible to correct for the effect of ice rings in data-processing software, better results can be obtained by ensuring that samples are not contaminated with ice to begin with.
4.1. Future improvements
The current implementation uses a simple static background model which is applied to each image in the data set. A future enhancement to the algorithm may be to employ a scan-varying global background model, where the model is allowed to vary over the course of the rotation scan. Additionally, the algorithm may be enhanced by generating a number of models (for example a flat and planar model as well as a curved model based on the global background model) and fitting to each reflection, with the model then being selected by a model-selection algorithm; for example, the Akaike Information Criteria (AIC; Akaike, 1973).
APPENDIX A
Algorithm usage in DIALS
The algorithm was implemented in C++ for use within DIALS. The global background-model calculation is implemented as a separate program, dials.model_background. This program generates a file, background.pickle, which contains the computed global background model. It also generates a series of diagnostic images which can be used to inspect the properties of the data set and the quality of the background model prior to integration. These include the minimum and maximum value at each pixel in the data set and the mean, variance and index of dispersion (variance/mean) images. The mean image is used to generate the background model and the index of dispersion image is useful for evaluating the variation in the background at each pixel. Recalling that for a the index of dispersion D = variance/mean = 1, then values significantly greater than 1.0 will indicate large variation in the counts for that pixel over the course of the data set. An image of the final background model is also generated; viewing this allows a qualitative assessment of whether the generated model is appropriate for the data. The mean image or generated background model could also be used to provide automatic ice-ring detection.
The background model is then applied in the dials.integrate program by setting the background.algorithm=gmodel user parameter to perform integration using the global background-model algorithm. The robust or nonrobust fitting algorithm can be selected via a user parameter depending on what is most appropriate for the particular data set. Currently, the input experiments file must contain the profile information generated from a successful integration run; therefore, an initial integration run is required before performing the global background modelling. In future versions of DIALS these steps may be applied together. Sample program usage is shown below.
APPENDIX B
Robust M-estimator for background scale factor
The terms used in the following equations are defined in Table 2.
|
In robust estimation, M-estimators minimize a function of residuals of the form
The value of each residual ri depends at each iteration on the value of the parameter estimates, β. Taking derivatives with respect to each parameter, βj, gives
Weights are then defined as
The equation to be solved then becomes
The parameter estimates can be found at each iteration as
In order to fit the global background model, a single scale factor is used. The design matrix X then has a single column. Therefore, each iteration can then be simplified to
In our implementation, the Huber function is used, which gives the robust function of residuals as
This results in the following weighting function:
APPENDIX C
Data processing, reduction and refinement
Aside from the choice of background-model algorithm, the details of the processing were identical in each case. Each data set was processed with xia2 (Winter, 2010) using DIALS (Waterman et al., 2013) as the data-analysis engine. The integrated experiments.json file produced by xia2 after integration was then passed to a new program (dials.model_background), which was used to compute the global background model. The data were then integrated again, first using the default background algorithm and then using the global background-model algorithm. In each case the data were integrated using summation integration and profile fitting. Reflections falling on ice rings were not excluded from the data processing. For data sets composed of more than one sweep, each sweep was integrated separately.
The data were processed using the DIALS pipeline as follows, where ${PATH_TO_IMAGES} is a placeholder for the path to the directory containing the image data.
The procedure for re-integrating the data using the global background-model algorithm and again with the default background algorithm is shown as follows, where ${ORIGINAL_EXPERIMENTS} is a placeholder for the path to the integrated experiments.json file from the xia2 processing.
The data reduction was performed using POINTLESS (Evans, 2006), AIMLESS (Evans & Murshudov, 2013) and CTRUNCATE (Winn et al., 2011), specifying the known and the resolution as reported in the PDB entry for each data set. For data sets composed of more than one sweep, the data sets were scaled and merged together in AIMLESS to produce a single merged MTZ file. A free set of reflections for cross-validation in was then selected using the FREERFLAG program. The UNIQUEIFY script in the CCP4i GUI application (Winn et al., 2011) was used to ensure that the same free set was used for the processing of all instances of the same PDB entry. Prior to the coordinates in the PDB file for the data set were randomized using PDBSET (Winn et al., 2011) with a maximum noise level of 0.4 Å to ensure that there was no bias in the and Rfree calculation. Finally, each data set was refined to convergence against the randomized structure using REFMAC5 (Murshudov et al., 2011).
A complete script detailing the data-reduction and ${PDBID}, ${SPACEGROUP} and ${RESOLUTION} are placeholders for the known PDB identifier, and resolution, respectively.
steps is shown below, whereAPPENDIX D
The effect of noise on the intensity moments
The observed reflection intensity Io is the sum of the true intensity It and a noise contribution n, such that Io = It + n. Therefore, the first and second moment of Io can be written as
The normalized moment can then be written as the following ratio:
If we denote k = var(It)/〈It〉2, then the above ratio can be written as
The value of k depends on the distribution of true intensities. For single-crystal intensities without statistical peculiarities such as and pseudo-translation, k = 1. For merohedral k = 1/2. For n-fold k = 1/n. Therefore, for single-crystal, untwinned data the ratio is given by
Assuming in each case that there is no correlation between the signal and the noise [i.e. cov(It, n) = 0], the following hold.
|
Acknowledgements
The development of DIALS is supported by Diamond Light Source and CCP4. We also thank Dr Harry Powell, Dr Andrew Leslie, Dr Phil Evans, Professor Randy Read and Dr Roger Williams for their help and advice.
Funding information
JMP was supported in part by Biostruct-X project No. 283570 of the EU FP7, by the Wellcome Trust and by CCP4. AT was funded by European Union FP7 Marie-Curie IEF grant SOUPINMYCRYSTAL. GNM is funded by MRC grant MC_US_A025_0104.
References
Akaike, H. (1973). Proceedings of the Second International Symposium on Information Theory, edited by B. N. Petrov & F. Csaki, pp. 267–281. Budepest: Akadémiai Kiado. Google Scholar
Anscombe, F. J. (1948). Biometrika, 35, 246–254. CrossRef Web of Science Google Scholar
Arndt, U. W. & Wonacott, A. J. (1977). The Rotation Method in Crystallography. Amsterdam: North Holland. Google Scholar
Chapman, M. S. & Somasundaram, T. (2010). Acta Cryst. D66, 741–744. Web of Science CrossRef IUCr Journals Google Scholar
Diamond, R. (1969). Acta Cryst. A25, 43–55. CrossRef CAS IUCr Journals Web of Science Google Scholar
Evans, P. (2006). Acta Cryst. D62, 72–82. Web of Science CrossRef CAS IUCr Journals Google Scholar
Evans, P. R. & Murshudov, G. N. (2013). Acta Cryst. D69, 1204–1214. Web of Science CrossRef CAS IUCr Journals Google Scholar
Fuentes-Landete, V., Mitterdorfer, C., Handle, P. H., Ruiz, G. N., Fuhrmann, S. & Loerting, T. (2015). Water: Fundamentals as the Basis for Understanding the Environment and Promoting Technology, edited by P. G. Debenedetti, M. A. Ricci & F. Bruni, pp. 173–208. Amsterdam: IOS Press. https://doi.org/10.3254/978-1-61499-507-4-173. Google Scholar
Gabanyi, M. J. et al. (2011). J. Struct. Funct. Genomics, 12, 45–54. CrossRef CAS PubMed Google Scholar
Henrich, B., Bergamaschi, A., Broennimann, C., Dinapoli, R., Eikenberry, E. F., Johnson, I., Kobas, M., Kraft, P., Mozzanica, A. & Schmitt, B. (2009). Nucl. Instrum. Methods Phys. Res. A, 607, 247–249. Web of Science CrossRef CAS Google Scholar
Huber, P. J. (1964). Ann. Math. Stat. 35, 73–101. CrossRef Web of Science Google Scholar
Kabsch, W. (2010). Acta Cryst. D66, 133–144. Web of Science CrossRef CAS IUCr Journals Google Scholar
Leslie, A. G. W. (1999). Acta Cryst. D55, 1696–1702. Web of Science CrossRef CAS IUCr Journals Google Scholar
McCoy, A. J., Grosse-Kunstleve, R. W., Adams, P. D., Winn, M. D., Storoni, L. C. & Read, R. J. (2007). J. Appl. Cryst. 40, 658–674. Web of Science CrossRef CAS IUCr Journals Google Scholar
Mitchell, E. P. & Garman, E. F. (1994). J. Appl. Cryst. 27, 1070–1074. CrossRef CAS IUCr Journals Google Scholar
Murshudov, G. N., Skubák, P., Lebedev, A. A., Pannu, N. S., Steiner, R. A., Nicholls, R. A., Winn, M. D., Long, F. & Vagin, A. A. (2011). Acta Cryst. D67, 355–367. Web of Science CrossRef CAS IUCr Journals Google Scholar
Otwinowski, Z. & Minor, W. (1997). Methods Enzymol. 276, 307–326. CrossRef CAS PubMed Web of Science Google Scholar
Parkhurst, J. M., Winter, G., Waterman, D. G., Fuentes-Montero, L., Gildea, R. J., Murshudov, G. N. & Evans, G. (2016). J. Appl. Cryst. 49, 1912–1921. Web of Science CrossRef CAS IUCr Journals Google Scholar
Pflugrath, J. W. (1999). Acta Cryst. D55, 1718–1725. Web of Science CrossRef CAS IUCr Journals Google Scholar
Rossmann, M. G. (1979). J. Appl. Cryst. 12, 225–238. CrossRef CAS IUCr Journals Web of Science Google Scholar
Stein, N. (2007). CCP4 Newsl. Protein Crystallogr. 47, 2–5. Google Scholar
Sutherland, I. E. & Hodgman, G. W. (1974). Commun. ACM, 17, 32–42. CrossRef Web of Science Google Scholar
Thorn, A., Parkhurst, J., Emsley, P., Nicholls, R., Vollmar, M., Evans, G. & Murshudov, G. (2017). Acta Cryst. D73, 729–737. CrossRef IUCr Journals Google Scholar
Waterman, D. G., Winter, G., Parkhurst, J. M., Fuentes-Montero, L., Hattne, J., Brewster, A., Sauter, N. K. & Evans, G. (2013). CCP4 Newsl. Protein Crystallogr. 49, 16–19. Google Scholar
Winn, M. D. et al. (2011). Acta Cryst. D67, 235–242. Web of Science CrossRef CAS IUCr Journals Google Scholar
Winter, G. (2010). J. Appl. Cryst. 43, 186–190. Web of Science CrossRef CAS IUCr Journals Google Scholar
Winter, G. & Hall, D. (2014). Thaumatin/Diamond Light Source I04 User Training. https://dx.doi.org/10.5281/zenodo.10271. Google Scholar
Zwart, P. H., Grosse-Kunsteleve, R. W. & Adams, P. D. (2005). CCP4 Newsl. Protein Crystallogr. 43, contribution 7. Google Scholar
This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.