research papers
Can I solve my structure by SAD phasing? Planning an experiment, scaling data and evaluating the useful anomalous correlation and anomalous signal
aBioscience Division, Los Alamos National Laboratory, Mail Stop M888, Los Alamos, NM 87545, USA, bDepartment of Haematology, University of Cambridge, Cambridge Institute for Medical Research, Wellcome Trust/MRC Building, Cambridge CB2 0XY, England, cPhysics Division, Los Alamos National Laboratory, Mail Stop D454, Los Alamos, NM 87545, USA, dPhysical Biosciences Division, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA, eLife Sciences Institute, University of Michigan, Ann Arbor, MI 48109, USA, and fDepartment of Biological Chemistry, University of Michigan, Ann Arbor, MI 48109, USA
*Correspondence e-mail: terwilliger@lanl.gov
A key challenge in the SAD phasing method is solving a structure when the anomalous signal-to-noise ratio is low. Here, algorithms and tools for evaluating and optimizing the useful anomalous correlation and the anomalous signal in a SAD experiment are described. A simple theoretical framework [Terwilliger et al. (2016), Acta Cryst. D72, 346–358] is used to develop methods for planning a SAD experiment, scaling SAD data sets and estimating the useful anomalous correlation and anomalous signal in a SAD data set. The phenix.plan_sad_experiment tool uses a database of solved and unsolved SAD data sets and the expected characteristics of a SAD data set to estimate the probability that the anomalous will be found in the SAD experiment and the expected map quality that would be obtained if the were found. The phenix.scale_and_merge tool scales unmerged SAD data from one or more crystals using local scaling and optimizes the anomalous signal by identifying the systematic differences among data sets, and the phenix.anomalous_signal tool estimates the useful anomalous correlation and anomalous signal after collecting SAD data and estimates the probability that the data set can be solved and the likely figure of merit of phasing.
Keywords: SAD phasing; anomalous signal; experimental design.
1. Introduction
The single-wavelength anomalous diffraction (SAD) method is a widely used experimental phasing technique (Dauter et al., 2002; Hendrickson, 2014) that accounts for over 70% of depositions of experimentally phased structures in the Protein Data Bank (PDB; Berman et al., 2000). It exploits differences observed between the intensities of reflections that are related by inversion symmetry (Bijvoet, 1954) caused by the element- and wavelength-dependent X-ray absorption characteristics of atomic scatterers. Although this effect is universally present in the Sohncke space groups most commonly encountered in macromolecular crystallography, it is often not detectable because of its small magnitude. The use of anomalous differences in experimental phasing typically requires a specific element to be present at a limited number of sites in the macromolecular structure and the choice of an X-ray wavelength near an The `anomalous' differences are used to locate the atoms in the (Weeks et al., 1993; Terwilliger & Berendzen, 1999; Schneider & Sheldrick, 2002; Grosse-Kunstleve & Adams, 2003) and are then used along with the to estimate phases for the entire structure (Otwinowski, 1991; de La Fortelle & Bricogne, 1997; Furey & Swaminathan, 1997; McCoy et al., 2004; Pannu & Read, 2004).
In this work, we use the anomalous signal, defined as the peak height in a model-phased anomalous difference Fourier map at coordinates of atoms in the anomalous et al., 2003), as a measure of the information about the present in an anomalous data set. It has been shown in Terwilliger et al. (2016) that the anomalous signal is a good predictor of the ability to locate atoms in the and that it is related to the experimental data by a simple relationship,
(YangHere, Sanoobs denotes the observed anomalous signal and CCano is the useful anomalous correlation (Terwilliger et al., 2016). The `useful anomalous correlation' is defined as the correlation of observed anomalous differences with ideal anomalous differences from the final refined structure but considering only from the nsites atom included in the anomalous It is essentially a measure of how similar the observed anomalous differences are to the best set of anomalous differences that could possibly be obtained for the non-anomalously scattering atoms of this crystal and its detectable anomalous All of the quantities in (1) refer to the data set as a whole, so that, for example, CCano is the overall mean useful anomalous correlation. The resolution-dependence of measurements of anomalous differences is reflected in CCano, which accordingly will typically become lower as high-resolution data are included. The number of unique reflections in the data set is Nrefl. The factor fB is the second moment of the scattering factors of the anomalous calculated using the factors fh,B (including atomic displacement) at the resolution corresponding to each reflection in the data set,
where the average is over all reflections in the data set. The factor fB is also dependent on resolution, typically becoming larger when higher resolution data are included. The combined effect of the decrease in useful anomalous correlation CCano and the increase in fB with the addition of high-resolution data is that the overall anomalous signal does not normally increase proportionally to the square root of the number of reflections and can even decrease (if random anomalous differences are added).
In this work, we describe methods for scaling and merging anomalous data from multiple crystals or data collections and for estimating the useful anomalous correlation CCano and the anomalous signal Sanoobs at different stages of the experiment. We also develop empirical relationships between the anomalous signal Sanoobs and the probability of solving the and between the useful anomalous correlation CCano and the expected quality of initial phases.
2. Methods
2.1. Scaling and merging anomalous data
Our procedure for scaling and merging SAD data from any number of crystals or orientations of crystals involves seven steps that are an expanded version of the local scaling procedure used previously in SOLVE (Terwilliger & Berendzen, 1999) and phenix.autosol (Terwilliger et al., 2009). These are the following.
|
These steps are described in groups in the following sections.
2.1.1. Choice of data sets and correction to averaged anisotropy
The first steps in our procedure for scaling and merging of SAD data sets includes the choice of which data sets to include in the process and the application of an anisotropy correction to each data set so that all of the data sets have anisotropy similar to the average of all of the original data sets. When data sets from several crystals are available, a group of data sets from crystals with similar unit-cell parameters is chosen. The required similarity among data sets can be adjusted by the user. The default criteria for similarity are unit-cell lengths matching within 1% and unit-cell angles matching within 1°. An alternative criterion available for unit-cell lengths is that they must match within a specified fraction (typically one quarter to one half) of the high-resolution limit of the data (Drenth, 1999). The group of data sets with the largest total number of measured reflections satisfying these criteria are chosen and the remainder of the data sets are set aside.
Next, the average anisotropy parameters for the remaining data sets are estimated using the tools in phenix.xtriage (Zwart, 2005; Zwart et al., 2005). The anisotropy parameters for all of these data sets are averaged to estimate the average anisotropy. The data in all data sets are then adjusted so that each data set has this average anisotropy. In this way, differences among the data sets are minimized while maintaining the anisotropy and fall-off with resolution of the data sets as a whole.
Once the data sets have been selected and brought to a common anisotropy, they are split, if necessary, into smaller data sets containing at most one observation corresponding to each unique index (h, k, l), where in this context `unique' refers to the entire limiting sphere, not the reciprocal This step is included so that the subsequent local scaling step can be carried out on data sets that contain no duplicate measurements. The assumption is made that unmerged datafiles will group symmetry-related reflections together, and within such a group of reflections the reflections will be ordered based on order of measurement. The splitting of measurements into separate sub-datafiles is therefore carried out considering reflections in the order that they are present in the input datafile. Within a group of symmetry-related reflections, for any reflection for which the indices duplicate a set of indices already found, the corresponding reflection is placed in a new sub-datafile. When a datafile is split into sub-datafiles, any sub-datafiles that contain less than 30% of the number of reflections in the largest sub-datafile are typically discarded. Additionally, in order to reduce systematic errors, an attempt is made to match Bijvoet mates within each data set and to exclude measurements of acentric reflections for which no Bijvoet mate was measured.
2.1.2. Local scaling of each individual data set or sub-data set
The key scaling algorithm applied to an individual data set or sub-data set in our procedure is local scaling (Matthews & Czerwinski, 1975) as implemented in SOLVE and phenix.autosol (Terwilliger & Berendzen, 1999; Terwilliger et al., 2009; Adams et al., 2010). The idea of local scaling is that any systematic errors that affect the intensity of a particular reflection will tend to similarly affect the intensities of reflections nearby in which were presumably recorded at nearly the same time during data collection. If data set A is to be scaled to data set B, a local scale factor can be calculated for each reflection in data set A based on the ratio of the intensities of nearby reflections in data set B to the corresponding reflections in data set A. The reflections for calculating the scale factor are chosen in pairs symmetrically arranged around the reflection to be scaled if possible, and typically 30 or more reflections are chosen for estimating the scale factor. The scaling procedure is carried out using amplitudes (Terwilliger & Berendzen, 1999), but we emphasize that the input data are unmerged intensities with original hkl indices as assigned by the indexing and integration software. The intensities are converted to amplitudes by taking their square roots (or setting them to zero if negative) and they are converted back to intensities at the end of the procedures by squaring.
The procedure carried out here for local scaling of a single data set begins by averaging all observations of each unique reflection in the reciprocal-space F+) observations that are symmetry-equivalent to each reflection in the reciprocal-space of the crystal and one with the Bijvoet mates (F−) of these reflections. Each of these partial data sets is scaled to the average data set with local scaling. The F+ and F− data sets are then combined without further scaling to create a scaled anomalous data set with scaled F+ and F− values for each reflection in the reciprocal-space asymmetric unit.
to create an average data set to be used as a scaling target. The original unmerged data set is then split into two: one with all the (2.1.3. Estimation of systematic errors or features unique to each data set and merging including estimates of systematic differences
As the data sets that are to be merged may come from different crystals and after different exposures of an individual crystal, the anomalous differences for the various data sets, even if measured and scaled perfectly, might not all be equal. Our algorithm for scaling multiple data sets attempts to identify the intrinsic differences between each individual data set and the mean (or a selected data set) and then weights the anomalous differences from each data set including these data-set-based intrinsic differences. The procedure is first to convert each pair of measurements of F+ and F− to estimates of the mean structure-factor amplitude and the anomalous difference Δi. Next, an average data set is created by simple merging of all of the observations of a particular anomalous difference Δi from all data sets i, with weights wi for each observation based on the experimental uncertainties,
Estimates of the intrinsic differences between anomalous differences in each data set and the average (Di2) are then obtained by subtracting the sum of mean-square error estimates for the mean (〈σm2〉) and individual data sets (〈σi2〉) from the observed mean-square difference between the average and individual data sets [〈(Δi − Δm)2〉],
The logic of (4) can perhaps be most easily understood by considering the case where many data sets are collected so that Δm is essentially the true mean anomalous difference for an average crystal. In this case, the mean-square difference between an individual measurement Δi and the true anomalous difference for an average crystal Δm would be the sum of the mean-square measurement error in Δi (〈σi2〉) and the mean-square difference between anomalous differences for crystal i and the average crystal (Di2). This calculation slightly underestimates the intrinsic differences because the mean anomalous difference (Δm) includes the value from the individual data set (Δi); however, if there are many data sets included the effect will be small and it is ignored here. Finally, the anomalous differences from all data sets are again averaged together, this time including the intrinsic differences in the weights,
The resulting anomalous differences are then recombined with the estimates of the average F+ and F−.
() to yield new estimates of the members of the2.2. Calculation of metrics of anomalous data quality
We calculated the values of three metrics of anomalous data quality. One is based on the half-data-set anomalous correlation, one on the skew of the anomalous difference Patterson and one on estimates of the ratio of the mean-square errors in measurement to the mean-square anomalous differences. These metrics of data quality will form the basis for Bayesian estimation of the useful anomalous correlation CCano for a data set.
2.2.1. Calculation of half-data-set anomalous correlation
A half-data-set anomalous correlation is generally obtained (Evans, 2006) by randomly assigning each reflection in a data set into one of two groups, merging the data within each group and calculating the correlation of anomalous differences between the groups. In this work, several data sets were typically combined to create merged data sets and we anticipated that the Bijvoet pairs in one data set might be systematically different from those in another data set. We attempted to minimize the effects of such systematic differences by keeping reflections measured from one crystal together when the half data sets are created. If multiple SAD data sets were available for a particular the data sets were divided into two approximately equally sized groups, each half data set was scaled with local scaling as described above and the correlation of anomalous differences between the two half data sets was calculated. If only a single unmerged data set was available, it was split by choosing approximately half of the observations of each unique reflection to be in each of two half data sets. If the observations for a unique reflection were grouped together in the data file, the reflections were simply split into approximately the first and second half as they appeared in the file, otherwise they were chosen randomly.
Using the half-data-set anomalous correlation we calculated a metric that we anticipated would be a useful predictor of the useful anomalous correlation CCano between the anomalous differences for the entire data set and the anomalous differences expected from the true anomalous Our metric is related to the widely used estimator for the expected correlation of the intensities in a merged data set with true intensities (CC*; Karplus & Diederichs, 2012). If a data set containing multiple measurements of intensities for each reflection is divided into two parts, each containing half of the measurements of each reflection, then the expected correlation CC* of the intensities in the merged data set with the true intensities is given approximately by (Karplus & Diederichs, 2012)
where CC1/2 is the correlation between intensities in the two half data sets, known as the half-data-set correlation. A key assumption in deriving this formula is that the observations for each reflection can be split into two equally sized groups. Following the same analysis, substituting the half-data-set anomalous correlation for the half-data-set correlation of intensities, and considering the possibility that only a fraction w of the reflections have been measured more than once, the expected correlation of anomalous differences in a merged data set with the true anomalous differences is given approximately by
As the value of the estimated anomalous correlation CC* is not defined when the measured half-data-set correlation CC1/2 is negative, our metric for anomalous data quality based on the half-data-set correlation is instead the square of the expected correlation, CCano*2,
As in (1), the values of these correlations are for the data set as a whole (after scaling and merging). The values of the correlations will normally decrease when higher resolution data are added.
2.2.2. Calculation of the skew of an anomalous difference Patterson function
An anomalous difference et al., 2013). The skew (the third moment) of a function reflects the positive and negative distributions of values in the function. In the case of an anomalous difference Patterson, the skew is generally positive if there are strong positive peaks and few negative peaks. We have previously used the skew of an electron-density map (Podjarny, 1976; Lunin, 1993) as a measure of its quality (Terwilliger et al., 2009). Here, we use a modified calculation of the skew of the difference as a metric of anomalous signal. The procedure is to calculate an origin-removed anomalous adjusting the mean to zero and calculating the r.m.s. (σ) of the resulting map, and then to truncate the map at ±4σ. Optionally, the map is further truncated at ±3σ at all points where the native has a value outside the range of ±3σ in order to reduce the effect of any translational (the default is not to carry out this truncation). The skew s of the resulting adjusted anomalous difference Patterson is then calculated,
normally has strong positive peaks corresponding to vectors between coordinates of atoms in the anomalous substructure. A very high peak is always present at the origin. Additionally, high peaks corresponding to translations that are part of may also be present (ReadAlthough there is no simple relationship between the skew of the anomalous difference Fourier and the useful anomalous correlation CCano between the anomalous differences and those expected from the anomalous we anticipated that a higher value of CCano might be associated with higher values of the skewness of the map.
2.2.3. Estimation of errors in measurement of anomalous differences
During the process of measuring diffraction spots and estimating X-ray intensities, the uncertainties in the intensities are normally estimated as well. It is well known, however, that it is difficult to estimate these uncertainties accurately (Dauter, 2006; Evans, 2006). We have adopted a simple procedure for rescaling the uncertainty estimates for a data set. Our procedure is related to the rescaling procedures used in SCALA (Evans, 2006) and in HKL-2000 (Otwinowski & Minor, 1997), but in our procedure the scale factor is obtained using only anomalous differences and using only data from the highest resolution shells. Our procedure is based on two assumptions. One is that the relative uncertainties of measurements within a data set are reasonably accurate, so that an overall scale factor can be applied to all uncertainties to improve their accuracy. The second assumption is that for data measured near the highest resolution obtained in the experiment the anomalous signal is much smaller than the error in measurement. Our procedure for rescaling uncertainties consists simply of finding a scale factor β to apply to the uncertainties that will yield a mean-square uncertainty in anomalous differences in the highest shell of resolution 〈σ2ano〉 that is equal to the mean-square anomalous difference 〈(Δobsano)2〉,
The mean-square values in the highest shell of resolution in this calculation are extrapolated based on the values in several shells of resolution. The tool get_sigma_ratio in phenix.get_patterson_skew was used to carry out this calculation. All the uncertainties in that data set are then multiplied by the scale factor β. We further calculate a normalized error estimate e for the entire data set based on the ratio of the mean-square (rescaled) uncertainties to the mean-square observed anomalous differences,
Note that, by construction, for the highest resolution shell the value of e is essentially unity. This normalized error estimate e was used as a metric representing the overall accuracy with which the anomalous differences were measured. We note that if there were no minor anomalous scatterers in a structure, so that Δanoother = 0, then the overall normalized error in the anomalous differences would be simply equal to e and the useful anomalous correlation CCano would be expected to be (cf. Terwilliger et al., 2016)
2.3. Estimators
2.3.1. Bayesian estimation of the useful anomalous correlation
We previously created a simple tool for Bayesian estimation (bayesian_estimator.py) and used it to estimate the quality of electron-density maps from features of the map such as its skewness (Terwilliger et al., 2009). This estimator starts by constructing a two-dimensional histogram from a training set of values of predictor variable/target variable pairs. The estimator then uses the histogram to calculate the variance of the predictor variable for a given value of the target variable. Finally, given a particular value of a predictor variable, it calculates the posterior probability distribution for the target variable using Bayes' rule and a flat prior probability distribution. When more than one predictor variable is available, the tool assumes independence of the predictor variables and calculates a composite probability for the target variable. Here, we use the same tool to estimate the correlation (CCano) of anomalous differences in a SAD data set to the anomalous differences corresponding to the true The training data for the Bayesian estimator consists of data from a set of 218 SAD data sets (166 of which have unmerged data available) taken from SAD or MAD data deposited in the PDB for 113 structures (see the list in §2.4), truncated at resolutions varying from 1.5 to 6 Å to yield a total of 1874 data sets with known structures. For each data set the true useful anomalous correlation CCano was calculated from the observed anomalous differences and the known anomalous Additionally, the square of the estimated anomalous correlation (CCano*2), the skew of the anomalous difference (s) and the estimate of the normalized error in the anomalous differences (e) were calculated. For data sets where unmerged data were not available, the expected useful anomalous correlation was not calculated. The Bayesian prior (the information available about the useful anomalous correlation CCano before making any measurements) was simply the distribution of observations of the useful anomalous correlation in the training set. Given a set of observations (, s and e), the useful anomalous correlation CCano was estimated by weighting each possible value of CCano by the prior probability for that value of CCano multiplied by the probability that the observations , s and e would have been made if that value of CCano were correct (Hamilton, 1964; Terwilliger et al., 2009). The estimator was trained on all the complete data sets used in this work and separately for data truncated to high-resolution limits from 1.5 to 6 Å in increments of 0.5 Å.
2.3.2. Bayesian estimation of atomic displacement factors for atoms in the substructure
We developed a similar Bayesian estimator for the atomic displacement factor for atoms in the anomalous B value (Wilson, 1942) for the entire structure. Using 138 MAD and SAD data sets from the PDB (listed in §2.4), the Wilson B value for the data sets was estimated using the PHENIX tool phenix.xtriage (Zwart et al., 2005), and the mean atomic displacement factor for atoms in the anomalous was calculated from the deposited entry in the PDB. A Bayesian estimator was trained as above with a list of Wilson B values and corresponding mean atomic displacement factors for the anomalous substructure.
based on the Wilson2.3.3. Estimation of the probability of obtaining a correct based on the anomalous signal
We used a simple approach to estimate the likelihood of obtaining a correct HySS likelihood-based substructure-determination method (Bunkóczi et al., 2014) was applied to each of the data sets and the fraction of sites in the that were obtained (within 3 Å of a correct site) was noted. A was designated as `solved' if 50% or more of the sites in the were obtained. The estimator of the probability of solution for a particular value of anomalous signal (grouped into bins) constructed with these data was then simply the fraction of substructures with this anomalous signal that were solved.
based on values of the anomalous signal. The complete and truncated SAD data sets described above were grouped into bins based on their anomalous signal estimated with the Bayesian estimator just described. The2.3.4. Estimation of the accuracy of phasing based on the useful anomalous correlation
The same set of SAD data sets and the same approach as in the previous section were used to estimate the quality of initial phases and to compare them with the useful anomalous correlation. For each data set, phase calculations were carried out with Phaser (McCoy et al., 2004) using the known anomalous and the measured anomalous differences for the data set. The resulting map correlation to a model-phased map was then determined and compared with the useful anomalous correlation (cf. Fig. 4 in Terwilliger et al., 2016). The estimator for the expected accuracy of phasing given a value of the useful anomalous correlation was then simply the mean correlation to the model-phased maps for those data sets with similar values of useful anomalous differences (calculated in bins of the useful anomalous difference).
2.3.5. Estimation of anomalous signal before and after collecting the data
We used (1) to estimate the expected value of the anomalous signal Sanoobs in a This expression requires values of the useful anomalous correlation, the number of reflections and the atomic displacement factors and number of sites in the anomalous substructure.
Even before measuring diffraction intensities, some estimates of these values can be made based on the composition of the crystal. After measuring the data, improved estimates can be made. The useful anomalous correlation CCano can be estimated after anomalous data are available as described in the previous section. In advance of measuring the data the useful anomalous correlation is not known, but it is related (Fig. 2, below) to the normalized errors in the anomalous differences e (11). It is not necessary to know e very precisely, as the value of the anomalous signal approaches a maximum value asymptotically as the normalized error decreases (12). In our approach the user can specify the errors in measurement in terms of the anticipated mean value of the ratio of intensity to uncertainty in measurement of intensity 〈I/σ(I)〉. The empirical relationship of e ≃ 0.88/[〈I/σ(I)〉] (derived from a simple plot of these two variables for 82 of the data sets examined in this work and with a squared Pearson r2 of 0.82 for this relationship) is then used to calculate e and to estimate the useful anomalous correlation using the Bayesian estimator described in §2.3.1.
The number of reflections Nrefl is of course known after the data have been measured. In advance of this, it can be estimated from the resolution to which diffraction data are to be measured, the composition of the macromolecule and the solvent content in the crystal. As the high-resolution limit for data collection is generally not known before measuring the data, several values can be examined. The solvent content for many macromolecular crystals is near 50%, although occasionally it may be much higher or lower (Matthews, 1968; Kantardjieff & Rupp, 2003; Weichenberger & Rupp, 2014). We used the PHENIX tool phenix.ncs_and_number_of_ha to estimate the composition of the of the crystal and the solvent content. From the resulting estimate of the volume Vau of the in the crystal and the resolution dmin to which data are to be collected, the number of unique (non-anomalous) reflections can be estimated as (following Ladd, 1998 and noting the caveat that this calculation includes centric reflections that will not contribute to anomalous scattering)
The number of sites in the anomalous ). In other cases such as soaks with noncovalent heavy-atom derivatives it may be necessary to guess the number of sites. We use the PHENIX tool phenix.ncs_and_number_of_ha to estimate the number of sites.
can often be estimated from the sequence of the macromolecule, for example in cases in which the anomalous is part of the macromolecule, such as in selenomethionine or sulfur SAD experiments (Dauter, 2006The mean atomic displacement factor (needed to calculate the second moment of the scattering factors fB with equation 2) for the atoms in the is generally not known in advance of measuring anomalous data, and in this case a Bayesian estimate of its value is made based on the anticipated resolution of data collection and the values of atomic displacement factors for the anomalous and resolution for the 248 data sets used in §2.3.2 (these data are available in the PHENIX software in the file $PHENIX/modules/cctbx/mmtbx/scaling/ha_b_from_wilson.dat). Once the data have been measured it could in principle be estimated from the fall-off with resolution of anomalous differences, corrected for errors in measurement. We have instead calculated the atomic displacement factors for the anomalous from the Wilson B value of the data as a whole using a simple Bayesian estimator as described in §2.3.2.
2.4. Test data from the PDB
We downloaded data sets from the PDB to serve as test cases for our analyses. The data consisted of 218 MAD and SAD data sets from 113 different PDB entries with diffraction data extending to resolutions from 1.2 to 4.5 Å and with anomalously scattering atoms including selenium, sulfur, cobalt, mercury, zinc, nickel, iron, calcium, barium and iridium. The MAD PDB entries were split into individual data sets for each wavelength of X-ray data used to measure diffraction data. The PHENIX tool phenix.sad_data_from_pdb was used to extract the individual data sets from PDB entries. The PDB entries used were 1vjn , 1vjr , 1vjz , 1vk4 , 1vkm (Levin et al., 2005), 1vlm , 1vqr (Xu et al., 2006), 1xri (Aceti et al., 2008), 1y7e , 1z82 , 1zy9 , 1zyb , 2a2o , 2a3n , 2a6b , 2aj2 , 2aml , 2avn , 2b8m , 2etd , 2etj , 2ets (Kozbial et al., 2008), 2etv , 2evr (Xu, Sudek et al., 2009), 2f4p , 2fea (Xu et al., 2007), 2ffj , 2fg0 (Xu, Sudek et al., 2009), 2fg9 , 2fna (Xu, Rife et al., 2009), 2fqp , 2fur , 2fzt , 2g0t , 2g42 , 2gc9 , 2nlv (Hwang et al., 2014), 2nuj , 2nwv , 2o08 , 2o1q , 2o2x , 2o2z , 2o3l , 2o62 , 2o7t , 2o8q , 2obp , 2oc5 , 2od5 , 2od6 , 2oh3 , 2okc , 2okf (Hwang et al., 2014), 2ooj , 2opk , 2osd , 2otm , 2ozg , 2ozj , 2p10 , 2p4o , 2p7h , 2p7i , 2p97 , 2pg3 , 2pg4 , 2pgc , 2pim , 2pn1 , 2pnk , 2ppv , 2pr1 , 2pr7 , 2prv , 2pv4 , 2pw4 , 2wcd (Mueller et al., 2009), 2xdd (Fineran et al., 2009), 2zxh (Osawa et al., 2009), 3caz , 3din (Zimmer et al., 2008), 3dto , 3fx0 (Lo et al., 2009), 3guw , 3gw7 , 3hxk , 3hxp , 3lml , 3mv3 (Hsia & Hoelz, 2010), 3ov0 (Pokkuluri et al., 2011), 3pg5 , 3zgx (Bürmann et al., 2013), 3zxu (Schmitzberger & Harrison, 2012), 4acb (Leibundgut et al., 2004), 4asn (Aylett & Lowe, 2012), 4bql (Lindås et al., 2014), 4cb0 (Mechaly et al., 2014), 4cbv (Boudes et al., 2014), 4fsx (Du et al., 2012), 4g9i (Tominaga et al., 2012), 4gkw (Qiao et al., 2012), 4h6y (He et al., 2013), 4hkr (Hou et al., 2012), 4hnd (Zhou et al., 2014), 4ifq (Sampathkumar et al., 2013), 4lck (Zhang & Ferré-D'Amaré, 2013), 4nsc (Wang et al., 2014), 4nt5 (Zhou & Springer, 2014), 4px7 (Fan et al., 2014), 4q8j (Schäfer et al., 2014), 4qka (Gao & Serganov, 2014) and 4tq5 (Huang et al., 2014).
For the estimation of the atomic displacement factors for the atoms in the anomalous 2.3.2, an additional 25 PDB entries were used. These were 1hf8 (Ford et al., 2001), 2ahy (Shi et al., 2006), 2b78 , 2fdn (Dauter et al., 1997), 2hba (Cho et al., 2014), 2o0h (Sun et al., 2007), 2prx , 2wxw (Zhou et al., 2010), 3fki (Meyer et al., 2009), 3i5d (Kawate et al., 2009), 3iko (Nagy et al., 2009), 3k9g (Abendroth et al., 2011), 3km3 (Abendroth et al., 2011), 3m6a (Duman & Löwe, 2010), 3p96 (Abendroth et al., 2011), 3qqc (Martinez-Rucobo et al., 2011), 4a2n (Yang et al., 2011), 4ai6 (Schmidt et al., 2012), 4aj5 (Jeyaprakash et al., 2012), 4aki (Schmidt et al., 2012), 4b09 (Choudhury & Beis, 2013), 4biu (Mechaly et al., 2014), 4cv5 (Mathys et al., 2014), 4m2s (Li et al., 2014) and 4nha (Tian et al., 2014).
in §3. Results and discussion
3.1. Scaling and merging of anomalous data from one or more data sets while explicitly modeling inter-data-set variation
Our procedure for scaling and merging SAD data has three key elements. Firstly, our procedure uses local scaling (Matthews & Czerwinski, 1975; Terwilliger & Berendzen, 1999) to minimize systematic differences between members of Bijvoet pairs. Secondly, our procedure explicitly models the differences between the data coming from different data sets as a data-set-specific variance and weights the data from different data sets accordingly. Thirdly, this data-set variance is calculated based on anomalous differences, not the Bijvoet-averaged amplitudes, so that the weighting of data sets optimizes the anomalous differences, not the overall amplitudes.
Modeling the differences in data coming from different data sets is essentially a way to replace the standard procedure of outlier rejection with a method for down-weighting data coming from data sets that are systematically different from an average data set. For each data set (within a bin of resolution), the anomalous differences measured for that data set are compared with anomalous differences obtained by averaging all data sets. This yields an estimate of the total variance between that data set and the mean. Part of this total variance can normally be accounted for by the experimental uncertainties for the data set in question and from the estimated errors in the averaged values. In our approach, the remaining (unexplained) variance is considered to be inter-data-set variation. This inter-data-set variance represents how different this data set is from the average of all data sets. If the data sets correspond to different crystals, the inter-data-set variance is an estimate of how different the data obtained from this crystal would be from data averaged over all crystals if all the data were measured without error. Including this inter-data-set variance in the weighting of the data during merging has the effect of automatically reducing the contribution of data sets that are very different from the others, but still including an appropriate amount of information from these data sets.
In a SAD experiment, it is normally the accuracy of the anomalous differences, rather than the accuracy of the amplitudes obtained after averaging Bijvoet pairs of reflections to remove the anomalous contribution, that is most critical for
In cases where there is substantial inter-data-set variation, the variation between data sets in Bijvoet-averaged amplitudes is not necessarily the same as the variation in anomalous differences. For example, a set of data sets might be collected at slightly different X-ray wavelengths but otherwise be essentially identical. In this case the inter-data-set variation for Bijvoet-averaged pairs might be very small, but the variation for anomalous differences might be very large. To obtain the most accurate estimate of anomalous differences at one X-ray wavelength, then, it would be important to down-weight data sets collected at other X-ray wavelengths. This can be accomplished by using the anomalous differences themselves in the estimation of the inter-data-set variation.3.2. Utility of modeling inter-data-set variation when merging anomalous data
Fig. 1 shows the utility of explicitly modeling inter-data-set variation in merging of data from multiple crystals. The data are taken from an analysis carried out by Akey et al. (2014) on data from 28 crystals of the flavivirus NS1 protein. As the structure of the NS1 protein is available (PDB entry 4tpl ), we were able to calculate expected (ideal) anomalous differences from the known structure based on anomalous contributions from the S atoms in the structure. These ideal anomalous differences were compared with the anomalous differences from individual data sets and from merging various groups of data sets, and the correlation of anomalous differences (the useful anomalous correlation, CCano) was used as a measure of the quality of the experimentally determined and merged anomalous differences. Using the useful anomalous correlation as a metric, we ordered 26 of the 28 data sets from high (0.35) to low (0.08) values of useful anomalous correlation using data to a resolution of 6 Å (shown in Fig. 1). We then created merged data sets containing from one to all 26 of these individual data sets and scaling in one of three ways. The first approach included modeling inter-data-set variation and optimization of anomalous differences. The second included modeling inter-data-set variation, but calculating the inter-data-set variation using Bijvoet-averaged pairs instead of with the anomalous differences, and the third used neither of these methods. Fig. 1 shows that if no modeling of inter-data-set variation is carried out at all, anomalous differences for the first data set have a correlation with the model anomalous differences of 0.38. Adding additional data sets with decreasing useful anomalous correlation initially increases the useful anomalous correlation of the merged data (up to a maximum of 0.52), but as very poorly correlated data sets are added the anomalous differences for the merged data set becomes less correlated with the model anomalous differences, so that when all 26 data sets are merged the correlation is 0.49. We then examined the effect of including inter-data-set modeling of variance based on the anomalous differences. In this case the correlation of anomalous differences for the merged data continually increases with additional data sets, even when the added data sets have very low correlation with the model anomalous differences. When all data sets are included, the correlation of anomalous differences with model differences is 0.61. Finally, we examined the importance of modeling the inter-data-set variation using anomalous differences. When the inter-data-set variation was based instead on the inter-data-set variation of Bijvoet-averaged structure-factor amplitudes [ = ½(F+ + F−)], the correlation of merged anomalous differences with model differences were consistently slightly lower than when modeling the inter-data-set variation on the anomalous differences (Δano = F+ − F−), but otherwise the results were quite similar. When all data sets were included in this case, the correlation with model anomalous differences was 0.59.
3.3. Estimating the useful anomalous correlation in a SAD data set after measurement of anomalous data
It has been shown in Terwilliger et al. (2016) that the anomalous signal and the useful anomalous correlation are useful indicators of the utility of the anomalous differences in a SAD data set. These metrics of data quality can only be calculated directly after a structure has been solved, so methods for estimating them from measured data would be valuable. In this section, we will focus on estimating the useful anomalous correlation using three measurable quantities available once the data have been collected: the half-data-set anomalous correlation, the skew of the anomalous difference Patterson and the normalized error in measurement of the anomalous differences.
3.3.1. Relationship between useful anomalous correlation and half-data-set anomalous correlation
A measure of the utility of anomalous differences is the half-data-set anomalous correlation (CCanohalf; Evans, 2006). A high value of the half-data-set anomalous correlation indicates that the anomalous differences can be reproducibly measured. Taking into consideration the number of observations of each reflection in each half data set, it is possible to use the half-data-set anomalous correlation CCanohalf to estimate how similar the merged anomalous differences for a data set are to the merged differences that would be obtained if infinitely many observations of them were made (Karplus & Diederichs, 2012; equation 7). This estimated anomalous correlation CCano* is essentially a measure of how close the measured anomalous differences are to the true anomalous differences for this crystal. It is not, however, necessarily a measure of how close the anomalous differences are to those that would be obtained from an idealized crystal in which the only scatterers are those in the anomalous Accurately measured anomalous differences can also reflect the from minor sites for the principal anomalous scatterers in the structure as well as scattering from all of the weak anomalous scatterers in the structure.
Fig. 2 shows the relationship between the estimated anomalous correlation CCano* and the useful anomalous correlation CCanoobs for the subset of SAD data sets listed in §2.4 where unmerged data are available. The estimated anomalous correlation is very closely related to the useful anomalous correlation (squared Pearson r2 of 0.85). It can be seen, however, that the useful anomalous correlation is consistently less than the estimated anomalous correlation (the slope of the least-squares fit of CCanoobs to CCano* in Fig. 2 is about 0.75). This suggests that for this group of SAD data sets (and presumably others as well) there are systematic differences between the measured anomalous differences and those calculated from the final model for the structure and substructure. These differences could come from systematic errors in measurement, but another likely source of such systematic differences would be that a substantial fraction of the is owing to not from the itself. Extrapolation of the relationship shown in Fig. 2 suggests that even if anomalous differences were measured perfectly in these data sets, the useful anomalous correlation would be only about 0.75.
We note that obtaining the relationship shown in Fig. 2 requires careful scaling and grouping of the anomalous data. Single-wavelength anomalous data (SAD data) are often collected from multiple crystals or from multiple orientations of a single crystal. The various crystals may differ slightly and even a single crystal may change during data collection. Consequently, the scaling and merging of the data for a SAD experiment is an important step in solving the structure. In calculating the half-data-set anomalous correlation, all of the data taken from the PDB were first split into half data sets and rescaled using the phenix.scale_and_merge algorithm described in §2.1. When half-data-set anomalous correlations were calculated using data from the PDB without rescaling and choosing half data sets randomly, the squared Pearson r2 for the relationship between CCanoobs and CCano* was only 0.37 (rather than 0.85 as in Fig. 2).
3.3.2. Relationship between useful anomalous correlation and the skew of the anomalous difference Patterson
Although the estimated anomalous correlation (CCano*) as estimated from the half-data-set anomalous correlation (CCanohalf) is a very good indicator of the useful anomalous correlation (CCanoobs), in cases where multiple measurements of anomalous differences have not been made or are not available it is helpful to have other metrics that are related to the useful anomalous correlation. One of these that we have used is the skew of the anomalous difference Patterson. The skew of the values in a map is generally positive if there are many positive peaks in the map and few negative ones, as should be the case for a useful anomalous difference We calculate the skew of a map after truncating very high and very low values (see §2.2.2). Fig. 3 shows the relationship between the skew (s) of anomalous difference Patterson functions calculated using the SAD data sets listed in §2.4 and the useful anomalous correlation (CCanoobs). It can be seen that in general data sets that have a high useful anomalous correlation have a high skew as well.
3.3.3. Relationship between useful anomalous correlation and estimates of the normalized error in anomalous differences
A third indicator of the useful anomalous correlation that we have used here is an estimate of the normalized error in measured anomalous differences. It is difficult to obtain accurate estimates of uncertainties in anomalous differences (or in intensity measurements; Dauter, 2006; Evans, 2006). Here, we have made the assumption that error estimates for a particular SAD data set might be proportionally smaller or larger than the true errors, and we have adopted a procedure designed to find this scale factor. Our procedure (see §2.2.3) is simply to assume that at the highest resolution where data were collected there is essentially no anomalous signal, so that the anomalous differences are entirely noise. Using this assumption, it is simple to rescale all of the uncertainties in a data set and to calculate the ratio of the r.m.s. uncertainty in measurement to the r.m.s. anomalous difference, which we term the normalized error estimate (11). Fig. 4 shows that these normalized error estimates are indeed inversely related to the useful anomalous correlation, where the normalized error estimates are small for cases where the useful anomalous correlation is high, and is about one for cases where the anomalous signal is near zero.
3.3.4. Bayesian estimation of the useful anomalous correlation after obtaining anomalous data
We created a simple Bayesian estimator (§2.3.1) that uses information from three sources, the half-data-set anomalous correlation, the skew of the anomalous difference and the normalized error in the anomalous differences, to predict the useful anomalous correlation. To evaluate the utility of this estimator, we carried out a cross-validation analysis in which one data set was excluded at a time in the training of the estimator and this version of the estimator was then used to predict the value of the useful anomalous correlation for this data set. We carried out this analysis for estimators created with each source of information separately and for all three sources together. Fig. 5 illustrates this cross-validation analysis. The squared Pearson (r2) between the predicted and observed useful anomalous correlation ranged from 0.64 based on the skew of the anomalous difference (Fig. 5b) to 0.77 based on estimates of the normalized error in measurement (Fig. 5c) to 0.87 using the half-data-set anomalous correlation (Fig. 5a) and 0.89 using all of these measures together (Fig. 5d). This analysis indicates that it is possible to obtain quite accurate estimates of the quality of anomalous differences (their useful anomalous correlation) based on simple measures that can be calculated from the measured data. If unmerged data are available so that the half-data-set anomalous correlation can be calculated, estimates of the useful anomalous correlation can be particularly accurate (Figs. 5a and 5d).
3.4. Planning a SAD experiment and evaluating a SAD data set
As shown in Terwilliger et al. (2016), the anomalous signal in a SAD data set is a very good predictor of whether the anomalous can be determined using likelihood-based methods. The anomalous signal in turn is a simple function of the useful anomalous correlation, the number of unique reflections, the number of sites in the anomalous and the atomic displacement factors for the anomalous (1). If estimates can be made of these factors, then it would be possible to estimate the anomalous signal in a SAD data set and subsequently the probability of finding the anomalous We have developed simple tools for carrying out this estimation of the anomalous signal and the probability of determining the anomalous both before and after measuring the diffraction data.
3.4.1. Planning a SAD experiment
Estimates of the anomalous signal for a SAD experiment before measuring the diffraction data would be of considerable use in planning an experiment. If the number of atoms in the anomalous substructure were known and the atomic displacement factors could be guessed, it would be possible to identify how many reflections would have to be measured to find the ). Further, our Bayesian approach for estimation of the useful anomalous correlation CCanoobs from the normalized error in anomalous differences e (§2.2.3) could be used to identify how accurately the anomalous differences would need to be measured to find the with real data.
if the data were measured perfectly (1We have created a PHENIX tool, phenix.plan_sad_experiment, that estimates the anomalous signal in a SAD experiment in advance of collecting the anomalous data (see §2.3.5). The tool uses the composition of the macromolecule in the crystal, any available information about the type and number of anomalous scatterers and the wavelength of planned data collection. The approach then uses (1) to estimate, for various high-resolution limits in data collection, how accurately the data would have to be measured (what value of mean intensity divided by uncertainty in intensity) in order to achieve an anomalous signal of about 15 or greater (if such a signal can be achieved at all). The tool uses the Bayesian estimator introduced in §2.3.3 to calculate the probability of determining the anomalous with likelihood-based methods using data to these various resolution limits and measured with this accuracy. The tool also estimates the accuracy of phasing that could be expected if the is solved (§2.3.4).
Fig. 6 illustrates the accuracy of the overall predictions that could have been obtained by using the phenix.plan_sad_experiment tool on the 218 SAD data sets listed in §2.4 before measuring the diffraction data. The information provided to the tool consisted of the sequence of the macromolecule, the identity of the anomalously scattering atom, the wavelength of data collection and the high-resolution limit of data collection. The high-resolution limit was provided so that the tool would estimate the anomalous signal at a resolution matching the actual data, but we note that this did provide some information to the tool that might not be available in a real situation. The high-resolution limit was used to estimate the atomic displacement factors for the anomalously scattering atoms. The number of sites in the anomalous was not provided to the tool but was instead guessed from the sequence and the type of anomalous scatterer using the phenix.ncs_and_number_of_ha method in PHENIX. The phenix.plan_sad_experiment tool was then used to predict the anomalous signal and the probability of successful determination. Fig. 6(a) shows the predicted and actual anomalous signal for each SAD data set. For most of the data sets the actual anomalous signal was within about a factor of two of the predicted signal, and the squared Pearson r2 for this prediction is 0.58. Fig. 6(b) shows the fraction of atoms correctly identified for each SAD data set as a function of the estimated probability of successful determination. The (smoothed) mean fraction of sites found is plotted as a solid line in Fig. 6(b), and it can be seen that the estimated probability of success is fairly close to the actual success rate. The reason the lowest values of predicted success are not zero, but rather are about 20%, is that there are some cases where the anomalous signal estimated before collecting any data was very low but there was significant anomalous signal and the could still be determined.
3.4.2. Analyzing a SAD data set and estimating the probability of solution and expected accuracy in phasing
Once SAD data have been collected, improved estimates of the useful anomalous correlation and anomalous signal can be obtained because several of the factors in (1) can be estimated with increased accuracy. The Bayesian estimator described in §2.3.1 can be applied to the half-data-set anomalous correlation, the skew in the anomalous difference and the normalized error estimate for the anomalous differences to obtain a realistic estimate of the correlation CCanoobs between measured anomalous differences and those expected for an ideal structure where anomalous differences come only from atoms in the Fig. 5(d) illustrates a cross-validation analysis of predicted and actual useful anomalous correlation calculated in this way for those data sets where all three sources of information are available (i.e. those for which unmerged data are available so that the half-data-set anomalous correlation can be obtained). The squared Pearson r2 for this relationship was 0.89.
Once the data have been collected, the number of unique reflections Nrefl is of course known. Additionally, some information becomes available about the atomic displacement factors for the anomalous The mean atomic displacement factors could in principle be estimated from the anomalous differences and the errors in measurement. In this work, we simply estimate them from the Wilson B value (overall atomic displacement factor) for the measured data (Wilson, 1942) as described in §2.3.2. The relationship between the overall Wilson B value and mean atomic displacement factor for the anomalous is shown in Fig. 7. It can be seen that the mean atomic displacement factor for the anomalous is larger than the Wilson B value by about 40% on average, although there is considerable variation (the squared Pearson r2 for the linear fit shown is 0.79).
Fig. 8(a) illustrates calculations of the anomalous signal obtained with (1) for all data sets using estimates of the useful anomalous correlation, the number of reflections and atomic displacement factors for the available after collecting the data. The squared Pearson r2 for the linear fit shown is 0.73. This prediction is less accurate than that shown in Fig. 5(d) for the useful anomalous correlation. This is partly because the anomalous signal depends on the number of sites and the atomic displacement factors for the sites in the each of which are known only approximately. The lower accuracy of the prediction of the anomalous signal in Fig. 8(a) compared with the useful anomalous correlation shown in Fig. 5(d) is also owing to the fact that all data sets from §2.4 are included in Fig. 8(a) but data sets without unmerged data are excluded in Fig. 5(d).
Using the anomalous signal estimates available after collecting the data from Fig. 8(a), we estimated the probability of successful determination as described in §2.3.3. Fig. 8(b) illustrates the actual fraction of sites found as a function of this estimated probability. Comparing Fig. 8(b) with Fig. 6(b), it can be seen that the discrimination between data sets that are likely to lead to a successful determination has been improved by using the data in the prediction. The squared Pearson r2 for the relationship between predicted success in determination and the actual fraction of sites found increases from 0.34 to 0.48.
Once data have been collected and the useful anomalous correlation CCanoobs has been estimated, it is possible to obtain improved estimates of the quality of experimental phasing that can be obtained if the is determined. Fig. 8(c) compares estimates and actual values of the accuracy of experimental phasing, as measured by the correlation between experimentally phased electron-density maps and the corresponding maps calculated using a refined model.
4. Conclusions
There are two crucial steps in et al., 2013). Empirical studies have shown that the two steps depend on two related but different aspects of the data in a SAD experiment. Success in solution is most closely related to the anomalous signal (Bunkóczi et al., 2014; Terwilliger et al., 2016). The anomalous signal is the mean peak height at coordinates in a model-phased anomalous difference Fourier, and as such is a measure of the overall information about each anomalously scattering atom in the structure. Consequently, it is not surprising that the ability to find the locations of these atoms is closely related to the anomalous signal. In contrast, the quality of experimental phases in the SAD method is found to be most closely related to the useful anomalous correlation CCanoobs (Terwilliger et al., 2016). This observation is also not surprising because the quality of experimental phases is dependent on how closely the measured anomalous differences represent the useful anomalous differences corresponding to the atoms in the and the useful anomalous correlation describes this similarity. This analysis is consistent with the observations of Zwart (2005) and provides a basis for predicting experimental map quality before and after collecting SAD data. The anomalous signal is related to the useful anomalous correlation in a simple way (1) that depends on the square root of the number of reflections divided by the number of sites in the anomalous and the second moment of the scattering factors of the anomalously scattering atoms. Before the collection of the data, an upper limit on the value of the useful anomalous correlation can be estimated from the anticipated errors in measurement. In this work, we add an additional step and calculate an expected value of the useful anomalous correlation with a Bayesian estimator (§2.3.1) trained on the uncertainties in measurement and useful anomalous correlations found in the SAD data sets examined here. After measurement of X-ray data, much better estimates of the useful anomalous correlation can be obtained. In particular, the estimates of uncertainties in measurement obtained from the experiment, calculations of the skewness of the anomalous difference obtained from the anomalous data and calculation of the half-data-set anomalous correlation all provide substantial information about the useful anomalous correlation. As the anomalous signal is related to the anomalous correlation through (1), after collection of the X-ray data both can be estimated much more accurately than before carrying out the experiment. Consequently, both the probability of determination and the expected accuracy of experimental phases can be estimated more accurately after collection of the data (cf. Fig. 6 versus Fig. 8).
using SAD phasing. The first is determining the locations of the atoms in the and the other is the estimation of crystallographic phases (LiuThe phenix.scale_and_merge software tool described here is useful for carrying out local scaling on one or more anomalous data sets and merging the resulting scaled data sets into a single data set with estimates of the intensities of each unique reflection and its Bijvoet mate. This tool is designed to take data-set-specific differences explicitly into account, so that if a few data sets are systematically different from all the others, intensities from those few data sets are included with much lower weights and are effectively excluded from the analysis. The phenix.plan_sad_experiment and phenix.anomalous_signal tools both carry out estimation of the probability of finding the and of the quality of experimental phases expected in a SAD experiment. The phenix.plan_sad_experiment tool only uses information available before carrying out the experiment and the phenix.anomalous_signal tool takes advantage of the information obtained from the experiment itself to improve the estimates. Taken together, these tools provide a practical implementation of our theoretical analysis of the anomalous signal and useful anomalous correlation in data from a SAD experiment and their implications for structure determination.
Finding the
of anomalously scattering atoms and calculating an initial electron-density map with a particular phase accuracy does not in itself define whether a structure can be solved. This work could be extended by developing an estimator of the probability of structure solution based on prediction of map quality combined with solvent content and present in the crystal. Our Bayesian estimator linking the anomalous signal in a data set to the likelihood of solution could potentially be integrated into data-processing procedures optimizing integration parameters, selecting the most useful sub-data sets from radiation-damaged data and combining multiple data sets to produce optimized data for likelihood-based determination.Acknowledgements
The authors appreciate the support received from the US National Institutes of Health (grant P01GM063210 to PDA, TCT and Randy J. Read, and grant P01AI055672 to JLS). This work was partially supported by the US Department of Energy under contract DE-AC02-05CH11231.
References
Abendroth, J., Gardberg, A. S., Robinson, J. I., Christensen, J. S., Staker, B. L., Myler, P. J., Stewart, L. J. & Edwards, T. E. (2011). J. Struct. Funct. Genomics, 12, 83–95. CrossRef CAS PubMed Google Scholar
Aceti, D. J., Bitto, E., Yakunin, A. F., Proudfoot, M., Bingman, C. A., Frederick, R. O., Sreenath, H. K., Vojtik, F. C., Wrobel, R. L., Fox, B. G., Markley, J. L. & Phillips, G. N. Jr (2008). Proteins, 73, 241–253. Web of Science CrossRef PubMed CAS Google Scholar
Adams, P. D. et al. (2010). Acta Cryst. D66, 213–221. Web of Science CrossRef CAS IUCr Journals Google Scholar
Akey, D. L., Brown, W. C., Konwerski, J. R., Ogata, C. M. & Smith, J. L. (2014). Acta Cryst. D70, 2719–2729. Web of Science CrossRef IUCr Journals Google Scholar
Aylett, C. H. S. & Löwe, J. (2012). Proc. Natl Acad. Sci. USA, 109, 16522–16527. CrossRef Google Scholar
Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., Shindyalov, I. N. & Bourne, P. E. (2000). Nucleic Acids Res. 28, 235–242. Web of Science CrossRef PubMed CAS Google Scholar
Bijvoet, J. M. (1954). Nature (London), 173, 888–891. CrossRef Web of Science Google Scholar
Boudes, M., Sanchez, D., Graille, M., van Tilbeurgh, H., Durand, D. & Quevillon-Cheruel, S. (2014). Nucleic Acids Res. 42, 5302–5313. CrossRef Google Scholar
Bunkóczi, G., McCoy, A. J., Echols, N., Grosse-Kunstleve, R. W., Adams, P. D., Holton, J. M., Read, R. J. & Terwilliger, T. C. (2014). Nature Methods, 12, 127–130. Web of Science PubMed Google Scholar
Bürmann, F., Shin, H., Basquin, J., Soh, Y., Giménez-Oya, V., Kim, Y., Oh, B. & Gruber, S. (2013). Nature Struct. Mol. Biol. 20, 371–379. Google Scholar
Cho, J.-H., Meng, W., Sato, S., Kim, E. Y., Schindelin, H. & Raleigh, D. P. (2014). Proc. Natl Acad. Sci. USA, 111, 12079–12084. CrossRef Google Scholar
Choudhury, H. G. & Beis, K. (2013). Protein Sci. 22, 1287–1293. CrossRef CAS PubMed Google Scholar
Dauter, Z. (2006). Acta Cryst. D62, 867–876. Web of Science CrossRef CAS IUCr Journals Google Scholar
Dauter, Z., Dauter, M. & Dodson, E. J. (2002). Acta Cryst. D58, 494–506. Web of Science CrossRef CAS IUCr Journals Google Scholar
Dauter, Z., Wilson, K. S., Sieker, L. C., Meyer, J. & Moulis, J. M. (1997). Biochemistry, 36, 16065–16073. Web of Science CrossRef CAS PubMed Google Scholar
Drenth, J. (1999). Principles of Protein X-ray Crystallography, 2nd ed. Berlin: Springer-Verlag. Google Scholar
Du, J., Zhong, X., Bernatavichute, Y. V., Stroud, H., Feng, S., Caro, E., Vashisht, A. A., Terragni, J., Chin, H. G., Tu, A., Hetzel, J., Wohlschlegel, J. A., Pradhan, S., Patel, D. J. & Jacobsen, S. E. (2012). Cell, 151, 167–180. CrossRef Google Scholar
Duman, R. E. & Löwe, J. (2010). J. Mol. Biol. 401, 653–670. Web of Science CrossRef CAS PubMed Google Scholar
Evans, P. (2006). Acta Cryst. D62, 72–82. Web of Science CrossRef CAS IUCr Journals Google Scholar
Fan, J., Jiang, D., Zhao, Y., Liu, J. & Zhang, X. C. (2014). Proc. Natl Acad. Sci. USA, 111, 7636–7640. CrossRef Google Scholar
Fineran, P. C., Blower, T. R., Foulds, I. J., Humphreys, D. P., Lilley, K. S. & Salmond, G. P. C. (2009). Proc. Natl Acad. Sci. USA, 106, 894–899. CrossRef Google Scholar
Ford, M. G. J., Pearse, B. M. F., Higgins, M. K., Vallis, Y., Owen, D. J., Gibson, A., Hopkins, C. R., Evans, P. R. & McMahon, H. T. (2001). Science, 291, 1051–1055. CrossRef Google Scholar
Furey, W. & Swaminathan, S. (1997). Methods Enzymol. 276, 590–620. CrossRef Web of Science Google Scholar
Gao, A. & Serganov, A. (2014). Nature Chem. Biol. 10, 787–792. CrossRef Google Scholar
Grosse-Kunstleve, R. W. & Adams, P. D. (2003). Acta Cryst. D59, 1966–1973. Web of Science CrossRef CAS IUCr Journals Google Scholar
Hamilton, W. C. (1964). Statistics in Physical Science. New York: Ronald Press. Google Scholar
He, X., Kuo, Y.-C., Rosche, T. J. & Zhang, X. (2013). Structure, 21, 355–364. CrossRef Google Scholar
Hendrickson, W. A. (2014). Q. Rev. Biophys. 47, 49–93. Web of Science CrossRef PubMed Google Scholar
Hou, X., Pedi, L., Diver, M. M. & Long, S. (2012). Science, 338, 1308–1313. CrossRef Google Scholar
Hsia, K.-C. & Hoelz, A. (2010). Proc. Natl Acad. Sci. USA, 107, 11271–11276. Web of Science CrossRef CAS PubMed Google Scholar
Huang, H., Levin, E. J., Liu, S., Bai, Y., Lockless, S. W. & Zhou, M. (2014). PLoS Biol. 12, e1001911. CrossRef Google Scholar
Hwang, W. C., Golden, J. W., Pascual, J., Xu, D., Cheltsov, A. & Godzik, A. (2014). Proteins, doi:10.1002/prot.24679. Google Scholar
Jeyaprakash, A. A., Santamaria, A., Jayachandran, U., Chan, Y. W., Benda, C., Nigg, E. A. & Conti, E. (2012). Mol. Cell, 46, 274–286. CrossRef Google Scholar
Kantardjieff, K. A. & Rupp, B. (2003). Protein Sci. 12, 1865–1871. Web of Science CrossRef PubMed CAS Google Scholar
Karplus, P. A. & Diederichs, K. (2012). Science, 336, 1030–1033. Web of Science CrossRef CAS PubMed Google Scholar
Kawate, T., Michel, J. C., Birdsong, W. T. & Gouaux, E. (2009). Nature (London), 460, 592–598. Web of Science CrossRef PubMed CAS Google Scholar
Kozbial, P. et al. (2008). Proteins, 71, 1589–1596. CrossRef Google Scholar
Ladd, M. F. C. (1998). Introduction to Physical Chemistry. Cambridge University Press. Google Scholar
La Fortelle, E. de & Bricogne, G. (1997). Methods Enzymol. 276, 472–494. Google Scholar
Leibundgut, M., Frick, C., Thanbichler, M., Böck, A. & Ban, N. (2004). EMBO J. 24, 11–22. CrossRef Google Scholar
Levin, I. et al. (2005). Proteins, 59, 864–868. CrossRef Google Scholar
Li, J., Jaimes, K. F. & Aller, S. G. (2014). Protein Sci. 23, 34–46. CrossRef PubMed Google Scholar
Lindås, A.-C., Chruszcz, M., Bernander, R. & Valegård, K. (2014). Acta Cryst. D70, 492–500. CrossRef IUCr Journals Google Scholar
Liu, Q., Liu, Q. & Hendrickson, W. A. (2013). Acta Cryst. D69, 1314–1332. Web of Science CrossRef CAS IUCr Journals Google Scholar
Lo, Y.-C., Lin, S.-C., Rospigliosi, C. C., Conze, D. B., Wu, C.-J., Ashwell, J. D., Eliezer, D. & Wu, H. (2009). Mol. Cell, 33, 602–615. CrossRef Google Scholar
Lunin, V. Y. (1993). Acta Cryst. D49, 90–99. CrossRef CAS Web of Science IUCr Journals Google Scholar
Martinez-Rucobo, F. W., Sainsbury, S., Cheung, A. C. M. & Cramer, P. (2011). EMBO J. 30, 1302–1310. Google Scholar
Mathys, H., Basquin, J., Ozgur, S., Czarnocki-Cieciura, M., Bonneau, F., Aartse, A., Dziembowski, A., Nowotny, M., Conti, E. & Filipowicz, W. (2014). Mol. Cell, 54, 751–765. CrossRef Google Scholar
Matthews, B. W. (1968). J. Mol. Biol. 33, 491–497. CrossRef CAS PubMed Web of Science Google Scholar
Matthews, B. W. & Czerwinski, E. W. (1975). Acta Cryst. A31, 480–487. CrossRef CAS IUCr Journals Web of Science Google Scholar
McCoy, A. J., Storoni, L. C. & Read, R. J. (2004). Acta Cryst. D60, 1220–1228. Web of Science CrossRef CAS IUCr Journals Google Scholar
Mechaly, A. E., Sassoon, N., Betton, J. M. & Alzari, P. M. (2014). PLoS Biol. 12, e1001776. CrossRef Google Scholar
Meyer, P. A., Ye, P., Suh, M.-H., Zhang, M. & Fu, J. (2009). J. Biol. Chem. 284, 12933–12939. CrossRef Google Scholar
Mueller, M., Grauschopf, U., Maier, T., Glockshuber, R. & Ban, N. (2009). Nature (London), 459, 726–730. Web of Science CrossRef PubMed CAS Google Scholar
Nagy, V., Hsia, K.-C., Debler, E. W., Kampmann, M., Davenport, A. M., Blobel, G. & Hoelz, A. (2009). Proc. Natl Acad. Sci. USA, 106, 17693–17698. CrossRef Google Scholar
Osawa, T., Ito, K., Inanaga, H., Nureki, O., Tomita, K. & Numata, T. (2009). Structure, 17, 713–724. CrossRef Google Scholar
Otwinowski, Z. (1991). Proceedings of the CCP4 Study Weekend. Isomorphous Replacement and Anomalous Scattering, edited by W. Wolf, P. R. Evans & A. G. W. Leslie, pp. 80–86. Warrington: Daresbury Laboratory. Google Scholar
Otwinowski, Z. & Minor, W. (1997). Methods Enzymol. 276, 307–326. CrossRef CAS Web of Science Google Scholar
Pannu, N. S. & Read, R. J. (2004). Acta Cryst. D60, 22–27. Web of Science CrossRef CAS IUCr Journals Google Scholar
Podjarny, A. D. (1976). PhD thesis. Weizmann Institute of Science, Rehovot, Israel. Google Scholar
Pokkuluri, P. R., Londer, Y. Y., Duke, N. E., Pessanha, M., Yang, X., Orshonsky, V., Orshonsky, L., Erickson, J., Zagyanskiy, Y., Salgueiro, C. A. & Schiffer, M. (2011). J. Struct. Biol. 174, 223–233. CrossRef Google Scholar
Qiao, R., Cabral, G., Lettman, M. M., Dammermann, A. & Dong, G. (2012). EMBO J. 31, 4334–4347. CrossRef Google Scholar
Read, R. J. (1986). Acta Cryst. A42, 140–149. CrossRef CAS Web of Science IUCr Journals Google Scholar
Read, R. J., Adams, P. D. & McCoy, A. J. (2013). Acta Cryst. D69, 176–183. Web of Science CrossRef CAS IUCr Journals Google Scholar
Sampathkumar, P. et al. (2013). Structure, 21, 560–571. CrossRef Google Scholar
Schäfer, I. B., Rode, M., Bonneau, F., Schüssler, S. & Conti, E. (2014). Nature Struct. Mol. Biol. 21, 591–598. Google Scholar
Schmidt, H., Gleave, E. S. & Carter, A. P. (2012). Nature Struct. Mol. Biol. 19, 492–497. CrossRef Google Scholar
Schmitzberger, F. & Harrison, S. C. (2012). EMBO Rep. 13, 216–222. CrossRef Google Scholar
Schneider, T. R. & Sheldrick, G. M. (2002). Acta Cryst. D58, 1772–1779. Web of Science CrossRef CAS IUCr Journals Google Scholar
Shi, N., Ye, S., Alam, A., Chen, L. & Jiang, Y. (2006). Nature (London), 440, 570–574. Web of Science CrossRef PubMed CAS Google Scholar
Sun, S., Kondabagil, K., Gentz, P. M., Rossmann, M. G. & Rao, V. B. (2007). Mol. Cell, 25, 943–949. Web of Science CrossRef PubMed CAS Google Scholar
Terwilliger, T. C., Adams, P. D., Read, R. J., McCoy, A. J., Moriarty, N. W., Grosse-Kunstleve, R. W., Afonine, P. V., Zwart, P. H. & Hung, L.-W. (2009). Acta Cryst. D65, 582–601. Web of Science CrossRef CAS IUCr Journals Google Scholar
Terwilliger, T. C. & Berendzen, J. (1999). Acta Cryst. D55, 849–861. Web of Science CrossRef CAS IUCr Journals Google Scholar
Terwilliger, T., Bunkóczi, G., Hung, L.-W., Zwart, P. H., Smith, J., Akey, D. & Adams, P. D. (2016). Acta Cryst. D72, 346–358. CrossRef IUCr Journals Google Scholar
Tian, Y., Simanshu, D. K., Ma, J.-B., Park, J.-E., Heo, I., Kim, V. N. & Patel, D. J. (2014). Mol. Cell, 53, 606–616. CrossRef Google Scholar
Tominaga, T., Watanabe, S., Matsumi, R., Atomi, H., Imanaka, T. & Miki, K. (2012). Acta Cryst. F68, 1153–1157. CrossRef IUCr Journals Google Scholar
Wang, L., Yang, X., Li, S., Wang, Z., Liu, Y., Feng, J., Zhu, Y. & Shen, Y. (2014). EMBO J. 33, 594–604. CrossRef Google Scholar
Weeks, C. M., DeTitta, G. T., Miller, R. & Hauptman, H. A. (1993). Acta Cryst. D49, 179–181. CrossRef CAS Web of Science IUCr Journals Google Scholar
Weichenberger, C. X. & Rupp, B. (2014). Acta Cryst. D70, 1579–1588. Web of Science CrossRef IUCr Journals Google Scholar
Wilson, A. J. C. (1942). Nature (London), 150, 152. CrossRef Google Scholar
Xu, Q. et al. (2007). Proteins 69, 433–439. CrossRef Google Scholar
Xu, Q. et al. (2006). Proteins, 62, 292–296. CrossRef Google Scholar
Xu, Q., Rife, C. L. et al. (2009). Proteins, 74, 1041–1049. CrossRef Google Scholar
Xu, Q., Sudek, S. et al. (2009). Structure, 17, 303–313. Web of Science CrossRef PubMed CAS Google Scholar
Yang, J., Kulkarni, K., Manolaridis, I., Zhang, Z., Dodd, R. B., Mas-Droux, C. & Barford, D. (2011). Mol. Cell, 44, 997–1004. CrossRef Google Scholar
Yang, C., Pflugrath, J. W., Courville, D. A., Stence, C. N. & Ferrara, J. D. (2003). Acta Cryst. D59, 1943–1957. Web of Science CrossRef CAS IUCr Journals Google Scholar
Zhang, J. & Ferré-D'Amaré, A. R. (2013). Nature (London), 500, 363–366. CrossRef Google Scholar
Zhou, A., Carrell, R. W., Murphy, M. P., Wei, Z., Yan, Y., Stanley, P. L., Stein, P. E., Broughton Pipkin, F. & Read, R. J. (2010). Nature (London), 468, 108–111. Web of Science CrossRef CAS PubMed Google Scholar
Zhou, Q., Li, J., Yu, H., Zhai, Y., Gao, Z., Liu, Y., Pang, X., Zhang, L., Schulten, K., Sun, F. & Chen, C. (2014). Nature Commun. 5, 3552. Google Scholar
Zhou, Y.-F. & Springer, T. A. (2014). Blood, 123, 1785–1793. CrossRef Google Scholar
Zimmer, J., Nam, Y. & Rapoport, T. A. (2008). Nature (London), 455, 936–943. CrossRef Google Scholar
Zwart, P. H. (2005). Acta Cryst. D61, 1437–1448. Web of Science CrossRef CAS IUCr Journals Google Scholar
Zwart, P. H., Grosse-Kunstleve, R. W. & Adams, P. D. (2005). CCP4 Newsl. Protein Crystallogr. 43, contribution 7. Google Scholar
This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.