research papers
Asymmetry in serial femtosecond crystallography data
^{a}Department of Chemistry and Molecular Biology, University of Gothenburg, Box 462, Gothenburg 40530, Sweden, and ^{b}Department of Chemistry, Bridge Institute, University of Southern California, Los Angeles, CA 90089, USA
^{*}Correspondence email: gergely.katona@cmb.gu.se
Serial crystallography is an increasingly important approach to protein crystallography that exploits both Xray freeelectron laser (XFEL) and synchrotron radiation. Serial crystallography recovers complete Xray diffraction data by processing and merging diffraction images from thousands of randomly oriented nonuniform microcrystals, of which all observations are partial Bragg reflections. Random fluctuations in the XFEL pulse energy spectrum, variations in the size and shape of microcrystals, integrating over millions of weak partial observations and instabilities in the XFEL beam position lead to new types of experimental errors. The quality of Bragg intensity estimates deriving from serial crystallography is therefore contingent upon assumptions made while modeling these data. Here it is observed that serial femtosecond crystallography (SFX) Bragg reflections do not follow a unimodal Gaussian distribution and it is recommended that an idealized assumption of single Gaussian peak profiles be relaxed to incorporate apparent asymmetries when processing SFX data. The phenomenon is illustrated by reanalyzing data collected from microcrystals of the Blastochloris viridis photosynthetic reaction center and comparing these intensity observations with conventional synchrotron data. The results show that skewness in the SFX observations captures the essence of the Wilson plot and an empirical treatment is suggested that can help to separate the diffraction Bragg intensity from the background.
Keywords: exGaussian distribution; serial femtosecond crystallography; Bragg reflections; systematic absences; intensity distribution.
1. Introduction
Xray freeelectron lasers (XFELs) are linear accelerator based Xray sources that deliver a peak Xray et al., 2010). These revolutionary machines were foreseen to create new possibilities in life science (Neutze et al., 2000) and over the six years since XFELs have been available to users the rapid pace of development has been impressive (Schlichting, 2015). One major application of XFEL radiation is the development of serial femtosecond crystallography (SFX). A proofofprinciple study first performed at low resolution using crystals of photosystem I (Chapman et al., 2011) was shortly afterwards extended to high resolution (Boutet et al., 2012) and has since been applied to timeresolved Xray diffraction (Tenboer et al., 2014), the study of protein–protein receptor complexes (Kang et al., 2015) and de novo phasing (Barends et al., 2014). Serial crystallography has also since been applied to studies using synchrotron radiation (Nogly et al., 2015) and is expected to become a broadly applied method at storage ring based microfocus beamlines.
a billion times greater than synchrotron radiation (EmmaClassical synchrotronbased protein crystallography records diffraction images by rotating a protein crystal within an Xray beam and thereby samples data from all unique reflection planes. In contrast, SFX is a random sampling method whereby complete Xray data are obtained by processing diffraction images collected from thousands of randomly oriented microcrystals as they are continuously streamed across the path of a highly intense XFEL beam (Chapman et al., 2006). This strategy creates new challenges and the last few years have seen the emergence of various experimental and data processing tools designed to handle such nuances. CrystFEL (White et al., 2012) is an SFX data analysis software suite which performs indexing by calling DirAx (Duisenberg, 1992), XDS (Kabsch, 2010) and MOSFLM (Leslie, 2006). CrystFEL then models diffraction spots as circular regions surrounded by an annulus masking background pixels, similar to early versions of Denzo (Otwinowski & Minor, 1997). Diffraction intensities are quantified by integrating over all pixels occupied within the selected regions, and the spot intensity is calculated either by subtracting the total peak counts from that estimated from the background region, or by using profile fitting (Rietveld, 1969).
A Monte Carlo merging approach in CrystFEL calculates merged intensity for the unique reflections by taking a simple mean of all the symmetrically equivalent observations (Kirian et al., 2010). This is appropriate when the corresponding intensities follow a unimodal normal distribution. An alternative to CrystFEL which is based upon an extrapolation method assumes that all the crystals in an SFX experiment are identical and the final energy distribution in the is Gaussian (Zhang et al., 2014). Microcrystals possess very different diffraction power and the detector distance cannot be optimized for each crystal as in a conventional synchrotronbased experiment. The data collection parameters are instead optimized to capture the highestresolution reflections from the best ordered crystals. This also means that many highresolution reflections without signal are integrated from the large body of weakly diffracting crystals. Although attempts are made to limit the integration radius to that of the crystal resolution, this point estimate is error prone. As a result, intensity observations may not necessarily follow a single normal distribution.
Here, we explore an alternative to the perfect Gaussian distribution for serial crystallography data using data recorded at the LCLS (Linac Coherent Light Source, Stanford University, California) from microcrystals of the Blastochloris viridis (B. viridis) photosynthetic reaction center (RC_{vir}) as a representative example. We examine the asymmetry in the reflection intensities using an exGaussian distribution as a minimal extension of a Gaussian distribution and contrast the asymmetry in SFX data to more conventional Xray diffraction observations from a single crystal collected at a synchrotron source. Finally, we make a preliminary proposal for how the properties of an exGaussian distribution may be exploited to infer the Bragg intensities of an `idealized crystal' in the microcrystal slurry.
2. Materials and methods
2.1. Growth and purification of reaction center from B. viridis
The photosynthetic reaction center from B. viridis was cultivated and purified as described by Johansson et al. (2013).
2.2. Lipidic sponge phase batch crystallization
Lipidic sponge phase was prepared as described by Wöhri et al. (2009) with the following modifications. Melted monoolein was thoroughly mixed in a ratio of 3:2 (v/v) with 0.1 M HEPES pH 7.5, 0.1% LDAO until a viscous transparent lipidic cubic phase was obtained. The formed phase was then transferred into a glass vial and spongephaseinducing solution (1:4 ratio) was added containing 16% Jeffamine M600, 1 M HEPES pH 7.9, 0.7 M ammonium sulfate, 2.5% 1,2,3heptanetriol, which swells the cubic phase to the sponge phase. After overnight, the upper phase (sponge phase) was harvested. Crystals were grown using batch crystallization in the lipidic sponge phase. Equal amounts of sponge phase and protein were mixed in a 4:1 ratio (v/v) with 1.2 M trissodium citrate (2 parts sponge phase, 2 parts protein, 1 part trissodium citrate) and allowed to incubate for several weeks. Crystals grew in the dark at room temperature and were delivered to the CXI (coherent Xray imaging) instrument using a sample loop. The protein concentration used for crystallization setups was 20 mg ml^{−1} with an ratio of A_{280}/A_{830} = 2.27.
2.3. Synchrotron singlecrystal data collection
Singlecrystal Xray data were collected under cryoconditions with a 225 mm MarMOSAIC CCD detector at ID232 at the ESRF (Grenoble, France) (λ = 0.8726 Å). The oscillation range per image was 1°, the exposure time 1.0 s, the distance to the detector 373.1 mm. The crystals belong to the P2_{1}2_{1}2_{1} with unitcell dimensions of a = 57.6, b = 82.9, c = 382.1 Å, α = β = γ = 90°.
2.4. SFX data processing and analysis
RC_{vir_XFEL} data from 1175 images were indexed and integrated using the indexamajig program of the CrystFEL 0.6.2 software suite. Data were indexed using the P2_{1}2_{1}2_{1} with unitcell dimensions of a = 57.9, b = 84.8, c = 384.3 Å, α = β = γ = 90° and data reflections were integrated up to the apparent diffraction limit of each crystal by using the _rescut _pushres = 0 option. Three parallel data processing approaches, namely CrystFEL process_hkl, CrystFEL partialator and the Ideal Crystal approach, were used to merge data. The CrystFEL process_hkl scaled and merged the data using the Monte Carlo method; the CrystFEL partialator method was used to merge the data using the partiality `scgaussian' model with data scaling using three iterations. Thirdly, the Ideal Crystal approach which is based on the Markov chain Monte Carlo (MCMC) method (Gilks et al., 1996) was implemented using the pymc3 library (Salvatier et al., 2016) and the unmerged data which were sorted and arranged in the group of unique reflections using the cctbx libraries (Sauter et al., 2013). The data collection and processing statistics using all three approaches are summarized in Table 1. Wilson B factors for the Ideal Crystal approach were matched with those of CrystFEL process_hkl and CrystFEL partialator approaches by multiplying the intensities and σ's by a correction factor [f = b − (b − 1)q^{2}/q^{2}_{n}, where b is a variable, q is the inverse resolution squared (1/d^{2}) and q_{n} is the q of the highestresolution reflection]. Two sets of the Ideal Crystal data were generated using correction factors with b = 1.05 and b = 1.19 in order to compare with the CrystFEL process_hkl and partialator approach, respectively. All four data sets were processed using CCP4 7.0.020 (Winn et al., 2011) truncate software (French & Wilson, 1978).

For structural comparison between the Ideal Crystal data sets and those from CrystFEL data processing approaches, all four diffraction data sets were cut at 3.5 Å resolution. Molecular replacement (MR) solutions were searched in the P2_{1}2_{1}2_{1} with a search model of RC_{vir} (PDB entry 4cas, Johansson et al., 2013) using PhaserMR in Phenix version 1.1021551692 (Adams et al., 2010). The MR solutions using Ideal Crystal data sets showed the higher loglikelihood gains among the tested data processing strategies (shown in Table 1). RC_{vir_XFEL} structures were refined for all four data sets using the same strategies in the Phenix suite. The strategy implemented was performed using five cycles of for coordinates, real space, rigid body and individual B factors. The protocol was further modified by using target functions and the best weights for the Xray target functions, and the Bfactor restraints were optimized. Water update and automatic correction of N/Q/H errors were kept active during the are summarized in Table 1 which shows that parameters are quite similar between the corresponding Ideal Crystal and CrystFEL approaches. Simulated annealing composite omit maps were calculated in Phenix for all four data sets. All the maps were contoured at 1σ.
3. Results
3.1. Overview of data processing steps
The goal of any crystallographic analysis of diffraction patterns is to present the data in a way that the structural et al., 2011) deals with very high multiplicity, but the underlying principles are the same as in traditional approaches to crystallography in that serial crystallography records multiple observations for any unique reflection from multiple images, and then merges these observations to yield I_{hkl} and σ_{hkl} which scaling and other crystallographic programs can use. The data processing scheme used here starts with the indexing and integration of the diffraction images. Complete diffraction data are then obtained in the form of a stream file containing the list of all the observations. These observations are then mapped to the using the cctbx Python libraries (GrosseKunstleve et al., 2002). The key scientific idea here is to determine the distribution of the observations, and the histogram for each reflection is calculated and fitted with different distribution functions. The fitting parameters are then used to diagnose and determine the Bragg reflection and diffuse intensity response.
packages can use. The new concept of serial crystallography (Chapman3.2. Symmetric and asymmetric distribution functions
Intensity distributions for all the unique reflections were calculated and fitted using selected distribution functions. Standard approaches of processing crystallographic data assume an idealized Gaussian distribution function:
where μ and σ provide information about the mean and variability in the reflection, respectively. Serial crystallography risks merging many more weak observations than expected when using classical data collection strategies and therefore the distribution of observations may be expected to be skewed towards a larger number of weak observations. To test this possibility, we also consider a minimal extension of the Gaussian distribution known as an exGaussian distribution function which is a convoluted distribution of a Gaussian and an exponential distribution function and is represented as:
where erf is an error function with erf(0) = 0; erf(∞) = 1. Here, μ and σ provide information on localization and variability of the Gaussian part, respectively, and τ is the mean of an exponential component, providing information about the degree of skewness in the distribution of reflection intensities.
A parameter search algorithm using ) was used to recover optimal parameters for both Gaussian and exGaussian distributions to crystallographic observations for any given hkl For the parameter value (p) which allows a correct fit of the distribution function f(xp) to the data (x), the minus loglikelihood criterion was applied in which the minimum of a −LogL is estimated, where LogL for a parameter value p is defined as
estimation (Lacouture & Cousineau, 2008Scanning through all possible values of the parameter is time consuming, specifically when fitting with multiparameter distribution functions. Therefore, as a first approximation the local minimum of the function was reached by iteratively adjusting the starting parameter values using the Simplex method based on the steepest gradient algorithm (Lacouture & Cousineau, 2008). We later extend the inference within the a posteriori parameter space using the MCMC algorithm (Gilks et al., 1996) to estimate the uncertainty in distribution parameters.
3.3. calculation using XFEL data
Xray diffraction images were collected by injecting thousands of microcrystals of RC_{vir} into the XFEL pulses coming with a repetition rate of 120 Hz at the LCLS. Images were indexed and integrated using the indexamajig program of the CrystFEL suite (White et al., 2012). All the indexed observations for each microcrystal are collectively put together into a complete diffraction data set in one stream file. Each batch contains a set of partial reflections which were reassembled to have all the equivalent reflections in an order. All the equivalent observations were then mapped to the of P2_{1}2_{1}2_{1} using the cctbx Python library through the map_to_asu function of Miller array objects.
XFEL diffraction RC_{vir} data (RC_{vir_XFEL}) were considered up to 3.5 Å resolution as previously described (Johansson et al., 2013). We calculated the histogram for the distribution of observations for each reflection and fitted it with both a Gaussian and an exGaussian distribution profile. Figs. 1(a)–1(d) show the Gaussian (red) and the exGaussian (blue) fits to the histograms for four reflections selected at different resolutions. The exGaussian fit was observed to provide a better shape fit to the histogram than the Gaussian fit. Table 2 provides the values of the fitting parameters obtained using the two distributions for the selected reflections. μ_{g} and σ_{g} are the fitting parameters obtained using the Gaussian fit whereas μ_{exg}, σ_{exg} and τ_{exg} are the ones obtained using the exGaussian fit. Consistent with the definition of an exGaussian distribution, we observed that for the reflections which have relatively reduced skewness the exGaussian approaches a normal distribution, as is seen for the reflection (1, 21, 54) in Fig. 1(d). In contrast, for the reflection (7, 4, 5) in Fig. 1(b), where skewness is high, the exGaussian distribution approaches an exponential distribution.

A Gaussian is a subset of an exGaussian function; hence a fit with an exGaussian will always be better than or equal to that of a Gaussian. In order to check the desirability of such a distribution function to correctly model the frequency of intensity observations, we performed a likelihood ratio test for nested functions. In this test, twice the difference between the negative of the loglikelihood of the Gaussian and exGaussian provides the chisquare estimate for an extra degree of freedom. Chisquare values for each reflection were calculated and the decision to fit the reflection using an exGaussian distribution profile was taken on the basis of 5% chance criteria, which gives a chisquare cutoff score of 3.84 for a single degree of freedom. For RC_{vir_XFEL} data, it was found that 95% of reflections strongly favour an estimation to be made using an exGaussian distribution function. This preference for an exGaussian over a Gaussian fit was found to be consistent over the complete resolution range (Fig. 2a).
To explore further the information contained in a Gaussian and the exponential parts of an exGaussian distribution, we plotted the mean (μ_{exg}) and the skewness (τ_{exg}) parameters of the exGaussian function as a function of resolution (Fig. 3a). At high resolution (above 7 Å), τ_{exg} follows the Wilson distribution in a similar manner to μ_{g} of the Gaussian function. τ_{exg} and μ_{g} have the same magnitude in the highresolution range and show standard maxima and minima at 4.5 Å and 6 Å, respectively. On the other hand, μ_{exg} does not appear to follow the expected Wilson intensity distribution at high resolution.
3.4. Comparison with the systematic absences
The magenta and yellow coloured histograms in Figs. 1(a)–1(d) show the distributions of the four systematically absent and nonabsent Bragg reflections, respectively, in different resolution ranges, 27.3, 7.6, 4.2 and 3.8 Å. Comparing the histograms of the Bragg reflections at high resolutions with those of the systematically absent reflections in our data, we observe that the most frequent intensity observations of nonabsent Bragg reflections overlap with those of the systematically absent reflections present in the same resolution range. In addition, there is a small fraction of valuable observations that are responsible for the extended tail of the distribution. Curiously, not even at the lowestresolution reflection (27.3 Å in Fig. 1a) is the distribution symmetric and we observe that there is no genuine shift in the most frequent observations compared with the systematic absence at similar resolution.
3.5. Comparison with synchrotron data
A similar analysis of reflection intensities was carried out using diffraction data collected at a synchrotron source (ESRF) from a single macrocrystal of RC_{vir}. Lipidic sponge phase microcrystals had a different from the earlier form of the macrocrystals (Johansson et al., 2012). To make a fair comparison, we have reproduced an RC_{vir} macrocrystal to match the crystal packing with that of the microcrystals used for XFELbased data collection. Although we were able to produce macrocrystals in the P2_{1}2_{1}2_{1} they diffracted only up to 3.6 Å in contrast to the 1.86 Å limit achieved earlier by using the RC_{vir} crystals produced in the P2_{1}2_{1}2 (Wöhri et al., 2009). Table 1 provides the crystallographic data statistics showing the comparison between the data collected at the synchrotron source to 3.6 Å and those collected at the XFEL source at 3.5 Å. The synchrotron data (RC_{vir_Sync}) have smaller multiplicity in comparison with the XFEL data.
It is often sufficient that crystals are indexed with the help of their lowresolution reflections, but the measured intensities at predicted spot positions can be practically zero at higher resolution in the case of lowquality crystals. Fig. 4(a) shows an SFX diffraction snapshot from a weakly diffracting crystal where highresolution reflections are not observed; nevertheless Bragg positions are integrated beyond the visible limit of Bragg spots. In synchrotron crystallographic data collection (Fig. 4b), a similar large variation in diffraction intensity is not observed unless the diffraction is very anisotropic or the crystal is poorly centered. For this reason, we see that the histogram of synchrotron reflections is more symmetric and can be modeled unambiguously with a Gaussian distribution (Fig. 2b). If fitted using an exGaussian distribution, the tail is less pronounced and τ_{exg} has little influence on the mean intensity of the reflection (Fig. 3b). Conversely, in SFX data only a few goodquality crystals produce overall highintensity observations leading to a tail in the intensity histogram.
3.6. Empirical inference of Bragg intensity from idealized crystals
When developing a statistical method, it is important to define the goal of the analysis. The presumed goal of current practice is to describe the central tendency of the data and the variability of observations. It is expected that partiality correction and imagebyimage scaling reduce the variability of observations, but this does not change the original goal. If the distribution is symmetric and unimodal the statistical mean could estimate the most frequent intensity observation and our data show that this is a valid assumption for most of the Bragg intensities recorded from a single crystal of reaction center at a synchrotron. There are two serious problems with the original goals when it comes to SFX data. Firstly, we have shown that the distribution is very asymmetric, the mean is ill suited to describe the central tendency of the distribution and the standard errors determined from such distributions cannot accurately describe the confidence interval of the mean. Secondly, the comparison of
and nonabsent Bragg reflections at similar resolution shows that their mode is essentially the same; therefore, it is potentially misleading to try to determine (more accurately) the most frequent intensity of nonabsent Bragg reflections. On the other hand, we are free to choose more meaningful goals for the statistical analysis, for example by replacing the question `what is the typical observed Bragg reflection intensity in an experiment?' with `how high can the Bragg intensity be in an experiment?'. While the typical intensity observation is strongly influenced by diffuse scattering, the highest ones are more likely to originate from good crystals. Thus, we can aim to determine the diffraction intensity of an `idealized' crystal in its ideal diffraction condition. The highestintensity observation of any given unique reflection may or may not originate from this group of ideal crystals at the top of their rocking curve, but we can define a region of the intensity probability distribution where we expect the ideal crystal reflections to appear even in the absence of an actual observation. This depends on how restrictively the ideal region is defined and the multiplicity of observations.As a first step, we have developed a Bayesian model to infer the probability distribution of the parameters of the empirical exGaussian distribution from the intensity observations of each Bragg reflection using a minimally informative prior knowledge (assuming a uniform distribution). We have approximated the posterior distribution (given the intensity observations) using the MCMC method (Gilks et al., 1996) based on a similar probabilistic model that was previously used for determining the difference of correlated intensity observations (Katona et al., 2016). For each Bragg reflection we determined the maximum a posteriori values of model parameters (μ_{exg}, σ_{exg}, τ_{exg}) as a starting point and calculated 50 000 Monte Carlo samples [Metropolis stepping (Metropolis et al., 1953)], the first 40 000 of which we discarded. We performed thinning of the Markov chain by taking every tenth sample from the posterior joint probability distribution and determined the intensity value (I_{ideal}) at which the cumulative distribution function (c.d.f.) of each exGaussian distribution sample reached a critical value (0.95). The optimal level of critical cumulative probability can be set empirically, but ideally it should not be less than the expected frequency of the diffuse scattering intensity response. A representative example illustrating the posterior distribution samples and corresponding I_{ideal} positions is shown in Fig. 5. Finally, we have defined the intensity of the idealized crystals as the mean of I_{ideal} and its uncertainty as the standard deviation of I_{ideal}.
These idealized data were further processed with truncate of the CCP4 package in parallel with the CrystFEL process_hkl and partialator data as reference data sets. The Ideal Crystal approach resulted in a flatter Wilson plot than the data processed by CrystFEL process_hkl (15 Å^{2} versus 27 Å^{2}, respectively). These Wilson plots are comparable with singlecrystal synchrotron data recorded to similar resolution (37.6 Å^{2}) (Fig. 6), but the partialitycorrected data set is substantially steeper even if it originates from the same set of observations. This is not very surprising since many traditional crystallographic properties have weaker theoretical foundations in SFX. In particular, the observed Wilson plot cannot be directly related to the random displacement of atoms in the unit cells of a single crystal since each crystal has different diffractive power, mosaic spread, atomic displacement parameter distribution etc. Thus, the Wilson plot and the derived Wilson B factor lose their traditional physical meaning without further information about the distribution of the microcrystals. This is not necessarily a problem since empirical tools can be employed to approximate the SFX observations to those of singlecrystal diffraction or to improve the quality of the electrondensity maps or Partialator scaling tries to incorporate a crystalspecific scaling factor and B factor to compensate for this heterogeneity in SFX data sets, but the question then becomes `what is the optimal ultimate scale target?'.
We have applied a correction factor [b − (b − 1)q^{2}/q^{2}_{n}, where b is a variable, q is the inverse resolution squared (1/d^{2}) and q_{n} is the q of the highestresolution reflection] to the intensities and σ's prior to the truncate step to match the Wilson B factor of the Ideal Crystal approach with that of the process_hkl and partialator data (26.6 and 59.6 Å^{2}, respectively, after the correction) to allow a fair comparison. The resulting Wilson plots are shown in Fig. 6. The I/σ (Fig. 7) determined by the Ideal Crystal approach appears to be higher and reflects an appropriate accuracy of the measurement. This is strongly influenced by the choice of the c.d.f. critical value (0.95).
Subsequent modeling steps and map calculations were performed in the Phenix suite (Adams et al., 2010) using identical protocols (see §2). After by Phaser the final loglikelihood gain was higher when using the Ideal Crystal data (Table 1). The best R_{free} value was obtained from the Ideal Crystal approach when scaled to the partialator data, but at the same time the omitmap quality became worse, although not to the same extent as seen in the partialator data. When scaled to the process_hkl data the R_{free} was slightly lower using the Ideal Crystal approach than process_hkl (27.3% versus 27.4%), and the resulting figures of merit, which provide a measure of phase quality for each reflection, were higher (Fig. 8).
Fig. 9 presents a comparison of simulated annealing omit maps calculated from the two data sets – Ideal Crystal (b = 1.05) and process_hkl. Map comparison [Ideal Crystal (blue) versus process_hkl (magenta)] for four selected regions of RC_{vir}, i.e. residues 57–67 in cytochrome C subunit, residues 47–50 in the intramembrane subunit L, residues 65–68 in the intramembrane subunit L and the menaquinone in subunit M, is shown. In summary, the process_hkl and Ideal Crystal data sets yield electrondensity maps and other quality indicators that are broadly comparable, with the Ideal Crystal data sets in some respects seeming better, without any extensive optimization.
It will ultimately be necessary to distinguish distributions that are likely to contain at least one Bragg intensity observation from those that do not contain any. Although one may expect that the best Bragg reflections are at the high end of the c.d.f., the converse is not necessarily true and some observation distributions are presumed to not contain any measurable Bragg reflections at all. In the absence of a genuine observation a prior estimate has to be used. These efforts may be greatly facilitated by the intensity observations of I_{ideal}. One may also find better ways to analyze the posterior distribution of I_{ideal} (reporting the median or mode) and alternative ways to describe their dispersion (for example, using median absolute deviation). Our procedure does not necessitate the use of an exGaussian distribution; in principle, any asymmetric distribution (uni or multimodal) may be applied. Once the most successful empirical distribution is identified, a suitable outlier recognition method can be developed. Since genuine Bragg intensity observations may be a small fraction of the multiplicity, it may be beneficial to incorporate more a priori information in the Bayesian model (using empirical Bayes methods or from first principles).
as they can help to define the low end of the at each resolution bin. As a further development, it may also be possible to optimize the choice of the critical c.d.f. probability: at a higher value one may expect even better selectivity, at the expense of increased uncertainty of4. Conclusion
SFX experiments can produce highly heterogeneous data and our primary purpose was raising the awareness of their incorrect treatment. We observed that in the SFX data the skewness of the intensity observations follows the characteristic trend of a protein Wilson plot; the same is not true for the intensity of the most frequent observations. The most frequent intensity observations do not appear to originate from Bragg reflections of protein. To deal with the weak diffraction images one possibility is to prefilter the reflection observations using a dynamic resolution cutoff per image basis. This approach risks rejecting weak observations that otherwise contain useful information, and indeed we have not observed a sharp distinction between the diffuse scattering signal and Bragg reflections. Instead, the information content can be judged from the distribution of the entire data set and the described exGaussian diagnostics and our intensity inference strategy is a step in this direction.
Acknowledgements
The authors acknowledge the LCLS, a national user facility operated by Stanford University on behalf of the DOE, for collection of the SFX data. The singlecrystal Xray diffraction experiment was carried out at the ID232 beamline of the ESRF. This research was funded by the Swedish Science Research Council (VR) and the Knut and Alice Wallenberg Foundation. Data and the protein coordinates have been deposited with PDB codes 5m7k, 5m7j and 5m7l.
References
Adams, P. D. et al. (2010). Acta Cryst. D66, 213–221. Web of Science CrossRef CAS IUCr Journals Google Scholar
Barends, T. R. M., Foucar, L., Botha, S., Doak, R. B., Shoeman, R. L., Nass, K., Koglin, J. E., Williams, G. J., Boutet, S., Messerschmidt, M. & Schlichting, I. (2014). Nature (London), 505, 244–247. Web of Science CrossRef CAS PubMed Google Scholar
Boutet, S. et al. (2012). Science, 337, 362–364. CrossRef CAS PubMed Google Scholar
Chapman, H. N. et al. (2006). Nat. Phys. 2, 839–843. Web of Science CrossRef CAS Google Scholar
Chapman, H. N. et al. (2011). Nature (London), 470, 73–77. Web of Science CrossRef CAS PubMed Google Scholar
Duisenberg, A. J. M. (1992). J. Appl. Cryst. 25, 92–96. CrossRef CAS Web of Science IUCr Journals Google Scholar
Emma, P. et al. (2010). Nat. Photonics, 4, 641–647. Web of Science CrossRef CAS Google Scholar
French, S. & Wilson, K. (1978). Acta Cryst. A34, 517–525. CrossRef CAS IUCr Journals Web of Science Google Scholar
Gilks, W. R., Richardson, S. & Spiegelhalter, D. (1996). Markov Chain Monte Carlo in Practice. USA: Chapman and Hall. Google Scholar
GrosseKunstleve, R. W., Sauter, N. K., Moriarty, N. W. & Adams, P. D. (2002). J. Appl. Cryst. 35, 126–136. Web of Science CrossRef CAS IUCr Journals Google Scholar
Johansson, L. C. et al. (2013). Nat. Commun. 4, 2911. Web of Science PubMed Google Scholar
Johansson, L. C. et al. (2012). Nat. Methods, 9, 263–265. Web of Science CrossRef CAS PubMed Google Scholar
Kabsch, W. (2010). Acta Cryst. D66, 125–132. Web of Science CrossRef CAS IUCr Journals Google Scholar
Kang, Y. et al. (2015). Nature (London), 523, 561–567. Web of Science CrossRef CAS PubMed Google Scholar
Katona, G., GarciaBonete, M.J. & Lundholm, I. V. (2016). Acta Cryst. A72, 406–411. Web of Science CrossRef IUCr Journals Google Scholar
Kirian, R. A., Wang, X. Y., Weierstall, U., Schmidt, K. E., Spence, J. C. H., Hunter, M., Fromme, P., White, T., Chapman, H. N. & Holton, J. (2010). Opt. Express, 18, 5713–5723. Web of Science CrossRef PubMed Google Scholar
Lacouture, Y. & Cousineau, D. (2008). Tutorials in Quantitative Methods for Psychology, 4, 35–45. CrossRef Google Scholar
Leslie, A. G. W. (2006). Acta Cryst. D62, 48–57. Web of Science CrossRef CAS IUCr Journals Google Scholar
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H. & Teller, E. (1953). J. Chem. Phys. 21, 1087–1092. CrossRef CAS Web of Science Google Scholar
Neutze, R., Wouts, R., van der Spoel, D., Weckert, E. & Hajdu, J. (2000). Nature (London), 406, 752–757. Web of Science CrossRef PubMed CAS Google Scholar
Nogly, P. et al. (2015). IUCrJ, 2, 168–176. Web of Science CrossRef CAS PubMed IUCr Journals Google Scholar
Otwinowski, Z. & Minor, W. (1997). Methods Enzymol. 276, 307–326. CrossRef CAS PubMed Web of Science Google Scholar
Rietveld, H. M. (1969). J. Appl. Cryst. 2, 65–71. CrossRef CAS IUCr Journals Web of Science Google Scholar
Salvatier, J., Wiecki, T. V. & Fonnesbeck, C. (2016). PeerJ Comput. Sci. 2, e55. https://doi.org/10.7717/peerjcs.55. CrossRef Google Scholar
Sauter, N. K., Hattne, J., GrosseKunstleve, R. W. & Echols, N. (2013). Acta Cryst. D69, 1274–1282. Web of Science CrossRef CAS IUCr Journals Google Scholar
Schlichting, I. (2015). IUCrJ, 2, 246–255. Web of Science CrossRef CAS PubMed IUCr Journals Google Scholar
Tenboer, J. et al. (2014). Science, 346, 1242–1246. Web of Science CrossRef CAS PubMed Google Scholar
White, T. A., Kirian, R. A., Martin, A. V., Aquila, A., Nass, K., Barty, A. & Chapman, H. N. (2012). J. Appl. Cryst. 45, 335–341. Web of Science CrossRef CAS IUCr Journals Google Scholar
Winn, M. D. et al. (2011). Acta Cryst. D67, 235–242. Web of Science CrossRef CAS IUCr Journals Google Scholar
Wöhri, A. B., Wahlgren, W. Y., Malmerberg, E., Johansson, L. C., Neutze, R. & Katona, G. (2009). Biochemistry, 48, 9831–9838. Web of Science PubMed Google Scholar
Zhang, T., Li, Y. & Wu, L. (2014). Acta Cryst. A70, 670–676. Web of Science CrossRef IUCr Journals Google Scholar
This is an openaccess article distributed under the terms of the Creative Commons Attribution (CCBY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.