Received 1 May 2008
Prospects for de novo phasing with de novo protein models
The prospect of phasing diffraction data sets `de novo' for proteins with previously unseen folds is appealing but largely untested. In a first systematic exploration of phasing with Rosetta de novo models, it is shown that all-atom refinement of coarse-grained models significantly improves both the model quality and performance in molecular replacement with the Phaser software. 15 new cases of diffraction data sets that are unambiguously phased with de novo models are presented. These diffraction data sets represent nine space groups and span a large range of solvent contents (33-79%) and asymmetric unit copy numbers (1-4). No correlation is observed between the ease of phasing and the solvent content or asymmetric unit copy number. Instead, a weak correlation is found with the length of the modeled protein: larger proteins required somewhat less accurate models to give successful molecular replacement. Overall, the results of this survey suggest that de novo models can phase diffraction data for approximately one sixth of proteins with sizes of 100 residues or less. However, for many of these cases, `de novo phasing with de novo models' requires significant investment of computational power, much greater than 103 CPU days per target. Improvements in conformational search methods will be necessary if molecular replacement with de novo models is to become a practical tool for targets without homology to previously solved protein structures.
Molecular replacement has become one of the most widely used tools for solving the crystallographic phase problem for protein diffraction data sets. With widely available software, rapid phasing is possible if models with structural similarity to the crystallized protein are available (Blow & Rossmann, 1961). As the data bank of solved protein crystal structures continues to expand and as comparative modeling methods become increasingly sophisticated (Schwarzenbacher et al., 2004; Giorgetti et al., 2005; Raimondo et al., 2007; Qian et al., 2007), the use of molecular replacement is likely to continue to grow.
In recent years, a new frontier for molecular replacement has come into view. A number of diffraction data sets have now been phased `de novo', i.e. in the absence of evolutionary information from structural homologs or experimental data from methods such as NMR. For a tetrameric coiled coil (Howard et al., 2007) or a heptameric membrane helix assembly (Strop et al., 2007), the stereotypical conformation of helices and assumptions regarding the internal symmetry of the complexes have been sufficient to produce successful molecular-replacement templates. [There has also been a long history of phasing nucleic acid crystals with ideal double helices; see, for example, Szep et al. (2003).] For the more general case of an asymmetric protein, our group, in collaboration with the developers of Phaser (McCoy, 2007), has recently presented an example in which the diffraction data for target T0283 in the 2006 Critical Assessment of Structure Prediction were phased by a de novo blind model produced with the Rosetta high-resolution prediction methodology (Qian et al., 2007). These examples suggest that de novo modeling is beginning to pass a quite stringent test for accuracy, as was eloquently anticipated by Petsko eight years ago (Petsko, 2000). Perhaps more importantly, a template-free approach holds practical promise for assisting crystallographic phasing for the substantial number of targets for which structural homologues or other experimental data are not available. However, the number of existing examples remains anecdotal; a much larger set of successful de novo phasing solutions is required to delineate the current capabilities and limitations of the method.
In this study, we systematically explore three aspects of this molecular-replacement approach, which we have termed `de novo phasing with de novo models'. We first test whether all-atom refinement of initial low-resolution models is critical for successful molecular replacement, carrying out a benchmark on 30 diffraction data sets. Secondly, we test whether bringing to bear a large amount of computational power (well over 1000 CPU days per target) increases the rate of successful phasing with Rosetta de novo models. Finally, we inspect these benchmark results to determine whether particular parameters such as solvent content and the number of copies in the asymmetric unit render diffraction data sets more amenable or more difficult for molecular replacement. With more than a dozen new examples of successful de novo phasing, this study presents a first portrait of what can and cannot be achieved when combining state-of-the-art de novo structure modeling and state-of-the-art molecular-replacement methods.
The critical advance that has enabled blind de novo methods to produce high-resolution predictions (better than 2 Å C r.m.s.d. from the crystal structure) has been the refinement of initial coarse-grained models in the context of a physically realistic all-atom force field (Rohl et al., 2004; Kuhlman et al., 2003; Bradley et al., 2005; Das et al., 2007). [We note here that `refinement' refers to the optimization of model conformations in the absence of experimental data and should not be confused with refinement of coordinates based on diffraction data, as occurs during crystallographic structure determination (Murshudov et al., 1997).] The Rosetta all-atom refinement method is computationally expensive. The sharp penalties associated with atom-atom steric clashes require the extensive minimization of all the protein degrees of freedom after each exploratory perturbation of the side-chain or backbone conformation. With current processors, the Rosetta algorithm requires on the order of an hour to refine a protein model with a length of 100 residues, nearly twice as long as the initial low-resolution conformational search (Das et al., 2007).
On one hand, this expensive procedure produces very little change in the structure, with the protein backbone typically shifting by less than 2 Å. On the other hand, the final all-atom score is typically far better at discriminating near-native conformations from non-native models than low-resolution force fields and is thus critical for selecting a small number of blind high-resolution predictions from pools of thousands of low-resolution models. For the CASP7 blind trials in 2006, de novo predictions from our group required the use of a distributed network of tens of thousands of volunteer computers, Rosetta@home, to carry out all-atom refinement on the models generated for nearly 100 targets (Das et al., 2007).
However, for applications to the crystallographic phase problem such refinement may not be necessary. Automated robust molecular-replacement software packages such as Phaser permit the screening of thousands of models in a single night on current computer clusters. It may be that models containing only the N, C, C, C and O heavy atoms produced by the first low-resolution conformational search of Rosetta can be selected based on their performance in likelihood-based molecular replacement, without a computationally expensive Rosetta all-atom refinement occurring in between. For example, while the diffraction data for CASP target T0283 could be phased with a high-resolution blind prediction (Qian et al., 2007), we subsequently discovered that automated and nearly complete rebuilding of the structure could also be achieved by molecular replacement with a coarse-grained low-resolution model, albeit one selected based on knowledge of the crystal structure (unpublished results). Can low-resolution computationally inexpensive models be used in general for molecular replacement?
To investigate this question, we carried out a benchmark of phasing with low-resolution and high-resolution models, focusing on sequences of length 100 residues or less from an in-house de novo modeling benchmark. For each of these sequences, the structures of targets and of proteins homologous in sequence or structure were removed from the fragment libraries used to generate the Rosetta models (Bradley et al., 2005), thus mimicking a real-world trial in which templates would not be available for a new protein target. The set of benchmark sequences was pre-filtered based on small-scale low-resolution modeling runs indicating that Rosetta conformational sampling could produce models within 3 Å C r.m.s.d. from experimental structures, with the hope that aggressive sampling and high-resolution refinement would yield structures within the 1.5 Å C r.m.s.d. accuracy bound that is widely considered to be necessary for accurate molecular replacement (Chen et al., 2000). (Targets for which Rosetta cannot currently achieve this accuracy were assumed to be beyond the scope of successful molecular replacement and remain challenges for improving Rosetta's low-resolution conformational sampling.) For 16 of the 32 considered sequences, experimental structure factors were available in the Protein Data Bank for crystals containing the protein sequence of interest and no other macromolecule chains. For several of the sequences, crystals in different space groups were available and the diffraction data with the highest resolution available for each space group were chosen. A total of 30 diffraction data sets were assembled into a final benchmark for de novo phasing (Table 1). For each sequence, we invested 100 CPU days per target for low-resolution modeling and 100 CPU days per target for high-resolution modeling. This computational effort is on a scale that is feasible with computer clusters available at most research institutions and leads to 1 × 104 to 4 × 104 low-resolution models for each sequence. Fewer high-resolution models (3 × 103 to 1 × 104) are obtained with the same computational power owing to the expense of all-atom refinement. The modeling was carried out on Rosetta@home (v.5.96).
+The Rosetta-modeled sequences were taken from an in-house curated benchmark used to test de novo modeling; in some cases the sequence does not include terminal segments (typically loops) or particular mutations present in the crystallized sequence.
§Results of 100 CPU days per target without all-atom refinement, as is typically achievable by a state-of-the-art computer cluster; application of the same computational effort but including all-atom refinement led to pools of approximately one third the size.
##Results from 104-105 CPU days per target, with all-atom refinement, as is achievable with distributed computing.
++Out of each pool of de novo models, the 200 models with best energies were tested for molecular replacement.
§§Out of pools of approximately 50 000 models produced with the de novo method constrained with coarse native information for the backbone torsion angles, 40 models with the lowest C r.m.s.d. were tested for molecular replacement.
###Minimum F1 Å that led to an unambiguous Phaser solution among all models tested in this study, including an additional 50 models with the lowest C r.m.s.d. to the crystal structure for each set (results not separately shown). These values are used as estimates of the `ease of phasing' for each data set (see Table 2).
Molecular-replacement trials were carried out with Phaser 1.3.3, available as part of the CCP4 software suite (McCoy, 2007), using the default Phaser parameters and inputting a putative C r.m.s.d. uncertainty of 1.5 Å for each model. To save on computational expense at this phasing step, we targeted a subset of 200 models filtered with the best energies and as a control a group of 200 randomly chosen models.
The criteria we used to determine whether the molecular-replacement solution was unambiguous and accurate were twofold. Firstly, the Phaser translation-function Z score (TFZ) of the model was required to be five standard deviations beyond the mean TFZ score seen in the randomly chosen models; a universal absolute cutoff for TFZ did not seem to be appropriate because some diffraction data sets showed uniformly depressed or elevated TFZ values for random models. For the P1 space group, the rotation-function Z score (RFZ) was monitored instead of TFZ. If more than one molecule was present in the asymmetric unit, iterative and automated Phaser searches for all the molecules were carried out using the software's default settings and the TFZ score for the final model was monitored. Secondly, the rotational orientation of the model needed to be correct; we required that at least half of the C atoms in the model were positioned within 2 Å of a C atom in the native structure after translating the centers of mass to the origin and applying the different rotation matrices associated with the crystal's point group.
The results of this benchmark, given in Table 1, strongly indicate the importance of all-atom refinement in carrying out molecular replacement with de novo models. Out of 30 data sets, low-resolution models passing these criteria for unambiguous phasing were found in only one case. The rate of successful molecular replacement was significantly greater among the smaller but more accurate pools of high-resolution all-atom-refined models, with nine cases giving success. In the 21 cases in which phasing was not achieved, was success precluded by limits in the applied conformational search or other properties of the protein sequence or the diffraction data set? To derive a broader understanding of the factors that affect the success of de novo phasing, we sought a larger and more diverse set of diffraction data sets phased by de novo models, as described in the following.
In de novo modeling, increasing the amount of computational power enables larger scale conformational searches and higher resolution models that can be selected based on their all-atom energies (Das et al., 2007). For the protein sequences tested here, very large collections of all-atom refined models were already available from previous benchmark studies on Rosetta@home. With 104-105 CPU days invested in each target, which is more than one hundred-fold greater computational power than in the tests above, between 1 × 105 and 5 × 107 models could be generated for each target. As above, to save computational time for molecular replacement (which has not been implemented for distributed computing), Phaser runs were carried out on 200 models with the lowest all-atom energy and 200 randomly chosen models.
With the application of greatly enhanced computational power, the number of diffraction data sets unambiguously phased by de novo models increased significantly from nine to 15. Examples of these phasing successes are shown in Fig. 1. Furthermore, for each of the all-atom refined cases, we put the models with the highest Phaser TFZ scores through flex-wARP (Cohen et al., 2008), the latest version of the automated coordinate-building package ARP/wARP, using default parameters (Perrakis et al., 1999). This widely used method can produce complete and accurate models if the quality of the beginning molecular-replacement solution was high (Cohen et al., 2008). In each of the cases investigated, flex-wARP was able to successfully and accurately build and sequence-assign the majority of the protein residues (see Fig. 1). The data sets that were successfully phased span the full spectrum of crystallographic space groups, from the most common, P212121 (Figs. 1a and 1b), to rarer groups such as H32 (Fig. 1g) to groups with fewer symmetry operators such as P1 (Fig. 1h). Furthermore, crystals with solvent contents at the lowest end of the probed diffraction data sets (e.g. 33%; see Fig. 1a) were phased. Finally, crystals with multiple copies in the asymmetric unit appeared to pose no fundamental barrier to Phaser's automated multi-copy search (Figs. 1g-1i); use of a newer version of Phaser that takes into account noncrystallographic symmetry, which is a frequent property of protein crystals (Kleywegt & Read, 1997), may even further enhance the success rate.
| || Figure 1 |
New examples of successful molecular replacement with Rosetta de novo models. (a)-(c) and (g)-(i) display correlations of Phaser translation-function Z score (TFZ) with model accuracy (the fraction of C atoms within 1 Å of the crystal structure). For each target, the displayed subsets are 200 randomly selected all-atom refined models (black) and 200 models with lowest energy from the 100 CPU-day low-resolution set (gray), from the 100 CPU-day all-atom refined set (magenta) and from the large-scale all-atom refined set (red). The solid line and dashed line display the mean TFZ scores and a cutoff value five standard deviations above the mean TFZ, respectively, in the randomly chosen models. Larger open circles indicate Phaser solutions with correct orientations in the unit cell (see text). (d)-(f) and (j)-(l) give overlays corresponding to each plot in (a)-(c) and (g)-(i), respectively, of the least accurate model that passes the TFZ cutoff value (red, partly transparent), nearly complete models built by ARP/wARP after molecular replacement (green) and the crystal structure (blue). In some cases, the modeled sequence did not include terminal segments present in the crystal structures [see red structures in (d)-(f) and (j)-(l)].
Finally, we investigated potential causes for the failure of molecular replacement for the remaining 15 of the 30 diffraction data sets. On one hand, these cases may have been refractory to phasing by de novo models owing to artefacts in the Rosetta all-atom force field, e.g. its tendency to extend surface side chains into solution or its use of ideal bond lengths and bond angles. On the other hand, de novo phasing may have failed simply as a consequence of the unavailability of sufficiently accurate structures in the tested pools of Rosetta models1. To test these hypotheses, we carried out phasing runs on a more native-like set of Rosetta all-atom refined models that had been prepared with the de novo protocol constrained with information derived from the native structure. Additional constraints were imposed to favor the native assignment of each residue's backbone torsions in coarse regions of the Ramachandran plot (Blum et al., 2007; D. Kim & D. Baker, manuscript in preparation). From the approximately 50 000 models in each of these sets, a subset of the 40 lowest C r.m.s.d. models were subjected to Phaser molecular replacement. With this more native-like population of models, 26 of the 30 diffraction data sets could be phased successfully (Table 1). The four remaining data sets could be phased by models generated by all-atom refinement of the native protein structure after idealization of bond lengths and bond angles. These results suggest that there are no intrinsic artefacts in the current Rosetta all-atom force field that fundamentally confound molecular replacement, but that improved conformational search methods will be required if molecular replacement with de novo models is to become a practical routine tool.
Overall, half of the cases tested in this benchmark could be phased de novo using a small set of the lowest energy all-atom models. Because approximately one third of proteins in the tested size range appear to be predictable at high resolution (Bradley et al., 2005; Das et al., 2007), we estimate that one sixth of diffraction data sets for proteins with new folds and sizes of 100 residues or less can be phased with existing methods. We emphasize, however, that the presented successful molecular-replacement cases have made use of many thousands of CPU days per target made available through distributed computing. Limiting the computational expense from >10 000 CPU days to 100 CPU days significantly reduced the number of phased data sets (from 15 to nine). Omission of the all-atom refinement step led to an even more significant drop (from nine successes to one success). Additional strategies to explore in the future include the use of alternative measures of phasing success beyond the Phaser TFZ score, such as the reduction in Rfree upon likelihood-based refinement of the molecular-replacement solution against the diffraction data (Murshudov et al., 1997), as well as alternative processing of de novo models before phasing, such as incorporating estimates of model uncertainty into the Phaser likelihood calculation.
Based on the phasing results presented so far, neither a low solvent content nor the presence of multiple protein copies in the asymmetric unit appears to be an insurmountable barrier for phasing with de novo models. It may be possible, however, that these factors or other properties of the diffraction data set can render the phase problem more difficult or more straightforward to solve by molecular replacement. With more than 500 Rosetta models tested in Phaser molecular replacement for each of 30 diffraction data sets, this study permits an initial exploration of factors that might correlate with the ease with which de novo models lead to successful molecular replacement.
We estimated this ease of phasing for each diffraction data set by assessing the minimal model accuracy F1 Å required to achieve a significant TFZ score and correct orientation of the model in the unit cell (see above). These estimates (Table 1) are intrinsically noisy, since for many diffraction data sets only a few models were found to give successful Phaser hits. However, these minimal F1 Å values provide useful initial estimates to search for the strongest (and thus most practically useful) correlations of crystal parameters with the ease of phasing.
Table 2 lists the correlations of these minimal F1 Å values with ten parameters associated with the crystallographic data sets, from the number of reflections available to the resolution of the diffraction data to the solvent content of the data. No correlation was detected between higher solvent content and ease of phasing (Fig. 2a). For example, the benchmark includes four diffraction data sets for ubiquitin, in which the same pool of Rosetta models was tested for phasing, and the data set with the lowest solvent content (PDB code 1ubq ) was the only one for which a de novo model gave a successful Phaser solution. Further, there was no correlation of ease of phasing with the number of molecules in the asymmetric unit (Fig. 2b); as noted above, use of the next-generation Phaser may in fact soon further ease the confident and rapid phasing of crystals with multi-copy asymmetric units.
| || Figure 2 |
Dependence of de novo phasing on crystallographic parameters. The ease of phasing is estimated as the minimal accuracy required for successful molecular replacement (minimum F1 Å, the fraction of C atoms within 1 Å of the crystal structure). No correlation is observed with the crystal solvent content (a) or the number of molecules in each asymmetric unit (b), but a statistically significant correlation is found with the number of residues in the molecular-replacement model (c). See also Table 2.
Of the other parameters tested (Table 2), only one, the molecular weight of the monomer, gave a statistically significant correlation (P < 10-1) with minimal F1 Å values (Fig. 2c). Larger macromolecules give crystals that are easier to phase (P < 5.7 × 10-4). As was pointed out by Randy Read (personal communication) in an informal discussion, more low-resolution data are available for each molecule for constraining its rotation and translation in the unit cell. Indeed, the correlation of more straightforward molecular replacement with larger macromolecules is abundantly illustrated by other articles in this issue, with the successful phasing of the ribosome, the fatty-acid synthase complex (Jenni & Ban, 2009) and other massive complexes with partly accurate low-resolution models. In our case, as the conformational search in de novo modeling becomes (exponentially) more difficult with protein length, it is gratifying that successful molecular replacement may require somewhat less accurate models for longer chains.
Molecular replacement with de novo models of protein structures is a potentially useful new tool for phasing diffraction data sets for which experimental phasing has failed and structural homologs cannot be identified from sequence alone. In this study, we have explored the necessity of all-atom refinement of de novo models, the general rate of success of this de novo phasing method and the properties of a diffraction data set that aid or complicate the method.
Firstly, all-atom refinement of coarse-grained Rosetta models and the application of increasing computational power appear to significantly bolster both model quality and performance in Phaser molecular replacement. Secondly, we have presented 15 new cases of diffraction data sets for a wide range of protein folds that have been phased by de novo models. These results suggest that approximately one sixth of existing diffraction data sets for small-sized proteins of new folds may be phased with current algorithms if a large amount of computational power is available. Finally, the ease of phasing appears to be poorly correlated with the crystal solvent content or the number of molecules in the asymmetric unit, but is correlated with molecular weight: larger proteins require somewhat less accurate models for successful molecular replacement. As the conformational search for Rosetta modeling improves or is aided by limited additional experimental information (from, for example, NMR chemical shifts; see Cavalli et al., 2007; Shen et al., 2008), molecular replacement with de novo models can perhaps join molecular replacement with structural homologues as a practical tool for phasing protein diffraction data sets.
The utility of phasing with de novo models will be best demonstrated by cases in which blind predictions provide molecular-replacement solutions for diffraction data that have not been phased by other means. We are currently collaborating with structural genomics initiatives and traditional biology laboratoriess in an effort to identify and solve such data sets. In the meanwhile, a posteriori crystallographic phasing continues to be a powerful and stringent test of de novo modeling algorithms.
We thank David Kim for permission to use de novo models generated for another study, Keith Laidig and Chance Reschke for expert administration of computational resources, Randy Read and Vatsan Raman for useful discussions, and members of the Baker group for comments on this study. We thank users of Rosetta@home for allowing rapid benchmarking of de novo modeling. We are greatly indebted to the developers who have contributed to the CCP4 software and to previous proceedings of the CCP4 Study Weekends. We acknowledge the NIH, the Howard Hughes Medical Institute (to DB) and a Jane Coffin Childs Fellowship and a Burroughs-Wellcome Foundation Career Award at the Scientific Interface (to RD) for funding.
Blow, D. M. & Rossmann, M. G. (1961). Acta Cryst. 14, 1195-1202.
Blum, B., Jordan, M. I., Kim, D., Das, R., Bradley, P. & Baker, D. (2007). In Advances in Neural Information Processing Systems, Vol. 20, edited by J. Platt, D. Koller, Y. Singer & A. McCallum. Cambridge, USA: MIT Press.
Bradley, P., Misura, K. M. & Baker, D. (2005). Science, 309, 1868-1871.
Cavalli, A., Salvatella, X., Dobson, C. M. & Vendruscolo, M. (2007). Proc. Natl Acad. Sci. USA, 104, 9615-9620.
Chen, Y. W., Dodson, E. J. & Kleywegt, G. J. (2000). Structure, 8, R213-R220.
Cohen, S. X., Ben Jelloul, M., Long, F., Vagin, A., Knipscheer, P., Lebbink, J., Sixma, T. K., Lamzin, V. S., Murshudov, G. N. & Perrakis, A. (2008). Acta Cryst. D64, 49-60.
Das, R. et al. (2007). Proteins, 69, 118-128.
Giorgetti, A., Raimondo, D., Miele, A. E. & Tramontano, A. (2005). Bioinformatics, 21, Suppl. 2, ii72-ii76.
Howard, R. J., Clark, K. A., Holton, J. M. & Minor, D. L. Jr (2007). Neuron, 53, 663-675.
Jenni, S. & Ban, N. (2009). Acta Cryst. D65, 101-111.
Kleywegt, G. J. & Read, R. J. (1997). Structure, 5, 1557-1569.
Kuhlman, B., Dantas, G., Ireton, G. C., Varani, G., Stoddard, B. L. & Baker, D. (2003). Science, 302, 1364-1368.
McCoy, A. J. (2007). Acta Cryst. D63, 32-41.
Murshudov, G. N., Vagin, A. A. & Dodson, E. J. (1997). Acta Cryst. D53, 240-255.
Perrakis, A., Morris, R. & Lamzin, V. S. (1999). Nature Struct. Biol. 6, 458-463.
Petsko, G. A. (2000). Genome Biol. 1, comment 002.
Qian, B., Raman, S., Das, R., Bradley, P., McCoy, A. J., Read, R. J. & Baker, D. (2007). Nature (London), 450, 259-264.
Raimondo, D., Giorgetti, A., Giorgetti, A., Bosi, S. & Tramontano, A. (2007). Proteins, 66, 689-696.
Rohl, C. A., Strauss, C. E., Misura, K. M. & Baker, D. (2004). Methods Enzymol. 383, 66-93.
Schwarzenbacher, R., Godzik, A., Grzechnik, S. K. & Jaroszewski, L. (2004). Acta Cryst. D60, 1229-1236.
Shen, Y. et al. (2008). Proc. Natl Acad. Sci. USA, 105, 4685-4690.
Strop, P., Brzustowicz, M. R. & Brunger, A. T. (2007). Acta Cryst. D63, 188-196.
Szep, S., Wang, J. & Moore, P. B. (2003). RNA, 9, 44-51.