electron diffraction\(\def\hfill{\hskip 5em}\def\hfil{\hskip 3em}\def\eqno#1{\hfil {#1}}\)

Journal logoSTRUCTURAL
CHEMISTRY
ISSN: 2053-2296

How to use DIALS to process chemical crystallography 3D ED rotation data from pixel array detectors

crossmark logo

aDepartment of Materials and Environmental Chemistry, Stockholm University, Stockholm SE-106, Sweden, and bResearch Complex at Harwell, UKRI–STFC Rutherford Appleton Laboratory, Harwell, Didcot, Oxfordshire, OX11 0FA, England, United Kingdom
*Correspondence e-mail: david.waterman@stfc.ac.uk

Edited by G. P. A. Yap, University of Delaware, USA (Received 9 July 2024; accepted 15 November 2024; online 6 December 2024)

This article is part of the collection Advances in electron diffraction for structural characterization.

The DIALS package provides a set of tools for crystallographic data processing. The open-source nature of the project, and a flexible inter­face in which individual command-line pro­grams each have a dedicated job, have enabled the adaptation of DIALS to a wide range of experiment types, including electron diffraction. Here we present detailed instructions for the use of DIALS to process chemical crystallography diffraction data from con­tin­u­ous rotation electron diffraction experiments. We demonstrate processing and structure solution from three different samples from three different instruments, including two commercial instruments dedicated to electron diffraction. Each instrument has a pixel array detector, allowing low-noise data to be obtained, resulting in high quality structures. Various new features were added to DIALS to simplify the workflow for these use cases. These are described in detail, along with useful pro­gram options for electron diffraction work.

1. Introduction

Electron crystallography has rapidly evolved over the past decade due to the development of 3D acquisition and electron diffraction data analysis protocols (Gemmi et al., 2019[Gemmi, M., Mugnaioli, E., Gorelik, T. E., Kolb, U., Palatinus, L., Boullay, P., Hovmöller, S. & Abrahams, J. P. (2019). ACS Central Science, 5, 1315-1329.]). These advancements enable us to study the structure of materials with enhanced data quality and acquisition speed, which has been proved by the successful determination of various structures from minerals (Gemmi et al., 2019[Gemmi, M., Mugnaioli, E., Gorelik, T. E., Kolb, U., Palatinus, L., Boullay, P., Hovmöller, S. & Abrahams, J. P. (2019). ACS Central Science, 5, 1315-1329.]), small organic mol­ecules (Andrusenko & Gemmi, 2022[Andrusenko, I. & Gemmi, M. (2022). WIREs Nanomed. Nanobiotechnol. 14, e1810.]), zeolites (Cho et al., 2023[Cho, J., Willhammar, T. & Zou, X. (2023). Microporous Mesoporous Mater. 358, 112400.]) and metal–organic frameworks (Samperisi et al., 2022[Samperisi, L., Zou, X. & Huang, Z. (2022). CrystEngComm, 24, 2719-2728.]; Huang et al., 2021[Huang, Z., Willhammar, T. & Zou, X. (2021). Chem. Sci. 12, 1206-1219.]) to proteins (Clabbers & Xu, 2021[Clabbers, M. T. B. & Xu, H. (2021). Acta Cryst. D77, 313-324.]).

Software development has also been crucial in supporting these new techniques, by providing robust data processing. DIALS (Winter et al., 2018[Winter, G., Waterman, D. G., Parkhurst, J. M., Brewster, A. S., Gildea, R. J., Gerstel, M., Fuentes-Montero, L., Vollmar, M., Michels-Clark, T., Young, I. D., Sauter, N. K. & Evans, G. (2018). Acta Cryst. D74, 85-97.]), originally developed for X-ray crystallography data processing, was later extended to work with electron diffraction data (Clabbers et al., 2018[Clabbers, M. T. B., Gruene, T., Parkhurst, J. M., Abrahams, J. P. & Waterman, D. G. (2018). Acta Cryst. D74, 506-518.]), with an aim to provide unified software for crystallographic data processing. DIALS is freely available for download from https://dials.github.io/ under the terms of the BSD-3 license. Linux and Mac packages are provided. Additionally, CCP4 (Agirre et al., 2023[Agirre, J., Atanasova, M., Bagdonas, H., Ballard, C. B., Baslé, A., Beilsten-Edmands, J., Borges, R. J., Brown, D. G., Burgos-Mármol, J. J., Berrisford, J. M., Bond, P. S., Caballero, I., Catapano, L., Chojnowski, G., Cook, A. G., Cowtan, K. D., Croll, T. I., Debreczeni, J. É., Devenish, N. E., Dodson, E. J., Drevon, T. R., Emsley, P., Evans, G., Evans, P. R., Fando, M., Foadi, J., Fuentes-Montero, L., Garman, E. F., Gerstel, M., Gildea, R. J., Hatti, K., Hekkelman, M. L., Heuser, P., Hoh, S. W., Hough, M. A., Jenkins, H. T., Jiménez, E., Joosten, R. P., Keegan, R. M., Keep, N., Krissinel, E. B., Kolenko, P., Kovalevskiy, O., Lamzin, V. S., Lawson, D. M., Lebedev, A. A., Leslie, A. G. W., Lohkamp, B., Long, F., Malý, M., McCoy, A. J., McNicholas, S. J., Medina, A., Millán, C., Murray, J. W., Murshudov, G. N., Nicholls, R. A., Noble, M. E. M., Oeffner, R., Pannu, N. S., Parkhurst, J. M., Pearce, N., Pereira, J., Perrakis, A., Powell, H. R., Read, R. J., Rigden, D. J., Rochira, W., Sammito, M., Sánchez Rodríguez, F., Sheldrick, G. M., Shelley, K. L., Simkovic, F., Simpkin, A. J., Skubak, P., Sobolev, E., Steiner, R. A., Stevenson, K., Tews, I., Thomas, J. M. H., Thorn, A., Valls, J. T., Uski, V., Usón, I., Vagin, A., Velankar, S., Vollmar, M., Walden, H., Waterman, D., Wilson, K. S., Winn, M. D., Winter, G., Wojdyr, M. & Yamashita, K. (2023). Acta Cryst. D79, 449-461.]) and conda-forge provide builds for Windows. The DIALS package consists of a suite of com­mand-line pro­grams, each of which performs a discrete step of data processing. In X-ray crystallography, where comprehensive metadata are usually associated with the image data, data processing may be achieved with simple commands that mainly use pro­gram defaults (the following is based on the X-ray small-mol­ecule tutorial at the DIALS website):

dials.import ../data/*.cbf

dials.find_spots imported.expt

dials.index imported.expt strong.refl\

space_group=P222

dials.refine indexed.expt indexed.refl

dials.integrate refined.expt refined.refl

dials.symmetry integrated.expt integrated.refl

dials.scale symmetrized.expt symmetrized.refl

dials.export scaled.expt scaled.refl\

format=shelx composition=CHNOS

In our research, we examine the processing of 3D electron diffraction (3D ED) data collected in three different setups: con­tin­u­ous rotational electron diffraction with calibration images (cRED) collected on an electron microscope at Stockholm University, data collected on a Rigaku Synergy-ED instrument at the UK National Electron Diffraction Facility and data from an Eldico ED-1 dif­frac­tom­eter at the Eldico Customer Experience Center in Basel. Each configuration has its unique benefits and challenges for collecting and analyzing data. We describe how DIALS is applied and adapted for each experimental scenario. We have included additional functionalities in DIALS according to the requirements encountered during our investigations. The new features have made the data processing workflow more efficient while maintaining DIALS as a reliable tool for electron crystallography analysis. The examples are based on publicly-available data, and we provide example DIALS processing scripts with detailed explanations of pro­gram parameters. This enables users to follow along and reproduce the results shown in the article. All data processing results shown were produced with DIALS Version 3.21.1, which contains the new features introduced to improve the handling of electron diffraction data.

2. cRED data

The development of fast read-out electron detectors, such as Timepix (van Genderen et al., 2016[Genderen, E. van, Clabbers, M. T. B., Das, P. P., Stewart, A., Nederlof, I., Barentsen, K. C., Portillo, Q., Pannu, N. S., Nicolopoulos, S., Gruene, T. & Abrahams, J. P. (2016). Acta Cryst. A72, 236-242.]), made it possible to collect electron diffraction data con­tin­u­ously, leading to the development of con­tin­u­ous rotational electron diffraction (cRED) (Cichocka et al., 2018[Cichocka, M. O., Ångström, J., Wang, B., Zou, X. & Smeets, S. (2018). J. Appl. Cryst. 51, 1652-1661.]), also known as MicroED (Shi et al., 2013[Shi, D., Nannenga, B. L., Iadanza, M. G. & Gonen, T. (2013). eLife, 2, e01345.]). In a cRED experiment, the goniometer con­tin­u­ously rotates at a constant speed while the diffraction patterns are recorded over a certain exposure time. cRED allows faster data collection and more complete sampling of reciprocal space than stepwise tilt data collection, making it particularly useful for investigating radiation-sensitive materials, and it has been used successfully for studying various inorganic and organic samples and proteins, including a number of zeolites, MOFs and pharmaceuticals. The only hardware requirement for cRED data collection is a transmission electron microscope with a suitably high-quality single tilt sample holder and a camera. Merging several 3D ED data sets allows completeness to be increased (Ge et al., 2021[Ge, M., Yang, T., Wang, Y., Carraro, F., Liang, W., Doonan, C., Falcaro, P., Zheng, H., Zou, X. & Huang, Z. (2021). Faraday Discuss. 231, 66-80.]) and overall data quality to be improved (Xu et al., 2018[Xu, H., Lebrette, H., Yang, T., Srinivas, V., Hovmöller, S., Högbom, M. & Zou, X. (2018). Structure, 26, 667-675.]).

2.1. Electron nanocrystallography (NanED) Round Robin samples

NanED (https://naned.eu/) is a collaborative training pro­gram funded by the EU, aimed at training a new generation of electron crystallographers. This is intended to make it easier for electron diffraction methods to become widely accepted and used across academic and industrial environments.

Within the framework of the NanED project, the Round Robin deliverable was set up with two main goals: to train new researchers in 3D ED techniques using well-known samples and to compare results across different labs using a variety of microscopes and analysis methods (Gemmi et al., 2023[Gemmi, M., Palatinus, L., Klar, P., Faye, M., Agbemeh, V., Hajizadeh, A., Chintakindi, H., Suresh, A., Jeriga, B., Gemmrich Hernández, L., Santucci, M., Wang, L., Vypritskaia, A., Passuti, S., Cordero Oyonarte, E., Matinyan, S. & Ben Meriem, A. (2023). Acta Cryst. A79, C1085.]). As an example, we selected one of the Round Robin samples, natrolite, a mineral from a zeolite family, containing vertex-sharing TO4 tetra­hedra (T = Si or Al).

Crystals of the natrolite sample were crushed in an agate mortar. The powder was dispersed in ethanol and ultrasonicated for 3 min. A drop of the suspension was placed on a copper grid with lacey carbon film. Data collection was performed at room temperature.

cRED data of the natrolite crystals were collected on a JEM-2100 LaB6 microscope, with an accelerating voltage of 200 kV. A Timepix hybrid pixel detector and the Instamatic software (Cichocka et al., 2018[Cichocka, M. O., Ångström, J., Wang, B., Zou, X. & Smeets, S. (2018). J. Appl. Cryst. 51, 1652-1661.]) were used for data collection. The resulting data sets consist of SMV format images. During data collection using Instamatic, every nth diffraction pattern is defocused (usually n equals 10 or 20) to track the crystal during rotation. The beam diameter was around 700 nm, and if the crystal was seen to move away from the beam centre this was adjusted by movement of the sample stage. This prevents the loss of the crystal due to crystal movement and allows data collection with large rotation ranges (Cichocka et al., 2018[Cichocka, M. O., Ångström, J., Wang, B., Zou, X. & Smeets, S. (2018). J. Appl. Cryst. 51, 1652-1661.]). For the four data sets investigated here, the tilt per image ranged from 0.2296 to 0.2318°, and the total tilt ranged from 90.24 to 118.91°. Beam centre drift of a few pixels was evident over the course of data collection. However, diffraction patterns were not centred as the drift was tolerated in data processing.

2.2. Data processing

The DIALS commands used to integrate the natrolite data sets were similar in each case. For illustration, commands for processing a single natrolite data set within a BASH shell on a Linux computer are reproduced here.

dials.import "$NATROLITE_DATA"/Data1/SMV/data/*.img\

geometry.goniometer.axis=-0.6204,-0.7843,0.0000\

panel.gain=2.9

dials.generate_mask imported.expt\

untrusted.rectangle=0,516,255,261\

untrusted.rectangle=255,261,0,516

dials.apply_mask imported.expt mask=pixels.mask

dials.find_spots masked.expt\

exclude_images_multiple=20\

d_max=10 d_min=0.6 gain=0.5

dials.index masked.expt strong.refl\

detector.fix=distance space_group=F222

dials.reindex indexed.expt indexed.refl\

change_of_basis_op=b,c,a space_group=Fdd2

dials.refine reindexed.expt reindexed.refl\

detector.fix=distance

dials.integrate refined.expt refined.refl\

prediction.d_min=0.6\

exclude_images_multiple=20

This assumes that the path to the parent directory containing the natrolite data sets is given by the variable NATROLITE_DATA. Key points regarding the behaviour of DIALS during the execution of these commands are explained in the following sections.

2.2.1. Determining the rotation axis

The SMV format has no robust metadata standard and diffraction geometry metadata is typically incomplete (Waterman et al., 2023[Waterman, D. G., Frisina, N., Owen, C. D., Winter, G. & Nunes, P. (2023). Structure, 31, P1510-P1517.]). While the beam centre is written to the image header by Instamatic, and is read by DIALS, there is no header entry to represent the orientation of the rotation axis in the image. The dxtbx format class (Parkhurst et al., 2014[Parkhurst, J. M., Brewster, A. S., Fuentes-Montero, L., Waterman, D. G., Hattne, J., Ashton, A. W., Echols, N., Evans, G., Sauter, N. K. & Winter, G. (2014). J. Appl. Cryst. 47, 1459-1465.]) used to read the SMV images from this microscope assumes a default orientation, which was determined some years ago. During processing of the Round Robin data sets it was discovered that the rotation axis now differs slightly from this default.

An algorithm for determining the rotation axis orientation from diffraction data has been reported by Kolb et al. (2009[Kolb, U., Gorelik, T. & Mugnaioli, E. (2009). Mater. Res. Soc. Symp. Proc. 1184, 11-23.]), and since then has been adopted by other packages, such as PETS2 (Palatinus et al., 2019[Palatinus, L., Brázda, P., Jelínek, M., Hrdá, J., Steciuk, G. & Klementová, M. (2019). Acta Cryst. B75, 512-522.]) and edtools (Cichocka et al., 2018[Cichocka, M. O., Ångström, J., Wang, B., Zou, X. & Smeets, S. (2018). J. Appl. Cryst. 51, 1652-1661.]). The pro­gram dials.find_rotation_axis also implements this algorithm and is a direct adaptation of the open source edtools version. The algorithm is effective in the case of good quality spot-finding results from a single crystal. If a large number of noise peaks are found as spots, then the algorithm may fail to identify the correct orientation. We ran dials.find_rotation_axis on several of the Round Robin data sets, then set the same consensus value via the geometry.goniometer.axis= option of dials.import for all further processing. For any one data set, the dials.find_rotation_axis command was run after spot-finding as follows:

dials.find_rotation_axis masked.expt strong.refl

2.2.2. Determining the detector gain

The Timepix detector is able to count events with energy higher than a user-defined threshold (van Genderen et al., 2016[Genderen, E. van, Clabbers, M. T. B., Das, P. P., Stewart, A., Nederlof, I., Barentsen, K. C., Portillo, Q., Pannu, N. S., Nicolopoulos, S., Gruene, T. & Abrahams, J. P. (2016). Acta Cryst. A72, 236-242.]). Due to scattering of high-energy electrons within the silicon sensor, charge spread beyond the point of incidence may result in counts within neighbouring pixels. The detector gain, defined as the number of detected counts per incident electron, is expected to be greater than 1 due to this charge sharing. The value of the gain is important for spot-finding, and for a realistic scale of the integrated intensity error estimates, σ(I), before further modifications to the error model are made in scaling. For a detector without a pedestal offset, the gain can be estimated by comparing the ob­ser­ved index of dispersion with the value 1.0, which is the expected value for a perfect counting detector. The pro­gram dials.estimate_gain performs this calculation within a local region of background scatter, but this method is known to underestimate the true gain for a detector with non-negligible point spread (Water­man & Evans, 2010[Waterman, D. & Evans, G. (2010). J. Appl. Cryst. 43, 1356-1371.]; Clabbers et al., 2018[Clabbers, M. T. B., Gruene, T., Parkhurst, J. M., Abrahams, J. P. & Waterman, D. G. (2018). Acta Cryst. D74, 506-518.]).

A reviewer of an earlier version of this article pointed out an alternative way to experimentally measure gain for a PAD. This method is rather direct and subject to fewer assumptions than approaches based on variance of the signal. Illumination of the detector with a very low dose allows identification of single electron impacts, which generally form clusters of a few pixels. In this context, the gain may be known as the `event multiplicity', and is given by the average number of counts across correctly identified single electron impacts (Fernandez-Perez et al., 2021[Fernandez-Perez, S., Boccone, V., Broennimann, C., Disch, C., Piazza, L., Radicci, V., Rissi, M., Schulze-Briese, C., Trueb, P. & Zambon, P. (2021). J. Inst. 16, P10034.]). We collected low-dose images of 200 keV electrons from the Timepix detector with the software SoPhy, provided by Amsterdam Scientific Instruments. The smallest con­denser aperture (10 µm) was used, and the spot size was 5, with magnification at 600 000× and 0.1 s frame exposure. An analysis of event clusters from 40 images resulted in the value 2.9 for the event multiplicity, which we then set at import using the panel.gain= parameter (see Section S1 in the supporting information for further details).

We found that the results from dials.find_spots using this higher gain estimate tended to omit weaker but clearly visible spots, as inspected with the dials.image_viewer. For this reason, we added the parameter gain=0.5 to the dials.find_spots command. Here it acts as a multiplier for the panel gain set at import, so that the gain assumed by the spot-finding algorithm is 1.45 rather than 2.9. This increased the sensitivity of spot-finding, recovering some of the weaker spots. While the panel gain set at import persists throughout the steps of data processing with DIALS, the adjustment performed for spot-finding affects that step only.

2.2.3. Masking the central cross

The Timepix quad detector consists of four 256 × 256 pixel chips, each of which has an outer border composed of wider pixels (van Genderen et al., 2016[Genderen, E. van, Clabbers, M. T. B., Das, P. P., Stewart, A., Nederlof, I., Barentsen, K. C., Portillo, Q., Pannu, N. S., Nicolopoulos, S., Gruene, T. & Abrahams, J. P. (2016). Acta Cryst. A72, 236-242.]). The area where the chips join forms a central cross in the image of two pixels width, with greater intensity values than the surrounding pixels due to their larger physical size. After conversion by the Instamatic software, the overall image size is expanded to 516 × 516 pixels to account for the size of the central cross region. The intensity of pixels within the cross is adjusted to the scale of the surrounding pixels; however, the profiles of reflections recorded in the cross are affected and are not well modelled by reflection profiles recorded elsewhere on the detector. For this reason, for pro­grams like DIALS that do integration by profile fitting, it is not recommended to use the pixels in this cross. For the cRED processing presented here, this was achieved by explicitly masking those pixels using the dials.generate_mask and dials.apply_mask commands. These commands have been left in the script above as an example; however, for simplicity, this mask has now been added to the format class used to read the images.

2.2.4. Excluding crystal tracking images

DIALS can exclude images from spot-finding, integration and scaling, using a consistent syntax given by exclude_images=exp:start:stop, where exp gives the experiment number, and start and stop give the inclusive range of images to exclude from consideration. Multiple ranges can be provided in a single definition by comma-separated values, and multiple definitions of the parameter will be combined. While flexible, this syntax was found to be inconvenient for scripting the processing of cRED data. To simplify the inter­face, we added the parameter exclude_images_multiple=n, where, for example, n = 20. This is automatically expanded into the appropriate image exclusion definition to regularly exclude each image number exactly divisible by n within the image range of the data set. The collection of crystal tracking images is a feature provided by Instamatic, so the new parameter makes it easier to work with DIALS on data collected by Instamatic on any instrument it supports.

Image exclusions defined in spot-finding act as a mask, setting all pixels to `invalid' on the excluded images. Diffraction spots that are inter­rupted by a tracking image may be found within two separate spot shoeboxes (before and after the tracking image). Typically, dials.index will only index one of the two in these cases, leading to error in the centroid position and profile for that spot. Nevertheless, these effects are mitigated by the diffraction geometry refinement and profile modelling using data from the whole scan.

During integration, image exclusion also acts like a mask. For spots whose peak region is inter­sected by a tracking image, no summation integration intensity estimate is possible. There­fore, a plot of the number of summation integrated spots shows wide gaps around the calibration images, as shown by Fig. 1[link]. Profile fitting is able to recover an intensity estimate even when the peak region contains some invalid pixels. This is controlled by the valid_foreground_threshold parameter for dials.integrate, which is set to 0.75 by default. Thus, as long as 75% of the pixels forming the diffraction spot are outside the excluded image, or not otherwise masked, then a profile fitting estimate will be recorded. Fig. 1[link] shows that the number of profile-fitted intensities drops at the tracking images, but not to zero. The overall number of profile-fitted intensities is about 50% higher than the number of summation integrated intensities for this data set.

[Figure 1]
Figure 1
Comparison of the number of reflections integrated by either summation integration or profile fitting on each of the first 100 images of the first natrolite data set (Data1). Calibration image numbers are located at each multiple of 20.

This procedure was seen to work well for data sets we tried where every 20th image was a tracking image. In some cases where n = 10 instead we saw a failure in profile fitting because dials.integrate could not create a profile model. This occurred when the full extent of the ob­ser­ved rocking curve of strong reflections exceeded the spacing between tracking images. Thus, the spacing between these images should be chosen carefully based on the properties of the sample.

2.2.5. Indexing and refinement

The default 3D FFT indexing method of DIALS usually works well with these cRED data sets. Indexing success hinges on the quality of spot centroid data, and noise peaks may cause problems with basis vector determination. Pixel array detectors allow data collection without a beamstop and, unless there is an energy filter, this reveals a cone of significant background at low angle around the beam centre, caused by inelastic scatter of the direct beam. This typically leads to a spherical region around the centre of reciprocal space within which many noise peaks are found. The simplest way to avoid this and provide better data for indexing is to set a low resolution limit in Å, such as d_max=10, for dials.find_spots.

Unless a space group is provided, dials.index will return a triclinic solution. In this case, the space group for natrolite is known to be Fdd2 (Fig. 2[link]). However, dials.index will return an ortho­rhom­bic solution by convention with a < b < c, whereas the correct solution has c < a < b. Rather than setting the space group to Fdd2 immediately, we first specified the subgroup F222 to ensure that the unit-cell refinement performed by dials.index was appropriately constrained. Once this solution was written out, the pro­gram dials.reindex was used to change the basis and to set the correct space group.

[Figure 2]
Figure 2
I/σ(I) versus resolution for 364 reflections from the scaled natrolite data sets that should be systematically absent in the space group Fdd2 under the kinematic approximation. The points are coloured according to which of the three crystals they come from. A few reflections from each crystal show significant violation of their expected absence. On the right, images from the dials.image_viewer of the three spots with highest I/σ(I) are shown, clearly indicating that these violations are present in the data and are not an artefact of data processing.

In some cases with higher symmetry space groups, enforcing lattice constraints can lead to excessively high root-mean-square deviations between predicted and ob­ser­ved spot positions, negatively affecting integrated data quality. This can occur if unmodelled distortions from post-sample lenses (Brázda et al., 2022[Brázda, P., Klementová, M., Krysiak, Y. & Palatinus, L. (2022). IUCrJ, 9, 735-755.]), or other deviations from the refined diffraction geometry, are present. In such cases, it can be useful to process data using the triclinic solution, in which the unmodelled geometry errors may be transferred, to some extent, to errors in the unit-cell parameters. After integration, automatic determination of symmetry may be performed using tools such as dials.symmetry or dials.cosym (Gildea & Winter, 2018[Gildea, R. J. & Winter, G. (2018). Acta Cryst. D74, 405-410.]), to ensure scaling is performed with the correct Laue class. In the experience of the authors, however, much care must be taken when using the DIALS symmetry-determination tools with 3D ED data. The generally higher errors on intensities due to effects such as multiple scattering in such data as compared to X-ray data can lead to incorrect results.

Simultaneous refinement of the detector distance and the unit-cell parameters is not usually possible for 3D ED data unless a restraint is applied (Clabbers et al., 2018[Clabbers, M. T. B., Gruene, T., Parkhurst, J. M., Abrahams, J. P. & Waterman, D. G. (2018). Acta Cryst. D74, 506-518.]). Here we simply fixed the detector distance using the detector.fix=distance parameter, for the dials.index and dials.refine commands, both of which perform geometry refinement. This implies that errors in the calibrated effective detector distance will be expressed as errors in the refined unit-cell lengths. It may be possible to correct such errors after structure solution during model refinement (Gruene et al., 2022[Gruene, T., Clabbers, M. T. B., Luebben, J., Chin, J. M., Reithofer, M. R., Stowasser, F. & Alker, A. M. (2022). J. Appl. Cryst. 55, 647-655.]).

After refinement of a static model for the experiment, dials.refine performs a scan-varying refinement, in which parameters are allowed to vary as a smoothed function of position within the rotation scan (Waterman et al., 2016[Waterman, D. G., Winter, G., Gildea, R. J., Parkhurst, J. M., Brewster, A. S., Sauter, N. K. & Evans, G. (2016). Acta Cryst. D72, 558-575.]; Clabbers et al., 2018[Clabbers, M. T. B., Gruene, T., Parkhurst, J. M., Abrahams, J. P. & Waterman, D. G. (2018). Acta Cryst. D74, 506-518.]). The default behaviour is to allow the crystal orientation and unit-cell parameters to vary in this way, while other parameters, such as the beam direction, and the detector position and orientation are refined to static values. In the case of 3D ED data collection from nanocrystals using a selected area aperture, the beam is generally larger than the sample, ensuring there is no apparent unit-cell variation due to the sampling of different mosaic blocks during data collection. Changes to the unit-cell values due to radiation damage may still be present, but for the natrolite data these are expected to be small. Other errors, such as drift of the direct beam and distortion in the diffraction patterns caused by post-sample lenses, were not directly accounted for here; however, their effects may be partially compensated for by the scan-varying refinement of crystal parameters. There was a small im­provement in merging statistics seen by allowing the unit cell to vary smoothly, so we used this model for further processing.

2.2.6. Determining the best overall unit cell

The unit cells determined by dials.refine are based on refinement against the indexed strong spot centroids, without background subtraction. A more precise unit-cell refinement can be performed after integration using the recalculated integrated spot centroids, including background subtraction. The pro­gram dials.two_theta_refine performs this analysis. By using a target function based on the reflection 2θ scattering angles rather than the position of reflection impacts, the data from multiple crystals at different orientations are combined to produce a single best (in a least-squares sense) cell for all data sets. The command used to do this for a combination of three of the natrolite data sets was

dials.two_theta_refine\

"$NATROLITE_PROC"/Data1/integrated.{expt,refl}\

"$NATROLITE_PROC"/Data3/integrated.{expt,refl}\

"$NATROLITE_PROC"/Data4/integrated.{expt,refl}

This assumes that the processing of each data set was performed in its own directory, under a common parent directory, the path to which is stored in the variable NATROLITE_PROC. The command produced the file refined_cell.expt, in which the single unit cell with standard uncertainties was given as a = 18.640 (9), b = 18.788 (4) and c = 6.8419 (16) Å.

2.2.7. Scaling multiple data sets

Combining multiple data sets may be important in cRED in order to increase completeness and to help average out the typically high errors (compared to X-ray crystallography) (Xu et al., 2018[Xu, H., Lebrette, H., Yang, T., Srinivas, V., Hovmöller, S., Högbom, M. & Zou, X. (2018). Structure, 26, 667-675.]; Ge et al., 2021[Ge, M., Yang, T., Wang, Y., Carraro, F., Liang, W., Doonan, C., Falcaro, P., Zheng, H., Zou, X. & Huang, Z. (2021). Faraday Discuss. 231, 66-80.]). As long as the integrated data sets are consistently indexed, then they can be jointly-scaled by dials.scale (Beilsten-Edmands et al., 2020[Beilsten-Edmands, J., Winter, G., Gildea, R., Parkhurst, J., Waterman, D. & Evans, G. (2020). Acta Cryst. D76, 385-399.]). First we tried joint scaling of all four natrolite data sets. Inspection of the plot of scale factor against batch reported in the dials.scale.html file indicated that the second data set, Data2, comprised considerably weaker diffraction intensities than the other data sets. Exclusion of this data set produced better merging statistics and a lower refinement R1 value. Therefore, we discarded that data set and scaled the three remaining natrolite data sets using the command given here, run in the same directory as the refined_cell.expt file produced by dials.two_theta_refine.

dials.scale refined_cell.expt\

"$NATROLITE_PROC"/Data1/integrated.refl\

"$NATROLITE_PROC"/Data3/integrated.refl\

"$NATROLITE_PROC"/Data4/integrated.refl\

merging.nbins=10\

d_min=0.61

dials.export scaled.expt scaled.refl\

format=shelx\

composition="Si Al Na O H"

The first option passed to dials.scale after the sequence of integrated data sets is merging.nbins=10. This option does not change the behaviour of the scaling algorithm, but just sets the number of bins used for reporting merging statistics. The default value is 20, but for small unit cells this can lead to noisy values for the merging statistics, as there are relatively few reflections in each bin. We found that reducing the value to 10 produced more reasonable values for merging statistics in the inner and outer resolution shells, reported in tables such as Table 1[link].

Table 1
Statistics for joint scaling of three natrolite data sets

Crystallographic data and merging statistics
Mol­ecular formula Na2Al2Si3O10·2H2O    
Space group Fdd2    
a, b, c (Å) 18.640 (9), 18.788 (4), 6.8419 (16)
  Overall Low High
High resolution limit 0.61 1.31 0.61
Low resolution limit 6.62 6.62 0.63
Completeness (%) 95.7 100 71.1
Multiplicity 7.2 8.3 3.2
I/σ 13.0 39.3 2.2
Rmeas(I) 0.198 0.115 0.515
Rpim(I) 0.067 0.039 0.261
CC1/2 0.991 0.994 0.474
Total observations 10211 1395 345
Total unique 1410 168 108
       
Kinematical refinement
Reflections   All [I > 2σ(I)]
Independent reflections   2469 1948
R1   0.1681 0.1448
wR2   0.3767 0.3557
Goof   1.175  

The second option passed to dials.scale, d_min=0.61, sets the high resolution limit for reflections included in scaling and merging.

2.3. Structure solution and refinement

After scaling, the unmerged data were exported using dials.export, specifying the composition to produce dials.ins and dials.hkl files suitable for immediate use by SHELXT (Sheldrick, 2015a[Sheldrick, G. M. (2015a). Acta Cryst. C71, 3-8.]). Structure solution was straightforward with the data processed as described; however, it is worth raising a note of caution. Prior to estimating the detector gain using the method described in Section 2.2.2[link], we used a lower value for the detector gain, and in this case found that the structure could be solved by SHELXT Version 2014/5, but Version 2018/2 failed to produce a solution. A feature introduced in Version 2018/2 is the rejection of space groups where systematic absences have a mean I/σ(I) > 5 (as noted at https://shelx.uni-goettingen.de/changes.php). DIALS always integrates reflections that should be absent due to screw axes or glide planes given the supposed space group, and we suspected that systematic absence violation was the cause of the failure to solve the structure in this case.

Once the gain was better estimated by the event multiplicity method, the structure was solved by either version of SHELXT. Nevertheless, an analysis of the systematic absences shown in Fig. 2[link] revealed numerous reflections that are expected to be absent in fact still had significant diffraction intensity. These violations of the reflection conditions are expected in 3D ED due to multiple scattering. Although increasing the gain value, which led to an increase in the sigma estimates for reflections, was enough to avoid failure in SHELXT in this case, it is worth being aware of this issue, particularly in cases where crystals are relatively thick, or the sigma estimates on intensities may be severely underestimated. The error model refined by dials.scale defaults to a physical model similar to that in AIMLESS (Evans & Murshudov, 2013[Evans, P. R. & Murshudov, G. N. (2013). Acta Cryst. D69, 1204-1214.]), which works well for synchrotron X-ray data sets. In general, we suspect that for 3D ED data sets the error estimates from DIALS may be too small. The issue of optimal error modelling for 3D ED data has been addressed by Khouchen et al. (2023[Khouchen, M., Klar, P. B., Chintakindi, H., Suresh, A. & Palatinus, L. (2023). Acta Cryst. A79, 427-439.]). This model has not yet been assessed within DIALS.

The structure was solved using the dual-space method with SHELXT and least-squares refinement was performed using SHELXL (Sheldrick, 2015b[Sheldrick, G. M. (2015b). Acta Cryst. C71, 3-8.]). All atoms were refined anisotropically. The extinction parameter EXTI was applied in the refinement. This was required to partially compensate for the dynamical effects on the intensities, thereby avoiding anisotropic displacement parameters for some atoms from becoming non-positive definite (NPD), and to stabilize the positions of H atoms, which were not fixed. The structure is shown in Fig. 3[link].

[Figure 3]
Figure 3
The crystal structure of natrolite along the [001] direction.
2.3.1. Investigation of reindexing possibilities

Natrolite is pseudo-tetra­gonal with ab. Errors on ob­ser­ved unit-cell dimensions are generally higher from 3D ED data on a standard Transmission Electron Microscope (TEM) than from an X-ray dif­frac­tom­eter. We considered the possibility that individual data sets may have been misindexed, swapping the a and b axes. In many cases such a situation would be associated with poor merging statistics. Programs such as dials.symmetry allow automatic reindexing of data sets to form a consistent set. However, for natrolite, the effect of misindexing on the diffraction intensities is subtle. Indeed, the pro­gram combines the three data sets assuming tetra­gonal symmetry. Scaling under these constraints produced merging statistics that are similar [overall Rmeas(I) = 0.235 compared to 0.198 from the run in Fdd2]. Subsequent phasing by SHELXT gave a solution in the space group I[\overline{4}]2d, which is the space group for gonnardite, a related mineral with a disordered natrolite framework (Artioli & Galli, 1999[Artioli, G. & Galli, E. (1999). Am. Mineral. 84, 1445-1450.]). We could not use dials.symmetry to automatically determine the correct reindexing possibilities for ortho­rhom­bic natrolite; however, with just three data sets to consider, and without treating one data set as a reference, there are only eight possible combinations in which between zero and three data sets are reindexed to swap the similar length axes. For any particular data set, that was achieved by replacing the dials.reindex command in the listing in Section 2.2[link] with the following command, and otherwise processing identically:

dials.reindex indexed.expt indexed.refl\

change_of_basis_op=c,b,-a space_group=Fdd2

For all eight runs, SHELXT found a solution in Fdd2. An initial refinement of the solutions showed clearly better results for the run in which no reindexing was performed, therefore the initial assignment of axes was found to be correct. Refinement results are presented in Table S4.

3. Rigaku Synergy-ED data

Data sets were collected at the UK National Electron Diffraction Facility (NEDF) site at the University of Southampton. The facility is equipped with Rigaku XtaLAB Synergy-ED instruments, combining a JEOL JSM-2300ED electron source optimized for diffraction studies at 200 kV, with a Rigaku HyPix-ED hybrid pixel array detector. We chose nine data sets of L-histidine chloride monohydrate collected at a temperature of 175 K by NEDF staff as our example of processing with DIALS. Two data sets were collected with a tilt per image of 0.25°, while the remaining five used 0.2° per image. Total tilt ranged from 112 to 126.4°.

3.1. Data processing

The DIALS commands used to integrate one of the histidine data sets are as follows:

dials.import\

"$HISTIDINE_DATA"/exp_705/frames/*.rodhypix\

panel.gain=2.9\

geometry.goniometer.axes=0,-1,0,\

0,-0.642788,0.766044,\

0.050593,-0.99872,0\

image_range=1,484

dials.find_spots imported.expt d_max=10 gain=0.5

dials.index imported.expt strong.refl\

detector.fix=distance space_group=P212121\

max_lattices=2 minimum_angular_separation=1

dials.refine indexed.expt indexed.refl\

detector.fix=distance

dials.integrate refined.expt refined.refl\

prediction.d_min=0.6

The path to the parent directory containing the histidine data sets is given by the variable HISTIDINE_DATA.

3.1.1. Importing the data set

The Rigaku Oxford Diffraction file format contains a comprehensive specification of diffraction geometry as metadata. The dxtbx format class used to read these images does not read all metadata items, but extracts enough from the header to create a model for the experiment. The gain is assumed to be equal to 2.9 and is set at import. This value was determined experimentally using low dose imaging to identify single electron impacts (Robert Bücker, personal communication). As with the natrolite example, we found that the sensitivity of spot-finding was too low using this gain value, so we passed the option gain=0.5 to dials.find_spots to ensure weak spots were located.

One complication with images from the Rigaku dif­frac­tom­eter is that the incremental image number that forms part of the filename is not zero-padded. For example, the 496 images of the exp_705 data set begin with file exp_705_1_1.rodhypix and end with exp_705_1_496.rodhypix. This is counter to the typical scheme used at synchrotron beamlines and other facilities, in which the final number has a fixed width, such as 0001 to 0496. Initially DIALS could not inter­pret this image filename template as a contiguous range of images, and we had to rename images to conform to a zero-padded template. During the course of this work, we added the ability to read filename templates with non-zero-padded image numbers.

The orientation of the rotation axis is read from the image metadata, which in this case locates it exactly anti­parallel to the y axis. In fact, runs of dials.find_rotation_axis on each data set gave a corrected axis orientation about 2.9° from this nominal orientation. We found that it was not necessary to correct the orientation in order to successfully index each of the example data sets; however, in general, it is best to determine the rotation axis using good data sets and then set it to process all other data sets where it should be the same. The Rigaku Oxford Diffraction format contains a description for a multi-axis goniometer, even though for the Synergy-ED instrument only a single axis is used. In order to set the corrected axis at import, we used the geometry.goniometer.axes option to set nine values, three for each axis in order from the sample to the goniometer base. These values were taken from the dials.find_rotation_axis log file for one of the runs.

These data sets contain some images at the extremes of the tilt range where part of the diffraction pattern is shadowed by the sample holder. We identified these images by inspection using the dials.image_viewer and then chose to exclude them from import using the image_range parameter.

3.1.2. Indexing multiple lattices

During the initial processing of these data sets, we found that the percentage of indexed spots was generally high, though somewhat lower for three of the data sets: exp_705, exp_710 and exp_712. Explorations with dials.reciprocal_lattice_viewer revealed the presence of more than one lattice in these cases. We indexed the second lattice for exp_705 by providing the option max_lattices=2 to dials.index, as shown in the example processing commands. This option causes the pro­gram to attempt to index again from the unindexed spots remaining after the first lattice is found. When an additional lattice is found, dials.index will reject it if it is in too similar an orientation to any previously-accepted lattice, under the control of the minimum_angular_separation parameter. The default value for this is 5°, which for the example data set exp_705 resulted in rejection of the second lattice, which was rotated by just 3.3° from the first. Reducing the value to minimum_angular_separation=1 en­sured that the second lattice was retained. Single lattice indexing assigned 59% of the found spots to one crystal model, while two lattice indexing assigned 52% of spots to the first lattice and a further 42% of spots to the second lattice. The decrease in proportion of spots assigned to the first lattice indicates the reassignment of spots that are more appropriately indexed by the second lattice. Finding the second lattice and reassigning those spots therefore improves the indexing results for the first lattice too.

Processing both lattices from exp_705 improved the overall merged data set, whereas conversely the additional lattices found in exp_710 and exp_712 diffracted weakly and reduced the overall quality of merged data. Therefore, we integrated only the major lattice in these two cases.

When there are multiple lattices in a single data set, it is likely that some diffraction spots will overlap, adding error to integrated intensities. This is particularly the case for lower resolution reflections of closely-aligned crystals. If all lattices that are present are successfully indexed, the information is available in principle to detect the spots that overlap and either reject their intensities, or attempt to deconvolute them. Unfortunately, dials.integrate does not offer this facility yet. We investigated overlapped reflections in this case and found that they were also not removed as outliers by dials.scale (see supplementary Section S2). Nevertheless, we encountered no difficulties in solving and refining the structure, so may conclude that errors from overlaps in exp_705 are tolerable in this case.

3.1.3. Combining data sets, scaling and export

An overall unit cell was refined against all of the integrated data sets with the following command:

dials.two_theta_refine\

"$HISTIDINE_PROC"/exp_705/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_706/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_707/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_708/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_710/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_711/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_712/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_713/integrated.{expt,refl}\

"$HISTIDINE_PROC"/exp_715/integrated.{expt,refl}

Here we assume that the processing of each data set was performed in its own directory, under a common parent directory, and we have provided the path to that parent directory in the HISTIDINE_PROC variable. The unit cell with standard uncertainties was determined to be a = 6.7936 (3), b = 8.8294 (4) and c = 15.1621 (10) Å, with the space group P212121. This unit cell was carried through to the exported SHELX .ins file and later used for model refinement. The commands used to scale and export the data were:

dials.scale\

refined_cell.expt\

"$HISTIDINE_PROC"/exp_705/integrated.refl\

"$HISTIDINE_PROC"/exp_706/integrated.refl\

"$HISTIDINE_PROC"/exp_707/integrated.refl\

"$HISTIDINE_PROC"/exp_708/integrated.refl\

"$HISTIDINE_PROC"/exp_710/integrated.refl\

"$HISTIDINE_PROC"/exp_711/integrated.refl\

"$HISTIDINE_PROC"/exp_712/integrated.refl\

"$HISTIDINE_PROC"/exp_713/integrated.refl\

"$HISTIDINE_PROC"/exp_715/integrated.refl\

merging.nbins=10\

d_min=0.64

dials.export scaled.expt scaled.refl\

format=shelx composition="C H N O Cl"

Merging statistics from the dials.scale run with options as above are given in Table 2[link].

Table 2
Statistics for joint scaling of nine histidine data sets

Crystallographic data and merging statistics
Mol­ecular formula C6H10ClN3O2    
Space group P212121    
a, b, c (Å) 6.795 (2), 8.824 (2), 15.149 (3)
  Overall Low High
High resolution limit 0.64 1.38 0.64
Low resolution limit 8.83 8.83 0.66
Completeness (%) 100 100 100
Multiplicity 40.4 35.9 35.6
I/σ 13.9 53.0 1.8
Rmeas(I) 0.430 0.231 1.946
Rpim(I) 0.065 0.037 0.333
CC1/2 0.997 0.997 0.350
Total observations 85372 8826 7296
Total unique 2115 246 205
       
Kinematical refinement
Reflections   All [I > 2σ(I)]
Independent reflections   3641 2589
R1   0.1484 0.1231
wR2   0.3237 0.3132
Goof   1.126  
       
Dynamical refinement
    L-His D-His
R1(all)   0.1904 0.2117
R1(obs)   0.1269 0.1473
wR2(all)   0.2677 0.2997
wR2(obs)   0.2380 0.2696
z-score   5.1σ  

3.2. Structure solution and refinement

The structure was solved by the dual-space method using SHELXT and least-squares refinement was performed using SHELXL. All non-H atoms were refined anisotropically. The extinction parameter EXTI was applied in the refinement to stabilize the refinement of H-atom positions. It was possible to locate all H atoms during kinematical refinement from the Fourier difference map, as shown in Fig. 4[link]. The last H atom was added after a refinement run after adding all other H atoms. Then H-atom ADPs were refined one atom at a time. Since the density peak for the last H atom was on the noise level and the N—H bond distance appeared to be very long (1.2 Å), the distance between these atoms was restrained. Table 2[link] summarizes the crystallographic data and refinement results and the structure is shown in Fig. 4[link].

[Figure 4]
Figure 4
The structural model of L-histidine. An asymmetric unit superimposed with the FobsFcalc map contoured at 3σ calculated (a) before any H atoms were added and (b) before adding the last H atom. H-atom positions were placed where they were expected to be based on the positive density peaks from the FobsFcalc omit map. Positive peaks are shown in green and negative ones are shown in red. The structure model viewed along the (c) [100], (d) [010] and (e) [001] directions, showing the hydrogen-bond network.
3.2.1. Determining the absolute hand

Data for the best diffracting histidine crystal, exp_715, were exported as `virtual frames' (Klar et al., 2023[Klar, P. B., Krysiak, Y., Xu, H., Steciuk, G., Cho, J., Zou, X. & Palatinus, L. (2023). Nat. Chem. 15, 848-855.]) by adopting the format pioneered by PETS2. The DIALS command used to do this was:

dials.export\

"$HISTIDINE_PROC"/exp_715/integrated.{expt,refl}\

format=pets n_merged=5 step=3

The n_merged parameter controls the number of real frames to merge in a virtual frame, while step selects the number of frames between each virtual frame. The step size is smaller than the number of frames to merge, so that virtual frames overlap. The output of this command is the file dials_dyn.cif_pets that can be passed to JANA2020 for dynamical refinement, as detailed in Klar et al. (2023[Klar, P. B., Krysiak, Y., Xu, H., Steciuk, G., Cho, J., Zou, X. & Palatinus, L. (2023). Nat. Chem. 15, 848-855.]). By this pro­cedure, the correct L-enanti­omer was determined suc­cess­fully as the one giving the smaller R value, with confidence as reported by the z-score, as calculated by jana_tools (Klar, 2023[Klar, P. B. (2023). jana_tools GitHub. https://github.com/pbklar/jana_tools.]). These dynamical refinement results are summarized in Table 2[link].

4. Eldico ED-1 data

The Eldico ED-1 instrument is a dedicated electron dif­frac­tom­eter, with a high-precision goniometer and a horizontal layout, minimizing the sphere of confusion at the sample position (Simoncic et al., 2023[Simoncic, P., Romeijn, E., Hovestreydt, E., Steinfeld, G., Santiso-Quiñones, G. & Merkelbach, J. (2023). Acta Cryst. E79, 410-422.]; Heidler et al., 2019[Heidler, J., Pantelic, R., Wennmacher, J. T. C., Zaubitzer, C., Fecteau-Lefebvre, A., Goldie, K. N., Müller, E., Holstein, J. J., van Genderen, E., De Carlo, S. & Gruene, T. (2019). Acta Cryst. D75, 458-466.]). The dif­frac­tom­eter has a 160 kV LaB6 electron source and no post-sample lenses. This simple yet robust design avoids distortions in diffraction patterns that are otherwise common with 3D ED data (Brázda et al., 2022[Brázda, P., Klementová, M., Krysiak, Y. & Palatinus, L. (2022). IUCrJ, 9, 735-755.]), enabling accurate unit-cell determination. The trade-off is that it is not possible to alter the effective detector distance. For the current instrument, this means it is not possible to analyse samples with very large unit cells. For example, if a minimum spacing of four pixels between spot centres is required for successful data processing of a particular crystal, then at the detector distance of 578.3 mm used for the data sets we investigated, the maximum unit-cell dimension would be 55 Å. For crystals where spot size is increased due to factors such as high mosaicity, the minimum spacing between resolved spots may be larger, further limiting the maximum unit-cell dimension. Nevertheless, in principle, the design still permits adjustments of the mechanical detector distance, exactly as with an X-ray beamline.

For illustration of data processing, four data sets from crystals of 1,3,5-tri­phenyl­benzene (TPB), collected at room temperature by Eldico staff, were chosen. Sample preparation and data collection details were the same as published previously in Simoncic et al. (2023[Simoncic, P., Romeijn, E., Hovestreydt, E., Steinfeld, G., Santiso-Quiñones, G. & Merkelbach, J. (2023). Acta Cryst. E79, 410-422.]). Each data set was collected with a tilt per image of 0.5° and total tilt ranged from 85 to 110°.

4.1. Data processing

The DIALS commands used to integrate each data set were equivalent. Here we show the script for one of the data sets, where the parent directory containing each data set directory is given by the variable TPB_DATA:

dials.import "$TPB_DATA"/03/*.cbf\

panel.gain=1.6\

geometry.goniometer.axis=-0.052336,0.99863,0

dials.find_spots imported.expt d_max=10

dials.index imported.expt strong.refl\

detector.fix=distance space_group=P222

dials.refine indexed.expt indexed.refl\

detector.fix=distance\

crystal.unit_cell.force_static=True

dials.integrate refined.expt refined.refl\

prediction.d_min=0.7

4.1.1. Importing the data set

Data from the ED-1 instrument was provided in miniCBF format, which is a relatively simple file format suitable for capturing diffraction geometry information from conventional rotation experiments with a single axis orthogonal to the beam direction. DIALS reads miniCBF format natively; nevertheless, we added a format class specific for the ED-1 instrument to the dxtbx library. This allowed us to set some specific defaults, ensuring an unpolarized electron beam model was created, and that the parallax and QE (Quantum Efficiency) corrections controlled by the detector model were disabled, as the form of these corrections in DIALS is appropriate only for X-ray data. The DIALS inter­pretation of these files places the rotation axis exactly along the y axis. In fact, runs of dials.find_rotation_axis indicated that the true axis is about 3° offset from this. As the rotation axis is fixed and there are no post-sample lenses, this value can be considered a constant for the instrument. As for previous examples, we set the orientation of the axis explicitly as an option to the dials.import command.

The miniCBF images do not contain metadata giving the detector gain. We performed a similar analysis to that presented in Section 2.2.2[link] to estimate the gain to be 1.6. In contrast to the previous two examples, we found that spot-finding did not require an increase in sensitivity to capture weak spots. In fact, setting gain=0.5 as an option to dials.find_spots in this case resulted in the algorithm being too sensitive, with many noise spots being found in addition to the Bragg peaks.

4.1.2. Further processing

The space group of TPB is Pna21, but it is unnecessary to set the exact space group for integration. What matters is that the Bravais lattice is correct. Here we ensured that by using the subgroup P222 to enforce ortho­rhom­bic lattice constraints, then allowed the correct space group to be found during structure solution by SHELXT.

The unit cells of the four indexed data sets were highly consistent, shown in Table S3. This may be attributed to the lack of post-sample lenses and the precision of the goniometer of the ED-1 instrumental. We found that scan-varying refinement of the unit cells showed only small changes during each scan, with the greatest change being an increase of 0.1 Å in the c parameter of data set 07. Merging statistics were no better using a scan-varying model for the cell as compared with allowing only the crystal orientation to vary smoothly with scan position. Therefore, we continued with this simpler model for each data set, by setting the option crystal.unit_cell.force_static=True for dials.refine.

4.1.3. Combining data sets, scaling and export

The integrated data sets were combined and a single unit cell was refined using this dials.two_theta_refine command, where the path to the parent directory containing processed data sets was stored in the variable TPB_PROC:

dials.two_theta_refine\

"$TPB_PROC"/03/integrated.{expt,refl}\

"$TPB_PROC"/06/integrated.{expt,refl}\

"$TPB_PROC"/07/integrated.{expt,refl}\

"$TPB_PROC"/08/integrated.{expt,refl}

The unit cell determined by this procedure was a = 7.5894 (4), b = 11.2305 (4) and c = 19.7150 (6) Å. Joint scaling and export of the four TPB data sets was achieved with these commands:

dials.scale refined_cell.expt\

"$TPB_PROC"/03/integrated.refl\

"$TPB_PROC"/06/integrated.refl\

"$TPB_PROC"/07/integrated.refl\

"$TPB_PROC"/08/integrated.refl\

d_min=0.75

dials.export scaled.expt scaled.refl\

format=shelx composition="C H"

We explored the use of ΔCC1/2 filtering but found no advantage for these data sets. Merging statistics for this dials.scale run are given in Table 3[link].

Table 3
Statistics for joint scaling of four TPB data sets

Crystallographic data and merging statistics
Mol­ecular formula C24H18    
Space group Pna21    
a, b, c (Å) 7.5894 (4), 11.2305 (4), 19.7150 (6)
  Overall Low High
High resolution limit 0.75 1.61 0.75
Low resolution limit 9.86 9.86 0.78
Completeness (%) 99.3 98.6 96.8
Multiplicity 12.5 12.2 6.8
I/σ 5.5 20.9 0.4
Rmeas(I) 0.230 0.140 1.541
Rpim(I) 0.061 0.039 0.564
CC1/2 0.993 0.991 0.295
Total observations 29950 3388 1465
Total unique 2391 277 214
       
Kinematical refinement      
Reflections   All [I > 2σ(I)]
Independent reflections   4137 1778
R1   0.1685 0.1087
wR2   0.2796 0.2511
Goof   0.889  

4.2. Structure solution and refinement

Structure solution was performed, as with the natrolite and histidine examples, with SHELXT. Refinement was made using SHELXL. All non-H atoms were refined anisotropically with no restraints. H atoms were added in riding positions, and the extinction parameter EXTI was applied in the refinement. The structure is shown in Fig. 5[link].

[Figure 5]
Figure 5
Projection of the TPB unit cell along the (a) [100], (b) [010] and (c) [001] directions.

5. Conclusions

The development of 3D ED has enhanced structure determination in chemical crystallography, enabling nano-crystallography from samples that previously could only be in­vestigated by bulk via powder diffraction (Huang et al., 2021[Huang, Z., Willhammar, T. & Zou, X. (2021). Chem. Sci. 12, 1206-1219.]; Gruene & Mugnaioli, 2021[Gruene, T. & Mugnaioli, E. (2021). Chem. Rev. 121, 11823-11834.]; Gemmi et al., 2019[Gemmi, M., Mugnaioli, E., Gorelik, T. E., Kolb, U., Palatinus, L., Boullay, P., Hovmöller, S. & Abrahams, J. P. (2019). ACS Central Science, 5, 1315-1329.]). This technique has benefited over recent years from optimizations in instrumentation, data collection protocols and processing. In particular, the use of pixel array detectors for 3D ED applications has enabled rapid data collection free from readout noise. Fast data collection in turn facilitates the fine-sliced con­tin­u­ous rotation methodology that is the standard in X-ray crystallography. Data processing software used in X-ray crystallography is now a popular choice, as discounting the effect of post sample lenses, the effective diffraction geometry of the con­tin­u­ous rotation experiment is equivalent. Thus, the advances in data processing that improved data quality in X-ray crystallography, such as 3D profile fitting, may be applied to 3D ED data too.

DIALS is a popular package for single crystal data pro­cessing, under current active development. Recent additions to the DIALS package have improved its usability for 3D ED, so that it now provides a unified easily-scriptable framework for data processing across X-ray and electron diffraction. We demonstrate the use of DIALS for 3D ED of small mol­ecule and framework structures with three examples from different instruments, with the common factor that data were recorded with a high-quality pixel array detector in each case. The first example shows how the software was adapted for data from an academic lab with a bespoke setup, in which regular calibration images were taken, inter­rupting the con­tin­u­ous sweep of diffraction data. The second and third examples come from commercial instruments, which we may expect to become increasingly important as the field matures. High quality data is achievable in each case. For the chiral amino acid L-histidine, we demonstrate how data processed with DIALS may be used for determining the absolute structure by emulating the output format used by PETS2, which is readable by JANA2020 for dynamic diffraction-based refinement.

Future developments in DIALS for 3D ED should address some remaining deficiencies. For the Timepix and HyPix-ED detectors with a higher event multiplicity, or gain, the default spot-finding algorithm was found to be insensitive to weak spots. The gain was effectively halved for this step to increase sensitivity. Improvements to the spot-finding algorithm may be sought to make this adjustment unnecessary. The precise determination of unit-cell parameters is best demonstrated with the TPB data, where the lack of post-sample lenses on the Eldico ED-1 diffraction means there are no distortions introduced into the diffraction pattern. Comprehensive modelling of distortions has already been demonstrated (Brázda et al., 2022[Brázda, P., Klementová, M., Krysiak, Y. & Palatinus, L. (2022). IUCrJ, 9, 735-755.]), and this provides another obvious direction for improvements in DIALS for data collected on a TEM. Our experiences indicate that the standard method of error modelling developed for X-ray data typically underestimates the true error. Existing work to address this fact (Khouchen et al., 2023[Khouchen, M., Klar, P. B., Chintakindi, H., Suresh, A. & Palatinus, L. (2023). Acta Cryst. A79, 427-439.]) should inform developments in DIALS. We also found that the symmetry-determination tools in DIALS that can be used to resolve indexing ambiguities were not as effective with 3D ED data as they are with X-ray data, and their use is not demonstrated here. Work to improve the robustness of these tools will be important to simplify the workflow in cases in which the correct space group is not previously known.

DIALS is an open-source community project. The growing community of practitioners performing 3D ED includes methods developers, and we would like to make it clear that contributions from software developers inter­ested in 3D ED are very welcome.

Supporting information


Computing details top

(natrolite) top
Crystal data top
Al8H16Na8O48Si12F(000) = 517
Mr = 1520.89Dx = 2.111 Mg m3
Orthorhombic, Fdd2Electrons radiation, λ = 0.0251 Å
a = 18.634 (8) ÅCell parameters from 2469 reflections
b = 18.788 (4) Åθ = 0.1–1.2°
c = 6.8361 (15) ŵ = 0.000 mm1
V = 2393.3 (13) Å3T = 293 K
Z = 2Powder, white
Data collection top
JEOL JEM-2100 TEM
diffractometer
Rint = 0.174
Radiation source: LaB6θmax = 1.2°, θmin = 0.1°
3D ED scansh = 2725
9890 measured reflectionsk = 2530
2469 independent reflectionsl = 1011
1948 reflections with I > 2σ(I)
Refinement top
Refinement on F2H atoms treated by a mixture of independent and constrained refinement
Least-squares matrix: full w = 1/[σ2(Fo2) + (0.1888P)2 + 2.0409P]
where P = (Fo2 + 2Fc2)/3
R[F2 > 2σ(F2)] = 0.139(Δ/σ)max < 0.001
wR(F2) = 0.379Δρmax = 0.32 e Å3
S = 1.17Δρmin = 0.25 e Å3
2469 reflectionsExtinction correction: SHELXL2019/2 (Sheldrick 2015b), Fc*=kFc[1+0.001xFc2λ3/sin(2θ)]-1/4
93 parametersExtinction coefficient: 3358 (82)
2 restraintsAbsolute structure: All f" are zero, so absolute structure could not be determined
Hydrogen site location: mixed
Special details top

Geometry. All esds (except the esd in the dihedral angle between two l.s. planes) are estimated using the full covariance matrix. The cell esds are taken into account individually in the estimation of esds in distances, angles and torsion angles; correlations between esds in cell parameters are only used when they are defined by crystal symmetry. An approximate (isotropic) treatment of cell esds is used for estimating esds involving l.s. planes.

Fractional atomic coordinates and isotropic or equivalent isotropic displacement parameters (Å2) top
xyzUiso*/Ueq
Si010.3464 (3)0.7117 (2)0.1828 (7)0.0120 (8)
Na10.2791 (5)0.5315 (4)0.1912 (14)0.0303 (15)
Si020.2500000.7500000.5547 (9)0.0134 (11)
Al030.2870 (3)0.8438 (2)0.9418 (7)0.0131 (9)
O0050.4298 (4)0.6816 (4)0.1979 (11)0.0156 (12)
O0060.3474 (5)0.7860 (4)0.0575 (14)0.0233 (16)
O0070.2934 (5)0.6531 (5)0.0824 (13)0.0228 (16)
O0080.3200 (5)0.7279 (5)0.4148 (10)0.0203 (15)
O0090.2728 (5)0.8174 (4)0.6949 (12)0.0213 (14)
O00A0.1930 (6)0.5602 (6)0.4460 (18)0.035 (2)
H1A0.1440 (15)0.557 (4)0.393 (4)0.052*
H1B0.195 (5)0.606 (5)0.529 (13)0.052*
Atomic displacement parameters (Å2) top
U11U22U33U12U13U23
Si010.012 (2)0.0095 (15)0.0139 (16)0.0009 (13)0.0002 (15)0.0023 (15)
Na10.030 (4)0.021 (3)0.040 (4)0.000 (2)0.006 (3)0.008 (3)
Si020.011 (3)0.015 (3)0.014 (2)0.002 (2)0.0000.000
Al030.015 (2)0.0107 (17)0.0137 (17)0.0019 (14)0.0030 (17)0.0048 (16)
O0050.015 (3)0.014 (3)0.018 (3)0.002 (2)0.004 (3)0.002 (2)
O0060.026 (4)0.014 (3)0.030 (4)0.007 (3)0.006 (3)0.006 (3)
O0070.017 (4)0.021 (3)0.029 (4)0.001 (3)0.012 (3)0.003 (3)
O0080.020 (4)0.029 (4)0.012 (3)0.002 (3)0.004 (2)0.001 (3)
O0090.020 (4)0.023 (3)0.021 (3)0.002 (3)0.003 (3)0.007 (3)
O00A0.031 (5)0.038 (5)0.034 (4)0.001 (4)0.001 (4)0.009 (4)
Geometric parameters (Å, º) top
Si01—O0071.630 (9)Na1—Al03v3.148 (9)
Si01—O0061.639 (9)Si02—O0091.644 (8)
Si01—O0051.658 (9)Si02—O009vi1.644 (8)
Si01—O0081.687 (8)Si02—O008vi1.671 (9)
Si01—Na1i3.136 (9)Si02—O0081.671 (9)
Na1—O0072.416 (11)Al03—O006vii1.752 (9)
Na1—O00A2.429 (16)Al03—O005viii1.762 (8)
Na1—O006ii2.436 (13)Al03—O0091.779 (9)
Na1—O00Aiii2.459 (14)Al03—O007ix1.782 (9)
Na1—O005iv2.582 (11)
O007—Si01—O006111.2 (5)Si01ii—Na1—Al03v152.4 (3)
O007—Si01—O005111.3 (5)O009—Si02—O009vi108.7 (7)
O006—Si01—O005108.2 (5)O009—Si02—O008vi110.1 (4)
O007—Si01—O008110.0 (5)O009vi—Si02—O008vi108.9 (4)
O006—Si01—O008110.0 (5)O009—Si02—O008108.9 (4)
O005—Si01—O008106.0 (5)O009vi—Si02—O008110.1 (4)
O007—Si01—Na1i120.6 (4)O008vi—Si02—O008110.1 (6)
O006—Si01—Na1i50.2 (4)O006vii—Al03—O005viii110.2 (5)
O005—Si01—Na1i58.7 (3)O006vii—Al03—O009110.5 (5)
O008—Si01—Na1i129.4 (4)O005viii—Al03—O009109.6 (5)
O007—Na1—O00A94.8 (4)O006vii—Al03—O007ix108.5 (5)
O007—Na1—O006ii87.9 (4)O005viii—Al03—O007ix104.6 (4)
O00A—Na1—O006ii112.5 (5)O009—Al03—O007ix113.3 (5)
O007—Na1—O00Aiii115.4 (5)O006vii—Al03—Na1ix117.9 (4)
O00A—Na1—O00Aiii141.6 (4)O005viii—Al03—Na1ix55.1 (3)
O006ii—Na1—O00Aiii92.7 (4)O009—Al03—Na1ix131.5 (4)
O007—Na1—O005iv68.1 (3)O007ix—Al03—Na1ix49.8 (3)
O00A—Na1—O005iv85.9 (4)Si01—O005—Al03x130.2 (5)
O006ii—Na1—O005iv151.4 (4)Si01—O005—Na1xi128.4 (4)
O00Aiii—Na1—O005iv84.3 (4)Al03x—O005—Na1xi90.9 (4)
O007—Na1—Si01ii118.4 (4)Si01—O006—Al03xii139.2 (7)
O00A—Na1—Si01ii101.8 (4)Si01—O006—Na1i98.7 (4)
O006ii—Na1—Si01ii31.1 (2)Al03xii—O006—Na1i118.7 (5)
O00Aiii—Na1—Si01ii84.8 (4)Si01—O007—Al03v135.6 (6)
O005iv—Na1—Si01ii169.0 (4)Si01—O007—Na1125.1 (5)
O007—Na1—Al03v34.3 (2)Al03v—O007—Na196.0 (4)
O00A—Na1—Al03v88.0 (4)Si02—O008—Si01144.1 (6)
O006ii—Na1—Al03v121.4 (3)Si02—O009—Al03143.7 (6)
O00Aiii—Na1—Al03v103.6 (4)Na1—O00A—Na1xiii101.2 (4)
O005iv—Na1—Al03v34.0 (2)
Symmetry codes: (i) x+3/4, y+1/4, z1/4; (ii) x+3/4, y1/4, z+1/4; (iii) x+1/2, y+1, z1/2; (iv) x1/4, y+5/4, z1/4; (v) x+1/2, y+3/2, z1; (vi) x+1/2, y+3/2, z; (vii) x, y, z+1; (viii) x+3/4, y+1/4, z+3/4; (ix) x+1/2, y+3/2, z+1; (x) x+3/4, y1/4, z3/4; (xi) x+1/4, y+5/4, z+1/4; (xii) x, y, z1; (xiii) x+1/2, y+1, z+1/2.
(histidine) top
Crystal data top
C6H10N3O2+·Cl·H2OF(000) = 155
Mr = 209.64Dx = 1.531 Mg m3
Orthorhombic, P212121Electrons radiation, λ = 0.0251 Å
a = 6.7936 (3) ÅCell parameters from 3641 reflections
b = 8.8294 (4) Åθ = 0.1–1.1°
c = 15.1621 (10) ŵ = 0.000 mm1
V = 909.47 (8) Å3T = 293 K
Z = 4Powder, white
Data collection top
Rigaku XtaLAB Synergy-ED
diffractometer
Rint = 0.425
Radiation source: JEOL JSM-2300EDθmax = 1.1°, θmin = 0.1°
3D ED scansh = 1010
85165 measured reflectionsk = 1313
3641 independent reflectionsl = 2323
2589 reflections with I > 2σ(I)
Refinement top
Refinement on F2All H-atom parameters refined
Least-squares matrix: full w = 1/[σ2(Fo2) + (0.1315P)2 + 0.1548P]
where P = (Fo2 + 2Fc2)/3
R[F2 > 2σ(F2)] = 0.123(Δ/σ)max = 0.060
wR(F2) = 0.322Δρmax = 0.18 e Å3
S = 1.12Δρmin = 0.19 e Å3
3641 reflectionsExtinction correction: SHELXL2019/2 (Sheldrick 2015b), Fc*=kFc[1+0.001xFc2λ3/sin(2θ)]-1/4
167 parametersExtinction coefficient: 9000 (16)
1 restraintAbsolute structure: All f" are zero, so absolute structure could not be determined
Hydrogen site location: difference Fourier map
Special details top

Geometry. All esds (except the esd in the dihedral angle between two l.s. planes) are estimated using the full covariance matrix. The cell esds are taken into account individually in the estimation of esds in distances, angles and torsion angles; correlations between esds in cell parameters are only used when they are defined by crystal symmetry. An approximate (isotropic) treatment of cell esds is used for estimating esds involving l.s. planes.

Fractional atomic coordinates and isotropic or equivalent isotropic displacement parameters (Å2) top
xyzUiso*/Ueq
Cl10.2817 (4)0.4777 (3)0.4269 (2)0.0196 (7)
O10.8578 (8)0.5116 (8)0.6705 (5)0.0314 (16)
O20.7942 (8)0.4333 (6)0.5365 (4)0.0207 (11)
C10.7555 (8)0.4440 (7)0.6157 (5)0.0142 (13)
C20.5738 (9)0.3657 (7)0.6517 (5)0.0146 (12)
H20.607 (8)0.277 (6)0.704 (4)0.045 (11)*
N10.4699 (8)0.2857 (6)0.5811 (4)0.0157 (11)
H1A0.413 (5)0.363 (4)0.531 (2)0.023 (7)*
H1B0.562 (4)0.204 (4)0.555 (2)0.018 (6)*
H1C0.333 (5)0.242 (5)0.612 (3)0.041 (10)*
C40.4402 (10)0.4731 (7)0.7016 (5)0.0177 (13)
H4A0.524 (6)0.503 (5)0.761 (3)0.038 (10)*
H4B0.314 (5)0.416 (4)0.719 (2)0.022 (7)*
C50.3822 (9)0.6121 (7)0.6520 (5)0.0157 (13)
N50.1917 (8)0.6488 (6)0.6339 (4)0.0176 (12)
H50.059 (5)0.579 (4)0.658 (3)0.024 (7)*
C60.1848 (9)0.7748 (8)0.5897 (5)0.0212 (15)
H60.063 (6)0.843 (5)0.566 (3)0.033 (8)*
N70.3655 (10)0.8235 (7)0.5804 (5)0.0237 (13)
H70.408 (6)0.920 (5)0.543 (3)0.033 (8)*
C80.4922 (9)0.7262 (7)0.6181 (5)0.0191 (14)
H80.645 (4)0.750 (3)0.621 (2)0.017 (6)*
O30.8396 (10)0.6514 (9)0.8312 (5)0.0374 (17)
H3A0.952 (6)0.622 (4)0.861 (3)0.030 (8)*
H3B0.831 (5)0.602 (4)0.775 (3)0.025 (7)*
Atomic displacement parameters (Å2) top
U11U22U33U12U13U23
Cl10.0119 (10)0.0187 (13)0.0282 (18)0.0005 (10)0.0027 (11)0.0058 (13)
O10.0105 (19)0.055 (4)0.029 (4)0.010 (2)0.003 (2)0.014 (3)
O20.019 (2)0.018 (2)0.025 (3)0.0012 (19)0.004 (2)0.003 (2)
C10.009 (2)0.013 (3)0.020 (4)0.0008 (18)0.002 (2)0.002 (3)
C20.015 (2)0.013 (3)0.016 (3)0.002 (2)0.002 (2)0.000 (3)
N10.016 (2)0.014 (2)0.017 (3)0.0027 (18)0.001 (2)0.001 (2)
C40.027 (3)0.008 (3)0.018 (3)0.000 (2)0.000 (3)0.000 (2)
C50.013 (2)0.013 (3)0.021 (4)0.000 (2)0.001 (2)0.004 (3)
N50.014 (2)0.014 (2)0.024 (3)0.0001 (18)0.002 (2)0.004 (2)
C60.009 (2)0.024 (3)0.030 (4)0.003 (2)0.005 (2)0.002 (3)
N70.030 (3)0.012 (2)0.029 (4)0.003 (2)0.003 (3)0.005 (3)
C80.014 (2)0.013 (3)0.031 (4)0.003 (2)0.004 (3)0.002 (3)
O30.031 (3)0.052 (4)0.029 (4)0.021 (3)0.005 (3)0.008 (4)
Geometric parameters (Å, º) top
O1—C11.236 (9)C5—C81.355 (9)
O2—C11.233 (9)C5—N51.362 (8)
C1—C21.516 (9)N5—C61.300 (9)
C2—N11.464 (9)C6—N71.309 (9)
C2—C41.515 (9)N7—C81.343 (9)
C4—C51.492 (9)
O2—C1—O1124.9 (6)C8—C5—N5105.7 (6)
O2—C1—C2119.2 (6)C8—C5—C4131.0 (6)
O1—C1—C2115.8 (6)N5—C5—C4123.2 (6)
N1—C2—C4112.2 (5)C6—N5—C5110.0 (5)
N1—C2—C1110.5 (6)N5—C6—N7107.6 (6)
C4—C2—C1112.5 (5)C6—N7—C8110.2 (6)
C5—C4—C2114.9 (6)N7—C8—C5106.5 (6)
(tpb) top
Crystal data top
C24H18F(000) = 279
Mr = 306.41Dx = 1.211 Mg m3
Orthorhombic, Pna21Electrons radiation, λ = 0.02851 Å
a = 7.5893 (4) ÅCell parameters from 4137 reflections
b = 19.7154 (6) Åθ = 0.1–1.1°
c = 11.2305 (4) ŵ = 0.000 mm1
V = 1680.38 (12) Å3T = 293 K
Z = 4Powder, white
Data collection top
Eldico ED-1
diffractometer
Rint = 0.213
Radiation source: LaB6θmax = 1.1°, θmin = 0.1°
3D ED scansh = 1010
28267 measured reflectionsk = 2626
4137 independent reflectionsl = 1414
1778 reflections with I > 2σ(I)
Refinement top
Refinement on F2H-atom parameters constrained
Least-squares matrix: full w = 1/[σ2(Fo2) + (0.1515P)2]
where P = (Fo2 + 2Fc2)/3
R[F2 > 2σ(F2)] = 0.109(Δ/σ)max < 0.001
wR(F2) = 0.280Δρmax = 0.14 e Å3
S = 0.89Δρmin = 0.13 e Å3
4137 reflectionsExtinction correction: SHELXL2019/2 (Sheldrick, 2015b), Fc*=kFc[1+0.001xFc2λ3/sin(2θ)]-1/4
218 parametersExtinction coefficient: 3621 (22)
1 restraintAbsolute structure: All f" are zero, so absolute structure could not be determined
Hydrogen site location: inferred from neighbouring sites
Special details top

Geometry. All esds (except the esd in the dihedral angle between two l.s. planes) are estimated using the full covariance matrix. The cell esds are taken into account individually in the estimation of esds in distances, angles and torsion angles; correlations between esds in cell parameters are only used when they are defined by crystal symmetry. An approximate (isotropic) treatment of cell esds is used for estimating esds involving l.s. planes.

Fractional atomic coordinates and isotropic or equivalent isotropic displacement parameters (Å2) top
xyzUiso*/Ueq
C0010.7767 (11)0.6076 (3)0.3482 (6)0.0310 (19)
C0020.7545 (12)0.7194 (4)0.7358 (7)0.038 (2)
H0020.8264070.7530000.7038910.045*
C0030.7159 (10)0.6695 (3)0.5338 (6)0.0292 (17)
C0040.7512 (11)0.7312 (3)0.3482 (7)0.0348 (19)
C0050.7188 (13)0.7306 (3)0.4698 (7)0.039 (2)
H0050.6988070.7712900.5094840.046*
C0060.6872 (14)0.7992 (4)0.1649 (7)0.050 (2)
H0060.6447990.7599980.1289600.060*
C0070.7807 (11)0.6707 (3)0.2883 (7)0.038 (2)
H0070.8035410.6716520.2070060.046*
C0080.8168 (11)0.5461 (3)0.2878 (7)0.038 (2)
C0090.5803 (13)0.6186 (4)0.7121 (7)0.044 (2)
H0090.5391210.5834260.6644930.053*
C00A0.9123 (12)0.4917 (3)0.3409 (8)0.043 (2)
H00A0.9526250.4960130.4187690.052*
C00B0.7500 (12)0.6099 (3)0.4713 (7)0.036 (2)
H00B0.7553030.5695050.5137960.044*
C00C0.6089 (14)0.6683 (4)0.9053 (8)0.057 (3)
H00C0.5819570.6682960.9860420.068*
C00D0.6810 (11)0.6697 (3)0.6612 (7)0.0352 (18)
C00E0.8020 (15)0.4736 (4)0.1123 (9)0.062 (3)
H00E0.7683880.4680460.0332490.075*
C00F0.5403 (14)0.6189 (4)0.8313 (8)0.053 (2)
H00F0.4664990.5856660.8624100.064*
C00G0.7196 (16)0.7184 (4)0.8575 (7)0.058 (3)
H00G0.7695990.7509310.9070790.070*
C00H0.7500 (11)0.7961 (3)0.2791 (7)0.0359 (19)
C00I0.8878 (12)0.4239 (4)0.1630 (10)0.056 (2)
H00I0.9097650.3834690.1228650.067*
C00J0.7570 (13)0.5348 (4)0.1689 (7)0.049 (2)
H00J0.6896310.5673150.1297110.059*
C00K0.8191 (14)0.8552 (4)0.3281 (8)0.051 (2)
H00K0.8688900.8537700.4036690.061*
C00L0.8155 (13)0.9153 (4)0.2679 (9)0.056 (3)
H00L0.8540480.9547240.3052950.067*
C00M0.7552 (15)0.9181 (4)0.1522 (9)0.067 (3)
H00M0.7611540.9583200.1090050.080*
C00N0.6855 (16)0.8598 (4)0.1014 (9)0.069 (3)
H00N0.6378690.8611800.0251540.082*
C00O0.9453 (14)0.4339 (3)0.2803 (9)0.060 (3)
H00O1.0084050.3995420.3177100.072*
Atomic displacement parameters (Å2) top
U11U22U33U12U13U23
C0010.041 (6)0.018 (3)0.034 (5)0.005 (3)0.016 (3)0.001 (3)
C0020.041 (6)0.030 (4)0.043 (5)0.014 (4)0.010 (4)0.005 (3)
C0030.036 (5)0.022 (3)0.029 (4)0.001 (3)0.001 (3)0.002 (3)
C0040.040 (5)0.023 (4)0.041 (5)0.008 (3)0.005 (4)0.004 (3)
C0050.049 (7)0.022 (4)0.045 (5)0.007 (3)0.007 (4)0.008 (3)
C0060.085 (8)0.041 (4)0.026 (4)0.005 (4)0.005 (5)0.003 (4)
C0070.054 (7)0.034 (4)0.026 (4)0.007 (3)0.014 (4)0.003 (3)
C0080.053 (6)0.024 (3)0.038 (4)0.001 (3)0.005 (4)0.011 (3)
C0090.046 (7)0.044 (5)0.043 (5)0.019 (4)0.004 (4)0.001 (3)
C00A0.049 (6)0.028 (4)0.052 (5)0.017 (3)0.002 (4)0.003 (3)
C00B0.047 (6)0.020 (3)0.042 (5)0.004 (3)0.001 (4)0.001 (3)
C00C0.083 (9)0.061 (6)0.027 (5)0.004 (5)0.011 (5)0.009 (4)
C00D0.049 (6)0.026 (3)0.030 (4)0.002 (3)0.013 (4)0.005 (3)
C00E0.081 (9)0.058 (5)0.047 (6)0.023 (5)0.014 (5)0.031 (5)
C00F0.061 (7)0.047 (5)0.051 (6)0.009 (4)0.012 (5)0.000 (4)
C00G0.088 (10)0.050 (5)0.037 (5)0.007 (5)0.001 (5)0.014 (4)
C00H0.047 (6)0.024 (3)0.037 (4)0.006 (3)0.008 (4)0.002 (3)
C00I0.051 (6)0.037 (4)0.079 (7)0.006 (4)0.007 (6)0.019 (5)
C00J0.075 (7)0.033 (4)0.038 (5)0.004 (4)0.011 (5)0.006 (4)
C00K0.061 (7)0.040 (4)0.051 (5)0.008 (4)0.008 (5)0.013 (4)
C00L0.059 (8)0.026 (4)0.082 (7)0.001 (4)0.006 (5)0.013 (4)
C00M0.106 (9)0.038 (5)0.057 (6)0.016 (5)0.019 (6)0.027 (4)
C00N0.105 (9)0.059 (5)0.042 (5)0.036 (6)0.005 (6)0.006 (5)
C00O0.074 (8)0.025 (4)0.080 (7)0.006 (4)0.030 (6)0.006 (4)
Geometric parameters (Å, º) top
C001—C00B1.399 (10)C008—C00J1.428 (11)
C001—C0071.413 (9)C009—C00F1.372 (11)
C001—C0081.423 (9)C009—C00D1.388 (10)
C002—C00G1.392 (11)C00A—C00O1.350 (10)
C002—C00D1.405 (10)C00C—C00F1.382 (12)
C003—C00B1.392 (9)C00C—C00G1.404 (13)
C003—C0051.402 (10)C00E—C00I1.307 (13)
C003—C00D1.455 (11)C00E—C00J1.407 (11)
C004—C0051.388 (10)C00H—C00K1.392 (11)
C004—C0071.388 (9)C00I—C00O1.402 (14)
C004—C00H1.495 (9)C00K—C00L1.364 (10)
C006—C00H1.370 (11)C00L—C00M1.379 (14)
C006—C00N1.390 (11)C00M—C00N1.389 (14)
C008—C00A1.426 (10)
C00B—C001—C007116.4 (6)C003—C00B—C001123.5 (7)
C00B—C001—C008122.0 (6)C00F—C00C—C00G119.5 (8)
C007—C001—C008121.3 (6)C009—C00D—C002118.6 (7)
C00G—C002—C00D120.0 (8)C009—C00D—C003120.2 (7)
C00B—C003—C005117.6 (7)C002—C00D—C003121.1 (7)
C00B—C003—C00D122.1 (6)C00I—C00E—C00J124.6 (9)
C005—C003—C00D120.3 (6)C009—C00F—C00C120.4 (9)
C005—C004—C007119.8 (6)C002—C00G—C00C119.9 (8)
C005—C004—C00H121.1 (6)C006—C00H—C00K117.5 (7)
C007—C004—C00H119.0 (7)C006—C00H—C004121.8 (7)
C004—C005—C003121.0 (6)C00K—C00H—C004120.6 (7)
C00H—C006—C00N121.5 (8)C00E—C00I—C00O117.3 (8)
C004—C007—C001121.5 (7)C00E—C00J—C008118.6 (8)
C001—C008—C00A123.5 (7)C00L—C00K—C00H121.7 (8)
C001—C008—C00J120.6 (7)C00K—C00L—C00M120.5 (8)
C00A—C008—C00J115.9 (6)C00L—C00M—C00N118.7 (8)
C00F—C009—C00D121.4 (8)C00M—C00N—C006119.8 (10)
C00O—C00A—C008121.2 (9)C00A—C00O—C00I122.4 (9)
Statistics for joint scaling of three natrolite data sets top
Crystallographic data and merging statistics
Molecular formulaNa2Al2Si3O10·2H2O
Space groupFdd2
a, b, c (Å)18.640 (9), 18.788 (4), 6.8419 (16)
OverallLowHigh
High resolution limit0.611.310.61
Low resolution limit6.626.620.63
Completeness (%)95.710071.1
Multiplicity7.28.33.2
I/σ13.039.32.2
Rmeas(I)0.1980.1150.515
Rpim(I)0.0670.0390.261
CC1/20.9910.9940.474
Total observations102111395345
Total unique1410168108
Kinematical refinement
ReflectionsAll[I > 2σ(I)]
Independent reflections24691948
R10.16810.1448
wR20.37670/3557
Goof1.175
Statistics for joint scaling of nine histidine data sets top
Crystallographic data and merging statistics
Molecular formulaC6H10ClN3O2
Space groupP212121
a, b, c (Å)6.795 (2), 8.824 (2), 15.149 (3)
OverallLowHigh
High resolution limit0.641.380.64
Low resolution limit8.838.830.66
Completeness (%)100100100
Multiplicity40.435.935.6
I/σ13.953.01.8
Rmeas(I)0.4300.2311.946
Rpim(I)0.0650.0370.333
CC1/20.9970.9970.350
Total observations8537288267296
Total unique2115246205
Kinematical refinement
ReflectionsAll[I > 2σ(I)]
Independent reflections36412589
R10.14840.1231
wR20.32370.3132
Goof1.126
Dynamical refinement
L-HisD-His
R1(all)0.19040.2117
R1(obs)0.12690.1473
wR2(all)0.26770.2997
wR2(obs)0.23800.2696
z-score5.1σ
Statistics for joint scaling of four TPB data sets top
Crystallographic data and merging statistics
Molecular formulaC24H18
Space groupPna21
a, b, c (Å)7.5894 (4), 11.2305 (4), 19.7150 (6)
OverallLowHigh
High resolution limit0.751.610.75
Low resolution limit9.869.860.78
Completeness (%)99.398.696.8
Multiplicity12.512.26.8
I/σ5.520.90.4
Rmeas(I)0.2300.1401.541
Rpim(I)0.0610.0390.564
CC1/20.9930.9910.295
Total observations2995033881465
Total unique2391277214
Kinematical refinement
ReflectionsAll[I > 2σ(I)]
Independent reflections41371778
R10.16850.1087
wR20.27960.2511
Goof0.889
 

Acknowledgements

We thank Huw Jenkins for discussions about the number of summation and profile fitted reflections integrated in cRED data, and for adding the option to export SHELX format. Takanori Nakane added the Rigaku Oxford Diffraction format reader in DIALS, enabling us to read the Synergy-ED data without further conversion. James Beilsten-Edmands provided advice about the usage of dials.scale. Tarik Drevon added the capability to export PETS2 format. Stef Smeets allowed us to adapt the edtools code to produce dials.find_rotation_axis. We also thank Lei Wang at Stockholm University for providing data sets, including the natrolite sample, Daniel Rainer at the National Electron Diffraction Centre in Southampton for providing data sets, including the histidine example, and Gunther Steinfeld and Christian Jandl from Eldico Scientific for providing data sets, including the TPB example. We are grateful to the reviewers who made insightful comments that helped to improve the work, especially regarding gain estimation for the PADs used in this study.

Data availability

The data sets described in this article are available to download on Zenodo. The direct links are: Natrolite, https://zenodo.org/records/12592764; Histidine, https://zenodo.org/records/10974780; TPB, https://zenodo.org/records/11119252. Data processing scripts for the examples presented here are made available on GitHub at https://github.com/aimeon/DIALS-proc. For the purpose of open access, the author has applied a Creative Commons Attribution (CC BY) licence to any Author Accepted Manuscript version arising.

Funding information

Funding for this research was provided by: European Union's Horizon 2020 research and innovation pro­gramme under the Marie Skłodowska-Curie grant agreement (grant No. 956099); Biotechnology and Biological Sciences Research Council (BBSRC) (grant No. BB/S007040/1).

References

First citationAgirre, J., Atanasova, M., Bagdonas, H., Ballard, C. B., Baslé, A., Beilsten-Edmands, J., Borges, R. J., Brown, D. G., Burgos-Mármol, J. J., Berrisford, J. M., Bond, P. S., Caballero, I., Catapano, L., Chojnowski, G., Cook, A. G., Cowtan, K. D., Croll, T. I., Debreczeni, J. É., Devenish, N. E., Dodson, E. J., Drevon, T. R., Emsley, P., Evans, G., Evans, P. R., Fando, M., Foadi, J., Fuentes-Montero, L., Garman, E. F., Gerstel, M., Gildea, R. J., Hatti, K., Hekkelman, M. L., Heuser, P., Hoh, S. W., Hough, M. A., Jenkins, H. T., Jiménez, E., Joosten, R. P., Keegan, R. M., Keep, N., Krissinel, E. B., Kolenko, P., Kovalevskiy, O., Lamzin, V. S., Lawson, D. M., Lebedev, A. A., Leslie, A. G. W., Lohkamp, B., Long, F., Malý, M., McCoy, A. J., McNicholas, S. J., Medina, A., Millán, C., Murray, J. W., Murshudov, G. N., Nicholls, R. A., Noble, M. E. M., Oeffner, R., Pannu, N. S., Parkhurst, J. M., Pearce, N., Pereira, J., Perrakis, A., Powell, H. R., Read, R. J., Rigden, D. J., Rochira, W., Sammito, M., Sánchez Rodríguez, F., Sheldrick, G. M., Shelley, K. L., Simkovic, F., Simpkin, A. J., Skubak, P., Sobolev, E., Steiner, R. A., Stevenson, K., Tews, I., Thomas, J. M. H., Thorn, A., Valls, J. T., Uski, V., Usón, I., Vagin, A., Velankar, S., Vollmar, M., Walden, H., Waterman, D., Wilson, K. S., Winn, M. D., Winter, G., Wojdyr, M. & Yamashita, K. (2023). Acta Cryst. D79, 449–461.  Web of Science CrossRef IUCr Journals Google Scholar
First citationAndrusenko, I. & Gemmi, M. (2022). WIREs Nanomed. Nanobiotechnol. 14, e1810.  Google Scholar
First citationArtioli, G. & Galli, E. (1999). Am. Mineral. 84, 1445–1450.  CrossRef CAS Google Scholar
First citationBeilsten-Edmands, J., Winter, G., Gildea, R., Parkhurst, J., Waterman, D. & Evans, G. (2020). Acta Cryst. D76, 385–399.  Web of Science CrossRef IUCr Journals Google Scholar
First citationBrázda, P., Klementová, M., Krysiak, Y. & Palatinus, L. (2022). IUCrJ, 9, 735–755.  Web of Science CrossRef PubMed IUCr Journals Google Scholar
First citationCho, J., Willhammar, T. & Zou, X. (2023). Microporous Mesoporous Mater. 358, 112400.  CrossRef Google Scholar
First citationCichocka, M. O., Ångström, J., Wang, B., Zou, X. & Smeets, S. (2018). J. Appl. Cryst. 51, 1652–1661.  Web of Science CrossRef ICSD CAS IUCr Journals Google Scholar
First citationClabbers, M. T. B., Gruene, T., Parkhurst, J. M., Abrahams, J. P. & Waterman, D. G. (2018). Acta Cryst. D74, 506–518.  Web of Science CrossRef IUCr Journals Google Scholar
First citationClabbers, M. T. B. & Xu, H. (2021). Acta Cryst. D77, 313–324.  Web of Science CrossRef IUCr Journals Google Scholar
First citationEvans, P. R. & Murshudov, G. N. (2013). Acta Cryst. D69, 1204–1214.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationFernandez-Perez, S., Boccone, V., Broennimann, C., Disch, C., Piazza, L., Radicci, V., Rissi, M., Schulze-Briese, C., Trueb, P. & Zambon, P. (2021). J. Inst. 16, P10034.  Google Scholar
First citationGe, M., Yang, T., Wang, Y., Carraro, F., Liang, W., Doonan, C., Falcaro, P., Zheng, H., Zou, X. & Huang, Z. (2021). Faraday Discuss. 231, 66–80.  Web of Science CSD CrossRef CAS PubMed Google Scholar
First citationGemmi, M., Mugnaioli, E., Gorelik, T. E., Kolb, U., Palatinus, L., Boullay, P., Hovmöller, S. & Abrahams, J. P. (2019). ACS Central Science, 5, 1315–1329.  Web of Science CrossRef CAS PubMed Google Scholar
First citationGemmi, M., Palatinus, L., Klar, P., Faye, M., Agbemeh, V., Hajizadeh, A., Chintakindi, H., Suresh, A., Jeriga, B., Gemmrich Hernández, L., Santucci, M., Wang, L., Vypritskaia, A., Passuti, S., Cordero Oyonarte, E., Matinyan, S. & Ben Meriem, A. (2023). Acta Cryst. A79, C1085.  CrossRef IUCr Journals Google Scholar
First citationGenderen, E. van, Clabbers, M. T. B., Das, P. P., Stewart, A., Nederlof, I., Barentsen, K. C., Portillo, Q., Pannu, N. S., Nicolopoulos, S., Gruene, T. & Abrahams, J. P. (2016). Acta Cryst. A72, 236–242.  Web of Science CSD CrossRef IUCr Journals Google Scholar
First citationGildea, R. J. & Winter, G. (2018). Acta Cryst. D74, 405–410.  Web of Science CrossRef IUCr Journals Google Scholar
First citationGruene, T., Clabbers, M. T. B., Luebben, J., Chin, J. M., Reithofer, M. R., Stowasser, F. & Alker, A. M. (2022). J. Appl. Cryst. 55, 647–655.  Web of Science CSD CrossRef CAS IUCr Journals Google Scholar
First citationGruene, T. & Mugnaioli, E. (2021). Chem. Rev. 121, 11823–11834.  Web of Science CrossRef CAS PubMed Google Scholar
First citationHeidler, J., Pantelic, R., Wennmacher, J. T. C., Zaubitzer, C., Fecteau-Lefebvre, A., Goldie, K. N., Müller, E., Holstein, J. J., van Genderen, E., De Carlo, S. & Gruene, T. (2019). Acta Cryst. D75, 458–466.  Web of Science CrossRef IUCr Journals Google Scholar
First citationHuang, Z., Willhammar, T. & Zou, X. (2021). Chem. Sci. 12, 1206–1219.  Web of Science CrossRef CAS Google Scholar
First citationKhouchen, M., Klar, P. B., Chintakindi, H., Suresh, A. & Palatinus, L. (2023). Acta Cryst. A79, 427–439.  Web of Science CSD CrossRef ICSD IUCr Journals Google Scholar
First citationKlar, P. B. (2023). jana_tools GitHub. https://github.com/pbklar/jana_toolsGoogle Scholar
First citationKlar, P. B., Krysiak, Y., Xu, H., Steciuk, G., Cho, J., Zou, X. & Palatinus, L. (2023). Nat. Chem. 15, 848–855.  Web of Science CSD CrossRef CAS PubMed Google Scholar
First citationKolb, U., Gorelik, T. & Mugnaioli, E. (2009). Mater. Res. Soc. Symp. Proc. 1184, 11–23.  CrossRef Google Scholar
First citationPalatinus, L., Brázda, P., Jelínek, M., Hrdá, J., Steciuk, G. & Klementová, M. (2019). Acta Cryst. B75, 512–522.  Web of Science CrossRef IUCr Journals Google Scholar
First citationParkhurst, J. M., Brewster, A. S., Fuentes-Montero, L., Waterman, D. G., Hattne, J., Ashton, A. W., Echols, N., Evans, G., Sauter, N. K. & Winter, G. (2014). J. Appl. Cryst. 47, 1459–1465.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationSamperisi, L., Zou, X. & Huang, Z. (2022). CrystEngComm, 24, 2719–2728.  CrossRef CAS Google Scholar
First citationSheldrick, G. M. (2015a). Acta Cryst. C71, 3–8.  Web of Science CrossRef IUCr Journals Google Scholar
First citationSheldrick, G. M. (2015b). Acta Cryst. C71, 3–8.  Web of Science CrossRef IUCr Journals Google Scholar
First citationShi, D., Nannenga, B. L., Iadanza, M. G. & Gonen, T. (2013). eLife, 2, e01345.  Web of Science CrossRef PubMed Google Scholar
First citationSimoncic, P., Romeijn, E., Hovestreydt, E., Steinfeld, G., Santiso-Quiñones, G. & Merkelbach, J. (2023). Acta Cryst. E79, 410–422.  Web of Science CrossRef IUCr Journals Google Scholar
First citationWaterman, D. & Evans, G. (2010). J. Appl. Cryst. 43, 1356–1371.  Web of Science CrossRef CAS IUCr Journals Google Scholar
First citationWaterman, D. G., Frisina, N., Owen, C. D., Winter, G. & Nunes, P. (2023). Structure, 31, P1510–P1517.  Google Scholar
First citationWaterman, D. G., Winter, G., Gildea, R. J., Parkhurst, J. M., Brewster, A. S., Sauter, N. K. & Evans, G. (2016). Acta Cryst. D72, 558–575.  Web of Science CrossRef IUCr Journals Google Scholar
First citationWinter, G., Waterman, D. G., Parkhurst, J. M., Brewster, A. S., Gildea, R. J., Gerstel, M., Fuentes-Montero, L., Vollmar, M., Michels-Clark, T., Young, I. D., Sauter, N. K. & Evans, G. (2018). Acta Cryst. D74, 85–97.  Web of Science CrossRef IUCr Journals Google Scholar
First citationXu, H., Lebrette, H., Yang, T., Srinivas, V., Hovmöller, S., Högbom, M. & Zou, X. (2018). Structure, 26, 667–675.  Web of Science CrossRef CAS PubMed Google Scholar

This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.

Journal logoSTRUCTURAL
CHEMISTRY
ISSN: 2053-2296
Follow Acta Cryst. C
Sign up for e-alerts
Follow Acta Cryst. on Twitter
Follow us on facebook
Sign up for RSS feeds