research papers
High-throughput continuous rotation electron diffraction data acquisition via software automation
aDepartment of Materials and Environmental Chemistry, Stockholm University, Stockholm, SE-10691, Sweden
*Correspondence e-mail: stef.smeets@gmail.com
Single-crystal electron diffraction (SCED) is emerging as an effective technique to determine and refine the structures of unknown nano-sized crystals. In this work, the implementation of the continuous rotation electron diffraction (cRED) method for high-throughput data collection is described. This is achieved through dedicated software that controls the transmission electron microscope and the camera. Crystal tracking can be performed by defocusing every nth diffraction pattern while the crystal rotates, which addresses the problem of the crystal moving out of view of the selected area aperture during rotation. This has greatly increased the number of successful experiments with larger rotation ranges and turned cRED data collection into a high-throughput method. The experimental parameters are logged, and input files for data processing software are written automatically. This reduces the risk of human error, and makes data collection more reproducible and accessible for novice and irregular users. In addition, it is demonstrated how data from the recently developed serial electron diffraction technique can be used to supplement the cRED data collection by automatic screening for suitable crystals using a deep convolutional neural network that can identify promising crystals through the corresponding diffraction data. The screening routine and cRED data collection are demonstrated using a sample of the zeolite mordenite, and the quality of the cRED data is assessed on the basis of the refined crystal structure.
1. Introduction
Over the past decade, several techniques have been developed for collecting single-crystal electron diffraction data (SCED) by rotating the crystal in the electron beam. These have reached a stage where data can now be collected routinely to elucidate the structures of submicrometre-sized crystals of organic and inorganic materials (Mugnaioli & Kolb, 2013; Yun et al., 2015). Initially, data were collected with discrete steps of the goniometer (Kolb et al., 2007; Zhang et al., 2010; Wan et al., 2013; Shi et al., 2013). To achieve improved sampling of between the tilt steps, goniometer rotation can be combined with precession (Vincent & Midgley, 1994; Mugnaioli et al., 2009) or many small steps of the beam tilt (Zhang et al., 2010; Wan et al., 2013). With the recent introduction of dedicated detectors for electron diffraction with fast readout times (Nederlof et al., 2013; Hattne et al., 2015), data can now be collected while the crystal is rotating continuously in the electron beam. The benefit of the continuous rotation method (Arndt & Wonacott, 1977) is that data collection times are greatly reduced and that all of is sampled, with the exception of a small wedge that is excluded when the detector is being read out. This was demonstrated first on radiation-sensitive materials, such as protein nanocrystals (Nederlof et al., 2013; Nannenga et al., 2014; Yonekura et al., 2015; Clabbers et al., 2017; Xu et al., 2018), and more recently on organic and inorganic materials, such as metal oxides and metal–organic frameworks (Gemmi et al., 2015; van Genderen et al., 2016; Wang et al., 2017; Köppen et al., 2018).
To the best of our knowledge, no dedicated software exists to assist with collection of continuous rotation electron diffraction (cRED) data. Because the cRED method is (1) conceptually and experimentally very simple, (2) time efficient, and (3) able to provide high data quality, especially for radiation-sensitive materials by reducing beam exposure, it has become the method of choice in several laboratories for XDS (Kabsch, 2010) or DIALS (Winter et al., 2018).
We found that there is a strong need for automation to enable high-throughput collection of cRED data. Heretofore, the acquisition of cRED data required a large number of manual operations, and needed the active presence of an operator to locate crystals and supervise the data collection procedure, which still makes it both demanding and time consuming. The most significant complication during data collection has been crystal drift, which is much more difficult to correct for when the crystal is rotating continuously. We also found there is a demand for a well defined, standardized data processing pipeline to make it easier to access standard X-ray crystallographic software such asTherefore, we have implemented a new routine in the program Instamatic (Smeets et al., 2017) with the aim of automating data acquisition. Instamatic is a multi-functional Python toolbox that can interface with the electron microscope and camera, which gives great flexibility in the design of new experiments. With the implementation, the number of steps required to collect data is greatly reduced, crystal tracking during continuous crystal rotation can be achieved by defocusing the diffraction pattern at regular intervals, and experimental log files and instruction files for data processing software are written automatically. This not only makes the cRED method more accessible to novice or irregular users, but also minimizes the risk of human error, which in turn leads to more reproducible experiments and enables high-throughput data collection. Instamatic was initially developed for collecting serial electron diffraction (SerialED) data. The SerialED method combines computer-controlled stage translation with beam shift to automatically collect diffraction data on a large number of crystals (Smeets, Zou & Wan, 2018). Here, we demonstrate that SerialED data can be used to supplement the cRED data collection by automatic screening for suitable crystals using a deep convolutional neural network that can identify good crystals through the corresponding diffraction data. This can make searching for crystals more effective, because the most suitable ones can be identified by the algorithm.
In this paper, we describe the practical implementation of the cRED data collection routine in Instamatic and the application of SerialED data in combination with machine learning for crystal screening. We also make an assessment of the quality of the collected data using zeolite mordenite as an example.
2. Software implementation
We have developed the electron diffraction software Instamatic (Smeets et al., 2017), which controls our transmission electron microscope from JEOL and cameras (currently ASI Timepix and Gatan OriusCCD), and implemented routines for crystal screening and cRED data collection. The software is implemented in Python 3.6, which means it has full access to the rich ecosystem of Python libraries and debugging tools. However, the methods described in this paper are presented in a generic manner so that they may be implemented in other software for microscope automation. For microscope control, we have developed an object-oriented wrapper around the TEMCOM application programming interface (API) for control of the JEOL microscope (lenses, deflectors, sample stage etc.), which was inspired in part by the PyScope library (Suloway et al., 2005). We have implemented interfaces to the Timepix (ASI) and Gatan OriusCCD cameras using their respective APIs provided by the manufacturers. These interfaces have been abstracted away in a generic microscope class so that other microscopes and cameras may be included in the future. The control interface can be imported into an interactive Python shell (e.g. IPython; Perez & Granger, 2007), which has been very useful for quickly testing new ideas and developing small scripts. On top of the same interface we have developed a modular graphical user interface (GUI) using the tkinter library (Tcl/Tk; Fig. 1). It features a live view of the camera (Timepix), provides an interface for running the different experiments, and offers convenience functions to streamline data I/O and microscope control. Supported formats for data storage are HDF5 (using the h5py library; https://www.h5py.org/), SMV and TIFF (both using the implementation in fabio; Knudsen et al., 2013), and MRC (implementation from https://github.com/ezralanglois/arachnid/). The software is developed for Windows, because it needs to access the microscope API.
3. Experimental
The diffraction experiments were performed on a JEOL JEM-2100-LaB6 at 200 kV equipped with a 512 × 512 Timepix hybrid pixel detector (55 × 55 µm pixel size, model QTPX-262k) from ASI. Data were collected without the use of a beam stop. A well known zeolite, mordenite (Meier, 1961), was used as the test sample. The mordenite powder was crushed and dispersed in ethanol, and then subjected to 2 min ultrasonication. One droplet was transferred to a copper grid with continuous carbon film (CF400-Cu-UL from Sciences). Excess liquid was removed using filter paper, after which the ethanol was allowed to evaporate. SerialED data were collected using a small condenser aperture (50 µm), spot number 4, and exposure times of 0.1 s for diffraction patterns and 0.5 s for images. Parallel illumination was used in imaging mode. In diffraction mode, the electron beam was focused using the condenser lens (CL1) to give an effective probe diameter of approximately 400 nm. cRED data were collected using a small condenser aperture (70 µm), spot size 2, using parallel illumination with the first (reffective = 0.75 µm) and second (reffective = 0.35 µm) selected area (SA) apertures. Data were collected using a high-tilt tomography holder (±80°). For the SerialED and cRED experiments, the diffraction patterns were focused to give sharp spots using the intermediate lens (IL1), and the camera length used was 250 mm (giving a maximum resolution dmin ≃ 0.8 Å).
4. Crystal screening using SerialED
The Instamatic software was initially developed to collect SerialED data (Smeets, Zou & Wan, 2018) and later modified to collect cRED data. In a SerialED experiment, diffraction data are collected from a large number of isolated submicrometre-sized crystals. This is achieved by combining stage translation and beam shift. The sample stage is translated in a raster over a large area (typically several hundreds of micrometres), and at each position of the stage, crystals are detected in imaging mode at low magnification using image-recognition techniques. Once some crystals have been located, the electron beam is focused and shifted to the position of each of the crystals so that a diffraction pattern can be collected. After initial calibrations, the method is fully automated and can survey an area of approximately 400 × 400 µm in an hour. We have shown previously that it is possible to use the electron diffraction data from a large number of crystals for phase analysis (Smeets, Ångström & Olsson, 2018) and that the merged data are suitable for (Smeets & Wan, 2017; Smeets et al., 2018). In this section, we discuss the application of the SerialED method as a way of screening for good crystals for cRED data collection. Because SerialED uses low-magnification images (typically at 2500× magnification) to locate crystals, information about the size, shape and position of crystals is available, but the quality of the data is difficult to judge automatically. For this purpose, we trained a deep convolutional neural network to predict whether a crystal is suitable for collecting cRED data on the basis of its diffraction pattern.
4.1. Deep convolutional neural network
A deep convolutional neural network (CNN) (LeCun et al., 1989) was used to distinguish between good and bad diffraction patterns. A basic CNN is trained to find small (in this case starting with 3 × 3 pixels) features in an image which are combined to build larger higher-level features, which may in turn be used to build even higher level features, etc., depending on the number of layers in the network. The highest-level features found in the image are input into a number of dense layers, which carry out the classification, e.g. the features feline face, legs, torso and tail lead to the classification `cat'.
Image preprocessing was performed using numpy (Walt et al., 2011) and scikit-image (Walt et al., 2014). The primary beam is located by finding the average position of the top 5% brightest pixels in the image. A new image is cropped out from the 400 × 400 pixels around the primary beam to ensure that the strongest feature is always at the center of the image, while maintaining a consistent resolution. Because the pixels in the central beam usually have values that dwarf the values of the diffraction spots, the intensity of the pixels (z) was capped at the mean intensity (μ) plus four times the standard deviation (σ), i.e.
The values were then normalized by feature scaling unless the largest (zmax) and smallest (zmin) intensities were identical, in which case all values were set to zero, i.e.
The images were finally shrunk to 150 × 150 pixels to reduce the cost of computation in the neural network.
The model was specified and trained in Keras (Chollet, 2015) using the Tensorflow (Abadi et al., 2015) backend and Nvidia CUDA (Nickolls et al., 2008) on approximately 78 000 labeled images of diffraction patterns split 80, 10 and 10% into training, validation and test data sets, respectively. Model details can be found in Table S1 of the supporting information. Dropout (Srivastava et al., 2014) was used as regularization to avoid overfitting and rectifier activation (Hahnloser et al., 2000) was used in all convolutional and dense layers, except the output layer where logistic activation was used. About 55 000 of the images were SerialED data, 15 000 cRED data and 8000 computer-generated powder rings; about 57% were labeled as good and 43% as bad. The final model was trained in batches of 75 images in 20 epochs using a dropout rate of 15%, the binary as loss function, and the RMSprop optimizer on an Nvidia GeForce GTX 970 GPU. The achieved accuracies are 94.6, 93.1 and 93.3% on the training, validation and testing data sets, respectively. Note that the line between good and bad is subjective and inconsistency in the labeling probably limits the maximal accuracy.
When a diffraction pattern is passed through the CNN, a prediction score between 0.0 and 1.0 is returned, where any value greater than 0.5 corresponds to a good quality diffraction pattern [see also Smeets, Ångström & Olsson (2018)].
4.2. Application
To show the potential of the method for screening crystals, SerialED data were collected on a sample of synthetic mordenite. In total, 236 images were collected at a magnification of 2500×, by moving the stage over an area of 200 × 200 µm, and 867 diffraction patterns were collected in 24 min (corresponding to 2167 patterns per hour). The diffraction patterns are run through a script that applies the CNN algorithm and generates a csv file where each row contains the path to the image on which the crystal was identified (in imaging mode), sequence number of the image and crystal, prediction score, object size, and x and y coordinates of the sample stage. Two criteria were used to identify suitable crystals for data collection. First, only isolated crystals were selected. Crystals that were within 1.5 µm from another crystal or 0.5 µm from the edge of the image frame were discarded, leaving 75 candidates. Second, the CNN was used to predict which crystals would be most suitable, leaving 52 crystals with a prediction score of >0.5. Fig. S1 shows the almost binary distribution of the prediction scores for this data set, which means that the CNN is very confident in its prediction. The corresponding stage positions can be loaded into Instamatic and recalled with an accuracy of approximately ±1.0 µm, depending on the precision of the goniometer. The operator can then decide whether a crystal is indeed adequate and perform the cRED data collection experiment, or choose a different one. Six of the best crystals, as an example, are shown in Fig. 2, and six more with prediction values <1.0 in Fig. S2. This shows that the combination of complementary information from direct (images) and reciprocal (diffraction patterns) space proved to be effective for identifying suitable crystals for data collection. The time to complete the crystal screening process mainly depends on the size of the area selected, because it is limited by the speed of the stage translation on our microscope. For an area of 200 × 200 µm, the process from SerialED data collection to the final identification of suitable crystals takes about 30 min to complete.
5. Continuous rotation electron diffraction
The cRED technique has been a fully manual and operator-dependent method up till now. One of the reasons was the lack of a dedicated program for data collection. Initially, cRED data were collected using the software SoPhy provided by ASI, normally used for setting up and calibrating the camera, using the function to collect a series of images. A typical cRED data collection experiment involves (1) unblanking the beam (if used), (2) starting the crystal rotation using the pedals while simultaneously (3) starting image recording in the camera software, and (4) tracking the crystal during rotation. On our microscope, the rotation is controlled through two pedals, one for clockwise and one for anticlockwise rotation. The pedal needs to be held down during data collection. To complete the experiment, the following procedures are involved: stopping (1) image recording and (2) rotation, (3) saving the data on the hard drive, and (4) noting down experiment metadata, such as the starting angle, ending angle, spot number, rotation setting (rotation speed) and camera length. Manually noting metadata and saving files may lead to errors and data loss. The metadata are necessary to prepare the input files for the data processing software. Essentially all the steps, except for acquiring a series of images, were previously done manually.
Our intention is to make the cRED method more accessible and turn it into a high-throughput method. We implemented the data collection routine in the program Instamatic (Smeets et al., 2017) and made an effort to automate as many steps as possible. In addition, we integrated a set of scripts into the program for preparing data and input files for data processing software. In this way cRED data acquisition becomes a semi-automated routine, and the number of steps required is greatly reduced. Data acquisition has been simplified through the following procedures:
(1) Start recording images automatically once rotation starts. Once the data collection routine is initialized, the program enters a state where it will wait for the stage to start rotating, which will then initiate data recording. A delay of 0.2 s is introduced to avoid acceleration and any possible backlash of the goniometer. The time and current rotation angle at the start of the experiment are logged. Data are saved to a buffer in memory and written once data collection has finished.
(2) Option to retract the beam blank automatically once rotation starts, which is especially useful for radiation-sensitive materials.
(3) Option to defocus every nth frame (using diffraction focus, IL1 lens) according to the needs of the operator, which is used for crystal tracking (see §5.1).
(4) Log all experimental parameters, such as exposure time, spot number, camera length, rotation speed, timestamps etc.
(5) Apply corrections to the diffraction data (see below), write image files with the specified formats (TIFF, SMV, MRC) and embed the required metadata where possible.
(6) Save all data to a new directory automatically. The number suffix for the directory is incremented after every experiment, so that previous data acquisitions are never overwritten.
(7) Write instruction files for data processing software, specifically XDS (Kabsch, 2010), DIALS (Winter et al., 2018) and REDp (Wan et al., 2013). The instruction files provide good default values and can be used directly, although some tweaking may be required.
The procedure for cRED data collection with Instamatic is illustrated in a flowchart in Fig. S3. Although the software is not yet fully automated and still requires an active operator during data collection, it can perform many of the routine steps and addresses some of the common problems with fully manual data collection. Furthermore, it introduces a standard protocol for data acquisition.
5.1. Crystal tracking through defocusing diffraction patterns
The most consequential difficulty during data collection has been to keep the crystal in the beam during rotation. Crystal drift is a problem caused by goniometer mechanics and the crystal not being centered on the rotation axis, which is particularly noticeable at high tilt angles. Adjusting the height of the crystal helps to minimize the sample movements during rotation (Dierksen et al., 1992; Zhang et al., 2010). The problem is exacerbated because the data collection cannot be paused once the rotation has started. In our initial experiments, the position of the crystal is corrected by manual adjustment of the stage position while monitoring the shape and intensity of the diffraction pattern during data collection, and attempting to re-center the crystal once the diffraction signal becomes weak because the crystal is moving partly outside the view of the SA aperture. This is a common problem with cRED data collection, which limits the maximum rotation range that can be obtained. Gemmi et al. (2015) demonstrated an elegant solution with a focused electron beam, using the beam-shift deflectors to follow the pre-programmed path of the crystal, albeit with limited success.
In our setup, improved crystal tracking is achieved by defocusing the diffraction pattern via the intermediate lens (IL1) at regular intervals. Crystal tracking in diffraction mode through defocusing has been described previously in the context of collecting stepwise SCED data (Wan et al., 2013). In the implementation in Instamatic, every nth diffraction pattern is defocused (n can be tuned to the extent of the crystal movement, typically n = 10). This returns a snapshot of the crystal in the primary beam and can be used as a reference for tracking the crystal, simplifying the process of re-centering the crystal. At present, crystal tracking is performed manually, but the defocused images provide a way to automate tracking in the future. The ray diagrams for the different modes are illustrated in Fig. S4 and the corresponding images are given in Fig. 3. Afterwards, the diffraction focus is set back to the previous value. The defocused images are stored automatically in a different directory from the diffraction data and can be used to check and verify the data collection. Note that defocusing every nth image introduces gaps in the data, which may lead to partially recorded reflections and therefore reduced accuracy of the integration. Low-angle reflections are less affected by this than high-angle reflections, because they are recorded on more frames. The integration routine in XDS, for example, uses profile fitting to integrate the observed intensity, which means that it can compensate for missing frames to some degree. High-angle reflections that are only observed on a few frames may be lost. However, the fact that the crystal can be tracked ensures the crystal can be kept in the electron beam, which leads to higher rotation ranges, data redundancy and completeness, and, in turn, to data more suitable for structure refinements. This is demonstrated by the successful structure against a data set obtained using this method in §6.
The implementation of the crystal tracking method has had a meaningful impact on the way data are collected in our laboratory. First, it greatly reduced the number of failed or interrupted experiments that would occur because crystals moved out of the view of the SA aperture during data collection. Second, it has made it possible to consistently achieve higher rotation ranges (>120°). To follow the statistics of the cRED experiments, we implemented metadata logging for each experiment, which includes experimental information such as the rotation range, rotation speed, exposure times, camera length and number of frames collected. Fig. 4 shows a histogram of the rotation ranges achieved from 818 experiments by 15 different (including novice and experienced) operators between December 2017 and July 2018. Of these experiments, 766 (93.6%) used the crystal tracking and 50% reached high rotation ranges (>80°) so that high data completeness can be achieved, which is important for Interestingly, the histogram reveals that ca 24% of all experiments were interrupted before reaching 20° rotation. This is usually the result of the crystal moving out of the beam. The spike around 60° can be explained by the use of a cooling or cryo-transfer specimen holder, which has a limited rotation range (±42°). The data show that the crystal tracking implementation has contributed to the speed and success rate of the cRED data collection. In turn, this has increased the reproducibility of the experiments and made the method more accessible to novice and experienced users alike.
5.2. Other practical aspects for cRED data collection
Several other important aspects need to be considered during cRED data collection: (1) timing, (2) lens hysteresis and (3) possible primary beam shift after defocusing. First, because the goniometer keeps rotating throughout the entire data collection, including the gap periods for crystal tracking under which no diffraction patterns are recorded, the timing of a defocus cycle must match the acquisition time of a diffraction pattern. Gaps in the data must cover the same rotation range (or an integer multiple thereof) to ensure that the oscillation angle of the missing data is consistent with the rest for the data processing algorithms implemented in XDS (Kabsch, 2010) and DIALS (Winter et al., 2018). Another point related to timing is that any changes to the electron beam optics are not instantaneous. We estimate the time it takes for the electron beam to come back to its refocused state to be around 300–400 ms, although this number goes up when a larger defocus value is applied. The data collection routine keeps track of the average acquisition time for a diffraction pattern, which is a summation of the exposure time (typically 500 ms), readout time (8 ms for the Timepix camera) and overhead, for example for allocating memory and arranging the data (approximately 3–4 ms). Each defocused image is taken with a much shorter exposure time (typically 10 ms), so that approximately 400 ms can be allocated to refocus the diffraction pattern, taking into account that every call to the JEOL API takes about 35 ms. Second, it is important to relax the beam before the experiment, because frequently changing the value of the intermediate lens introduces a hysteresis that influences the position of the primary beam in the diffraction pattern on our transmission electron microscope. This may cause the position of the primary beam to drift after a defocus cycle. To avoid this, the electron beam is relaxed by toggling between the focused and defocused state a few times before the data collection. In this way, the primary beam is set to its neutral position. Lastly, depending on the alignment of the microscope and the position of the SA aperture, the defocus is not necessarily applied concentrically. In combination with the fact that refocusing is not instantaneous, this can manifest itself as a small but noticeable shift of the primary beam position in the first pattern following a defocus cycle. The shifts are typically less than 0.2 pixels, which did not cause any issues with data processing (§S1).
5.3. Data processing
The steps for data processing have been adapted from the method described by Smeets, Zou & Wan (2018). Because the pixels connecting the four modules (each 256 × 256 pixels in size) in the Timepix detector are three times larger (165 µm instead of 55 µm), the images are converted to a 516 × 516 array to ensure the correct geometry for further processing [see also Nederlof et al. (2013)]. The cross pixels are masked in XDS using the UNTRUSTED_RECTANGLE instruction. A flatfield correction is applied by Instamatic to correct for slight variations in pixel response, which also partially accounts for the effects of the larger pixels between the modules. The position of the primary beam is estimated at the pixel with the largest intensity value on the diffraction pattern after applying a Gaussian filter with a large enough standard deviation (usually 10–30). The median value for the primary beam positions over all diffraction patterns is used in the data processing software packages (XDS and DIALS), which expect a stationary primary beam. In XDS, an affine transformation can be applied to each image using the X-GEO_CORR/Y-GEO_CORR instructions to correct for the lens distortions (Capitani et al., 2006). An elliptical distortion with an eccentricity of 0.22 was observed on our microscope, and the required geometrical correction files for XDS are generated by Instamatic. Missing diffraction patterns (as a result of tracking) are specified in the XDS input file using the EXCLUDE_DATA_RANGE instruction and in DIALS using the scan_range (for dials.find_spots) and exclude_images (for dials.integrate) command-line parameters. The oscillation angle used for integration is calculated by dividing the rotation range by the data collection time.
6. Application for structure analysis of mordenite
The crystal tracking method has been applied for cRED data collection and structural analysis using a well known synthetic zeolite with the mordenite structure (Meier, 1961) as an example (Fig. S5). Firstly, we collected two cRED data sets using Instamatic with the conditions presented in Table 1, defocusing every tenth image for crystal tracking. The data were processed using the software XDS (Kabsch, 2010) and indexed using the lattice parameters of a = 18.668, b = 20.513, c = 7.691 Å, α = 89.93, β = 90.31, γ = 89.59° for data set 1, and a = 18.619, b = 20.838, c = 7.753 Å, α = 90.20, β = 90.12, γ = 90.52° for data set 2. Both fit with the expected orthorhombic C-centered of mordenite and are close to the published lattice parameters (a = 18.13, b = 20.49, c = 7.52 Å). Reflection intensities were extracted in Cmcm (Table 2) using XDS. We noticed that data set 2 is of higher quality than data set 1, with a higher mean of unique reflections (6.25 versus 2.37) and lower redundancy-independent R factor, Rmeas (10.8% versus 33.0%), despite having a lower completeness (93.6 versus 99.3%). The difference may be attributed to the choice of crystal or to the choice of SA aperture. For data set 2, a smaller aperture was used than for data set 1. A smaller SA aperture does not reduce the dose on the crystal, but can prevent unwanted local information and (inelastic) scattering events that contribute to increased background and noise levels (Fig. S6).
‡A defocused image was taken every tenth diffraction pattern. |
|
For both data sets, the structure could be determined by using SHELXS (Sheldrick, 2008). All framework Si and O atoms were found successfully in the initial model from the structure solution. SHELXL (Sheldrick, 2008, 2015) was used for structure using the known unit-cell parameters from the literature (Meier, 1961). All Si and O atoms were refined anisotropically. While there is no need to use any restraints for data set 2, for data set 1, rigid-bond restraints (Thorn et al., 2012) were applied to all framework atoms using the RIGU instruction to maintain reasonable atomic displacement parameters. In addition, the resolution was cut to 0.91 Å for data set 1, because of the low for reflections with d < 0.91 Å. Finally, we introduced an extinction coefficient (EXTI), which is an empirical correction useful when some of the most intense reflections have reduced the intensities, for example as a result of dynamical scattering (see also §S3). We were unable to find any sodium cations or water molecules in the difference potential map. The details of the are given in Table 3. The difference in data quality is reflected in the precision of the structure where the R1 value for data set 1 (R1 = 30.07%) is significantly higher than that for data set 2 (R1 = 17.69%). The geometry of the distances and angles for both refined structures was analyzed by using PLATON (Spek, 2009; Tables 4 and S2–S4).
implemented in
|
|
In the absence of restraints on the structure parameters, the spread of the Si—O bond distances is 1.59–1.66 Å (mean: 1.610 ± 0.018 Å) for data set 1 and 1.59–1.64 Å (mean: 1.614 ± 0.012 Å) for data set 2. The tetrahedral O—Si—O angles are 107.2–113.0° (mean: 109.5 ± 1.8°) for data set 1 and 106.4–112.4° (mean: 109.5 ± 1.9°) for data set 2. The values for both data sets are consistent with the expected values of d(Si—O) = 1.61 ± 0.01 Å and ∠(O—Si—O) = 109.5 ± 0.8°. Compared with the published structure of mordenite we obtained accurate refined results for both data sets (Tables S2–S4). Particularly noteworthy are the atomic displacement parameters obtained for data set 2 (Fig. 5). Anisotropic displacement parameters are known to act as a fudge factor for poor quality data, resulting in physically meaningless displacement ellipsoids. For data set 2, however, the atomic displacement parameters are physically sensible. The atomic displacement parameters for oxygen are slightly larger than those for Si, and elongated perpendicular to the plane formed by the Si—O—Si bond. All bonds pass the Hirshfeld rigid-bond test (Hirshfeld, 1976), with an r.m.s. difference of 0.0058 Å. The largest differences are found for the Si3—O1 and Si3—O4 bonds, with values of 0.010 (5) and 0.013 (8) Å, respectively (Table S6). This is approximately an order of magnitude larger than the value of 0.001 Å suggested by Hirshfeld for X-ray diffraction data. This may indicate that the precision of the structure using cRED data is not yet at a level where such small deviations may be discerned. We therefore consider the atomic displacement parameters to be reliably determined, but further study is warranted.
After the model was parametrized the data were examined for outliers. An Fobs–Fcalc plot (Fig. 6) was created to obtain a visual impression of the data quality using the software ANAFCF and LOGLOG (Lutz & Schreurs, 2012). An fcf file of phased structure factors containing h, k, l, Fobs, σ(Fobs), A(real) and B(imag) from SHELXL (LIST 4) was used to prepare the plots. For data set 1, the majority of the most discrepant reflections belong to the (hk0) plane, which can be attributed to the rotation almost exactly passing through the [00l] where the dynamical effect is maximized. Notwithstanding, the two plots are mutually consistent (Fig. S8), and they contain mostly the same reflections which are roughly proportionate to one another.
6.1. Validating crystal tracking
To judge how well the crystal remains in the SA aperture during data collection, the SCALE factor reported by the INIT job in XDS (Kabsch, 2010) can be consulted. The SCALE factor uses the ED frames only and is employed in XDS to correct for variations in the incident beam We found that this parameter is sensitive to the crystal moving (partially) out of the SA aperture. As the crystal gets obscured by the SA aperture, the corresponding diffracted intensities weaken. Figs. 7(a) and 7(b) show the evolution of the scale factor with frame number for data sets 1 and 2, respectively. The data reveal a slowly varying scale over the entire image range, indicating that the crystal remained in the aperture during data acquisition. The large spike on the right of Fig. 7(b) corresponds to the diffraction data being obscured by the copper grid at a high rotation angle. It is unclear what happened for the first frame in Fig. 7(a).
For comparison, the scale evolution for two data sets (out of eight) from a previous study on the coordination polymer Co-CAU-36 (Wang et al., 2018) is given in Figs. 7(c) and 7(d). cRED data on Co-CAU-36 were collected while blindly tracking the position on the crystal (i.e. before the defocus method was implemented). Although the data sets consist of rotation ranges of over 100°, in both cases the crystal repeatedly moved (partially) outside the view of the SA aperture, as indicated by the rapidly varying SCALE factor. In the Co-CAU-36 study, data set 5 (Fig. 7d) was found to comprise the highest data quality, and was used to determine and refine the Data set 1 (Fig. 7c) was still sufficient for determination of the crystal structure.
7. Conclusions
We have shown that high-throughput SCED data collection of submicrometre-sized crystals using the continuous rotation method is attainable through software automation, as implemented in the program Instamatic. This is achieved on two fronts. First, a routine for the screening of suitable crystals was developed, making use of the SerialED method to collect image and diffraction data on a large number of crystals. The image data are used to find isolated crystals. A CNN was trained to differentiate between good and bad diffraction patterns and identify the most promising crystals. Combining direct (image) and reciprocal (diffraction) space information in this way was found effective for identifying suitable crystals on which to collect cRED data.
Second, we have automated many of the steps to collect cRED data in Instamatic, and some of the problems with data collection have been addressed. Of particular importance is that the crystal can be tracked during the data collection by defocusing the diffraction pattern at regular intervals, which enables reliable and reproducible experiments. This also makes high rotation ranges more accessible, so that the data cover a larger portion of Moreover, the collected data format is compatible with standard single-crystal processing software like XDS, DIALS and REDp, and usable input files with compatible data files are produced by Instamatic. All these factors make the method more accessible to novice and irregular users, and enable data to be collected routinely in under 5 min.
The data show that, despite forgoing every nth frame for the purpose of crystal tracking, the resulting data set can be of high quality and suitable for structure The accuracy of the refined structure was assessed by examining the deviations in the bond lengths and angles. The atomic displacement parameters for data set 2 were refined anisotropically and validated by means of the Hirshfeld rigid-body test, showing that physically meaningful atomic displacement parameters can be obtained from cRED data. This opens up new possibilities to study atomic motion (libration, translation, internal vibrations) and disorder (static or dynamic) from submicrometre-sized crystals.
At this stage, cRED data collection still requires an active operator to supervise the data collection and correct for the position of the crystal during the experiment. The development of automated tracking procedures using the defocused images is currently in progress. In the future, we hope to further integrate the SerialED and cRED methods for automated crystal selection and data collection so that a large number of data sets can be collected without (or with very little) human supervision. With the increased interest in radiation-sensitive materials, such as organic, pharmaceutical and macromolecular crystals, more automation is a way to reduce the dose on a sample. The methods described here are generally applicable and can be applied to any material that forms submicrometre-sized crystals.
The software used to collect the data is available from https://github.com/stefsmeets/instamatic. Movies of the data collection using crystal tracking and the crystallographic data for both structures in format are provided as supporting information. The cRED and SerialED data sets used in this study have been deposited at https://dx.doi.org/10.5281/zenodo.1321880.
Supporting information
Link https://dx.doi.org/10.5281/zenodo.1321880
The cRED and SerialED data sets used in this study
https://doi.org/10.1107/S1600576718015145/yr5038sup1.cif
contains datablocks mordenite_1, mordenite_2. DOI:Structure factors: contains datablock mordenite_1. DOI: https://doi.org/10.1107/S1600576718015145/yr5038mordenite_1sup2.hkl
Structure factors: contains datablock mordenite_2. DOI: https://doi.org/10.1107/S1600576718015145/yr5038mordenite_2sup3.hkl
Movie of the data collection using crystal tracking. DOI: https://doi.org/10.1107/S1600576718015145/yr5038sup4.mp4
Movie of the data collection using crystal tracking. DOI: https://doi.org/10.1107/S1600576718015145/yr5038sup5.mp4
Supporting information file. DOI: https://doi.org/10.1107/S1600576718015145/yr5038sup6.pdf
For both structures, data collection: Instamatic-0.6.2 (Smeets, 2018); cell
XDS-20180126 (Kabsch, 2018); data reduction: XDS-20180126 (Kabsch, 2018); program(s) used to solve structure: SHELXS2013/1 (Sheldrick, 2013); program(s) used to refine structure: SHELXL2014/7 (Sheldrick, 2014).O96Si48 | V = 2798.9 (10) Å3 |
Mr = 3022.66 | Z = 1 |
Orthorhombic, Cmcm | F(000) = 470 |
a = 18.110 (4) Å | Dx = 1.793 Mg m−3 |
b = 20.530 (4) Å | µ = 0.000 mm−1 |
c = 7.5280 (15) Å | T = 293 K |
Jeol JEM-2100-LaB6 diffractometer | Rint = 0.266 |
Radiation source: electron microscope | θmax = 0.8°, θmin = 0.1° |
Continuous rotation electron diffraction scans | h = −19→19 |
4432 measured reflections | k = −22→22 |
1090 independent reflections | l = −8→8 |
684 reflections with I > 2σ(I) |
Refinement on F2 | 93 restraints |
Least-squares matrix: full | w = 1/[σ2(Fo2) + (0.2P)2] where P = (Fo2 + 2Fc2)/3 |
R[F2 > 2σ(F2)] = 0.284 | (Δ/σ)max = 0.057 |
wR(F2) = 0.575 | Δρmax = 0.26 e Å−3 |
S = 1.65 | Δρmin = −0.35 e Å−3 |
1090 reflections | Extinction correction: SHELXL-2014/7 (Sheldrick 2014), Fc*=kFc[1+0.001xFc2λ3/sin(2θ)]-1/4 |
96 parameters | Extinction coefficient: 3023 (61) |
Geometry. All esds (except the esd in the dihedral angle between two l.s. planes) are estimated using the full covariance matrix. The cell esds are taken into account individually in the estimation of esds in distances, angles and torsion angles; correlations between esds in cell parameters are only used when they are defined by crystal symmetry. An approximate (isotropic) treatment of cell esds is used for estimating esds involving l.s. planes. |
x | y | z | Uiso*/Ueq | ||
Si1 | 0.1940 (4) | 0.4243 (4) | 0.5425 (10) | 0.060 (2) | |
Si2 | 0.1965 (4) | 0.1899 (3) | 0.5439 (11) | 0.056 (2) | |
Si3 | 0.0840 (5) | 0.3801 (5) | 0.2500 | 0.061 (3) | |
Si4 | 0.0852 (5) | 0.2218 (5) | 0.2500 | 0.056 (3) | |
O1 | 0.1227 (8) | 0.4077 (8) | 0.424 (2) | 0.092 (4) | |
O2 | 0.1236 (7) | 0.1950 (7) | 0.427 (2) | 0.082 (4) | |
O3 | 0.2622 (9) | 0.3783 (7) | 0.4972 (17) | 0.089 (4) | |
O4 | 0.0918 (10) | 0.3011 (8) | 0.2500 | 0.093 (6) | |
O5 | 0.1723 (10) | 0.1902 (9) | 0.7500 | 0.082 (5) | |
O6 | 0.1722 (11) | 0.4196 (9) | 0.7500 | 0.082 (4) | |
O7 | 0.2200 (10) | 0.5000 | 0.5000 | 0.078 (5) | |
O8 | 0.2500 | 0.2500 | 0.5000 | 0.098 (6) | |
O9 | 0.0000 | 0.4039 (11) | 0.2500 | 0.070 (6) | |
O10 | 0.0000 | 0.1962 (9) | 0.2500 | 0.063 (5) |
U11 | U22 | U33 | U12 | U13 | U23 | |
Si1 | 0.056 (4) | 0.048 (4) | 0.075 (5) | 0.011 (3) | −0.007 (3) | −0.001 (3) |
Si2 | 0.042 (4) | 0.057 (4) | 0.071 (5) | 0.020 (3) | −0.005 (3) | −0.003 (3) |
Si3 | 0.036 (5) | 0.064 (5) | 0.081 (6) | 0.002 (3) | 0.000 | 0.000 |
Si4 | 0.030 (5) | 0.067 (5) | 0.070 (6) | 0.001 (3) | 0.000 | 0.000 |
O1 | 0.072 (7) | 0.103 (8) | 0.101 (7) | 0.001 (6) | −0.017 (5) | −0.006 (6) |
O2 | 0.043 (6) | 0.114 (9) | 0.090 (7) | 0.002 (5) | −0.008 (5) | 0.012 (5) |
O3 | 0.077 (7) | 0.079 (8) | 0.111 (10) | 0.020 (6) | −0.001 (6) | −0.007 (6) |
O4 | 0.053 (8) | 0.073 (6) | 0.153 (15) | 0.002 (4) | 0.000 | 0.000 |
O5 | 0.049 (8) | 0.115 (14) | 0.082 (7) | 0.001 (8) | 0.000 | 0.000 |
O6 | 0.076 (10) | 0.082 (10) | 0.087 (7) | −0.001 (8) | 0.000 | 0.000 |
O7 | 0.056 (9) | 0.066 (7) | 0.111 (11) | 0.000 | 0.000 | 0.004 (6) |
O8 | 0.069 (9) | 0.100 (11) | 0.124 (13) | −0.007 (9) | −0.004 (8) | 0.018 (9) |
O9 | 0.040 (7) | 0.062 (10) | 0.107 (15) | 0.000 | 0.000 | 0.000 |
O10 | 0.030 (7) | 0.073 (11) | 0.085 (14) | 0.000 | 0.000 | 0.000 |
Si1—O3 | 1.592 (15) | Si4—O2ii | 1.603 (17) |
Si1—O1 | 1.606 (16) | Si4—O2 | 1.603 (17) |
Si1—O6 | 1.614 (9) | Si4—O4 | 1.632 (19) |
Si1—O7 | 1.655 (9) | Si4—O10 | 1.631 (11) |
Si2—O2 | 1.589 (16) | O3—Si2i | 1.617 (15) |
Si2—O8 | 1.603 (8) | O5—Si2iii | 1.613 (10) |
Si2—O5 | 1.613 (10) | O6—Si1iii | 1.614 (9) |
Si2—O3i | 1.617 (15) | O7—Si1iv | 1.655 (9) |
Si3—O1ii | 1.590 (16) | O8—Si2i | 1.602 (8) |
Si3—O1 | 1.591 (16) | O9—Si3v | 1.598 (12) |
Si3—O9 | 1.598 (11) | O10—Si4v | 1.631 (11) |
Si3—O4 | 1.628 (19) | ||
O3—Si1—O1 | 112.3 (9) | O9—Si3—O4 | 112.8 (11) |
O3—Si1—O6 | 111.2 (9) | O2ii—Si4—O2 | 112.8 (12) |
O1—Si1—O6 | 109.1 (9) | O2ii—Si4—O4 | 108.1 (7) |
O3—Si1—O7 | 107.2 (9) | O2—Si4—O4 | 108.1 (7) |
O1—Si1—O7 | 108.7 (8) | O2ii—Si4—O10 | 107.4 (7) |
O6—Si1—O7 | 108.2 (7) | O2—Si4—O10 | 107.4 (7) |
O2—Si2—O8 | 109.7 (6) | O4—Si4—O10 | 113.0 (11) |
O2—Si2—O5 | 107.7 (9) | Si3—O1—Si1 | 152.5 (12) |
O8—Si2—O5 | 111.1 (8) | Si2—O2—Si4 | 147.4 (10) |
O2—Si2—O3i | 109.6 (9) | Si1—O3—Si2i | 155.9 (13) |
O8—Si2—O3i | 110.4 (8) | Si3—O4—Si4 | 170.9 (14) |
O5—Si2—O3i | 108.3 (9) | Si2—O5—Si2iii | 148.4 (14) |
O1ii—Si3—O1 | 111.0 (13) | Si1iii—O6—Si1 | 150.8 (14) |
O1ii—Si3—O9 | 108.0 (8) | Si1—O7—Si1iv | 147.0 (14) |
O1—Si3—O9 | 108.0 (8) | Si2i—O8—Si2 | 180.0 |
O1ii—Si3—O4 | 108.5 (8) | Si3—O9—Si3v | 144.4 (17) |
O1—Si3—O4 | 108.5 (8) | Si4—O10—Si4v | 142.4 (15) |
Symmetry codes: (i) −x+1/2, −y+1/2, −z+1; (ii) x, y, −z+1/2; (iii) x, y, −z+3/2; (iv) x, −y+1, −z+1; (v) −x, y, −z+1/2. |
O96Si48 | V = 2798.9 (10) Å3 |
Mr = 3022.66 | Z = 1 |
Orthorhombic, Cmcm | F(000) = 470 |
a = 18.110 (4) Å | Dx = 1.793 Mg m−3 |
b = 20.530 (4) Å | µ = 0.000 mm−1 |
c = 7.5280 (16) Å | T = 293 K |
Jeol JEM-2100-LaB6 diffractometer | Rint = 0.088 |
Radiation source: electron microscope | θmax = 0.9°, θmin = 0.1° |
Continuous rotation electron diffraction scans | h = −22→22 |
5244 measured reflections | k = −25→25 |
1585 independent reflections | l = −9→9 |
1140 reflections with I > 2σ(I) |
Refinement on F2 | 0 restraints |
Least-squares matrix: full | w = 1/[σ2(Fo2) + (0.2P)2] where P = (Fo2 + 2Fc2)/3 |
R[F2 > 2σ(F2)] = 0.160 | (Δ/σ)max = 0.006 |
wR(F2) = 0.448 | Δρmax = 0.24 e Å−3 |
S = 1.61 | Δρmin = −0.18 e Å−3 |
1585 reflections | Extinction correction: SHELXL-2014/7 (Sheldrick 2014), Fc*=kFc[1+0.001xFc2λ3/sin(2θ)]-1/4 |
96 parameters | Extinction coefficient: 508 (27) |
Geometry. All esds (except the esd in the dihedral angle between two l.s. planes) are estimated using the full covariance matrix. The cell esds are taken into account individually in the estimation of esds in distances, angles and torsion angles; correlations between esds in cell parameters are only used when they are defined by crystal symmetry. An approximate (isotropic) treatment of cell esds is used for estimating esds involving l.s. planes. |
x | y | z | Uiso*/Ueq | ||
Si1 | 0.19435 (17) | 0.42591 (15) | 0.5431 (4) | 0.0421 (10) | |
Si2 | 0.19691 (17) | 0.18957 (14) | 0.5440 (4) | 0.0404 (10) | |
Si3 | 0.0843 (2) | 0.3795 (2) | 0.2500 | 0.0379 (11) | |
Si4 | 0.08476 (19) | 0.2225 (2) | 0.2500 | 0.0368 (11) | |
O1 | 0.1220 (4) | 0.4100 (4) | 0.4267 (8) | 0.085 (2) | |
O2 | 0.1233 (3) | 0.1914 (3) | 0.4237 (9) | 0.0715 (19) | |
O3 | 0.2623 (4) | 0.3780 (3) | 0.4946 (9) | 0.0775 (19) | |
O4 | 0.0914 (6) | 0.2998 (4) | 0.2500 | 0.092 (4) | |
O5 | 0.1723 (5) | 0.1920 (5) | 0.7500 | 0.075 (3) | |
O6 | 0.1728 (5) | 0.4191 (5) | 0.7500 | 0.070 (2) | |
O7 | 0.2227 (5) | 0.5000 | 0.5000 | 0.066 (2) | |
O8 | 0.2500 | 0.2500 | 0.5000 | 0.088 (3) | |
O9 | 0.0000 | 0.4035 (6) | 0.2500 | 0.060 (3) | |
O10 | 0.0000 | 0.1982 (5) | 0.2500 | 0.055 (3) |
U11 | U22 | U33 | U12 | U13 | U23 | |
Si1 | 0.0500 (19) | 0.045 (2) | 0.0313 (16) | 0.0029 (12) | −0.0066 (11) | −0.0013 (12) |
Si2 | 0.0413 (19) | 0.050 (2) | 0.0299 (16) | 0.0056 (11) | −0.0026 (11) | 0.0014 (12) |
Si3 | 0.033 (2) | 0.048 (3) | 0.033 (2) | −0.0017 (15) | 0.000 | 0.000 |
Si4 | 0.0279 (19) | 0.052 (3) | 0.0309 (19) | 0.0027 (16) | 0.000 | 0.000 |
O1 | 0.068 (4) | 0.130 (6) | 0.058 (4) | −0.009 (4) | −0.023 (3) | −0.010 (4) |
O2 | 0.047 (3) | 0.114 (6) | 0.053 (3) | −0.002 (3) | −0.020 (2) | 0.018 (3) |
O3 | 0.079 (4) | 0.070 (5) | 0.083 (4) | 0.030 (3) | 0.002 (3) | −0.014 (3) |
O4 | 0.062 (5) | 0.060 (6) | 0.152 (12) | −0.004 (4) | 0.000 | 0.000 |
O5 | 0.057 (5) | 0.135 (9) | 0.031 (3) | 0.008 (4) | 0.000 | 0.000 |
O6 | 0.077 (5) | 0.096 (7) | 0.036 (3) | −0.013 (4) | 0.000 | 0.000 |
O7 | 0.070 (5) | 0.056 (5) | 0.072 (5) | 0.000 | 0.000 | 0.013 (4) |
O8 | 0.058 (5) | 0.087 (7) | 0.119 (8) | −0.015 (4) | −0.018 (5) | 0.031 (6) |
O9 | 0.033 (4) | 0.064 (6) | 0.083 (7) | 0.000 | 0.000 | 0.000 |
O10 | 0.028 (4) | 0.071 (7) | 0.066 (6) | 0.000 | 0.000 | 0.000 |
Si1—O1 | 1.610 (6) | Si4—O4 | 1.592 (10) |
Si1—O6 | 1.612 (4) | Si4—O2 | 1.613 (6) |
Si1—O3 | 1.617 (6) | Si4—O2ii | 1.613 (6) |
Si1—O7 | 1.638 (4) | Si4—O10 | 1.614 (5) |
Si2—O3i | 1.599 (6) | O3—Si2i | 1.599 (6) |
Si2—O8 | 1.604 (3) | O5—Si2iii | 1.615 (4) |
Si2—O2 | 1.612 (6) | O6—Si1iii | 1.612 (4) |
Si2—O5 | 1.615 (4) | O7—Si1iv | 1.638 (4) |
Si3—O9 | 1.605 (5) | O8—Si2i | 1.604 (3) |
Si3—O1 | 1.621 (6) | O9—Si3v | 1.605 (5) |
Si3—O1ii | 1.621 (6) | O10—Si4v | 1.614 (5) |
Si3—O4 | 1.642 (10) | ||
O1—Si1—O6 | 108.1 (4) | O1ii—Si3—O4 | 110.7 (4) |
O1—Si1—O3 | 111.9 (4) | O4—Si4—O2 | 111.2 (4) |
O6—Si1—O3 | 110.5 (5) | O4—Si4—O2ii | 111.2 (4) |
O1—Si1—O7 | 109.6 (4) | O2—Si4—O2ii | 108.3 (6) |
O6—Si1—O7 | 110.4 (4) | O4—Si4—O10 | 112.3 (6) |
O3—Si1—O7 | 106.4 (4) | O2—Si4—O10 | 106.9 (4) |
O3i—Si2—O8 | 110.9 (3) | O2ii—Si4—O10 | 106.9 (4) |
O3i—Si2—O2 | 107.5 (4) | Si1—O1—Si3 | 150.2 (6) |
O8—Si2—O2 | 111.2 (3) | Si2—O2—Si4 | 145.3 (5) |
O3i—Si2—O5 | 109.2 (5) | Si2i—O3—Si1 | 157.0 (6) |
O8—Si2—O5 | 109.8 (4) | Si4—O4—Si3 | 171.2 (7) |
O2—Si2—O5 | 108.1 (4) | Si2iii—O5—Si2 | 147.7 (7) |
O9—Si3—O1 | 106.3 (4) | Si1—O6—Si1iii | 150.2 (6) |
O9—Si3—O1ii | 106.3 (4) | Si1iv—O7—Si1 | 143.5 (6) |
O1—Si3—O1ii | 110.3 (6) | Si2i—O8—Si2 | 180.0 |
O9—Si3—O4 | 112.4 (6) | Si3v—O9—Si3 | 144.2 (9) |
O1—Si3—O4 | 110.7 (4) | Si4—O10—Si4v | 144.1 (8) |
Symmetry codes: (i) −x+1/2, −y+1/2, −z+1; (ii) x, y, −z+1/2; (iii) x, y, −z+3/2; (iv) x, −y+1, −z+1; (v) −x, y, −z+1/2. |
Funding information
The following funding is acknowledged: Swiss National Science Foundation (award No. 165282; award No. 177761); Knut and Alice Wallenberg Foundation (award No. 3DEM-NATUR).
References
Abadi, M. et al. (2015). TensorFlow, https://www.tensorflow.org/. Google Scholar
Arndt, U. W. & Wonacott, A. J. (1977). Rotation Method in Crystallography. Amsterdam: North Holland. Google Scholar
Capitani, G. C., Oleynikov, P., Hovmöller, S. & Mellini, M. (2006). Ultramicroscopy, 106, 66–74. Web of Science CrossRef Google Scholar
Chollet, F. (2015). Keras: The Python Deep Learning Library, https://keras.io/. Google Scholar
Clabbers, M. T. B., van Genderen, E., Wan, W., Wiegers, E. L., Gruene, T. & Abrahams, J. P. (2017). Acta Cryst. D73, 738–748. Web of Science CrossRef IUCr Journals Google Scholar
Dierksen, K., Typke, D., Hegerl, R., Koster, A. J. & Baumeister, W. (1992). Ultramicroscopy, 40, 71–87. CrossRef Web of Science Google Scholar
Gemmi, M., La Placa, M. G. I., Galanis, A. S., Rauch, E. F. & Nicolopoulos, S. (2015). J. Appl. Cryst. 48, 718–727. Web of Science CrossRef CAS IUCr Journals Google Scholar
Genderen, E. van, Clabbers, M. T. B., Das, P. P., Stewart, A., Nederlof, I., Barentsen, K. C., Portillo, Q., Pannu, N. S., Nicolopoulos, S., Gruene, T. & Abrahams, J. P. (2016). Acta Cryst. A72, 236–242. Web of Science CrossRef IUCr Journals Google Scholar
Hahnloser, R. H. R., Sarpeshkar, R., Mahowald, M. A., Douglas, R. J. & Seung, H. S. (2000). Nature, 405, 947–951. CrossRef Google Scholar
Hattne, J., Reyes, F. E., Nannenga, B. L., Shi, D., de la Cruz, M. J., Leslie, A. G. W. & Gonen, T. (2015). Acta Cryst. A71, 353–360. Web of Science CrossRef IUCr Journals Google Scholar
Hirshfeld, F. L. (1976). Acta Cryst. A32, 239–244. CrossRef IUCr Journals Web of Science Google Scholar
Kabsch, W. (2010). Acta Cryst. D66, 125–132. Web of Science CrossRef CAS IUCr Journals Google Scholar
Knudsen, E. B., Sørensen, H. O., Wright, J. P., Goret, G. & Kieffer, J. (2013). J. Appl. Cryst. 46, 537–539. Web of Science CrossRef CAS IUCr Journals Google Scholar
Kolb, U., Gorelik, T., Kübel, C., Otten, M. T. & Hubert, D. (2007). Ultramicroscopy, 107, 507–513. Web of Science CrossRef PubMed CAS Google Scholar
Köppen, M., Meyer, V., Ångström, J., Inge, A. K. & Stock, N. (2018). Cryst. Growth Des. 18, 4060–4067. Google Scholar
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W. & Jackel, L. D. (1989). Neural Comput. 1, 541–551. CrossRef Google Scholar
Lutz, M. & Schreurs, A. M. M. (2012). LOGLOG and ANAFCF. Utrecht University, The Netherlands. Google Scholar
Meier, W. (1961). Z. Kristallogr. 115, 439–450. CrossRef Google Scholar
Mugnaioli, E., Gorelik, T. & Kolb, U. (2009). Ultramicroscopy, 109, 758–765. Web of Science CrossRef PubMed CAS Google Scholar
Mugnaioli, E. & Kolb, U. (2013). Microporous Mesoporous Mater. 166, 93–101. Web of Science CrossRef CAS Google Scholar
Nannenga, B. L., Shi, D., Leslie, A. G. W. & Gonen, T. (2014). Nat. Methods, 11, 927–930. Web of Science CrossRef CAS PubMed Google Scholar
Nederlof, I., van Genderen, E., Li, Y.-W. & Abrahams, J. P. (2013). Acta Cryst. D69, 1223–1230. Web of Science CrossRef CAS IUCr Journals Google Scholar
Nickolls, J., Buck, I., Garland, M. & Skadron, K. (2008). Queue, 6, 40–53. CrossRef Google Scholar
Perez, F. & Granger, B. E. (2007). Comput. Sci. Eng. 9, 21–29. CrossRef Google Scholar
Sheldrick, G. M. (2008). Acta Cryst. A64, 112–122. Web of Science CrossRef CAS IUCr Journals Google Scholar
Sheldrick, G. M. (2015). Acta Cryst. C71, 3–8. Web of Science CrossRef IUCr Journals Google Scholar
Shi, D., Nannenga, B. L., Iadanza, M. G. & Gonen, T. (2013). eLife, 2, e01345. Web of Science CrossRef PubMed Google Scholar
Smeets, S., Ångström, J. & Olsson, C.-O. A. (2018). Steel Res. Int. https://doi.org/10.1002/srin.201800300. Google Scholar
Smeets, S. & Wan, W. (2017). J. Appl. Cryst. 50, 885–892. Web of Science CrossRef IUCr Journals Google Scholar
Smeets, S., Wang, B., Cichocka, M. O., Ångström, J. & Wan, W. (2017). Instamatic, https://doi.org/10.5281/zenodo.1090388. Google Scholar
Smeets, S., Zou, X. & Wan, W. (2018). J. Appl. Cryst. 51, 1262–1273. CrossRef IUCr Journals Google Scholar
Spek, A. L. (2009). Acta Cryst. D65, 148–155. Web of Science CrossRef CAS IUCr Journals Google Scholar
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I. & Salakhutdinov, R. (2014). J. Mach. Learn. Res. 15, 1929–1958. Google Scholar
Suloway, C., Pulokas, J., Fellmann, D., Cheng, A., Guerra, F., Quispe, J., Stagg, S., Potter, C. S. & Carragher, B. (2005). J. Struct. Biol. 151, 41–60. Web of Science CrossRef PubMed CAS Google Scholar
Thorn, A., Dittrich, B. & Sheldrick, G. M. (2012). Acta Cryst. A68, 448–451. Web of Science CrossRef CAS IUCr Journals Google Scholar
Vincent, R. & Midgley, P. A. (1994). Ultramicroscopy, 53, 271–282. CrossRef CAS Web of Science Google Scholar
Walt, S. van der, Colbert, S. C. & Varoquaux, G. (2011). Comput. Sci. Eng. 13, 22–30. Google Scholar
Walt, S. van der, Schönberger, J. L., Nunez-Iglesias, J., Boulogne, F., Warner, J. D., Yager, N., Gouillart, E., Yu, T. & scikit-image contributors (2014). PeerJ, 2, e453. Google Scholar
Wan, W., Sun, J., Su, J., Hovmöller, S. & Zou, X. (2013). J. Appl. Cryst. 46, 1863–1873. Web of Science CrossRef CAS IUCr Journals Google Scholar
Wang, B., Rhauderwiek, T., Inge, A. K., Xu, H., Yang, T., Huang, Z., Stock, N. & Zou, X. (2018). Chem. Eur. J. https://doi.org/10.1002/chem.201804133. Google Scholar
Wang, Y., Takki, S., Cheung, O., Xu, H., Wan, W., Öhrström, L. & Inge, A. K. (2017). Chem. Commun. 53, 7018–7021. Web of Science CrossRef Google Scholar
Winter, G., Waterman, D. G., Parkhurst, J. M., Brewster, A. S., Gildea, R. J., Gerstel, M., Fuentes-Montero, L., Vollmar, M., Michels-Clark, T., Young, I. D., Sauter, N. K. & Evans, G. (2018). Acta Cryst. D74, 85–97. Web of Science CrossRef IUCr Journals Google Scholar
Xu, H., Lebrette, H., Yang, T., Srinivas, V., Hovmöller, S., Högbom, M. & Zou, X. (2018). Structure, 26, 667–675. CrossRef Google Scholar
Yonekura, K., Kato, K., Ogasawara, M., Tomita, M. & Toyoshima, C. (2015). Proc. Natl Acad. Sci. 112, 3368–3373. Web of Science CrossRef CAS PubMed Google Scholar
Yun, Y., Zou, X., Hovmöller, S. & Wan, W. (2015). IUCrJ, 2, 267–282. Web of Science CrossRef CAS PubMed IUCr Journals Google Scholar
Zhang, D., Oleynikov, P., Hovmöller, S. & Zou, X. (2010). Z. Krist. Cryst. Mater. 225, 94–102. Google Scholar
This is an open-access article distributed under the terms of the Creative Commons Attribution (CC-BY) Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original authors and source are cited.