Macromolecular crystallography beamlines at the Canadian Light Source: building on success

The current capabilities of and future upgrade plans for the beamlines supporting structural biology at the Canadian Light Source are described.


Introduction
The Canadian Macromolecular Crystallography Facility (CMCF) operates two beamlines, CMCF-ID (08ID-1) and CMCF-BM (08B1-1), at the Canadian Light Source (Grochulski et al., 2011;Fodje et al., 2014). Located at the southeast corner of the facility (Fig. 1), both beamlines are moving towards full automation and now operate almost exclusively through remote access. About 70 crystallography groups are supported, including Canadian, American and international groups. The facility is dedicated to providing approximately 25% of the available beamtime to commercial projects and, at least on CMCF-ID, this is fully utilized primarily through remote control of the beamline or the mailin crystallography service, which is managed by a dedicated industrial team.
In 2016 the facility marked its tenth year of crystallography experiments, and 2017 saw the publication of the 1000th structure in the Protein Data Bank (https://www.rcsb.org/) as well as the 500th peer-reviewed publication using data collected at the facility. Now, after 13 years of successful operation, the facility is undergoing a series of upgrades aimed at increasing throughput and flux, while decreasing sample spot size, in order to support more challenging experiments that will include smaller sample sizes and serial crystallography using, for example, crystal-on-crystal chips or injectors.

CMCF-ID upgrade
The CMCF-ID upgrade secured Canada Foundation for Innovation (CFI) funding in 2015 to increase the beam flux, ISSN 2059-7983 reduce the beam focus size for micro-beam capabilities, improve the stability of the endstation and improve dataacquisition throughput.
The design philosophy was dictated by the inherent limitations of the CLS storage ring, especially the very large horizontal emittance. Therefore, a horizontally focusing mirror located close to the sample position was selected in order to maximize the demagnification ratio and provide a fixed horizontal focus at the sample. In the vertical direction, a secondary source and a dynamically focusing mirror close to the sample were chosen so that a variable vertical beam size of 5-50 mm could be achieved. To significantly increase the flux density of the beamline, the 1.5 m long in-vacuum undulator (IVU) will be replaced with a longer 3.8 m IVU (Research Instruments). The width of the undulator magnets were optimized such that the effect of transverse nonlinear field roll-off seen by the electron beam is negligible. In isolation, the relatively low field and short period of the undulator, compared with the wigglers in the storage ring, will not have a detrimental focusing effect. The optical layout of the beamline will be changed and the endstation will be replaced. The new optics will feature a double-crystal/multilayer monochromator (DCMM; Axilon) and three new mirror systems (FMB Oxford). The vertically and horizontally focusing mirrors act in a Kirkpatrick-Baez (KB) configuration; however, they are located in different vacuum chambers owing to space restrictions. The third mirror can be dynamically bent to adjust the beam focus to the requested pinhole size to maximize flux. All three mirrors have rhodium/iridium coatings, except for the first mirror, which also has a silicon stripe for higher harmonic rejection. The r.m.s. slope errors are 0.37, 0.78 and 0.15 mrad, respectively. Together with the new undulator, this will enable the beamline to achieve a focus spot size of 5 Â 55 mm with a photon flux of more than 10 13 photons s À1 or up to 5 Â 10 14 photons s À1 in the double multi-layer (DMM) mode (1% ÁE/E). In the DMM mode, the tunability of the monochromator is limited to the 7.2-10.4 keV range ( Table 1). The multilayer mirrors are arranged in series with the Si(111) crystals and will consist of two flat silicon substrates coated with 300 bilayers of Mo/B 4 C and bearing r.m.s. slope errors of 0.3 mrad. The new layout of the beamline is shown in Fig. 2 and the results of ray tracing are shown in Fig. 3. The configuration will allow the energy to be extended down to 5 keV, allowing the possibility of S-SAD work. A detailed technical design of the beamline and optics specifications will be published elsewhere.
The current PILATUS3 S 6M detector will be replaced with an EIGER X 9M detector, while the high-capacity ISARA automounter, which was installed in 2017, will continue to be a key component of the upgraded beamline.
In April 2019, the technical design report was completed. All major components have been procured and have either been received or are currently being received. The CMCF-ID beamline was closed for upgrades starting during the facility  Table 1 Specifications of the CMCF beamlines before and after the planned upgrades.
Flux estimates are shown for a ring current of 220 mA.

Figure 1
Schematic representation of the major components of the Canadian Light Source. The 2.9 GeV storage ring has a circumference of 170.88 m and currently operates with a maximum current of 220 mA. The horizontal emittance is approximately 22.7 nm rad, with a vertical emittance of 0.1017 nm rad. Operational beamlines which can support structural biology and biophysics projects include the Canadian Macromolecular Crystallography Facility (CMCF) and the BioMedical Imaging and Therapy (BMIT), Mid Infrared Spectromicroscopy (MID-IR) and Biological X-ray Absorption Spectroscopy (BioXAS) facilities.
shutdown period in spring 2020, at which time the installation of the new insertion device and other components began. Installation and commissioning are expected to last about six months, with an anticipated return to service in January 2021. A summary of the upgrade timeline is shown in Table 2. To alleviate the loss of beam time to users during this period, most experiments will be accommodated on the CMCF-BM beamline, which has also been revamped in preparation for the increased demand.

CMCF-BM upgrade
In the summer of 2019, the CMCF-BM beamline doublecrystal monochromator (DCM) was upgraded to include a double multi-layer monochromator (DMM), enabling a highflux mode. In a similar manner to the CMCF-ID beamline, the multilayers for the CMCF-BM beamline consist of two flat silicon substrates arranged in series with the Si(111) crystals and bear r.m.s. slope errors of 0.23 mrad. However, a coating of Ni 93 V 7 /B 4 C with 500 bilayers was chosen. The distances of the optical components and beamline did not change from the original design (Fodje et al., 2014). The DMM operates at a fixed energy of 8.157 keV, with a 0.37% ÁE/E energy bandpass. The DMM has already been commissioned and an 18-fold increase in flux over the DCM was observed at the sample. The high-flux mode is ideal for native experiments. Experiments requiring a higher energy resolution continue to be supported with the traditional Si(111) DCM. The high-flux mode has been available for use since September 2019. An example of a 1 s À1 frame from a thaumatin crystal is shown in Fig. 4. The diffraction patterns are readily analysed and integrated using the standard software pipeline already available at the beamline. Initial comparisons of both modes show that similar or better quality native data can be obtained for the same crystal at the same wavelength (Table 3). A more detailed comparative analysis will be described in a future publication.
To complement the faster collection times that are now possible on the beamline, the efficiency of the Stanford Optical layout of the planned CMCF-ID beamline. Absolute distances of the main components from the centre of the straight section of the ring are also included Automated Mounter (SAM) has been increased to become more comparable with the ISARA automounter at CMCF-ID.
The software updates on the SAM automounter now support a duty cycle of as low as 25 s (previously 2.5 min). Also, the PILATUS3 S 6M detector from CMCF-ID will be permanently moved to CMCF-BM, while CMCF-ID is equipped with the new EIGER X 9M detector.

Computing and software
Data acquisition, automated data processing, sample information management and data access are supported through the MxDC, MxLIVE and AutoProcess software packages developed in-house (Fodje et al., 2012). In 2019, the computing and storage infrastructure was upgraded to provide more storage capacity with faster access. Specifically, the storage server was upgraded from an 18 Tb RAID system with spinning discs connected through a 4 Gbps network to a 45 Tb SSD RAID system with 20 Gbps network access. Also, the ten-year-old 96-core compute cluster for data analysis was upgraded to more recent hardware with faster processors, providing a total of 336 cores. New versions of MxDC and MxLIVE were deployed to support the new capabilities.
Raw data collected at CMCF beamlines are stored under users' personal accounts on a network file system and are backed up in real time on the upgraded storage server. Files are maintained at the CMCF for as long as data-storage limitations allow, which is typically up to one year. Data downloads are facilitated through users' MxLIVE accounts.
Remote control of the beamlines is provided through the NoMachine client. Dedicated NoMachine servers for each beamline accept connections from a list of allowed users which is managed through MxLIVE. These connections provide the user with a desktop identical to that of a physical computer at the beamline, with full access to the CMCF computing infrastructure.
Demand for remote access in Canada has only grown since the first remote experiments were completed in 2011, and now accounts for about 85% of user access. Roughly 70% of remote-access experiments are completed through Result of ray-tracing for the CMCF-ID upgrade performed at 12 keV. Top, beam divergence; bottom, focus spot size at the sample position. remote control, with the remaining 30% going through the mail-in crystallography service.

Industrial usage of the CMCF beamlines
Over the past five years, industrial usage of the CMCF sector has seen a steady increase in the number of industrial clients from several sectors of industry. The usage of the CMCF-ID beamline has increased from 24% in 2015 to nearly 35% in 2020. A similar trend has been observed for the CMCF-BM beamline, where industrial usage grew from 5% to 11%. The majority of industrial users of the CMCF beamlines are represented by the United States (65%), followed by China (15%), Canada (10%) and the EU (10%).
Industrial access to the CMCF sector comprises two modes of access: remote control and mail-in. In 2020 nearly 55% of industry-allocated beam time was used by remote users and over 45% used mail-in access to the facility. Not surprisingly, most of the CMCF-ID allocated shifts were used by pharmaceutical industry clients, while CMCF-BM was largely used by environmental and material science clients. Of the CMCF-BM shifts used by industry, 18% were devoted to the pharmaceutical industry, 35% to environmental science and 47% to material science.

Scientific outcomes and training
Over the years, the CMCF has seen the publication of over 700 peer-reviewed articles containing data collected at the facility, as well as over 1300 PDB depositions, 11 patents or patent applications and more than 150 Masters and PhD theses. The transition from researchers having to come onsite to collect data to data collection via remote control of the beamlines has been largely facilitated by the annual CLS Mx Data Collection School. This event is hosted by CMCF staff and takes place at the Canadian Light Source, normally during a week in the spring or summer months. A series of lectures, as well as hands-on exercises, allow participants to be actively engaged in data collection while experiencing synchrotron-facility life first-hand. Crystallographers from the University of Saskatchewan support the school by mentoring participants during one-on-one data-collection sessions during their stay. Since 2010, the school has played a key role in the training of over 200 new crystallographers and has provided an opportunity for aspiring crystallographers to meet and establish new connections that are important for their careers.

Other beamlines
Other beamlines at the Canadian Light Source that support structural biology projects include the Mid Infrared Spectromicroscopy (Mid-IR; May et al., 2007), Biological X-ray  Table 3 Data-collection statistics for a thaumatin test crystal comparing the DCM [Si(111)] and DMM (multi-layer) modes.
Owing to the much higher flux for the DMM mode, the lowest available transmission of 10% was used for comparison. Statistics for the highest resolution shell are shown in parentheses. The data were processed using XDS (Kabsch, 2010) and data quality was assessed using Phenix (Liebschner et al., 2019).
Si (111) Figure 4 1 s À1 diffraction pattern from a thaumatin crystal using a 100 mm aperture in high-flux mode on CMCF-BM.
Absorption Spectroscopy (BioXAS; Grochulski et al., 2017) and Biomedical Imaging and Therapy (BMIT; Wysokinski et al., 2013) beamlines. The Mid-IR beamline is a state-of-the-art Fourier-transform IR spectrometer and microscope which provides diffraction-limited spatial resolution to an everwidening range of infrared spectromicroscopy experiments. The BioXAS beamline can perform extended X-ray absorption fine structure (EXAFS) experiments on 3-4 p.p.m. solid samples and millimolar solutions, and also supports multiresolution X-ray fluorescence imaging on biological samples. Additionally, BMIT can perform X-ray computed tomography (CT) measurements at various spatial and temporal scales. Phase-enhanced imaging, multi-contrast imaging and K-edge subtraction and spectral imaging are also supported.

Conclusion
We here report on recent advances at the macromolecular crystallography beamlines of the Canadian Light Source. Since 2006, the CMCF has become an integral part of the Canadian macromolecular crystallographic community, playing an important role in the development of a new generation of crystallographers through its annual CLS Mx Data Collection School, with over 200 trainees so far and over 150 graduate-level theses. The facility has also attracted the attention of industry, successfully retaining a client base that routinely makes use of up to 30% of available beamtime. The upgrade of CMCF-BM is complete and has enabled a sixfold decrease in the automounter duty-cycle time and an 18-fold increase in the photon flux at 8.15 keV using multi-layer optics. Initial data sets revealed that despite the higher energy bandwidth, the multi-layer optics produce similar or better quality data sets when compared with the Si(111) optics at the same energy. The CMCF-ID upgrade is still in progress but is expected to be completed by 2021. The updated CMCF-ID will enable high-flux micro-beam capabilities at the Canadian Light Source and these developments will allow the facility to effectively handle more challenging samples from a growing Canadian structural biology community.