US 20130147916A1 19 United States 12 Patent Application Publication 10 Pub No US 2013 0147916 A1 43 Pub Date Bennett et al 54 Jun 13 2013 Related US Application Data MICROSCOPY SYSTEM AND METHOD FOR CREATING THREE DIMENSIONAL IMAGES USING PROBE MOLECULES 60 Provisional application No 61 161 345 led on Mar 18 2009 provisional application No 61 177 701 led on May 13 2009 Publication Classi cation 75 Inventors Brian Thomas Bennett Park City UT US Joerg BeWersdorf Branford CT US Erik Jorgensen Salt Lake City 51 UT US Sam Hess StillWater ME US Travis Gould New Haven CT 52 USPC Orono ME US Assignee UNIVERSITY OF UTAH 21 Appl NO 22 86 PCT Flled _ PCT NO 371 c 1 Mar 18 2010 2 4 Date Apr 11 2012 348 46 sample is mounted on a stage 160 The sample has a plural ity of probe molecules The sample is illuminated With light causing the probe molecules to luminesce The probe lumi 13 257 588 _ 57 ABSTRACT A system 100 and method for creating three dimensional images using probe molecules is disclosed and described A RESEARCH FOUNDATION _ 2006 01 CPC G02B 21 367 2013 01 US Mudalige Siyath GuneWardene 73 Int Cl G02B 21 36 US Cl nescence can be split into at least four paths corresponding to at least four detection planes corresponding to object planes in the sample The at least four detection planes are detected via a camera 155 Object planes in corresponding recorded regions of interest are recorded in the camera 155 A signal PCT Us10 27866 from the regions of interest is combined into a three dimen sional image 112 1 14 100 1 1O 1 16 120 AOTF Com uter p 561 nm 132 145b 175 2 1400 140d 150 170 155 105 160
US 20130147916A1   19  United States  12  Patent Application Publication  10  Pub. No.  US 2013 0147916 A1  43  Pub. Date ...
Patent Application Publication Jun 13 2013 Sheet 1 0f 9 US 2013 0147916 A1 112 100 Computer 145b 175 1 W150 170 155 105 FIG 1
Patent Application Publication  Jun. 13, 2013 Sheet 1 0f 9  US 2013 0147916 A1  112  100  Computer  145b  175  1   W150 17...
Patent Application Publication Jun 13 2013 Sheet 2 0f 9 US 2013 0147916 A1 101 Computer 140d1 105 FIG 2 170
Patent Application Publication  Jun. 13, 2013 Sheet 2 0f 9  US 2013 0147916 A1  101  Computer  140d1 105  FIG. 2  170
Patent Application Publication Jun 13 2013 Sheet 3 0f 9 160 FIG 3 US 2013 0147916 A1
Patent Application Publication  Jun. 13, 2013 Sheet 3 0f 9  160  FIG. 3  US 2013 0147916 A1
Patent Application Publication Jun 13 2013 Sheet 4 0f 9 US 2013 0147916 A1 125a 18Gb i p u 170a g N 1 140a f 55a 5 i 1 145a 150a 14Ob V 140e 1608 FIG 4 5 145b 185 _ 132
Patent Application Publication  Jun. 13, 2013 Sheet 4 0f 9  US 2013 0147916 A1  125a 18Gb      -  i p .      u  170a     g...
Patent Application Publication Jun 13 2013 Sheet 5 0f 9 155 I 105 5 US 2013 0147916 A1 160 FIG 5
Patent Application Publication  Jun. 13, 2013 Sheet 5 0f 9  155  I  105  5  US 2013 0147916 A1  160 FIG. 5
Patent Application Publication Jun 13 2013 Sheet 6 0f 9 US 2013 0147916 A1 127 lu132a 1 11 150a 1608 FIG 6 145b 185
Patent Application Publication  Jun. 13, 2013 Sheet 6 0f 9  US 2013 0147916 A1  127  lu132a  1 11  150a  1608  FIG. 6  145...
Patent Application Publication Jun 13 2013 Sheet 7 0f 9 160 132 140d 155 1452140 125 170 150 132b 145b 1408 170 FIG 7 US 2013 0147916 A1
Patent Application Publication  Jun. 13, 2013 Sheet 7 0f 9  160  132  140d  155  1452140 125  170  150  132b  145b  1408  ...
Patent Application Publication Jun 13 2013 Sheet 8 0f 9 160 132 145b 1400 0 140d 175 LIV 170 L 150 132a 170 FIG 8 US 2013 0147916 A1
Patent Application Publication  Jun. 13, 2013 Sheet 8 0f 9  160  132 145b 1400  0  140d 175  LIV  170  L  150 132a  170  F...
Patent Application Publication Jun 13 2013 Sheet 9 0f 9 Vaccuum pumps US 2013 0147916 A1 L g Electron gun _ Condenser lenses Scanning Electron H Microscope I I Pl OjGCtlO i aperture Scan coils Backscatter electron detector Cover slip Inverted Fluorescence Microscope Detector Fluorescence SOU rce FIG 9
Patent Application Publication  Jun. 13, 2013 Sheet 9 0f 9  Vaccuum pumps  US 2013 0147916 A1  L  g  Electron gun  _  Cond...
US 2013 0147916A1 Jun 13 2013 MICROSCOPY SYSTEM AND METHOD FOR CREATING THREE DIMENSIONAL IMAGES USING PROBE MOLECULES activated and hence imaged at any time by a sensitive cam era This alloWs spatial separation of the diffraction limited FIELD OF THE INVENTION racy typically in the 10 nm range standard deviation 0 By intensity distributions of practically every uorescing mol ecule and localiZation of individual uorophores With accu 0001 This invention relates to microscopy More speci cally the invention relates to super resolution microscopy and the creation of three dimensional images obtainable there With Therefore the present invention relates generally to the elds of physics optics chemistry and biology BACKGROUND 0002 Until about a decade ago resolution in far eld light microscopy Was thought to be limited to 200 250 nanometers in the focal plane concealing details of sub cellular structures and constraining its biological applications Breaking this diffraction barrier by the seminal concept of stimulated emis sion depletion STED microscopy has made it possible to image biological systems at the nanoscale With light STED microscopy and other members of reversible saturable optical uorescence transitions RESOLFT family achieve a resolution l0 fold beyond the diffraction barrier by engi neering the microscope s point spread function PSF through optically saturable transitions of the uorescent probe molecules 0003 HoWever sloW progress in 3D super resolution imaging has limited the application of prior art techniques to two dimensional 2D imaging The best 3D resolution until recently had been 100 nanometers axially at conven tional lateral resolution 4 Pi microscopy achieved this through combination of tWo objective lens of high numerical aperture in an interferometric system 4 Pi microscopy Was only recently shoWn to be suitable for biological imaging Only lately the rst 3D STED microscopy images have been published exceeding this resolution moderately With 139 nanometer lateral and 170 nanometer axial resolutions While this represents a 5 fold smaller resolvable volume than pro vided by conventional microscopy it is still at least l0 fold larger than a large number of sub cellular components such as synaptic vesicles for example A more recent development achieves 3D resolution beloW 50 nm in all 3 directions by combining STED With 4 Pi microscopy 0004 To measure dynamic properties of a biological sys tem particle tracking techniques have been developed over the last decades Particle tracking techniques can localiZe small objects typically less than the diffraction limit in live cells With sub diffraction accuracy and track their movement over time by taking a time series of recordings Single par ticles are imaged conventionally With or Without total inter nal re ection illumination or in a multi plane arrangement Every particle produces a diffraction limited image By deter mining the center of the blurry image the Width of the inten sity distribution is equivalent to the spatial resolution of the microscope the position of the particle can be determined The spatial localiZation accuracy of single particles in a uo rescence microscope is the square root of the total number of detected uorescence photons from the particle in the absence of background and effects due to nite pixel siZe 0005 Recently this concept has also entered the emerging eld of super resolution microscopy In techniques such as FPALM PALM STORM or PALMIRA biological samples are labeled by photoactivatable uorescent mol ecules Only a sparse distribution of single uorophores is bleaching or deactivating the uorescing molecules during the read out process and simultaneously activating additional uorophores a large fraction of the probe molecules are imaged over a series of many image frames A super resolved image at typically 20 30 nm resolution measured as the FWHM of a distribution 2 4o is nally assembled from the determined single molecule positions 0006 Recently particle tracking of sub cellular uores cent components and localiZation based super resolution microscopy techniques have advanced from a tWo dimen sional 2D imaging method to the third dimension Local iZation in the Z direction is complicated by the fact that cam era images are 2D Different Z positions do not result in easily detectable shifts of the center of mass as it is in the 2D case The axial position has to be deduced from the defocused 2D intensity distributions taking the complex dependence of the focal intensity distribution in the axial direction into account Analyzing the diameter of the rings appearing in the defo cused images for example alloWs conclusions on its Z posi tion A major obstacle is the axial symmetry of the intensity distribution in a perfect microscope for an observed 2D image an axial position of Z0 is equally possible as ZO To break this symmetry multi plane detection has been devel oped 0007 Recording images in different focal planes simulta neously provides means to determine the axial position of a particle uniquely This multi plane detection approach has successfully been used in slightly varying arrangements to track particles doWn to single quantum dots Within cells and has been recently applied to localiZation based 3D super resolution microscopy 0008 The context of morphology and movement of a bio logical particle or structure With regard to other structures in a cell can be of high importance To measure this typically multiple labels marking different structures for example tWo different proteins by different photo physical properties usually tWo different uorescence colors are imaged Multi color recordings are used in super resolution microscopy as Well as in particle tracking 0009 In super resolution microscopy and particle track ing small structures featuring only a small number of labels often only single uorescent molecules are observed Back ground suppression is therefore of high importance An often applied method in 2D particle tracking and 2D super resolu tion microscopy is illumination at an angle at Which the light experiences total internal re ection at the coverslip specimen interface The light in this total internal re ection micros copy TIRF mode can in this case only penetrate on the order of 70 to 200 nm into the specimen depending on an adjust able incidence angle and no background light can be created in planes beyond this depth range therefore reducing the amount of light penetration into the sample dramatically SUMMARY 0010 There is a need for a microscopy system that can provide 3D imaging With resolution beloW 100 nanometers in all three dimensions The inventors have recogniZed a need for a microscopy system that can be used for three dimen sional imaging Without scanning In light of the problems and
US 2013 0147916A1  Jun. 13,2013  MICROSCOPY SYSTEM AND METHOD FOR CREATING THREE DIMENSIONAL IMAGES USING PROBE MOLECULES ...
US 2013 0147916A1 de ciencies noted above microscopy systems and methods for creating three dimensional images using probe molecules is described In accordance With one embodiment a method is provided for creating three dimensional images using probe molecules A sample having a plurality of probe molecules may be mounted on a stage The sample may be illuminated With light to cause probe luminescence The probe lumines cence may be split into at least four paths corresponding to at least four detection planes corresponding to object planes in the sample The at least four detection planes are detected via a camera Alternatively the probe luminescence can be split into at least tWo detectionplanes corresponding to at least tWo object planes in the sample For example a four channel Jun 13 2013 sample With the light source A camera can be used to capture a rst image of probe molecule uorescence corresponding to a rst object plane The light beam from the light source can be directed through a second portion of the objective lens Which is different from the rst portion At least one of the rst and second portions of the objective lens can cause total internal re ection of the light beam Within a material spatially proximal to or including the sample on a substrate A second image of probe molecule uorescence corresponding to a second object plane can be captured using the camera A three dimensional image can then be constructed using the cap tured images 0014 There has thus been outlined rather broadly the con guration can offer three of more colors or tWo colors and more important features of the invention so that the detailed polarization Which can optionally use a single focal plane description thereof that folloWs may be better understood Object planes in corresponding recorded regions of interest are recorded in the camera A signal from the regions of interest can be combined and analyZed to produce a three dimensional image 0011 According to one embodiment a microscopy sys and so that the present contribution to the art may be better appreciated Other features of the present invention Will become clearer from the folloWing detailed description of the invention taken With the accompanying draWings and claims or may be learned by the practice of the invention tem is con gured for creating three dimensional images using probe molecules The system includes a sample stage for mounting a sample The system also includes at least one light source con gured to cause luminescence in at least one subset of probe molecules At least tWo beam splitters are positioned to split a luminescence beam into at least four luminescence beams corresponding to at least one object plane and in one aspect at least tWo object planes At least one camera is positioned to detect the at least four luminescence beams and capture a plurality of images An image construction module is con gured to combine the plurality of captured images from the at least four luminescence beams and construct a BRIEF DESCRIPTION OF THE DRAWINGS 0015 The present invention Will become more fully apparent from the folloWing description and appended claims taken in conjunction With the accompanying draW ings Understanding that these draWings merely depict exem plary embodiments of the present invention and they are therefore not to be considered limiting of its scope It Will be readily appreciated that the components of the present inven tion as generally described and illustrated in the gures herein could be arranged siZed and designed in a Wide three dimensional image using the plurality of captured variety of different con gurations Nonetheless the invention Will be described and explained With additional speci city 0012 Which images Additional embodiments of systems and methods for creating three dimensional images using probe molecules are also provided For example a microscopy system for creating three dimensional images using probe molecules is provided The system includes a sample stage for mounting a sample having a plurality of probe molecules A light source can be used to illuminate the sample and cause the probe molecules to uoresce An objective lens in the system can direct a light beam from the light source toWard the sample A total internal re ection uorescence condenser can alter a beam path of the light beam betWeen a region proximal to a side of the objective lens back aperture and a region proximal to a center of the objective lens back aperture eg the path and position of the illuminationbeam to a set of conditions includ ing the beam striking a region proximal to the side of the objective lens and a condition Where the beam strikes a region proximal to center of the objective lens Images of probe molecule uorescence at a plurality of object planes can be captured via a camera positioned to capture or detect probe molecule uorescence The system can also include an image construction module for combining captured images from the plurality of object planes to construct a three dimensional image 0013 In accordance With another embodiment a method is provided for creating three dimensional images using probe and detail through the use of the accompanying draWings in 0016 FIG 1 is a microscopy system for creating three dimensional images using an acoustic optical tunable lter and a total internal re ection uorescence condenser in accor dance With one embodiment 0017 FIG 2 is a microscopy system for creating three dimensional images using an acoustic optical tunable lter a total internal re ection uorescence condenser and a dichroic beam splitter in accordance With one embodiment 0018 FIG 3 is a microscopy system for creating three dimensional images using a total internal re ection uores cence condenser in accordance With one embodiment 0019 FIG 4 is a microscopy system for creating three dimensional images using a dichroic beam splitter and a plurality of beam splitters in accordance With one embodi ment 0020 FIG 5 is a microscopy system for creating three dimensional images using a non coherent light source in accordance With one embodiment 0021 FIG 6 is a microscopy system for creating three dimensional images using a non coherent light source a dich roic beam splitter and a plurality of beam splitters in accor dance With one embodiment 0022 FIG 7 is a microscopy system for creating multi molecules A sample is mounted on a stage The sample can color three dimensional images on a single camera in accor have a plurality of probe molecules A light beam may be dance With one embodiment directed from a light source through a rst portion of an 0023 objective lens At least one subset of the plurality of probe molecules can be caused to uoresce by illuminating the plane three dimensional images on a single camera in accor dance With one embodiment and FIG 8 is a microscopy system for creating four
US 2013 0147916A1  de ciencies noted above, microscopy systems and methods for creating three dimensional images using pro...
US 2013 0147916A1 0024 FIG 9 is a microscopy system as described herein and as combined With a scanning electron microscope SEM in accordance With one embodiment Jun 13 2013 only the numerical values explicitly recited as the limits of the range but also to include all the individual numerical values or sub ranges encompassed Within that range as if each numerical value and sub range is explicitly recited For DETAILED DESCRIPTION 0025 The following detailed description of exemplary embodiments of the invention makes reference to the accom panying drawings Which form a part hereof and in Which are shoWn by Way of illustration exemplary embodiments in Which the invention may be practiced While these exemplary embodiments are described in su icient detail to enable those skilled in the art to practice the invention it should be under stood that other embodiments may be realiZed and that vari ous changes to the invention may be made Without departing from the spirit and scope of the present invention Thus the folloWing more detailed description of the embodiments of the present invention is not intended to limit the scope of the invention as claimed but is presented for purposes of illus tration only and not limitation to describe the features and characteristics of the present invention to set forth the best mode of operation of the invention and to su iciently enable one skilled in the art to practice the invention Accordingly the scope of the present invention is to be de ned solely by the appended claims DEFINITIONS 0026 In describing and claiming the present invention the folloWing terminology Will be used 0027 The singular forms a an and the include plu ral referents unless the context clearly dictates otherWise Thus for example reference to a beam splitter includes reference to one or more of such devices 0028 As used herein With respect to an identi ed property or circumstance substantially refers to a degree of devia tion that is su iciently small so as to not measurably detract from the identi ed property or circumstance The exact degree of deviation alloWable may in some cases depend on the speci c context 0029 As used herein the terms uorescence and lumi nescence may be used interchangeably and no distinction is intended or implied unless otherWise explicitly stated as such LikeWise variants of the terms uorescence and lumines cence such as luminesce or uoresce are also used synonymously 0030 As used herein proximal refers to the proximity of tWo structures or elements Particularly elements that are identi ed as being proximal may be in a precise location Such elements may also be near or close to a location Without necessarily being exactly at the location The exact degree of example a numerical range of about 1 to about 4 5 should be interpreted to include not only the explicitly recited limits of 1 to about 4 5 but also to include individual numerals such as 2 3 4 and sub ranges such as 1 to 3 2 to 4 etc The same principle applies to ranges reciting only one numerical value such as less than about 4 5 Which should be interpreted to include all of the above recited values and ranges Further such an interpretation should apply regardless of the breadth of the range or the characteristic being described 0033 In the present disclosure the term preferably or preferred is non exclusive Where it is intended to mean preferably but not limited to Any steps recited in any method or process claims may be executed in any order and are not limited to the order presented in the claims Means plus function or step plus function limitations Will only be employed Where for a speci c claim limitation all of the folloWing conditions are present in that limitation a means for or step for is expressly recited and b a corresponding function is expressly recited The structure material or acts that support the means plus function are expressly recited in the description herein Accordingly the scope of the inven tion should be determined solely by the appended claims and their legal equivalents rather than by the descriptions and examples given herein Creation of Three Dimensional Images Using Probe Molecules 0034 Simultaneous single molecule multi channel acquisition of photoactivatable or photosWitchable uores cent proteins in three dimensions can be achieved Without scanning The system utiliZes and is capable of sWitching betWeen TIRF microscopy and Biplane imaging microscopy This alloWs for an additional imaging detection channel as Will be described beloW In accordance With an embodiment shoWn in FIG 1 a microscopy system 100 is provided for three dimensional single color biplane imaging Without scanning A plurality oflasers such as 405 nm 112 488 nm 114 and 561 nm 116 can be used as light sources Other Wavelengths numbers of light sources and types of light sources can also be used Although speci c light sources may be mentioned herein other types of light sources can also be used to provide the functions of activation and readout as described herein The 405 nm laser or other lasers can be used to activate a subset of probe molecules A selected range of intensities can be used to convert only a sparse subset of proximity may in some cases depend on the speci c context molecules at a time e g to activate at least one molecule With at least one activation photon Although poWers can vary a 0031 As used herein a plurality of items structural ele ments compositional elements and or materials may be pre poWer ranging from about 0 01 nW to 1 0 mW can be suitable in some cases The poWer used can depend on the particular sented in a common list for convenience HoWever these lists should be construed as though each member of the list is probe molecules and sample characteristics The 488 nm laser is used to detect photoconvertible uorescent probes in a natural state prior to conversion The photoconvertible uo rescent probes can exist as green probe molecules prior to conversion The 561 nm laser has a high poWer and Will individually identi ed as a separate and unique member Thus no individual member of such list should be construed as a de facto equivalent of any other member of the same list solely based on their presentation in a common group Without indications to the contrary immediately folloWing conversion by the 405 nm laser excite the converted uorescent probe subsequently providing for 0032 collection of excitation light by a CCD camera 155 The Concentrations amounts and other numerical data may be presented herein in a range format It is to be under stood that such range format is used merely for convenience and brevity and should be interpreted exibly to include not uorescent probe can subsequently undergo photobleaching thus removing the probe from the population This process combined With irreversible sWitchable uorescent probes
US 2013 0147916A1   0024  FIG. 9 is a microscopy system as described herein and as combined With a scanning electron micro...
US 2013 0147916A1 Jun 13 2013 disalloWs further imaging of these molecules Typically high used as described above The lasers can be useful in conver power from the laser can be used to decrease the overall time of the process Generally a minimum of 25 mW may be considered LoWer poWers can be used Which may increase sion of photoactivatable molecules All three laser lines can be simultaneously delivered to the system in an automated and attenuable manner through existing softWare Optics image acquisition time Use of a very high poWered 561 nm laser eg 200 mW for example can result in a considerably more rapid process of excitation collection and bleaching of the microscope set up than may result from a loWer poWered laser or light source tiplying charge coupled device EMCCD 155 In one alter 0035 Although other probe molecules may be suitable the probe molecules used herein can generally be uoro phores The uorophores can be imaged either sequentially or simultaneously The system can include a uorophore local iZation module con gured to localiZe each uorophore in three dimensions The sample can include cells having pho toactivatable or photosWitchable uorescent molecules PAFMs residing in a biological membrane including pho toactivatable or photosWitchable uorescent proteins or pho toactivatable or photosWitchable uorescent lipids or lipids With photoactivatable or photosWitchable uorescent mol ecules attached by a chemical bond In one example the chemical bond can be a covalent bond In one optional aspect the cells can include at least tWo species of PAFMs to alloW simultaneous or subsequent imaging of at least tWo different subsets of materials The PAFM may be con gured to use Forster resonance energy transfer FRET to transfer energy to another probe molecule or to accept energy from another molecule Broadly the PAFM can be an energy transfer donor or an energy transfer acceptor 0036 An acoustic optical tunable lter AOTF 120 con trollable through softWare provides the ability to properly attenuate multiple light sources simultaneously and control the e iciency of activation excitation and bleaching For example a 488 nm laser line alloWs one to image or locate photoactivatable uorescence proteins prior to conversion by the 405 nm laser from a visibly green uorescence to red uorescence TheAOTF can also control the angle or position of the excitation Within the objective back aperture 0037 The AOTF can provide external control of light source intensity for modulating the light beam The AOTF can also be used to control the direction or position of the light beam Software can be used to control the AOTF to vary illumination intensity direction or position of the light sources independently of any other lters The AOTF can be con gured to control the light sources to provide time depen dent sequences of illumination of at least one Wavelength An optical ber can connect the light source to the AOTF An optical ber combiner can combine the optical poWer carried by tWo optical bers such as from a plurality of light sources into a single output ber The system can also use a total internal re ection uorescence TIRF condenser 125 With existing laser lines The condenser can include an enclosed box containing a pieZo driven motor alloWing sWitching from the critical angle required for TIRF to regular illumination Which can penetrate the sample completely and back again 0038 140a d can be added in both the excitation and detection paths 0039 The CCD camera can optionally be an electron mul native aspect the camera system can comprise a plurality of cameras An optional external liquid cooler can be used to cool the EMCCD The liquid cooler can use thermoelectric cooling to cool the EMCCD The EMCCD can include at least tWo detection channels The camera can capture images from a transmitted light channel In one aspect the transmit ted light can be imaged by differential interference contrast The camera can capture images of one or more molecules at a single instant or as a function of time The system can include a particle analysis module in communication With the camera and con gured to provide analysis of particle track ing Photoactivatable dyes Within a sample can be activated With UV activation The dyes can be excited to uoresce by 488 nm or 561 nm light and then bleached The system and method alloW for collection of a dye in three dimensional space over approximately 1 to 2 micron thickness of a sample Without scanning 0040 An optical beam splitter 150 is included to split an optical beam typically Within the detection path into tWo beams For example the beam splitter can be a 50 50 beam splitter or a polarizing beam splitter Splitting the beam cre ates tWo beams focused in different planes so that different object planes of a sample can be imaged or rather probe luminescence from the sample originating from different object planes is focused onto the camera and detected and or captured by the camera Images from the different object planes can be used to create three dimensional images using softWare rmWare or even hardWare Splitting the beam With the beam splitter can result in tWo beams having different optical path lengths The difference in optical path length can be utiliZed to image the sample at multiple different object planes 0041 The system can include a plurality of mirrors 130a b 132 to direct a light beam along the light path as illustrated The various optics apertures beam splitters and so forth used in the system can be installed on a construction rail 165 or a micro dovetail rail 170 as shoWn in FIG 1 The system can be set up on a table 105 or other surface and may also include a computer 110 having a processor con gured to process data and operate the softWare 0042 Referring to FIG 2 a microscopy system 101 is shoWn Which is similar in many regards to the system of FIG 1 HoWever FIG 2 includes a dichroic beam splitter 185 for separating tWo Wavelengths of a light beam Each Wavelength light beam can further be separated by a corresponding 50 50 beam splitter 150 15011 Additional optics 140e mirrors Still referring to FIG 1 a TIRF condenser 125 132a micro dovetail rails 170a cameras 155a etc can also Which may in some cases be located in a microscope stand 160 can be removed to facilitate the use of a eld aperture 14511 in the excitation pathWay The CCD camera 155 can be removed from the microscope stand to accommodate the use of a 50 50 beam splitter 150 to achieve the 3 dimensional be optionally used to accommodate and capture the additional beams In this manner four beams and four beam paths are created The system and method alloW for three dimensional aspect separation of a transmitted and re ected light path of biplane image acquisition Also a eld aperture 145 and taneous UV activation Further these tWo noW sWitched e g simultaneous tWo color biplane imaging Without scanning TWo photoactivatable dyes Within a sample can receive simul band pass lter 175 can be included betWeen the CCD camera activated dyes can be simultaneously excited Cameras 155 15511 are used to substantially simultaneously collect images and the microscope stand Three lasers 112 114 116 can be of or luminescence from the 2 dyes in three dimensional space
US 2013 0147916A1  Jun. 13,2013  disalloWs further imaging of these molecules. Typically, high  used, as described above. ...
US 2013 0147916A1 over approximately 1 to 2 microns of depth Without scanning Though the example of FIG 2 illustrates the creation of four beams along four different beam paths it is to be understood that the beams may in fact be split any number of times using any suitable combination of beam splitters For example the beam may be split into eight different beam paths Which may be separated by Wavelength polarization etc Jun 13 2013 0045 FIG 3 shoWs the TIRF directing a light beam along a rst path toWards the microscope stand 160 including the sample location at center FIG 4 shoWs the TIRF directing the light beam toWards the microscope stand 16011 at an angle With respect to the rst path The vertical dotted line of FIG 4 denotes that the components to the right of the line are the same as shoWn in FIG 2 To the left of the line the TIRF condenser the mirrors and the light beam path have been 0043 FIGS 3 4 shoW embodiments similar in many regards to those shoWn in FIGS 1 and 2 In these examples modi ed Also it is noted that the microscope stand of FIG 4 the TIRF condenser 125a includes an automated angle con microscope stand trol Also the mirrors 130a b of the previous examples are replaced With kinematic mirror mounts With visible mirrors 180a b to be used With the angle controlling TIRF condenser 0046 FIG 5 shoWs an embodiment similar in many regards to the embodiment of FIG 1 HoWever in FIG 5 a It is noted that a TIRF condenser can be used to alter a beam unit 127 is used as the light source For example the LED unit path betWeen passing through an objective lens proximal to the center of the objective lens The TIRF condenser can alter the beam path to pass through a portion of the objective lens proximal to the side of the objective lens and back Such alteration is used to sWitch betWeen causing a light source beam to pass through a substrate supporting the sample and causing the laser beam to be totally internally re ected at the interface betWeen a substrate and a specimen Where the laser beam passes through the substrate and the sample the Whole depth of the sample is illuminated Whereas When the laser beam is totally internally re ected at the interface only a layer of less than 100 to a feW hundred nanometers of thickness is illuminated This alloWs a user to sWitch betWeen different imaging modes With different background suppression and different depth access to the sample More speci cally When the laser beam passes through the substrate the optical beam Will have a rst optical path length for imaging a rst object plane When the laser beam is re ected Within the substrate energy from the beam exists Within a small area outside the substrate and can cause luminescence in probe molecules in the area adjacent to the substrate The illumination from the area adjacent to the substrate creates a second optical path length for imaging a second object plane Whereas FIGS 1 2 describe splitting a light beam to have multiple beam path lengths to obtain probe molecule images at different object planes sWitching the source beam from transmission to total internal re ection can likeWise result in different optical beam paths useful for 3D imaging 0044 Further regarding use of the TIRE the light beam can be directed at an optical interface supporting a sample at an angle above the critical angle for total internal re ection The TIRF can comprise an automated TIRF module con g ured to automatically determine an optimal TIRF angle In one aspect the automated TIRF module can also modulate rapidly betWeen a critical angle for TIRF and Wide eld microscopy The TIRF module may also be con gured to rapidly modulate betWeen different TIRF angles An auto mated beam steering device can be used to tilt the light beam Within the sample The automated beam steering device can be used for TIRF microscopy or for performing sheet illumi nation For example the automated beam steering device may be a sheet illumination beam steering device con gured to steer at least one light beam from the light source parallel to the image planes through the sample The sheet illumination can be used to provide an object plane in the sample for imaging lmages captured from this object plane can be com bined With other images captured through any of the methods described herein or other image capturing methods knoWn in the art to create three dimensional images as described herein includes the band pass lter of FIG 1 or 3 situated Within the four channel attenuable modular light emitting diode LED may provide 365 nm 470 nm 530 nm and 590 nm Wave lengths at 50 nm per channel It is to be understood that a four channel LED unit is not required and the number of channels may be altered according to requirements of a par ticular application Furthermore the systems and methods may be performed entirely With non coherent light entirely With coherent light or With a combination of non coherent and coherent light Previous three dimensional probe mol ecule imaging techniques have relied solely on coherent light sources e g lasers and have been unable to operate With non coherent light LEDs can be cost effective to use and easier to Work With than lasers LEDs are also attenuable The light of an LED spreads out gradually enough that nearby probes can be detected and or imaged before luminescence has diminished Further the gradual spreading alloWs detec tion and or imaging of a rst subset of probe molecules before a second subset is ready to be detected and or imaged 0047 FIG 6 shoWs an embodiment similar in many regards to the embodiment of FIG 4 As in FIG 5 an LED unit 127 is used as the light source As in FIG 2 a dichroic 185 can be used to separate a plurality of light beam Wave lengths Which can then be imaged on tWo cameras 155 15511 As Will be described beloW in some embodiments a single camera may be used for capturing images from the four light beam paths shoWn in FIG 2 4 or 6 0048 FIG 7 depicts an embodiment of a system for tWo color single camera biplane three dimensional imaging The top portion of FIG 7 is similar to a portion of the system shoWn in FIG 1 and is essentially duplicated to achieve the four Way beam splitting shoWn in the bottom portion of FIG 7 A dichroic beam splitter 185 is used to separate red and green light from a single light beam into tWo light beams Each of these light beams is split using a corresponding beam splitter 150 15011 and imaged on a CCD chip 155d of a camera The CCD chip can have four regions each for imag ing a different input light beam The system depicted can include an additional mirror 13219 and optic 140e above those previously described to facilitate the four Way beam split to a single camera chip 0049 FIG 8 depicts a system similar in many regards to the system shoWn in FIG 7 The dichroic beam splitter 185 of FIG 7 is replaced With a 50 50 beam splitter 15019 This con guration alloWs for one color four plane single camera three dimensional imaging 0050 It is noted that in the above embodiments using a beam splitter that beam path bifurcation is used to alloW imaging of probe molecules over a thick section sample With out scanning
US 2013 0147916A1  over approximately 1 to 2 microns of depth Without scanning. Though the example of FIG. 2 illustrates t...
US 2013 0147916A1 0051 A eld aperture can be included in the system to block parts of the sample from excitation light or radiation This reduces background noise and also avoids activation and bleaching of areas of the sample that are not meant to be imaged at that time point It also reduces overlap betWeen different regions of interest ROIs if a camera chip is shared to image several sample planes simultaneously in the multi plane arrangement Without the eld aperture parts of the Jun 13 2013 colors A suitable laser or light source at the right Wavelength may be used to activate and or excite the colors being used 0056 In one embodiment an optical microscope system With heightened resolution and capable of providing three dimensional images is provided Though the folloWing dis sample may be excited and bleached before equipment or a cussion does not reference a particular individual gure the system described may be understood by reference to FIGS 1 9 and to the above descriptions of embodiments The micro scope system can include a sample stage for mounting a user is able to measure luminescence Further such lumines sample having a plurality of probe molecules A light source cence can be ambient and disrupt the quality of image or detected luminescence of a target area of the sample 0052 A beam steering device or a sample movement device Which in one aspect may be a sample stage can be used to move the activation excitation beam up or doWn along such as a non coherent or coherent light source may be used to illuminate the sample At least one lens can be con gured to direct a beam of light from the at least one non coherent light source toWard the sample causing the probe molecules to the sample to image other portions of the sample In one luminesce A camera can detect luminescence from the probe molecules and a light beam path modi cation module can aspect the beam may be steered up or doWn approximately alter a path length of the probe molecule luminescence to one micron at a time and can image in one dimension as much alloW camera luminescence detection at a plurality of object planes The system can also include a eld aperture con g ured to restrict the light beam to limit a number of probe molecules caused to luminesce An acoustic optical tunable as six microns or more of a sample The system and method are able to process an entire 1 to 2 micron section of a sample all at once Without scanning Further imaging at a depth can be accomplished by moving a stage and Without scanning 0053 Previous methods of imaging thick optical sections of samples included scanning and stacking images When stacking images the focal point is not changed and resolution is lost When moving up and doWn in a sample more distor tion is created For example What may actually be a spherical object may appear elliptical due to distortion through scan ning and stacking Therefore the approach described herein can typically avoid many of these imaging artifacts 0054 With use of the TIRF condenser one additional channel can be imaged Additionally one could use TIRF illumination combined With biplane detection This Would alloW background reduction While alloWing for 3D biplane imaging Also it is noteWorthy that With the TIRF condenser it is not required that photoactivatable probes be used Any uorescent probe may be used 0055 The system can include an image construction mod ule The image construction module can include circuitry or a processor and softWare The image construction module can be built integrally With the microscope system or separately The image construction module can take captured images from different focal planes or object planes and combine them to produce a three dimensional image output The images acquired by the camera can be constructed by the image construction module in real time to provide a real time three dimensional display of combined captured images An image acquisition module can be used to automatically monitor the uorescence images and automatically trigger image acqui sition When a number of active uorophores per time is betWeen predetermined thresholds The image construction module can be con gured to analyZe images from the camera and to calculate at least one of a total orescence and a number of pixels over a threshold uorescence value Within a user de ned region of interest generating a single scalar value varying With time While some of the dyes discussed herein are photoactivatable meaning they are rst activated and then excited it is to be understood that non photoactivat able dyes Which are driven into a dark state and then imaged When they reappear from the dark state Single step dyes or probes may also be used For example a single step dye may be used Which is activated excited and bleached in one step While dyes discussed herein have included red and green colors it is to be understood that dyes can be in many different lter canbe con gured to ne tune a poWer of the light source A focusing module can be used to automatically maintain a plane of focus of the light source Within the sample 0057 In one aspect the light beam path modi cation mod ule can be a beam splitter con gured to split the probe mol ecule luminescence into at least tWo beam paths In this example the camera can be con gured to detect the probe molecule luminescence from the at least tWo beam paths The beam splitter can be a dichroic beam splitter for dichroically separating the probe luminescence into at least tWo Wave lengths of light prior to or after splitting the probe lumines cence A rst path of the at least tWo paths into Which the probe luminescence is split can correspond to a rst Wave length of the at least tWo Wavelengths and a second path of the at least tWo paths into Which the probe luminescence is split can correspond to a second Wavelength of the at least tWo Wavelengths The beam splitter can be a polarizing beam splitter The beam splitter can be a 50 50 beam splitter Fur ther the beam splitter can include a plurality of beam splitters in order to provide imaging of additional focal planes Within the sample The plurality of beam splitters can be any com bination of dichroic mirrors 50 50 beam splitters and polar iZing beam splitters or other types of beam splitters For example the plurality of beam splitters can be a 50 50 beam splitter and tWo polariZing beam splitters As another example the plurality of beam splitters can be tWo dichroic mirrors As another example the beam plurality of beam splitters may include at least one cylindrical lens beam split ter 0058 In another aspect and as has been described in greater detail above the light beam path modi cation module can comprise at least tWo beam splitters con gured to split the probe molecule luminescence into at least four beam paths The camera can be con gured to detect the probe molecule luminescence from the at least four beam paths 0059 In another aspect the light beam path modi cation module can comprise a linear scanning device con gured to scan the sample for probe luminescence at the plurality of object planes for the creation of a three dimensional image With extended axial range 0060 Other components may be included in the system For example a total internal re ection uorescence con denser TIRF or an AOTF can be con gured to alter a beam
US 2013 0147916A1   0051  A  eld aperture can be included in the system to block parts of the sample from excitation light...
US 2013 0147916A1 Jun 13 2013 path of the light beam between a region proximal to a side or periphery of an objective lens and a region proximal to a center of the objective lens A Wide eld microscope stand can be used to support the sample although other stands can be module con gured to control a temperature of the sample suitable An isolation table can be used to reduce vibration of for simultaneous or sequential imaging of the sample Alter the system and prevent undesirable artifacts from being intro duced into the collected data 0061 In one aspect the system can include a plurality of light sources and at least one of the plurality of light sources can be a laser The laser can be a laser capable of exciting tWo photon uorescence or tWo photon photochemistry Non coherent and coherent light sources can be used in com bination In one aspect the non coherent light source can be a point light source The light source can be an activation light source or a readout light source The activation and readout light sources can be the same light source or different light sources The activation and or readout light sources can be and or a humidity control module con gured to control a humidity of the sample 0066 The system can include a conventional microscope nately or additionally the system can include an electron microscope con gured to acquire electron microscope images of the sample simultaneously or sequentially With the camera Some examples of contemplated electron micro scopes include a scanning electron microscope SEM and a transmission electron microscope TEM In one exemplary embodiment the system can be located inside the SEM Referring to FIG 9 an SEM is provided With an inverted uorescence microscope under the electron microscope EM The structure of an SEM typically includes a cavity beneath EM The system herein may be placed or constructed Within the SEM cavity Though the gure shoWs a more coherent or non coherent light The activation and readout simplistic uorescence microscope than the system described light sources do not need to both be coherent or non coherent in FIG 1 for example one can readily appreciate hoW the present system may be integrated into an SEM microscope to create a larger system With more capabilities and applications light As described above a non coherent light source may comprise an LED or any other type of non coherent light source Laser light sources can be used as coherent light sources In one aspect the laser light source may comprise at than either an individual SEM or a microscopy system as least one modulated laser polarization A plurality of light to display images of the sample simultaneously With image sources may be used to provide more than one polarization A feedback module can be used to provide user acquisition by the camera 0067 As described herein the system can image in vivo ex vivo or in vitro molecules materials cells tissues organ age representing the total uorescence output of the camera molecules tissues etc Where perfusion temperature humid Within a sample plane 0062 feedback triggering image acquisition using an analog volt In one aspect the feedback module can include a speaker attached to the voltage to provide audio output as a pitch proportional to the total uorescence of the image An analog circuit can be used to generate a TTL logic pulse When the voltage is Within a predetermined range An integrated circuit or voltage comparator can apply the TTL voltage back to the camera to gate image acquisition 0063 A graphical processing unit GPU can be in con nection With the uorophore localiZation module and be con gured to provide processing for the uorophore local iZation module for localiZing uorophores Further a graphi cal user interface can be used to provide an interface for a user to interact With captured images created three dimensional models and other data 0064 In one aspect the system may include a multi Well plate imaging module con gured to automatically move from described herein The electron microscope can be con gured isms Whether alive or preserved The system can image these ity and other environmental conditions need be meet In one aspect the system can be used to collect and record informa tion about 0068 a PAFMs attached to proteins expressed from an in uenZa virus 0069 b PAFMs attached to lipids 0070 c PAFMs attached to the biology of cancer includ ing but not limited to all forms of cancer and nuclear archi tecture 0071 d membrane biology including but not limited viral uptake and expression at the surface of proteins important to function cell cell interaction and disease related defects and 0072 e PAFMs attached to the biology of neuroscience and disease including but not limited to peripheral neuropa thy AlZheimer s Multiple Sclerosis synaptic function spi one sample Well to another to image a plurality of sample Wells The multi Well plate imaging module can be con g ured to automatically translate the sample in any direction to nal injury and nerve degeneration and regeneration provide optimal imaging Also the multi Well plate imaging 0073 A bene t of the system disclosed herein as com pared With the prior art is the use of LEDs LEDs provide a non coherent light source and can be much less expensive module can be con gured to simultaneously image any num ber of individual molecules Within a single cellular compart than a laser light source Another bene t is the use of auto mation AOTF for laser control as Well as the use of a TIRF ment condenser in a 3 Dimensional Sub diffraction microscopic system The system can make use of commercially available 0065 Molecule molecule binding of molecules in the sample can be measured using a molecule molecule binding microscopic platforms Adjustments to such platforms can be measurement module The sample can optionally include living cells In some situations it may be useful to image these cells in various environments and in differing condi tions The system described herein may be used for samples Which are in vivo ex vivo in vitro perfused etc In one alternative aspect the sample may be incubated in gas In the biplane image acquisition case of a gas incubated sample the system can further com prise a gas control module con gured to control the gas in Which the sample is incubated To better control the sample environment the system can include a temperature control minimal and provide cost savings to consumers and manu facturers Another bene t of the system and method is the use of dual cameras Which alloWs for multi channel axial 0074 The microscopy system and method can offer both TIRF and Biplane imaging as Well as multi channel acqui sition in the same microscope This system provides clear advantages over prior art systems Which are generally only able to accommodate 2 dimensional imaging and single channel acquisition Other 3D imaging systems do not use a
US 2013 0147916A1  Jun. 13,2013  path of the light beam between a region proximal to a side  or periphery  of an objective...
US 2013 0147916A1 TIRF condenser The system and method can retail for con siderably less money than existing prior art systems even as much as 75 less Example 0075 An example Biplane Fluorescent Photoactivation Localization Microscope Biplane FPALM Will noW be described A version of the Till Photonics lmic microscope Was modi ed for use in this technique The microscope itself provides a unique platform that is highly unconventional When compared to more conventional commercial systems in that it is modular and lacks basics seen in other systems eg oculars Additionally the lmic alloWs access to the entire light path to easily manipulate the system for use in all the iterations described herein Further the system alloWs removal of the TIRF condenser and placing it aWay from the microscope Where it Would normally be attached to the scope This alloWs placement of additional optics necessary for Biplane betWeen the beam steering device that is the TIRF mirror and the internal components of the scope Finally the image acquisition softWare Till Vision proved to be ideal for capture of Biplane and Biplane FPALM images With little adaptation The collection is an endogenous function of the softWare and can export the les to a format usable in an image analysis softWare 0076 The system Was constructed on an isolation table measuring 35
US 2013 0147916A1  TIRF condenser. The system and method can retail for con  siderably less money than existing prior art ...
US 2013 0147916A1 point of the microscope stand to the TIRF condenser hence the folding of the beam path Additionally the tWo mirrors provide the ability to adjust the lasers Within this path to the tWo f 200 lenses Mirror 2 focuses the beam to the f 200 furthest from the microscope and mirror 1 focuses the beam through the eld aperture and to the f 200 lens closest to the microscope Which is positioned 200 mm from the back aper ture of the objective The beam should travel through the detection optics and into the scope in a straight manner not bent or curved This is enabled by the adjustment described above 0080 The con guration supplying the activation and Jun 13 2013 directly after the AOTF there can be a 2x beam expander This beam expander can make the beam leaving the ATOF bigger resulting in a more homogenous excitation of the eld of vieW 0081 On the detection side of the microscope Where the excited and emitted photons are directed to and collected by the EMCCD and or camera the microscope itself may be left as previously described The beam height Was 14 cm leaving the body of microscope The beam is propagated through a mounted achromatic doublet f 75 mm 400 700 nm lens positioned 15 cm from the edge of the microscopes leading readout Wavelengths for this instrumentation involved both edge on the emission side An additional 26 5 cm from that is a f 200 mm 400 700 nm lens The use of the f 75 plus the 405 nm and 561 nm lasers Additionally an acoustic optical f 200 provides one a 2 7 increase in magni cation 200 75 tunable lter AOTF shutter and 2x beam expander Were used Starting With the 561 laser the beam can be run through a beam box a small box that contains 2 mirrors and either a 3rd mirror or dichroic lens to direct the beam out of the box Here in the 561 beam box there is both a near eld and far eld correction mirror adjustable and a 3rd directional mir ror xed position The laser Was placed close to the box so the that emitted beam is directed and centered into the box hitting the near eld mirror folloWed by the far eld mirror then is re ected by the directional mirror out of the box and into a second box containing the 405 nm laser line optics The use of the tWo adjustable mirrors near and far eld adjust ment mirrors is valuable for one to have the ability to Walk the lasers or lineariZe multiple laser lines into a single beam path The 405 nm laser is directed into a box that is similar to the one previously described for the 561 nm laser HoWever the 405 nm box replaces the xed directional mirror With a Immediately folloWing the f 200 lens at 5 4 cm is a 20 mm beamsplitter cube 400 700 nm lambda l0 This cube Will split the beam or more accurately provide an equal prob ability that the emitted photon can either one take the shorter route to the camera directly through straight the beam splitter transmitted light path or tWo be directed sideWays from the beam splitter to a mirror and then on to the camera a longer beam path re ected beam path In the re ected path there is 9 cm from the beam splitter a mirror position to redirect the beam photon to the camera chip An Andor EMCCD camera can be positioned at a distance of 75 cm from the beam splitter cube Where both the transmitted and re ected light paths are directed Importantly the transmitted and re ected light paths are directed to separate sides of the camera chip This splitting of the chip alloWs us in one image to have both the light paths present These light paths can easily be adjusted by imaging a knoWn structure here 40 nm dichroic lens this lens Will alloW the 561 laser line being directed into this box to pass through the lens and out of the beads in both light paths simultaneously While adjusting the 405 nm box The dichroic lens also re ects the 450 nm laser equally Finally the entirety of the detection side optics can be encased Within a light tight box Common building supplies line combining it With the 561 laser line Both laser lines are directed toWards the AOTF Which is seated Within a third box in line With both the 561 and 405 nm boxes BetWeen the 405 nm box and the AOTF box is a shutter Which alloWs one to block the lines collectively from being introduced to the AOTF The lines are directed into the ATOF so that there is 2 fold control of these lines For our application and to sWitch uorescent molecules sloWly in a sparse subset man ner the 405 nm laser e g the activation laser can be attenu ated to very loW levels This is achieved optimally by use of the ATOF and this beam can typically be adjusted to the nano Watt level Conversely the 561 nm laser line may pro vide as much poWer to the sample as possible as once the sparse subset is sWitched it is necessary to excite the mol ecule collect the emitted photon and nally irreversibly bleach the molecule The AOTF alloWs combination of the laser lines While individually dictating the poWer of each and Without the use of neutral density lters By manually setting the total poWer level for each laser through the ATOF s remote control total poWer levels can be translated to the Till Vision softWare Where a slider tab in the softWare alloWs further attenuation of laser lines As an example the 405 nm laser can be set at 400 nW output This Would represent 100 of the poWer possible in the softWare by using the slider tab Therefore there is a range of betWeen 0 and 100 poWer or 0 405 nW possible poWer for this line Finally the use of the Till Vision softWare Imic microscope and EMCCD cam era along With the AOTF alloWs the system to coordinate the ATOF laser pulse With the camera shutter to time acquisition of the image throughout the entirety of the system Finally optics to direct the tWo paths to each half of the camera chip such as may be purchased form a home repair store can be used to construct the box For example 1A plyWood cut to siZe can be used With Wood glue and small nails to create the box Which ts tightly to and around the side of the microscope Which the detection beam emits from A lid can be created for the box using metal latches so one can have access to the optics Without removing the box Finally holes can be drilled into the box to alloW the electronics for the camera to enter and also to alloW for the cooling tubes for the camera 0082 Cooling the camera is important to providing an appropriate signal to noise ratio The Andor EMCCD comes With an internal fan as part of its Peltier cooling mechanism hoWever the fan induces vibration and drift Within the image Through the Till Vision softWare there is the ability to inter rupt the fan and eliminate the induced vibration and drift An external liquid cooler can be used such as a cooler purchased from Koolance Inc This radiator cooling system uses an antifreeZe fans and pumps to constantly infuse through the cameras oWn cooling ports antifreeZe These ports are adapted for liquid cooling This alloWs temperatures of
US 2013 0147916A1  point of the microscope stand to the TIRF condenser, hence the folding of the beam path. Additionally, ...
US 2013 0147916A1 uses the Till vision software to drive the entire system from Jun 13 2013 8 A system in accordance with claim 1 further comprising hardware movement to image collection and analysis a conventional microscope for simultaneous or sequential 0084 imaging of the sample The foregoing detailed description describes the invention with reference to speci c exemplary embodiments However it will be appreciated that various modi cations and changes can be made without departing from the scope of the comprises cells having photoactivatable or photoswitchable present invention as set forth in the appended claims The brane including photoactivatable or photoswitchable uo detailed description and accompanying drawings are to be regarded as merely illustrative rather than as restrictive and rescent proteins or photoactivatable or photoswitchable uo rescent lipids or lipids with photoactivatable or photoswitchable uorescent molecules attached by a chemi cal bond 10 A system in accordance with claim 9 further compris all such modi cations or changes if any are intended to fall within the scope of the present invention as described and set forth herein What is claimed is 1 A microscopy system for creating three dimensional images using probe molecules comprising a sample stage for mounting a sample an activation light source con gured to illuminate the sample with an activation light and to activate probe molecules in at least one subset of probe molecules a readout light source con gured to illuminate the sample with a readout light and to cause luminescence in the at least one subset of probe molecules an acoustic optical tunable lter AOTF con gured for ne tuning a power of the activation light source and the readout light source an objective lens con gured to direct a light beam from the light source toward the sample a total internal re ection uorescence condenser con g ured to alter a beam path of the light beam between a region proximal to a side of the objective lens and a region proximal to a center of the objective lens at least one camera positioned to capture a plurality of images by detecting the luminescence from the at least one sub set of probe molecules when the beam path of the 9 A system in accordance with claim 1 wherein the sample uorescent molecules PAFMs residing in a biological mem ing an image acquisition module con gured to automatically monitor the uorescence images and automatically trigger image acquisition when a number of active uorophores is between predetermined thresholds 11 A system in accordance with claim 1 wherein the image construction module is con gured to analyZe images from the camera and calculating at least one value or measure of a total orescence and a number of pixels over a threshold uorescence value within a user de ned region of interest generating a single scalar value varying with time 12 A system in accordance with claim 1 further compris ing a feedback module con gured to provide user feedback triggering image acquisition using an analog voltage repre senting the total uorescence output of the camera wherein the feedback module comprises a speaker attached to the voltage to provide audio output as a pitch proportional to the total uorescence of the image 13 A system in accordance with claim 1 wherein at least one of the probe molecules is a PAFM and is con gured to use Forster resonance energy to transfer or receive energy to or from another probe molecule 14 A system in accordance with claim 1 further compris ing a sheet illumination beam steering device con gured to light beam is directed through a region of the objective steer at least one light beam from at least one of the activation lens proximal to a side of the objective lens and when the and readout light sources parallel to the eld of view through beam path of the light beam is directed through a region the sample of the objective lens proximal to a center of the objective lens and capture a plurality of images and an image construction module con gured to combine the plurality of captured images from the at least two lumi nescence beams and construct a three dimensional image using the plurality of captured images 2 A system in accordance with claim 1 wherein the acti vation light source and the readout light source comprise a single laser 3 A system in accordance with claim 1 wherein the cam 15 A system in accordance with claim 1 further compris ing an electron microscope con gured to simultaneously or sequentially with the camera acquire electron microscope images of the sample 16 A method for creating three dimensional images using probe molecules comprising mounting a sample on a stage the sample having a plurality of probe molecules illuminating the sample with light to cause probe lumines cence era comprises an electron multiplying charge coupled device EMCCD having a plurality of detection channels 4 A system in accordance with claim 1 wherein the AOTF is con gured to control the light sources to provide time detecting the at least four detection planes via a camera dependent sequences of illumination of at least one wave recording the object planes in corresponding recorded length 5 A system in accordance with claim 1 further comprising a beam splitter positioned to split a luminescence beam into at least two luminescence beams corresponding to at least one object plane in the sample 6 A system in accordance with claim 5 wherein the beam splitter comprises one or more of a dichroic mirror a 50 50 beam splitter or a polariZing beam splitter 7 A system in accordance with claim 1 wherein a trans mitted light is imaged by differential interference contrast splitting the probe luminescence into at least four paths corresponding to at least four detection planes corre sponding to object planes in the sample regions of interest in the camera and combining a signal from the regions of interest into a three dimensional image 17 A method in accordance with claim 16 further com prising dichroically separating the probe luminescence into at least two wavelengths of light prior to or after splitting the probe luminescence and wherein a rst at least two of the at least four paths into which the probe luminescence is split correspond to a rst wavelength of the at least two wave lengths and a second at least two paths of the at least four
US 2013 0147916A1  uses the Till vision software to drive the entire system, from  Jun. 13,2013  8. A system in accordance...