A study on time‑resolved CMOS image sensors with draining‑only modulation pixels for fluorescence lifetime imaging microscopy
著者 Li Zhuo
year 2013‑01
出版者 Shizuoka University
URL http://doi.org/10.14945/00008283
DOCttORAL THESIS
A Study on Time-Resolved GMOS lmage Sensors with Draining-Only Modulation Pixels for Fluorescence Lifetime lmaging
Microscopy
Zhuo Li
Nanovision Technology
Graduate School of Science and Technology Shizuoka University
January 2013
静岡大学 博士論文
A Study on Time-resolved CMOS lmage Sensors with Draining-Only Modulation Pixels for Fluorescence Lifetime lmaging
Microscopy
蛍光寿命イメージング顕微鏡のための
電荷 J卜 出変調画素を用いた CMOS時 間分解型 センサに関する研究
李 卓
静岡大学 自然科学系教育部
ナノビジ ョンエ学専攻
2013年 1月
A Study on Time-resolved CMOS lmage Sensor with
Drai
nin g-On ly Mod
ulation Pixels for Fl uorescence Lifetime lmaging Microscopy
by Zhuo Li
Submitted for the degree of Doctor of Engineering January 2013
Abstract
This thesis presents a time-resolved CMOS image sensor with draining only modulation (DOM) pixels, for time domain fluoresc,ence lifetime
imaging.
ln the DOM pixels using pinned photo-diode technology, a time-windowed signal charge transferfrom a
pinned photo-diode (PPD)to a
pinned storagediode
(PSD) is controlled by a draining gate only, without a transfer gate between the two diodes.This structure allows
a
potential barrier-less and trap-less charge transfer from the PPD to PSD, which is suitable to transfer 1 electron at high speed.A 256
x
256 pixel time-resolved CMOS imager with 7 .\p,rnx
7.5pm DOM pix- els has been implemented using 0.18pm CMOS image senor process technology with pinned photo-diodeoption. The
PPDand
PSD are layout in a symmetrical shape, thus sensitivity of PPD to incident of light is increased and full well capacity is increased. The barrier between PSD to PPD is chosen large enough to prevent leakage during charge draining time. The prototype demonstrates high sensitivityficr weak signal of less than 1 electron per light pulse, and accurate measurement of fluorescence decay process with sub-nanosecond time resolution. Measured fluorescence decaying is
a
convolution of the target fluorescence decaying andthe time
responseof the
DOMpixel. The time
responseof the
DOMpixel
is measuredto
be 2ns, andthe
resulting target fluorescence decaying and the re-sulting target lifetime can be estimated by
the
proposed deconvolution method.The prototype sensor is useful for a compact low-cost camera for FLIM in biolog- ical measurements. Fluorescence from cells under microscope are observed by the sensor, and its related lifetime is successfully measured.
Dark electrons generated by a scooping effect of the draining gate (TD) clock-
ing
causeoffset to the
signaldetection. An
improved versionof
sensor chipwas
designed and fabricatedfor
reducingdark
offset,and the
reduction effect is proved by the measurement result.Declaration
The work in this thesis is based on research carried out at the lmaging Devices Laboratory, Research lnstitute of Electronics, Shizuoka University. No part of this thesis has been submitted elsewhere fur any other degree or qualification and it all my own work unless referenced to the contrary in the text.
Copyright(D 2013 by Zhuo Li
The oopyright Ofthis thesis rests with the authon No quotations from it should be published without the author's prior written∞ nsent and information derived from it should be acknow!edged".
「本論文の著作権は、国立大学法人静岡大学 自然科学系教育部ナノビジョンエ学 専攻李卓が所有 しています。本論文の記事 。図面の無断複写、複製および無断転載 を禁 じます。ただ し、著者は本論文の複写権を国立大学法人静岡大学に唯一許諾 し ます」。
V
Gontents
Abstract Declaration
1 lntroduction
Fluorescence lifetime measurement methods
2.1
Overview of fluorescencelibtime
measurements 2.1.1
Concept of fluorescencelifttime
2.1.2
Comparison of lifutime measurements in frequency domain and time domain2.1.3
Time-resolved fluorescence lifetime measurementin
time domain2.2
Relationshipbetween potential2.3
Estimation on optical system2.4
Estimation on time resolutionbarrier and current through
banier
1
10 10 10
12
14 18 25 26 Design of
time-resolved
CMOS imagesensor using draining-only mod-
ulation
(DOM)technique
343.1
FLIM using conventional 4 transistor type CMOS imagesensor
343.2
DOM pixeldesign
393.2.1
Pixelstructure ...
393.2.2 D0Mmechanism
423.2.3
Windowing by draining-onlymodulation
443.3
lmagerarchitecture
46Contents
V‖3.4 Device simulalon of DOM pixel
4 lmplementation and application of time-resolved
CMOSimage sen.
sor w■h DOM pixeis 41 :rnplemented chip
4.2
Measurement on basic characteristics4.3
Lifetime measurement results4.4
Summary of chip perficrmanceslmprovement of time-resolved
CMOS imagesensor with
DOMpixels
5.1
New structure for reducing scooped dark electrons in DOM pixels .5.1.1
Design of pixels on reducing charge injection5.1
.2
Measurement on reduction effect of chargeinjection . . .
.5.2
Deconvolution method to improve lifetime measurement accuracy5.2.1
Deconvolutionmethod
.5.2.2
Applying deconvolution method to measureddata . . . .
.6 Summary and conclusions
List of publications Acknowledgements
48
58 58 59 70
80 83 83 83 85 87
87 92100
i
1
Ghapter 1
lntroduction
Background
Nowadays, image sensor
is widely used in
mobile phone cameraand
dig-ital still
camera,and
becomea
consumer productnear us.
lmagesensor
ismainly divided into two categories, CCD (Charge Coupled Devices) image sen- sors
and
CMOS (Complementary Metal-Oxide Semiconductor) image sensor6.Unlike CCD image sensor which need special process in manufacturing, CMOS image sensor can be designed and manufactured in the same process like that
of
CMOSLSl.
Therefore, processing circuit ficr functional operationcan be
in- tegrated into CMOS image sensors, makingit
high functional, compact and low cost. The large noise problem which is a disadvantage in CMOS image sensors motivates many kinds of researches on noise reduction. Pinned diode structures originally developed for CCD image sensors for both charge generation and stor- age has the advantages of low dark cunent and no image lag [1]. Now the pinned photo-diode technologies are applied for CMOS image sensor[2].
As the report of [3], the CMOS image sensors are dramatically improved the image quality and the interest of CMOS image sensors has increased in various electronic cameras.One kind
of
high functional applications in CMOS image sensor isthe
fluo- rescen@imaging.
Fluorescence imaging isa
powerfultool
in biology. Fluores- cence has two physical quantities; intensity and lifetime of decaying. Qualitative imaging of fluorescence intensitycan
revealthe
locationor
distribution of fluo-Chapter
1,lntroduction
rophores. The fluorescence intensity measurement has difficulty in quantitative measurement because the fluorescence intensity is influenced by many factors, such as fluorophore concentration, degradation of fluorophore, wavelength and intensity
of
excitationflux,
sensitivityof
detectors, and transmittanceof
optical system. To address these difficulties and to provide additional novel information, fluorescence lifetime measurement has been becoming important technology in biological imaging[4].
Fluorescence lifetime measurement uses intensity decay rate rather than the absolute value of intensity, and therefore the quantification is not influenced by degradation of fluorescence intensity. The fluorescence lifetime imaging microscopy (FLIM) has a variety of applications. It can be used to quan- tifo physical parameters suchas
microviscosity, and chemical parameters such as pH and ion concentration. lt can also be a powerful tool in DNA sequencing.Motivation
Streak camera can measure two dimensional dishibution of fluorescence life- time. Optical pulses anive at a slit at photocathode with varying intensities which
vary
slightly in termsof
timeand space. As the
corresponding photoelectrons generated from photocathode pass betweena
pair of sweep electrodes, the ap- plied sweep voltage steers the electron paths away from the horizontal direction at different angles depending on their arrival time at the electrodes. The amplified electrons reachthe
phosphor screen formingan
imageof
three optical pulses arranged in vertical direction accordingto the
timeof
their arrival at the sweepelectrodes. The
earliestpulse is ananged in the upper most
position and the latest pulse is inthe
bottom most portion ofthe
phosphorimage.
The resulting streak image has spac,e as the x-axis and time as the y-axis. Two galvano mirrors in the optics are used f,cr scanning the pulsed excitation light spatially in the two dimensional object.Time-correlated single photon counting (TCSPC) method [5] is a typical method used in FLIM systems. A typical TCSPC system uses
a
photomultiplier tube [6]for detecting fluorescence emission and an expensive mechanical scanning mir- ror and optical systems are necessary for two-dimensional imaging, resulting in a
Chapter
1.lntrcduction
bulky and expensive system.lnstead of FLIM systems using the photomultiplier tube, semiconductor FLIM systems such as time-resolved CMOS imagers have been paid much attention to implementing a compact and low-cost FLIM system. Single photon avalanche diodes (SPADs) are known as devices for time-resolved lifetime measurement [7].
ln SPADs, when a p-n junction biased above breakdotitrn voltage absorbs
a
pho- ton, a large current is generated and then rapidly quenched by a load resistiance, causing an electric pulse per photon[8,9]. A
SPAD-based time-resolved imager consists of an SPAD detector anay with sensing electronics in each pixel,time{o-
digital converters (TDCs), digitral integrators to intensify the signals and readoutelectronics.
For high photon counting rate,a
large number of TDCs and digital integrators are necessary. These features make the SPAD-based time-resolved imagers complicated and limitthe
spatial resolution.A
differential pixel circuitry with an active reset technique using standard CMOS photodiode is proposedfor
time-resolved fluorescence detection [4]; however, the minimum light level is lim- ited by the large circuit noise ofl80e-.
Relerencea Rof.1101 Rof.111] R [121 Rof.1131 Rof.1141 Ref 11回
Tlms.
r€solvlng mothod
time{orrula!ad dngL photon coundng nrothod
optlcal .c.nnftrg tachnlqua
aingle photon counfng method
dngle photon countlng nethod
alngl. phoion countlngn thod
actlva iL€t
techniqua
Deteding
devi●●
phoiomuldplier
tube atrtakcamola dn0leDhoton avalanche diode
ringbphoton avalanch. dlode
rlnglephoton avalrncha dlod€
BIandadOl10S
pholodi●do Pixolanay
●睦
nax. i1006 x i1005 (rDport d)
656xml (rcpo €d,u.lng
CCDc.me6)
64x64 (ruport d)
10x16
(nOt reportod)
128x120
(repOrtodl
64x (nOtmporleo
Frame rate o.ml lralne.Js lor nru. lmago rraolution
033mmttb not ttporbd not llporled l mmOIB 310mm●●7o
Time
flgsolullon opo leao than 20po 350p● 160pe 97p● 150p3
Derl.lopel {Bo3bn日鶴 ∞companv
",
∞mpanv
O―ph―c31u unlYarally{colum!l)
m m
in
︲F unIVer31ty
(FPELl
unlversi"
loOmmbり
Figure
1.1:
Comparison ofcunent
study fur time-resolved fluorescence lifutime imaging among companies and universitiesRecent studies for the time-resolved fluorescence
lifttime
measurements basedon pulse
lif,atime measurementsare
representedclearly in Figure
1.1,
whichshows
time
resolutionof the
orderof
picosecondis the
most basic necessaryChapter
1.lntroduction
condition for the fluorescence lifetime measurement system by company
or
uni- versityor
even any othergroup.
lnterestingly,the
main difference between the systemsby
companies [10, 11]and
universities[1-4]
(included institute) is the pixelsize. lt
may showthat
supportingvisual
information isone
ofthe
current claims postulated fur commercially available fluorescencelibtime
measurementsystem.
On the other hands, eventhe
pixel sizeof
university systems is vastly insufficient compared with company's work, the frame speed is obviouslyhster
than company'swork.
lt may show that real time fluorescence lifetime image pro- cessingis the
near future trendof
fluorescencelifttime
measurement system.The final goal of this
work
isa
low noise real-time CMOS image sensorbr
the time-resolved FLIM with sub-nanosecond time resolution.ln
video
imaging devices, the time resolution which isabout
10 ms is deter- mined by frame rate. ln high frame rate imaging devices for special scientific mea- surement, time resolution is from 100 nsto
1ps. However, in the case of imaging object such as same repeated phenomenon, by synchronizing the trigger signal of the repeated light source which causes the phenomenon and repeated signal accumulation in the imager, time resolution of less than 1 ns can be achieved.lf
the detection of the pixel is synchronized with the light source, such kind of pixel is usually called lock-in pixel. Yoon et al. [5] from our laboratory proposed a CMOS time-resolved imager using two-stage charge transfer technique in pinned diodefor the
measurementof
fluorescencelifttime. ln the
previous structure, usinga fully
depleted pinned photo-diode, fluorescence lifetimeof
nano-second time scales has been measured. Because of the simple structure, a high spatial reso- lution fluorescence lifetime imager can be realized. The time resolution of 160ps has been achieved in the liEtime measurements. However, the implemented fluo- rescent lifetime imager has a problem of the pixel-to-pixel variation of sensitivity at very low light level. To address this problem, this paper presents a time+esolved CMOS image sensor with a draining only modulation (DOM) pixel structure. The draining only modulation (DOM) structure [1] removes the transfer gate betweenthe
pinned photo-diode (PPD) andthe
pinned storage diode (PSD). This allows usto
realizea
barrier-less charge transfer betweenthe
PPDand
PSD, leadingChapter
1.lntrcduction
to
high sensitivity of weak fluorescent signalswith
high time resolution. Using a monotonic positive lateral elec'tric field, high-speed charge transfer from the PPD to PSD in the time scales of nano-second is possible [18,19]. The time windowing is done by draining the charges with a draining gate (TD) only, which is attached besidethe canier
pathfrom the
PPDto
PSD.A
256x
256 pixel time-resolved CMOS image sensor chip has been implemented for the proof of concept of the DOM pixel.Thesis organization
This work is subdivided into six chapters.
Chapter 2 gives a short overview of fluorescence libtime measurements meth- ods
with
detailed conceptsof
fluorescencelibtime. As
mentioned above, this chapter roughly compares 'phase and modulation measurements in the frequency domain' and 'pulse lifetime measurements in the timedomain'.
ln addition, two techniquesof 'pulse
lifetime measurements',such as
'pulse sampling method'and
'single photon counting method',are also described. A
short overviewof
modern analytical needs and techniques fur fluorescence lifetime measurements is followed. Through the comparisonwith
modern analytical needs and modern techniques, the goal of this work is represented.Chapter 3 gives the method of this
work
howto
realize the fluorescence life- time imaging using time resolved CMOS image sensor with Draining-only modu- lation techniques. Firstly, the imager architecture for time-resolved liEtime mea- surement explained. After the short overview of pinned diode structure, the con- ceptand
principle of thedrainingonly
modulation technique whichis
proposedto
realizethe
real-time fluorescenceli€time
measurement based on CMOS im-age
sensorwith fast
sivitching operationare described. ln a
standard pinned photo-diode CMOS image sensor technology,the
attemptof
different impurity concentrations on same layeris
not available forthe
devicedesign.
Therefore, the pixel optimization for the twc.stage charge transfur technique is done by ma- nipulating the size of parameters in the pixel. The procedure of pixel optimization is described with simulation results.Chapter
1.lntroduction
Chapter
4
describesthe
applicationof
time-resolvedCMOS
image sensor with draining-only modulation pixels. For fluorescencelibtime
measurement and image display,an
user-friendly delay timing generatorwith
hightime
precision anda
low noise readout circuitry have been introducedto
implementa
CMOS FLIM sensor having 256(Row)x
256(Column)pixels. The
delay time generator can resolve the decaying of fluorescence with Sps time resolution. A double-stagenoise
cancellerwith high
readoutgain and
correlated double sampling (CDS) operation is used for the low noise readout circuitry of the CMOS FLIM sensor.The
resultof
photo-conversion characteristic showsthe
linearity, sensitivity, for detecting weak fluorescentsignal.
Lifetimesof
four kindsof
fluorophores were successfullymeasured.
Fluorescencefrom
cells under microscope is observed by the sensor, and its related lifetime is successfully measured.Chapter 5 describes the improvement
forthe
proposed imager. To obtain more accurate lifietime result, c,onvolution calculation was developed, andthe
linearityof
deconvoluted lifetimeis discussed.
Eventhe CMOS
FLIM sensorhas
suc- cessful results of lifetime measurements, dark electrons generated by a scooping effect of the draining gate (TD) clocking cause offset to the signal detection and reduces the SNR, causing it not qualifiedbr
more accurate lifetime measurement.lmprovement method of dark offset of the prototype image sensor was proposed, and the new structure of drained-only modulation pixel was designed and imple- mented
in a
sensor chip,to
reducethe dark offset.
Simulatedand
measured results demonstrate the availability of the improvements.Finally, this thesis finishes with a brief summary and conclusions.
Bibliography
[1l N.Teranishi,A.Kohno,Y ishihara and K Aral,IVo fimage rag ρゎοrO¨dilDde sfrycrareわ めeゎrerine ccD ittge sensο 4 in Technical Digest on lnternaJonal
Electron Device Meeting,pp 324‑327,San Fransisco,CA,Dec.1982
[21 P Lee,R.Gee,R.Guidash,T‐ H.Lee,and E Fossum,ハ
n acrire ρfxe′ sen―sorねb万cared usng CMOS/CCD process recヵrlοメOgμ in PЮceedings on lEEE
Workshop on CCD and AIS,Dana Point,CA,Apr 1995
[3]S Kawahito,CMOSfmagわ
g devi∝sわrrewmarkers
οrvisiOrl sysfems,lEiCE Transactions on Eledronics,Vo!.E90‑C:No 10,pp.1858‑1868,Oct.2007.14]D.Elson,S Webb,」
Siegel,K Suh‖ ng,D.Davis,J.LeveL D.Ph‖ ‖ps,A.Wal‐lace and P French,3fomedrcar aρρ″ca″ο″s οf fyorescence rilbrilme rmaging,
Optics&Photonics Newsi Vol.13,pp.26‐57,NoⅥ 2002
151 K Yoshiki,H Azuma,K.Yoshioka,M.Hashimoto and I Arakil月 ndingOfOρri mar calcium′or7 ρrObesわr″″Orescerce lib″me measυremen4 0plcal Review,
Vo1 12,No.5,pp 41541912005
[61 X E Wang and B. Herman, FryOrescerce rmaghg specrroscoρ y arld mi・
CDSCOpyI」
oHN llVILEY&SONS,lNC,1996
[7]Y Maruyama and E.Charbon,ハ
″me‐gared f28×f28 CMOS SttDaη
わ′Orl‐c力ゎ ″″Orescence deredion,in PЮceedings on lnternationalirnage Sensor
Workshop,pp 270‑273,Hokkaldo,Japan,」
un.2011.7
Bibliography
8[8]
S. Bellisai, F. Guerrieri, S. Tisa and F. Zappa, 3Dnnging
with a single-photon imagingamy,
in Proceedings on SPIE-IS&T Electronic lmaging, Vol, 7875, pp.78750M1 - 78750M6, San Fransisco, CA, Jan. 20't 1.
[9]
F. Guerrieri, S. Tisa, A. Tosi, S. Bellisai, B. Markovic and F. Zappa, Linear ar- rays of single-photon detectors for photon counting and timrng, in Proceedingson
SPIE-IS&T Electronic lmaging,Vol, 7875, pp.
78750N,|-
78750N9, San Fransisco, CA, Jan. 201 1 .l10l
Timecotelated single photon
countingsystems,
availableat
h@://w*nv.boselec.com/products/sigtcspc.htnl.
l11l FLIM
system C9136, available at http://sales.Hamamatsu.com./assets/pdf/parts_C/e_flim.pdf.
[12]
D. Schwartz, E. Charbon, and K. Shepard, A single-photon avalanche diode imager for fluorescence lifetime applicafions, in Digest Papers of Symposium on VLSI Circuits, pp. 144-145,2O07 .[13]
F. Borghetti, D. Mosconi, L. Pancheri, and D. Stoppa,A
CMOS single-photon avalanche diode sensor for fluorescence lifetime imaging,in
Proceedings on lnternational lmage SensorWorkshop, pp. 250-253, Jun. 2007.[14] C.
Niclass,C.
Favi,T
Kluter, M. Gersbach,and E.
Charbon,A
128x
128 single photonimager
with on-chip column-level 10b time-to-digital converterarny
capable of 97ps resolution, in Digest Papers on lnternational Solid-State Circuits Conference, pp. 44-45, Feb. 2008.[15]
T. Huang, S. Sorgenfrei, K. Shepard, P. Gong, and R. Levicky, A CMOSanay
sensor for sub-800 ps time-resolved fluorescence detection, in Proceedings on IEEE Custom lntegrated Circuits Conference, pp. 829-832, Sep.2007.[16]
H. Yoon,S.
ltoh and S. Kawahito,A
CMOSimage
sensorwith
in-pixel two- stage charge transfer for fluorescence lifetime imaging, IEEE Transactions on Electron Devices, Vol. 56, No. 2, pp. 214-22'1, Feb. 2009.[17]Z Li,S Kawahib,K.Yasutomi,K.Kagawa,」.Ukon,M.Hashimoto,and H.
N‖oka,ハ rilme̲resoryed cMos ttage se″sοr晰綸 d趙わわgorry mοdura″Oη ρ′x̲
ersゎr″υOrescerce‖b″me力
"aging,lEEE Transactions on ElectЮn Devices, Vo!.59,No 10,pp.2715‐
2722,Oct 2012
[18]H.Takeshita,I Sawada,K.ltoh,I lwahori and S.Kawahito,B」 rred ρ力Ofo¨
dbde srrycrare For力 ●力‐Speed c力 arge rransゎ 4 in PЮceedings on lTE Annual Convention,Kyushu,」 apan,Aug,2008,(in Japanese)
[19]C Tubert,L Simony F s、
A.TournieL L Pinze‖iand R Magnan,High
speed duar ρο″ρゎr7ed ρ力Oro‐dfOdeゎr ttme―οf―″gわrlmagrng,in PЮ ceedings on lnternationalimage Sensor VVorkshop,Bergen,NorwayI Jun 2009.
Ghapter 2
Fluorescence lifetime measurement methods
2.1 Overviewof fluorescence lifetime measurements 2.1.1 Goncept of fluorescence lifetime
The fluorophore excitation and emission was first described by Jablonski. Fig- ure 2.1 is a simplified Jabolonski diagram, considering only the singlet electronic state
(S).
Firstly, the fluorescent substancewhich
is called fluorophore absorbs the excitation photon energy hz6, and the electron is excited from ground state 56 to higher energy state 52. Secondly, the electron relaxes to lower energy state 51,this process is called internal conversion. Thirdly, the electron returns from lower state 51
to
ground state,96,while
releasing energyin
radiative fluorescent part(hzr) and
non-radiative part,which
havethe
decay rateI
andk",
respectively.The radiative decay rate
I
indicates the fluorophorespecies. The
non-radiative decay ratek*
indicates fluorophore environment[1].
The fluorescence quantum yield is the ratio of the number of photons emitted to the number absorbed. The rate constantsI
andk*
both depopulatethe
excitedstate.
The fraction of flu- orophores that decay through emission,and
hencethe
quantum yield, is given by10
2.'1.
Overview of fluorescence lifutime measurements
lin r
8y3Lm
` tT̲L
:Radiat陥 :Omi38:On
iヽ
卜P ウ /FluoraBccnce Phocphorrrcanco
Figure
2.1:
Simplified Jablonski Diagram to illustrate energy state of electron ex- citation and emission彙■●●ゝhrOru
9=「 +塩
r
(2.1)
Fluorescence liEtime which is the average time a fluorophore stays in the excita- tion state, is defined as
「 十硫r (22)
Electrons in the Sl state can also undergO a spin conversion to the nrst triplet electЮnic state Tl Emission from Tl is termed phosphorescence with energy of hゅ,and is genera‖ y shifted to longer wavelengths re:ative to the luorescence Conversion of Sl to Tlis ca‖ ed intersystem cЮ ssing ln this research!we obtain luorescent‖fetirne to distinguish difFerent species ofluoЮphores,and to observe the interaction of rnolecu!e with luorescent pЮ
be
Energy difFerence beh″ een gЮund state So and higher state S2 0fthe luo‐
Юphore is too large fbrthermal population;therefore,we use light and not heatto induce luorescence Figure 2 1 shows the luoЮ phore lrstly absorbs the shorter wavelength‖ght,such as ultraviolet‖ght pulse,and then emits longer wavelength luorescence ln luorescence experiment we do not observe number of excited molecules,but rather luorescence intensity A(o,whiCh iS propOrJonal to pOp‐
ulaJon of luoЮ phores n(0,in the excited state According to the physicallaw 90Verning the process of radiaJon in natureithe rate of change in intendじ
ギツ
,2,1.
Overview
offluorescence lifetime measurements
12as
is inversely proportional to intensity, A(t):
Ψ =一 :Jの
(2.3)By deriving Equation 2.3, the single exponential decay of intensity is expressed
用 =れ u― ゎ
(24)where, -4s is the initial intensity of fluorescence emission. Equation 2.4 shows
after the
exciting light pulse,the
fluorescentlight
pulse fullowsan
exponential decay. The average time a fluorophore remains in the excitedstate,
is calculated by Equation(2.5) revealsthe
average timea
fluorophore remains in the excited state is equal to thelibtime r,
which is typically near 10-8 second [2].τ =争 轟事 =牛 環鴇多 =ギ 〒 「
(25)Fluoreacgnca omlaalon
2.1.2 Comparison of lifetime measurements in frequency do- main and time domain
Excltslon by llght pulso Excltalon by
slnusoldally
Fluolaacencemodulated
llght
embsion#ffi -:0 * ,ifi"
fluorophore
Tlme sample
Tlmo姉 =語
L ttli L
Tlme Samp:● T:me
O τl
(a) Frequency domain lifetime measurements (b)Tlme domaln llletlme measurcments
Figure
2.2:
General fluorescence liEtime measurements. (a) Frequency domain lifetime measurement and (b) Time domain lifiatime measurements.There are two general methods
to
measure fluorescencelifetime.
ln the fre- quency domain method, as shown in Figure 2.2, a fluorophore sample is excitedTimo
む0 C
僣
2.1.
Overview of fluorescence lifutime measurements
with light in which the intensity is modulated sinusoidally. The fluorescence emis- sion
is
modulated atthe
same circular frequency (u,,) as the excitation because the emission is a forced responseto
theexcitation.
However, the fluorescence emission hasa
delayof
phase(Ad;
phase angle)and a
reductionof
relative amplitude modulation(m=\Esf ElFs;
demodulationfactor).
Through both mea- suringA/ and m,
phase and modulation lifetimes (16 andr^,
respectively) are obtained as(26) (27) The phase and modulation lifetimes are generally equal for a singular molecule having single exponential decay
[3].
Fluorescence lifetime imaging (FLIM) in fre- quency domain can be achieved bythe
modulated image intensifiers and wide- field microscopes or by modulating single channel deteclors used in laser scan- ning microscopes[4].
Onthe
other hand, time domain lifetime measurements use pulsed excitationfur
excitinga
fluorophore sampleand
recordthe
fluores- cence decaydirectly. As
shournin
Figure 2.2(b),the
fluorescence lifetime (r1) is defined as the timewhen
intensity decay becomes Anf e where,46 isthe
ini-tial
intensityof the
fluorescencedecay.
FLIM in time domaincan be
achieved by gated image intensifiers, by directly gated CCDs, by countingthe
photons in several parallel time gates,or
by time-conelated photon counting[5].
Becausethe time domain and the frequency domain are theoretically equivalent, it is very hard to judge simply which domain is superior for achieving FLIM. Here, there is a good report to deserve consideration for the
comparison. ln
[6], while in their practical implementation for the fluorescencelibtime
measurement the time do- main measurement provides a better signal-to-noise ratio (SNR) for low-intensity images, the frequency domain measurement ishster and
provides less distor- tion for brightsamples.
Moreover,a
remarkable development of CMOS process in recent can helpto
integrate various functions on a same chip, that makes in- creasing total system speed and reducing distortion bycrosstalk.
These reasons show obviously whycunent
studies including this work are focused on the time domain lifetime measurements.13
%=ω
ltan△φ
,… ‐ 77
2.1,
Overview of fluorescence lifetime measurements
2.1.3 Time-resolved fluorescence Iifetime measurement in time domain
Single photon counting method
14
Excitaion
by
Fluorescence lifetlmelightpulse
detectionlnputpulse
B-l--l oo Il Ar -,to |x--E
outputputseV
4 Avalanchelluorophore ii
dlod'sampre Monitoringclock
(clock 3p€ed;Mck)
lnputpulse(l.r) Output pulse(l.t)
lnputpuls.(znd) Output puls.(2nd)
lnputpuls€(3d) Output puli.(3d)
lnputpuls€(Nrh) Outputpulse(Nh)
Figure 2.3: Simple principle of single photon counting method.
Figure 2.3 shows a simple principle of the single photon counting method. The decaying measurement by the single photon counting method is started with the pulse input fur exciting
a
fluorophoresample.
The excitation light is weakenedto count
photonone at a time. The time
interval betweenthe pulse
input andthe
pulse outputs detectedwith
photomultipliertubes
(PMTs)or single
photon avalanche photodiodes (SPADs) is measured with atimeto-amplitude
converterTime
*Detected time(TD)
=(#olclks)x 1/Mck
Detected time(TD)
2.1.
Overview of fluorescence lifetime measurements
(TAC) or a time-to-digital converter (TDC). A periodical pulse input is used for de- tecting a large number of photons and measuring a time-histogram of the fluores- cence emission. This time-histogram represents the time-resolved decay, which shows the lifetime of the fluorescence emission because fluorescence emission is
a
random event and its lifetime is an averaged value.At
present the electron- ics are not fast enough to measure multiple photons at each excitation when the lifetimesare
inthe
nanosecondrange.
To avoid pileup effect in whieh multiple photons are excited at each excitation, excitation frequency is limited under 5%of
photon countingrate.
This limits the dynamic range of the fluorescence lifetime measurements.Pulse
sampling method
Figure 2.4 shows
a
simple principle ofthe
pulse samplingmethod.
The ob- jective of the pulse sampling method is the same as the single photon counting method, which isto
measurethe
time-resolveddecay. And the
decaying mea- surement is also started withthe
pulse input for excitinga fuorophore
sample- However,the
fluorescenceemission is
sampled sequentiallyby
moving time- window having different delaytimes. After a
large numberof
repetitive pulses, the time-resolved decay has been sampled fora
number of delay times and the decay can be analyzed.Time domain lifetime measurement method
inthis research
When a very short pulse (typically less than 100ps) excitation light irradiates
a
specimen which carries fluorescent probes,the
probeswill
emit fluorescencewith
rapid exponential decaying, typically nano-secondto
several tensof
nano- seconds, as shown in Figure2.5 (a).
When the fluorescence intensity becomesl/e
of the initial intensity A0 att : r,
the timer
is defined asthe libtime
of thefluorescence. The
fluorescence intensityA(t) is
proportionalto
populationof
fluorophores in the excitedstate.
The fluorescence decaying is detected in the system shown in the block diagramof
Figure 2.5(b).
Fluorescence incidents on 152.1.
Overview
offluorescence lifetime measurements
16Excltalon by light pulse
l!E !
Pulsein
Fluorescence llfietlme detection
aD
-* 0 -,to'JJ*uon"o"or,
lluorophore
vtl !
+sample
ヽ●E●一C¨
Pulsein Gatlng(18t)
Pulseln Gating(2nd)
Pulseln Gatlng(3rd)
Pulseln Gatlng(Nth)
Figure 2.4: Principle of pulse sampling method,
the photo detector and generates photo electrons. ldeally, the electron generation in
the
photo detector follows the fluorescence decay.The
number of generated electrons per unit time can be expressed asち●oo0>
n(t) : no."rpet
i'o)
(2.8)for
t >
0, where n6 is the initial electron number per unit time, to the delay of photo electron generation andr"
the apparent or measured lifetime.ln
orderto
measurethe
fluorescence lifiatime,a part of
fluorescence signal electrons is detected and collected during the time windows. The detection timeTlme TIme
2.1.
Overview
offluorescence lifetime measurements
17驀+
ー
m m
∝ ハ
S
Fluorescence lntensily decay a(t)= Aoexp(-! )
80ps'
Excitation light ,/' FluorqscencePhoto+lectronFlux
n(t)=ro.rpG
t;*n
)
VDrah
(1●1く tくtdl+T)
VDram (lυ くtくtd2+T)
Collecled
El●ctrons iogoN(td)
tor+
T
1o,+ TFigure 2.5: Collection of fluorescence signal electrons
window is set by a gate voltage Vo.ui" at the charge draining gate of photodiode.
The
detectiontime
windowsin
Figure2.5 are
indicatedby the
duration whenVo.,:, is
lowlevel.
Generated photo electrons are accumulated byan
electron collector every periodT
of the time window. The starting point of time window is delayed by a delay generator and the electrons are collected from the time of ta to td+ T.
lf t6 is assumedto
be zero for simplicity,the
number of accumulated electrons N(rd) by the charge collector is expressed asime 詢 td
D T
2
^. り
卜は T→ 撻
Ercitarion Light
嘲≪認 に
{糀 ,uり 難 同
(29)2,2.
Relationship between potential barrier and current through barrier
18if T
is chosen large enough so that theterm
ofexp(-(ta + T)/(2.))
is negli-gible.
As the fluorescence from an actual biological specimen is very weak, the average number of collected photo-electrons for each excitation light is often less thanone.
To intensify the signal,the
excitationis
repeatedbr
many times and the photo-electrons are repeatedly collected by the same window. The resultingtotal
numberof
photo-electrons bythe
repeated process also follows Equation (2.9). The dependency of the collected photon electrons during the time window as a function of td is illustrated in Figure 2.5 (c), together with fluorescence photo electrons and timewindow. The
number of collected electronsfirst
decays ex- ponentially, followed by a long low level tail which is caused by noise fluctuation.Fluorescence lifetime is obtained from the gradient of the exponentially decaying region of the number of collected electrons,
dUnN(td))
dta (2.1o)
2.2 Relationship between potential barrier and cur- rent through barrier
1
dimensional potential distribution of barrier
Current in n type semiconductor includes drift current (Ja,irt ) and diffusion cur- rent J66o"1o,,. Hence,
Jn
:
Ja,t,!t- Jai
lo"ionDrift velosity za,is is given by
(2.11)
ud,ri.lt:
ptu'E: tt"'Yd
Drift current J6;6 is given by
(2.12)
Jaafi
: Q.
udrnfi:
Q.n. F". Vd
Diffusion flux is given by
(2.13)
F": -D"'Vn
(2.14)Ta
2.2.
Relationship between potential barrier and current through barrier
19Diffusion current is given by
Jai1u"t-,: q. Fn: -q. D".Vn
Therefure, total current is given by
(2.15)
Jn: Ja,fil Ja$f."t-": e.n. ltn.Vd- q.Dn.Yn
(2.16)Potential of intrinsic level is given by
o: -8, 'q (2.17)
Fermi potential is given by
,b: 'q -E'n (2.18)
Goncentration of n-type semiconductor is given by
,:no.opl#@-,Dl e.$)
Diffusivity of electron is given by
D":
KTi.p^
(2.201Vector-valued differential form of concentration is given by
"" : ":'"ffir--^r"#'or-'r'
(2'21) Total cunent is given by
J* : s. nqnVd-
o.". #. (vd-vrD.ffu"
:
q.npn. Vd -
q.n.
p,".(Vd - Vt!)
--q.n.p".VlL,
(2.22)ln the case of
one-dimensional, currentis
continuousand
concentrationof
electron is invariable along time [7].▽ψ =#
{2.23)2.2.Relationship between potential barier and current through barrier 20
Pos:tion Position
poten‖ al φ potential d
Figure
2.6:
Potential distribution using broken line approximation (80, (E1 and E3are absolute values of each elechical field). (a) Normal barrier; (b) Barrier around storage diode.
ln area where no current is generated, Jn is contiant. Equation
2.22
can be written as f,cllows,﹇●ン●コ
¨ 暉
︐ EO■OL
︐ ¨ 0コ一●gL●●目O
(a)
/」
L・ e―券φ
Jα= /9 μπ η
̀
▽ψθ
静ψα″
=/9 μ η 物 併 Cホ ψ
dZ=/9.μ η ・ 物 ・
e みψ
dψ=9 μ π ・ し← 等
)・ e ttψ ttθ
=―
んT
μηQ c+ψ
tt 0r3xo
―
El(―″
o)+φo,″o≦″≦
01φ
l, ωl≦ ≦″2fu(c-r2) + fi,
021t 1a,
φ
3,0saa
As shown in Figure 2.6 (a), the potential distribution of barrier ficllows
φ
O,(224)
(2.25)
and Equation 2.24 can be solved in the following three conditions:
Xl X2 X̀ X2
2.2.
Relationship between potential barrier and current through barrier
21(1) When:16
( x (
x1, the current is constant,/Jn e― 滞φ
d″= /島
.e 静φ
dφ」 菫
(226)hence,
When
x: xr,
(2)When Xl
=幕 寺 ← 等
)イル φ
=島 告・ λ
Tg・ C 静φ
From Equation 2.24 and Equation 2 26,
=霧 ¬ 乳
λト ル
J「
静ψ― 励 句=等 <「
力φ一 ご 的Ii
島 =―
ltn. u
.Er
.q(e #+ - "- #h)
e ttφ ̲e―力術
"#@r'!t) : - 島 「 Fn' ― ni' C券 Et
(φl ・' o河a
s#@t-'to)Q
島・ C#φ
d″= ―λ
Tμn・π ,c 静 ψ
ttθ
l洗 (2.29)島 =―
̲ =e f2・
ψl̲e静
仇―
¨
=θ静(φl―ψ
l)̲e券
(φl―ψo)(2.27)
(2.28)
(2.30)
(231)
(2.32)
(233)
(234)
(235)
(2.36)
(2.37)
(238)
≦
X≦ X2,φ=φ
l iS COnstant,/43・ e―
+φd″
= ム
e 静φ ・″
: J^' s-#h ',
2.2.
Relationship between potential barrier and current through bawier
22 From Equation 2.22 and Equation 2.32,ガ島 計φ 伽=抑 rに 静 ψ +q挽 2η
=
島 c 券φl・ ″菫1 (240)
hence,
―λ7・ μη
η.(θ 券ψ―C―券ψ
l)=島
.θ 滞φl(″ ―″1) (2.41) 島 =― 魃 場 ψ σ滲り
φl(α 一 ″1)
= 00
From Equalion 2 42,
cポ← ω θ 急に の =場 00
(3)When X21≦ X≦ X3,e燈Ct口c lett E3=撃 ,dm‖ arto Equalon 2 32,
島 =‑ 2竹
When x=x2,Sim‖
arto EquaJon 2 36,計 ゆ初 =饉 脚 "の 20
Using Equation 2 43,Equation 2 36‐ Equation 2.45 obtains,
cポ仇■0̲θ が "の =覇
鳥 卜生 二
審 竺 里 一生三
餐 竺 2ト
θ静
(a―力 )̲e芸
(●― ψ 3) (246) 鼎 =「 れ 卜些 宰 霊 く :[ユ
l十θ券(φ
l力 )̲e静
(φl ψ3) (247)
Therefore,
島 =
(248)When ψ o≪ 化
,仇一φ l≫ 号
,φ3 φl≫ ギ
,the concentra‖ on of dectЮnsin the area of x≦ xO is nO.Assumingφ
O〜ψ
o,島 〜 N 田
2.2.
Relationship between potential barrier
andcurrent through barrier
231
dimensiona! potential distribution of barrier around storage diode
As shown in
Figure2.6 (b), the
potential distributionof banier
around the storage diode followsφ
(・)=
d", t 3r"
Es(r-r")+$", r"ar3ro
-Et(r-ro)*do, roar!rr
(2.50)
φ
l,rtSr3xz
E3(″ ″2)十
φ l, ″
2≦″≦″
3佑,
lDs3x
Assuming floating capacitanG€ Cso exists at x0, $s and Sl vary along time.
lnitial
curent
J6 is(251)
s
is
cross-sectionarea of
current, and d is distance that charges travel., ud,ift.t.S.no.q
tn: T : lln. b. J 'rh .q
lnitial electric field is given by
E=
ツT″2 πl
λ
T
9
″2
1(252)
(253)
(255)
JO=た Tμ
・ ・ηO S
(254) 12-fil
when
E1,, + E+
and E3 >>+ -,*'
Equation 2.49 can be rewritten as几 =考 争 =CsD等 「 〜
1生」 篭ご」 竺型生
N JOセ券
0「●
olんT
Also assume capacitance
Cr
exists between xo ondxr,
and capacitance C2 exists between x1 olld x3,△ 01=0△ 佑
(256)2.2.
Relationship between potential barrier
andcurrent through banier
24And,
△ 0=(α tt C)△ φ
l△ 0=△ 01
λ Tの D(1+a)
9.ι扮 +」 四
(257)
(2.58)
(259)
(260)
(2.61)
(262)
(2.63)
(264)
(265)
(266)
that is
△φ
l=乱
△φ。From Equalon 2.55,
θ
sD e券
(φo φl)dφO=島
.読From Equalon 2.59
d(φo―φ
l)=dφ
o一dφl=dφ
o―乱 dあ
=乱
αφ0GD e静 。∝φ l)∵
《φ
O―φl)=島
dι五 懲 )の D謡 。 ¨ ω ≒ヂ《 φ
O―ω =10島 効
の D⊆ 寿 2等
C滞°
Oφ。
1雛舞 =0=島 ・
t憶=0When t=0,φ 。=φ
l,SOι = (bD トホ●°
φll― ll(え +6ち笙
= 洗
=鱚 ∵ 十榊¨― 」
and,
φ
o―φ l=lFれ
[肩義讐ギ響 t,十 」
=等 れ 〔
wheЮ ,Cl=̀3,C2=̀翡 :△Vl=El.(xl Xo),and△ V2=E3(X3 Xl).
Assume El=E3,then t=会 普 =等 瑞
傷 ― 仇 =lF・ ltt rll tt ll
(2.68)2.3.
Estimation on optical system 25
2.3 Estimation on optical system
An estimation [8] of the intensity of the emitted light from the fluorescence dye spots can be derived from Beer-Lambert's law given by
T=1=10‑dM
where
T
is the transmissivity of light traveling through a medium.lt
is defined as the ratio ofthe
intensities of incident excitation light 16 to the transmitted excita- tion lightI.
e denotes the absorption coefiicient of the medium,I
is the distance traveled through the medium, andM
is its molar concentration in moles per unit volume. ln the proposed setup, where planar fluorophore spots are deposited on the surfiace of a glass slide, the medium length I is negligible.The fraction
of
excitration light intensity absorbed bythe
planar spotcan
be expressed as4=1‑T=1‑10(S
(2.70)where S
:
Ix M
is the concentration of fluorophores on the planar spot in moles per unit area.The fluorophore
emib
photonsat a
longer wavelengthwith
an efficiencyof
r;noo. The amount of photons
Nrr
incident on the photodetector can be calculated by(269)
(2.71)
(272)
where 461o()"-) is the filter
transmissionat the
fluorescence emission wave- length,4*
isthe
collection efficiencyof the
non-collimated light fromthe
fluo- rescing spot, and Epr is the photon energy of the excitration, given by月 ρλ=モ
‰ =Ъ ・ η μ セ rp師
)η″ ι 。 ス ・ 豊
雉 ≪
1where h is
planck's constant,c is the
speedof light, and .\o is the
excitationwavelength.
Equation 2.72 assumes that the amount of excitation reaching the photodetector is negligible compared to theemission.
The filter requirement for this assumption to be valid is(2.73)
2.4.
Estimation
ontime resolution 26
The photodetector current can be expressed asIpo:npo.rlfi.u,Npn
(274)where ?pD is the photocurrent collection efficiency of the photodetector, and 461 is the fill factor
ofthe
pixel. The voltage developed on the photodetector at the end of the integration time can be expressed aswhere Tint is the integration tirne of the photodiOde,and CPD iS the photodiOde capac:tance
yP,==貯
2.4 Estimation on time resolution
Lifigtime
can be
calculatedusing
numberof
photo charges detected different delay time of time windows 141,Tr
and 72.Tz
-Tt LTp - -w - I;E*,
where, number of photo charges N1 and
N,
are presented as,川
2=
0(T2)9
∂τ
∂Ⅳl
△■2
『η
(鍔】
2△T12
『π
(捲】
2銚 △T12
(2.75)
at mO
(276)
(277)
(2.78)
(279)
(280)
鋼 一 9
蝸
∂
7 1
5△
〒 再 面 可 顕
1 1 △
T12再 °
再 = 『 π持】
21
蝸一 r2
一
針 一
処 童← 鋳 )=デ 澄争 .島 =洗
(281)2.4.
Estimation
ontime resolution 27
The deviation fbr presenting accuracy is
ゲ =(轟
5アσ
l・2+(品 ア ■ +(乱 ルσ L
七 脳 2Httμ tt・ 洗 跳
Neglecting the read noise, the fluctuation of
Nr
and Ir2 is determined by shot noise41=Ⅳ
l42=乃
Number of charges can be ca!culated by
(2.84)
(285)
手 =(箭 ア +(豊 ア轟 +喘 ア
=(各 甍 号 )2+(品 ア 喘十 寺
θ η (:)酢 =1 7 θ η (:】
1+△Tθ η (:)洸 =卜 7 θ η (:】
1+△T
72
鳩
(282)
(283)
(2.86)
(287)
7 7
△
△
+
+
f f
一一 既
馬
島
一既
一ア
eaズ・
+△r)+7 eη (子
)―
r eqズー等 )+7 θ η (手
)=̀傾 雫 )=θ 颯等 )2町
両
=可
・θη(―埋│) 289)
△T12 iS the difFerence between h″ o delay tirno of tirne面ndows lts deviation is caused by the itter k Ofthe delay generaton
ん =(箭 ソ
(290)2.4.
Estimation
ontime resolution 28
Herel we ignore this tem and assume λ==o Set A= △T12
Then,
o2 IIt.1
u:f:k* Ar' (r, *n,'erpA):k+ Ar.Nt.fl+expA)
The minimum of A can be calculated at
島 =― 島 一 留 +轟 判
(2.91)
(292)
(293) Hence,
A. ecpA:2(1 +
erpA) (294)Set a function fto be
f : A.
ecpA-
2(1.+ expA)
(2.95)Equation 2.95
can
be calculated using Newton Methodas
shownin
Figure 2.7 . The procedures are as follows:(1) Find the minimum value of function
t
which is Ao.(2) Choose another value
Ar
to be different from A6, and plot the tangent line G(A1) of the functionf
atAr.
The crossing point of the tangent line G(A1) and A-axis is A2.(3)
Findthe
crossing pointof the
tangentline
G(A2)and the A-axis at
A3.Compared with Az, A3 is nearer to the solution
A*
of the functionI
which is thecrossing point of the function f and the A-axis,
(4) Then find the next crossing point at A4. A4 is nearer to
A*
than A3.The
morethe
above procedure repeats,the
morethe
crossing pointA"
be- comes nearer to the solution A*.The gradient of Equation 2.95 can be calculated as
∫ ′
=(И
‑1)eapA
(2.96)2.4.
Estimation
ontime resolution 29
∠´ )‐ ´ ´ 〜
when,
Figure 2.7'. lllustration of Newton Method fior Solving Function
θ
(■o)=∫ ′
(■
o)=(A‑1)・
Cηp五=0
→ ス
=1
G′
(4ol=∫
″(A=五 C"メ =̀〜 27>0 (299)
So A=l is the minimum vaiue offunction i Setinlial value ofス to beス
1=11>
0,C(■.)iS the gradient of function f at九 .
(297) (298)
(2100) (2101)
愕 =α 句
→ 五