USOO6607301B1

(12) United States Patent (10) Patent No.: US 6,607.301 B1

Glukhovsky et al. (45) Date of Patent: Aug. 19, 2003

(54) DEVICE AND METHOD FOR DARK 4,689,621 A 8/1987 Kleinberg

CURRENT NOISE TEMPERATURE SENSING 4,744,672 A * 5/1988 Tursky et al................ 374/178
IN AN IMAGING DEVICE 4,844,076 A 7/1989 Lesho et al.
4,891,970 A * 1/1990 Remboski, Jr. ............. 374/144
(75) Inventors: Arkady Glukhovsky, Nesher (IL); 5,098,197 A 3/1992 Shepard et al.
5,279.607 A 1/1994 Schentag et al.
Gavriel Meron, Petach Tikva (IL); 5,354,130 A * 10/1994 Seppa et al. ................ 374/175
Gavriel J. Iddan, Haifa (IL) 5,508,740 A * 4/1996 Miyaguchi et al. ......... 348/244
5,604,531. A 2/1997 Iddan et al. .................. 348/76
(73) ASSignee: Given Imaging Ltd., Yoqneam (IL) 5,640.235 A 6/1997 Iwasaki ...................... 356/218
5,746,511 A 5/1998 Eryurek et al.
(*) Notice: Subject to any disclaimer, the term of this 5,819,736 A 10/1998 Avny et al.
patent is extended or adjusted under 35 5,833,603 A 11/1998 Kovacs et al.
U.S.C. 154(b) by 0 days. 5,853,005 A 12/1998 Scanlon
6,184,511 B1 2/2001 Yamashita ............... 250/2012
(21) Appl. No.: 09/806,714
FOREIGN PATENT DOCUMENTS
(22) PCT Fed: Aug. 3, 2000
GB 2 353 166 A * 2/2001
(86) PCT No.: PCT/IL00/00470 JP 4109927 4/1992
JP SO15515 1/1993
S371 (c)(1),
(2), (4) Date: Oct. 9, 2001 OTHER PUBLICATIONS

(87) PCT Pub. No.: WO01/10291 Jones, B.K., “Electrical Noise Thermometer,” Appl. Phys.
vol. 16, No. 1, pp. 99-102 (May 1978).*
PCT Pub. Date: Feb. 15, 2001 The Radio Pill, Rowlands, et al., British Communications
(51) Int. Cl." ............................ G01K 7/32; A61 B 5/01; and Electronics, Aug. 1960, pp. 598-601.
A61B 1/04 Video Camera to “TAKE”-RF System lab, no date.
(52) U.S. Cl. ....................... 374/175; 374/117; 374/121; (List continued on next page.)
374/141; 600/549; 600/109
(58) Field of Search ................................. 374/175, 117, Primary Examiner Diego Gutierrez
374/141, 136, 121, 120, 128; 356/43, 44; Assistant Examiner Stanley J. Pruchnic, Jr.
600/474, 549, 101, 109, 117, 118, 127, (74) Attorney, Agent, or Firm-Eitan, Pearl, Latzer &
153, 160, 562, 573, 104-106; 348/65, 74–77, Cohen Zedek, LLP.
81–85,909; 250/339.04, 352; 327/512 (57) ABSTRACT
(56) References Cited A device, method and System for Sensing the temperature of
U.S. PATENT DOCUMENTS an environment. An image Sensor may be introduced into an
environment having an image Sensing module. The dark
3,937,086 A * 2/1976 von Thuna ................. 374/175 current noise of the image Sensor may be sensed, and the
3,971,362 A 7/1976 Pope et al. temperature of the image Sensor (and environment) calcu
4,246,784. A 1/1981 Bowen lated. Such a device, System and method may be used in, for
4.278,077 A 7/1981 Mizumoto example, a medical imaging device.
4,643,587 A * 2/1987 Makabe et al. ............. 374/124
4,646,723 A * 3/1987 ... 600/109
4,646,724. A 3/1987 Sato et al. .................. 600/109 37 Claims, 4 Drawing Sheets

ENSERT IMAGE SENSOR -10

DARK PEREOD -1 LLUMINATION PERFOD -12

-----
OTAIN WISUAL EDATA
OBAN DARK -13
CURRENT DAA -
DISPAY WISUAL DATA --- 16
AMPLY -5

CACULATE SENSOR
EPERATURE ---

CACUAE ENWRONMEN
TEMPERATURE

DISPLAY ENWROMENT
TEMPERATURE

Noo
 US 6,607.301 B1
Page 2

OTHER PUBLICATIONS CCD arrays cameras and displays, Holst G.C. p128, 2"
llesl ds bod Edition, Spie Press 1998 (no month).
Wellesley company sends body montiors into Space-Crum, Photobit PB-159 DX Product Specification, Aug. 1998
Apr. 1998. (Version 3.0).
WireleSS transmission of a color television moving image www.io.com-Random Electrical Noise: A Literature Sur
from the Stomach using a miniature CCD camera, light R hC
Source and microwave transmitter. Swain CP, Gong F,s Mills tS f
vey, Kesearcn Uomments Ciph
Irom Upners, Ritt
Killers, 1999 (Dec)
(Dec).

TN. Gastrointest Endosc 1997:45:AB40. * cited by examiner

U.S. Patent Aug. 19, 2003 Sheet 1 of 4 US 6,607.301 B1

INSERT IMAGE SENSOR 1O

DARK PERIOD 11 LLUMINATION PERIOD 12

OBTAIN VISUAL DATA - 14

OBTAN DARK 13
CURRENT DATA
DISPLAY VISUAL DATA - 16
AMPLFY 15

CALCULATE SENSOR 17
TEMPERATURE

CALCULATE ENVIRONMENT 19
TEMPERATURE

DISPLAY ENVIROMENT 18
EMPRATURE

1 OO

FIG.1
U.S. Patent Aug. 19, 2003 Sheet 2 of 4 US 6,607.301 B1

26
LLUMINATION
INDICATOR
MAGE
SENSOR 24 22 21
TEMPERATURE INTEGRATING
SENSOR SWITCH UNIT DISPLAY

28
TEMPERATURE
SENSITIVE UNITS

FIG.2
U.S. Patent Aug. 19, 2003 Sheet 3 of 4 US 6,607.301 B1

40

MAGE
SENSOR
42 CHIP

CONTROL CIRCUIT O
O
TIMING/LOGIC O
O

44 47 46

FIG.3
U.S. Patent Aug. 19, 2003 Sheet 4 of 4 US 6,607.301 B1

31

32 33
SAMPLE
CHAMBER CAMERAINTEGRATING
CAMERA UNIT ILLUMINATION
INDICATOR

FIG.4
 US 6,607.301 B1
1 2
DEVICE AND METHOD FOR DARK U.S. Pat. No. 4,246,784 to Bowen describes a method for
CURRENT NOISE TEMPERATURE SENSING noninvasive temperature measurement of the interior of a
IN AN IMAGING DEVICE body using the acoustic thermal noise Spectrum of the
measured body.
CROSS REFERENCE TO RELATED None of these temperature measurement methods utilize
APPLICATIONS an image Sensor to measure the thermal noise of a body
material.
This application claims the benefit of PCT patent appli SUMMARY OF THE INVENTION
cation PCT/IL00/00470, filed Aug. 4, 2000, titled “A
METHOD FOR TEMPERATURE SENSING”, which was The present invention provides a method and System for
published in English, and which is incorporated herein by Sensing the temperature of an environment, Such as inside a
reference in its entirety. PCT/IL00/00470 claims the benefit body, by calculating the temperature of an image Sensor in
of Israeli Patent Application 131242, filed Aug. 4, 1999, the environment and deducing the environment's tempera
entitled “A METHOD FOR TEMPERATURE SENSING”, ture from the image Sensor's calculated temperature. The
which is incorporated herein by reference in its entirety. 15
temperature of the image Sensor is calculated by measuring
its generated dark current noise.
FIELD OF THE INVENTION The method and system of the present invention have the
The present invention relates to a method and System for advantage of utilizing an image Sensor, in which thermal
measuring the temperature of an environment, Such as the noise is easily detectable, for deducing the temperature of a
interior of the body. material body. Furthermore, according to the invention, a
Single Sensor is utilized for obtaining visual data and data
BACKGROUND OF THE INVENTION relating to the temperature of the environment. Thus, diverse
information about an environment can be obtained utilizing
In many circumstances it is important to measure the a single Sensing device.
temperature inside a material body. Such circumstances may 25 There is thus provided according to the present invention
occur during industrial processes or exploration and analysis a method for Sensing the temperature of an environment
processes, Such as in geophysical probing or in medical comprising the Steps of introducing into an environment an
diagnostics and treatment of internal parts of the body. image Sensor having an image Sensing module, Sensing the
Conventional thermometry and absolute thermometry are dark current noise of the image Sensor, calculating the
known methods for measuring temperature. temperature of the image Sensor, calculating the temperature
Conventional thermometry is based upon the temperature of the environment and optionally displaying the calculated
coefficient of properties of materials, Such as resistance or environment temperature.
mechanical expansion. It will be appreciated that the term “environment” in the
Absolute thermometry is a method which directly mea present invention relates to a Space enclosed within walls in
Sures thermal energy of a Sensor resistance. This method is 35 which it is desired to measure the temperature of the Space
based upon the known physical phenomenon of Spontaneous and/or of the walls.
thermal noise arising from the Brownian motion of ionized The temperature of the image Sensor is indicative of the
molecules within a resistance. temperature of it's immediate Surroundings and, relying on
Thermal noise, which can be discussed in terms of ther known factorS Such as heat distribution, distance from the
mal current, provides a direct measurement of temperature 40 image Sensor, etc., the temperature of further areas can also
be calculated.
on a thermodynamic Scale, thus the Boltzmann constant The image Sensors utilized in the invention can be digital
defines the temperature. The phenomenon of thermal noise cameras or Video cameras Such as Vidiocon, CCD cameras
is derived, for example, in the book: CCD arrays cameras or CMOS cameras.
and displays by Hoist G. C., p. 128, 2" edition, SPIE Press, 45 The present invention further provides a System for Sens
1998. The formula used to define thermal current is:
ing the temperature of an environment. The System com
prises an image Sensor having an image Sensing module in
communication with an integrating unit for detecting the
where k is the Boltzmann constant, T is the temperature of dark current of the image Sensor image Sensing module and
a Sensor, and C is the capacitance of the Sensor. Thus the 50 for calculating the temperature of the image Sensor. The
magnitude of the Signals produced by the thermal current is integrating unit may further calculate the temperature of the
directly proportional to the Square root of the temperature of environment or the temperature of the environment may be
the Sensor. Experiments have indicated that the Signal calculated, based on data from the integrating unit, by a
doubles with the increase of 7 C. (degrees Centigrade), Separate unit that is in communication with the integrating
which means that a resolution better than 0.1° C. is achieved. 55 unit
In image Sensors, the thermal current produced in an The integrating unit may have an amplifying function for
operating photodetector device, when no optical radiation amplifying Signals received from the image Sensor.
impinges on the detector, is called “dark current”. In CCD The communication between the image Sensor and inte
cameras dark current is basically charge which accumulates grating unit can be optionally controlled according to the
in the CCD pixels due to thermal noise. The effect of dark 60
illumination conditions, optionally through a Switch which
current is to produce an additive quantity to the electron enables communication only during periods in which the
count in each pixel. Sensor is not illuminated.
U.S. Pat. No. 3,937,086 to von Thuna, U.S. Pat. No. BRIEF DESCRIPTION OF THE FIGURES
5,354,130 to Seppa et al. and U.S. Pat. No. 5,098,197 to
Shepard et al. all describe devices for measuring the absolute 65 The present invention will be understood and appreciated
temperature of a body material by receiving and analyzing more fully from the following detailed description taken in
the thermal noise of the body material. conjunction with the figures in which:
 US 6,607.301 B1
3 4
FIG. 1 is a block diagram representing an embodiment of It will be appreciated that the various calculations are
the method according to the invention; carried out by Software or Software means executable on
FIG. 2 is a Schematic illustration of an embodiment of the computing means Such as a computer or Similar data
System according to the invention; processors, microprocessors, embedded processors,
FIG. 3 is a schematic illustration of a functional block microcomputers, microcontrollers etc.,
layout of the image Sensor according to the invention; and The integrating unit 100 may comprise Separate
FIG. 4 is a schematic illustration of a medical device
processors, which need not all be physically connected.
Some of the functions carried out by integrating unit 100,
comprising the System according to the invention. Such as calculating the image Sensor temperature 17 and
DETAILED DESCRIPTION OF THE calculating the environment temperature 19, can be carried
INVENTION out in processors that are external to the environment and
that are fed with data from the integrating unit 100 by
Analytical and diagnostic processes which utilize image communication Such as by IR or radio. Indeed, if an operator
Sensors to monitor environments could benefit from obtain is to note the temperature of the environment, at least the
ing information relating to the temperature of the 15
function of displaying the calculated temperature 18 must be
environment, as a local change of temperature can indicate performed externally to the environment.
an irregular event. Integrating unit 100 may be in communication with other
For example, U.S. Pat. No. 5,604,531, which is assigned units to further process and use the data obtained by it. For
to the common assignees of the present application, example, a Swallowable capsule, Such as described in U.S.
describes a Swallowable capsule that can pass through the Pat. No. 5,604,531, may comprise a sample chamber for
entire digestive tract and operate as an autonomous video collecting Samples from the environment of the digestive
endoscope U.S. Pat. No. 5,604,531, is hereby incorporated tract. The process of collecting a Sample can be controlled by
by reference. The Swallowable capsule includes a) a camera integrating unit 100, Such that Samples are collected only in
System, b) an optical System for imaging an area of interest locations along the digestive tract in which a predetermined
onto the camera System and c) a transmitter which transmits temperature is prevalent.
the Video output of the camera System. Visual data obtained 25 Reference is now made to FIG. 2 which is a schematic
by the Swallowable capsule can indicate, inter alia, the illustration of the System according to an embodiment of the
location of pathologies in the gastrointestinal tract. Also a invention. The System comprises an image Sensor 20 having
local change of temperature in the gastrointestinal tract can an image Sensing module which includes a pixel array (as
be indicative of a pathology. Thus, the information obtained demonstrated in FIG. 3) in communication with an integrat
by Visual means can be complemented and focused by ing unit 22. Communication is enabled by temperature Sense
information relating to local temperature in the gastrointes Switch 24 which is controlled by illumination indicator 26,
tinal tract.
Such that communication is enabled only during dark peri
ods.
The method of the present invention enables contempo When communication between the image sensor 20 and
rary visual monitoring and temperature Sensing. 35 integrating unit 22 is established, integrating unit 22
The method is schematically described by a block dia receives dark current data from image Sensor 20.
gram shown in FIG.1. An image Sensor, Such as in the above As will be discussed below, it is possible to calculate the
mentioned Swallowable capsule, is inserted 10 into an image Sensor's 20 temperature based on dark current data
environment, Such as the gastrointestinal tract. obtained from a single pixel of the image Sensor pixel array,
Illumination is provided intermittently, either by elements 40 though data obtained from a higher number of pixels will
connected to the image Sensor itself or by external Sources. achieve more accurate results. It is therefore possible to keep
When illumination is provided 12 only visual data is a portion of the image Sensor's 20 pixels of the pixel array,
obtained 14 and displayed 16. A process for obtaining and constantly unexposed to illumination, and obtain dark cur
displaying Visual data is described, for example, in the above rent data from the unexposed pixels, without having to shut
mentioned U.S. Pat. No. 5,604,531. 45 off the illumination.
In an intermittent dark period 11 an integrating unit 100 Thus, dark current data can be obtained also during
is activated to obtain dark current data 13 from the image constant illumination by either covering a portion of the
Sensor, though it is not imperative to shut off illumination in pixels of the pixel array or by having a portion of the pixel
order to obtain data relating to dark current noise, as will be array pixels outside of the image field, e.g. the pixels in the
discussed in more detail below. 50 periphery of the pixel array.
The integrating unit 100 is a processor capable of ampli The integrating unit 22 is a processor capable of ampli
fying the obtained data 15, if necessary, and calculating the fying the dark current Signal and calculating the image
image Sensor temperature 17 using the known equations Sensor temperature from the dark current Signal. It is further
derived for thermal noise. It will be appreciated that these capable of calculating the environment temperature from the
equations are an approximation of a complex phenomenon 55 image Sensor temperature and is capable of displaying the
and that calibration should be employed in order to deduce calculated environment temperature 21. Integrating unit 22
the actual calculations that will be applied. may control different temperature Sensitive units 28, Such as
The environment temperature is then calculated 19, either the Sample chamber described above, in correspondence
by the integrating unit 100 or by a separate unit in commu with predetermined temperatures.
nication with the integrating unit 100. Calculations of the 60 Reference is now made to FIG. 3 which is a schematic
environment temperature are based on the existence of illustration of a functional block layout of the image Sensor
thermal equilibrium between the image Sensor and environ according to the invention. The image Sensor comprises a
ment. These calculations take into account energy dissipa Single chip 40 having an image Sensing module 42 and a
tion from the image Sensor. Local temperature or the average control circuits area 44. The image Sensing module 42
temperature within the environment may be calculated, 65 includes a pixel array 48 for capturing an image. The control
depending on Specific requirements. The calculated tem circuits area 44 includes the timing and logic circuitry 47
perature may then be displayed 18. and A/D circuitry 46.
 US 6,607.301 B1
S 6
Signals can be received from all the pixels of the pixel 2. A method according to claim 1 further comprising the
array 48. Dark current is received from pixels that are not Step of displaying the calculated environment temperature.
illuminated or from pixels during a dark period whereas 3. A method according to claim 1 further comprising the
current Signals received from an illuminated pixel are the Step of amplifying the Sensed dark current noise prior to the
Summation of the dark current and light current of the pixel. Step of calculating the temperature of the image Sensor.
The accumulation of Signals from all the pixels is converted 4. A method according to claim3 wherein the Sensed dark
to data which is communicated through a transmitter to the current noise is amplified by an integrating unit that is in
integrating unit for decoding and for displaying a visual communication with the image Sensor.
representation and/or the temperature derived from the data. 5. A method according to claim 1 wherein the step of
Sensing the dark current noise of the image Sensor is
The system of the invention will be further described and performed by an integrating unit that is in communication
demonstrated by FIG. 4 which is a schematic illustration of with the image Sensor.
a medical device comprising a System according to the 6. A method according to claim 5 wherein any one of the
invention. StepS Subsequent to the Step of Sensing the dark current noise
The medical device illustrated in FIG. 4 is a Swallowable
15
of the image Sensor is performed by a separate unit that is in
capsule, generally referenced 30, Such as that described in communication with the integrating unit.
the above mentioned U.S. Pat. No. 5,604,531. Swallowable 7. A method according to claim 6 wherein the Separate
capsule 30 comprises a CMOS camera 32, that is in com unit is located outside of the environment.
munication with integrating unit 34. The Swallowable cap 8. A method according to claim 5 wherein the integrating
Sule 30 further comprises illuminating elements 36 that are unit is located outside of the environment.
in communication with illumination indicator 33. The gas 9. A method according to claim 1 wherein the steps of
trointestinal tract walls 31 are illuminated by illuminating calculating the temperature of the image Sensor and calcu
elements 36, in intermittent pulses, capturing consecutive lating the temperature of the environment are performed by
images of the gastrointestinal tract walls 31 by camera 32, an integrating unit that is in communication with the image
SCSO.
enabling an operator to view the gastrointestinal tract walls. 25 10. A method according to claim 1 wherein the image
Communication between camera 32 and integrating unit 34 Sensor is exposed to intermittent illuminated and dark peri
is enabled in between illumination pulses when illumination ods.
indicator 33, Sensing the lack of illumination, activates the 11. A method according to claim 10 wherein the step of
temperature Sense Switch (not shown) to an ON position. Sensing the dark current noise of the image Sensor is
Alternatively, the illumination indicator 33 may be acti performed during one or more dark periods.
vated by the operator to simultaneously turn off the illumi 12. A method according to claim 1 wherein the image
nation elements 36 and Switch the temperature Sense Switch Sensor is a Video camera.
to an ON position. 13. A method according to claim 1 wherein the environ
Once communication is established between camera 32 ment is a body cavity.
and integrating unit 34 dark current Signals generated from 35 14. The method according to claim 1, comprising obtain
camera 32 are received and processed, as described above, ing visual data.
by integrating unit 34. The calculated gastrointestinal tem 15. A System for Sensing the temperature of an environ
perature is displayed on a display unit external to the ment comprising an image Sensor in communication with an
gastrointestinal tract. integrating unit,
Swallowable capsule 30 further comprises a sample 40 Said image Sensor being introduced into an environment;
chamber 35 for collecting Samples from the gastrointestinal and
tract environment. The collected Sample may be cells from Said integrating unit receiving dark current noise from the
the gastrointestinal tract walls or a liquid Sample from the image Sensor, calculating the temperature of the image
gastrointestinal tract environment. The mechanism for col Sensor, and calculating the temperature of the environ
lecting Samples, which can be any Suitable mechanism 45 ment.
known in the art, is controlled by integrating unit 34, Such 16. A System according to claim 15 wherein the integrat
that it is activated in accordance with the gastrointestinal ing unit amplifies the received dark current noise prior to
tract environment calculated temperature. Alternatively, the calculating the temperature of the image Sensor, and calcu
mechanism can be controlled by the operator based on the lating the temperature of the environment.
displayed temperature. 50 17. A System according to claim 16 wherein one or more
It will be appreciated by persons skilled in the art that the of the Steps of amplifying the received dark current noise,
present invention is not limited to what has been particularly calculating the temperature of the image Sensor and calcu
shown and described hereinabove. Rather the scope of the lating the temperature of the environment are performed by
present invention is defined only by the claims which a separate unit that is in communication with the integrating
follows. 55 unit.
What is claimed is: 18. A System according to claim 17 wherein the Separate
1. A method for Sensing the temperature of an environ unit is located outside of the environment.
ment comprising the Steps of: 19. A system according to claim 15 wherein one or both
introducing into the environment an image Sensor having of calculating the temperature of the image Sensor and
an image Sensing module, 60 calculating the temperature of the environment are per
Sensing the dark current noise of the image Sensing formed by a separate unit that is in communication with the
integrating unit.
module, 20. A system according to claim 19 wherein the separate
calculating the temperature of the image Sensor from the unit is located outside of the environment.
Sensed dark current noise, and 65 21. A System according to claim 15 wherein the integrat
calculating the temperature of the environment from the ing unit further displays the calculated environment tem
calculated image Sensor temperature. perature.
 US 6,607.301 B1
7 8
22. A System according to claim 21 wherein displaying the 29. A system according to claim 28 wherein the Switch is
calculated environment temperature is performed by a sepa capable of accepting Signals from an external operator.
rate unit that is in communication with the integrating unit. 30. A system according to claim 15 wherein the integrat
23. A System according to claim 22 wherein the Separate ing unit is in communication with functional units for
unit is located outside of the environment. operating Said functional units in accordance with a prede
24. A System according to claim 15 wherein the integrat termined temperature.
ing unit is located outside of the environment. 31. A medical device comprising the System according to
25. A System according to claim 15 wherein the image claim 30.
Sensor is exposed to intermittent illuminated and dark peri 32. A medical device according to claim 31 in which the
ods. functional units are units that enable the collection of
26. A System according to claim 25 further comprising a Samples from the environment.
Switch which is in communication with an illumination 33. A System according to claim 15 wherein the image
indicator for receiving indication of illumination, Said Sensor is a Video camera.
Switch enabling communication between the image Sensor 34. A system according to claim 15 wherein the environ
and integrating unit only during one or more dark periods. 15 ment is a body cavity.
27. A system according to claim 26 wherein the Switch is 35. A medical device comprising the System according to
capable of accepting Signals from an external operator. claim 15.
28. A System according to claim 15 further comprising a 36. A medical device according to claim 35 wherein the
Switch which controls illumination elements for exposing device is a Swallowable autonomous endoscope.
the image Sensor to intermittent illuminated and dark 37. The system according to claim 15, wherein said image
periods, Said Switch enabling communication between the Sensor is capable of obtaining visual data.
image Sensor and integrating unit only during one or more
dark periods. k k k k k