View source for Scale-space theory

A theory of multi-scale representation of sensory data developed by the image processing and computer vision communities. The purpose is to represent signals at multiple scales in such a way that fine scale structures are successively suppressed, and a scale parameter <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200201.png" /> is associated with each level in the multi-scale representation.

For a given signal <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200202.png" />, a linear scale-space representation is a family of derived signals <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200203.png" />, defined by <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200204.png" /> and

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200205.png" /></td> </tr></table>

for some family <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200206.png" /> of convolution kernels [[#References|[a1]]], [[#References|[a2]]] (cf. also [[Integral equation of convolution type|Integral equation of convolution type]]). An essential requirement on the scale-space family <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200207.png" /> is that the representation at a coarse scale constitutes a simplification of the representations at finer scales. Several different ways of formalizing this requirement about non-creation of new structures with increasing scales show that the Gaussian kernel

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200208.png" /></td> </tr></table>

constitutes a canonical choice for generating a scale-space representation [[#References|[a3]]], [[#References|[a4]]], [[#References|[a5]]], [[#References|[a6]]]. Equivalently, the scale-space family satisfies the [[Diffusion equation|diffusion equation]]

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s1200209.png" /></td> </tr></table>

The motivation for generating a scale-space representation of a given data set originates from the basic fact that real-world objects are composed of different structures at different scales and may appear in different ways depending on the scale of observation. For example, the concept of a  "tree"  is appropriate at the scale of meters, while concepts such as leaves and molecules are more appropriate at finer scales. For a machine vision system analyzing an unknown scene, there is no way to know what scales are appropriate for describing the data. Thus, the only reasonable approach is to consider descriptions at all scales simultaneously [[#References|[a1]]], [[#References|[a2]]].

From the scale-space representation, at any level of scale one can define scale-space derivatives by

<table class="eq" style="width:100%;"> <tr><td valign="top" style="width:94%;text-align:center;"><img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s12002010.png" /></td> </tr></table>

where <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s12002011.png" /> and <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s12002012.png" /> constitute multi-index notation for the derivative operator <img align="absmiddle" border="0" src="https://www.encyclopediaofmath.org/legacyimages/s/s120/s120020/s12002013.png" />. Such Gaussian derivative operators provide a compact way to characterize the local image structure around a certain image point at any scale. Specifically, the output from scale-space derivatives can be combined into multi-scale differential invariants, to serve as feature detectors (see [[Edge detection|Edge detection]] and [[Corner detection|Corner detection]] for two examples).

More generally, a scale-space representation with its Gaussian derivative operators can serve as a basis for expressing a large number of early visual operations, including feature detection, stereo matching, computation of motion descriptors and the computation of cues to surface shape [[#References|[a3]]], [[#References|[a4]]]. Neuro-physiological studies have shown that there are receptive field profiles in the mammalian retina and visual cortex, which can be well modeled by the scale-space framework [[#References|[a7]]].

Pyramid representation [[#References|[a8]]] is a predecessor to scale-space representation, constructed by simultaneously smoothing and subsampling a given signal. In this way, computationally highly efficient algorithms can be obtained. A problem noted with pyramid representations, however, is that it is usually algorithmically hard to relate structures at different scales, due to the discrete nature of the scale levels. In a scale-space representation, the existence of a continuous scale parameter makes it conceptually much easier to express this deep structure [[#References|[a2]]]. For features defined as zero-crossings of differential invariants, the implicit function theorem (cf. [[Implicit function|Implicit function]]) directly defines trajectories across scales, and at those scales where a [[Bifurcation|bifurcation]] occurs, the local behaviour can be modeled by singularity theory [[#References|[a3]]], [[#References|[a5]]].

Extensions of linear scale-space theory concern the formulation of non-linear scale-space concepts more committed to specific purposes [[#References|[a9]]]. There are strong relations between scale-space theory and wavelet theory (cf. also [[Wavelet analysis|Wavelet analysis]]), although these two notions of multi-scale representation have been developed from slightly different premises.

====References====
<table><TR><TD valign="top">[a1]</TD> <TD valign="top">  A.P. Witkin,   "Scale-space filtering" , ''Proc. 8th Internat. Joint Conf. Art. Intell. Karlsruhe, West Germany Aug. 1983''  (1983)  pp. 1019–1022</TD></TR><TR><TD valign="top">[a2]</TD> <TD valign="top">  J.J. Koenderink,   "The structure of images"  ''Biological Cybernetics'' , '''50'''  (1984)  pp. 363–370</TD></TR><TR><TD valign="top">[a3]</TD> <TD valign="top">  T. Lindeberg,   "Scale-space theory in computer vision" , Kluwer Acad. Publ.  (1994)</TD></TR><TR><TD valign="top">[a4]</TD> <TD valign="top">  L.M.J. Florack,   "Image structure" , Kluwer Acad. Publ.  (1997)</TD></TR><TR><TD valign="top">[a5]</TD> <TD valign="top">  J. Sporring,   et al.,   "Gaussian scale-space theory" , Kluwer Acad. Publ.  (1997)</TD></TR><TR><TD valign="top">[a6]</TD> <TD valign="top">  B.M ter Haar Romeny,   et al.,   "Proc. First Internat. Conf. scale-space" , ''Lecture Notes Computer Science'' , '''1252''' , Springer  (1997)</TD></TR><TR><TD valign="top">[a7]</TD> <TD valign="top">  R.A. Young,   "The Gaussian derivative model for spatial vision: Retinal mechanisms"  ''Spatial Vision'' , '''2'''  (1987)  pp. 273–293</TD></TR><TR><TD valign="top">[a8]</TD> <TD valign="top">  P.J. Burt,   E.H. Adelson,   "The Laplacian Pyramid as a Compact Image Code"  ''IEEE Trans. Commun.'' , '''9''' :  4  (1983)  pp. 532–540</TD></TR><TR><TD valign="top">[a9]</TD> <TD valign="top">  "Geometry-driven diffusion in computer vision"  B.M ter Haar Romeny (ed.) , Kluwer Acad. Publ.  (1994)</TD></TR></table>