Open access

Probabilistic Analysis of Projected Features in Binocular Stereo

Written By

Lorenzo J. Tardón, Isabel Barbancho and Carlos Alberola-López

Submitted: 05 December 2011 Published: 11 July 2012

DOI: 10.5772/46027

From the Edited Volume

Current Advancements in Stereo Vision

Edited by Asim Bhatti

Chapter metrics overview

1,976 Chapter Downloads

View Full Metrics

1. Introduction

Some geometrical relationships between projected primitives in binocular stereo systems will be analysed in the next sections with the aim of providing a characterization from a probabilistic point of view. To this end, we will consider the parallel stereo system model and the well known pinhole camera model [1].

The characterizations that will be derived will be readily usable as valuable sources of information to solve the correspondence problem in stereo systems [2] and their nature will be that of a priori information sources in Bayesian models.

To begin with, we will introduce the stereo system model that will be used for the analysis together with the notation that will be employed and the parameters that will be necessary for the calculations. Afterwards, we will use this model to derive the joint probability density function (pdf) of the orientation of the projections on the image planes of arbitrary small edges. In this case, we will find a cumbersome expression so, then, we will focus on the derivation of a tractable pdf of a convenient function of the orientation of the projections.

Later, we will turn our attention to the so called disparity gradient, which defines important relationships between projections in stereo systems. We will find three different usable pdfs of the disparity gradient that can be used to solve the correspondence problem in parallel stereo systems. Finally, a brief summary will be drawn.

Advertisement

2. Geometric relationships in the parallel stereo system model

In order to perform our analysis, we consider a common model for stereo image acquisition systems. The two cameras of the stereo system are considered to be identical. These cameras are modelled using the well known pinhole camera model with focal length f, parallel optical axes and image planes defined on the same geometric plane [3], [1]. This description defines the so called parallel stereo system model. An illustration of the geometry and the projection process with this model is represented in Fig. .

For simplicity, the centre of the real world coordinate system is considered to be equidistant to the optical centres of the two cameras of the system (C l and C r ). The optical centers of the cameras are separated a distance b: the baseline. As shown in Fig. , the X axis is parallel to the linebase b and the Z axis is perpendicular to the image planes.

Figure 1.

Parallel stereo system model.

In Fig. , A and B represent the edges of a straight segment AB ¯ of length δ. A is located at (X,Y,Z) in the world coordinate system. The segment has an arbitrary orientation described by the angles α and β defined with respect to the XY and XZ planes, respectively.

The edge points and the segment are projected onto the left and right image planes of our parallel stereo system. Thus, we find the projected points A l and B l on the left image and the projected segment δ l on the same image. Also, the angle between δ l and the horizontal on the left image is denoted θ l . Similarly, on the right image plane we find A r , B r , δ r and the angle θ r .

Recall that the optical axes of the two cameras are parallel in our stereo model. Also, we consider that equally numbered horizontal lines on the two image planes comply with the epipolar constraint [4].

The segments on the image planes that correspond to the projection of the same segment in the real world are partially characterized and related by their respective orientations on the left and right images. This orientation can be analysed to be used to solve the correspondence problem in stereo systems.

Using the model selected, we will focus in the next sections on the orientation of the projection of small straight edges (δ l and δ r ). Then, we will also consider a well known feature: the disparity gradient [5], and we will show how to develop probability characterizations of this feature under different conditions [6].

Advertisement

3. Joint probability density function of the orientation of projected edges

Making use of the geometrical relationships established in the previous section and in Fig. , we will derive a relationship between the location and orientation of the edgel δ [7] in the real world, and the orientations of its projections described by the angles θ l and θ r (Fig. ) in the corresponding image planes. Then, under appropriate hypotheses, we will find the description of the joint probabilistic behaviour of the projected angles.

Consider the definitions and the geometry shown in Fig. where the length of the segment δ is arbitrarily small. We can write the location of the projected points in the left and right images using their coordinates on the corresponding image planes [1]. Let B l =(B lx ,B ly ), then, using the geometry involved and using B and its projections as starting reference, we can write A l =(A lx ,A ly )=(B lx +δ l cosθ l ,B ly +δ l sinθ l ).

Now, let's look at the right (r) image. Under the hypotheses described previously, and using the length of the projected edgel on the right image, δ r , making use of the fact that the y coordinates must be the same in the two images, it is simple to observe that δ l sinθ l =δ r sinθ r and, so, δ r =δ l sinθ l sinθ r .

After these observations, the coordinates of the projections of A and B can be written as follows:

A r =(A rx ,A ry )=(B rx +δ l sinθ l sinθ r cosθ r ,B ry +δ l sinθ l )B r =(B rx ,B ry )uid2

But our objective must be to find the relation between the projections and the orientation of the edgel in the real world, such orientation is described by the angles α and β in Fig. . Working in this direction, the following relations can be observed:

α=arctanB z -A z B x -A x β=arctanB y -A y (B x -A x ) 2 +(B z -A z ) 2 =arcsinB y -A y (B x -A x ) 2 +(B y -A y ) 2 +(B z -A z ) 2 uid3

On the other hand, using the projection equations of the pinhole camera model [1], the following relations can be found:

X=-x l b x r -x l -b 2Y=-y l b x r -x l Z=fb x r -x l uid4

where (X,Y,Z) correspond to the coordinates of a generic point in the real world and (x l ,y l ), (x r ,y r ) correspond to its projections on the left and right images, respectively.

Now, using eqs. () to () together with eqs. () and (), it is possible to find the expressions of the following terms involved in the calculation of the projected angles:

B x -A x B y -A y B z -A z uid5

Then, using these expressions in eq. () and writing all the terms as functions of the real world coordinates of A, the coordinates of B r , the camera parameters f and b and the orientation of the projections of the edgel (θ l and θ r ), we find the equations that lead us from (α,β) to (θ l ,θ r ):

α=arctanZsin(θ r -θ l ) Xsin(θ r -θ l )-b 2sin(θ r +θ l )β=arctanbsinθ l sinθ r -Ysin(θ r -θ l ) [Xsin(θ r -θ l )-bsin(θ r +θ l )] 2 +[Zsin(θ r -θ l )] 2 uid6

After these operations, we are ready to derive the joint pdf of the orientation of the projections of the segment: f θ l ,θ r (θ l ,θ r ). To this end, only the pdf of (α,β) is required at this stage.

Since there is no reason to think differently, we will assume that these two parameters are independent uniform random variables (rv's) ranging from 0 to π [8]. Under these hypotheses, it is evident that the joint pdf of (α,β) is f αβ (α,β)=1 π 2 . So, in order to derive the desired expression, we only need to calculate the modulus of the Jacobian of the transformation [9]:

|J d |=α θ l α θ r β θ l β θ r uid7

Thus, we must find the partial derivatives of α and β with respect to θ l y θ r . These are not simple expressions because of the functions involved. As an example, observe the result obtained for the last element of J d :

β θ r =[bsinθ l cosθ r -Ycos(θ r -θ l )]{[Xsin(θ r -θ l )-bsin(θ r +θ l )] 2 +Z 2 sin 2 (θ r -θ l )}-... {[Xsin(θ r -θ l )-bsin(θ r +θ l )] 2 +......[bsinθ l sinθ r -Ysin(θ r -θ l )]{[Xsin(θ r -θ l )-bsin(θ r +θ l )]... ...Z 2 sin 2 (θ r -θ l )+[bsinθ l sinθ r -Ysin(θ r -θ l )] 2 }......[Xcos(θ r -θ l )-bcos(θ r +θ l )]+Z 2 sin(θ r -θ l )cos(θ r -θ l )} [Xsin(θ r -θ l )-bsin(θ r +θ l )] 2 +Z 2 sin 2 (θ r -θ l )uid8

Since analytical expressions for all the required terms can be found by direct calculations, it is possible to obtain the desired pdf operating in the usual way [9]:

f θ l ,θ r (θ l ,θ r )=1 π 2 |J d |uid9

Unfortunately, this expression far from being simple because of the complexity of the terms involved. This fact should encourage us to search for a more usable expression capable of statistically describing a certain relation between the orientation of the projected segments. In the next section, we find such expression by using a function of cot θ l and cot θ r .

Advertisement

4. Probability density function of the difference of the cot of the orientation of projected segments

A tractable expression to relate the orientation of projected segments can be found by defining a suitable function of the projected angles shown in Fig. . Let f K (k), with k a function of {θ l ,θ r } denote such function.

More specifically, the pdf of the modulus of the difference of the cot of the projected angles in the selected binocular stereo system will be derived.

Taking into account the scene depicted in Fig. , let AB ¯ define, again, a straight segment with arbitrary length δ. The orientation of this segment is described by the angles α y β as shown in the figure.

Now, the location of the edges of the segment in the real world coordinate system will be written as follows:

A:(A x ,A y ,A z )=(X,Y,Z)uid10
B:(B x ,B y ,B z )=(X+δcosβcosα,Y-δsinβ,Z-δcosβsinα)uid11

And taking into account the geometry selected, the coordinates of the projections of the edges of the segment can be written as:

A rx =-f A z (A x -b 2)A lx =-f A z (A x +b 2)A ry =-f A z A y A ly =-f A z A y uid12
B rx =-f B z (B x -b 2)B lx =-f B z (B x +b 2)B ry =-f B z B y B ly =-f B z B y uid13

Now, let

k=|cot(θ l )-cot(θ r )|uid14

Substituting the cot functions by the corresponding expressions in terms of the projections of the edges of the segment, using the projection equations () to (), multiplying by A z B z , substituting B i as a function of the coordinates of A and dividing by cosβ, the following expression is found:

k=-bsinα Ztanβ-Ysinαuid15

This expression will be used to derive the pdf of k.

To begin with, the joint pdf of k and α will be derived. To this end, the following transformation equations will be used:

k=-bsinα Ztanβ-Ysinαα=αuid16

The modulus of the Jacobian of the transformation can be easily determined:

|J|=k αk βα αα β=bsinαZsec 2 β (Ztanβ-Ysinα) 2 uid17

With all this, the joint pdf of k and α can be readily obtained [10], [9]:

f k,α (k,α)= r f(α(k r ,α r ),β(k r ,α r ))1 |J r |uid18

where r represents the set of roots of the transformation of (α,β) as a function of (k,α). Two different solutions can be found for this transformation because of the modulus operation in equation ():

β=arctansinαkY+b kZ,withk=bsinα Ztanβ-Ysinalphaβ=arctansinαkY-b kZ,withk=-bsinα Ztanβ-Ysinalphaα=αuid19

Assuming, that the orientation angles α and β behave as uniform random variables [8] with range (0,π) and assuming independence, it is clear that f(α,β)=1 π 2 [9]. Then, equation () can be written, after substitution of the terms involved as:

f k,α (k,α)=1 π 2 (Ztanβ-Ysinα) 2 bsinαZsec 2 β β=arctansinαkY+b kZ +1 π 2 (Ztanβ-Ysinα) 2 bsinαZsec 2 β β=arctansinαkY-b kZ uid20

Now, α and β can be expressed in terms of α and k, making use of the following identity: sec[arctana]=1+a 2 . Thus, the following expression is found after some simplifications:

f k,α (k,α)=1 π 2 bsinα k 2 Z1+sin 2 αkY+b kZ 2 +1 π 2 bsinα k 2 Z1+sin 2 αkY-b kZ 2 uid21

Now, the last step to reach our objective is to integrate with respect to α. The two terms of the previous fdp can be integrated similarly. It will be shown how the first one is handled:

I 1 = α=0 π b π 2 k 2 Zsinα 1+sin 2 αkY+b kZ 2 dα=cosα=x-sinαdα=dxb π 2 k 2 Z x(α=0) x(α=π) -dx 1+(1-x 2 )kY+b kZ 2 =b π 2 k 2 Z1+kY+b kZ 2 x(α=0) x(α=π) -dx 1-x 2 kY+b kZ 2 1+kY+b kZ 2 =xkY+b kZ 1+kY+b kZ 2 =ydx=1+kY+b kZ 2 kY+b kZdyb π 2 k 2 Z1+kY+b kZ 2 kY+b kZ y(x(α=0)) y(x(α=π)) -dy 1-y 2 =2b π 2 k1+kY+b kZ 2 (kY+b)arctanhkY+b k 2 Z 2 +(kY+b) 2 uid22

The second term can be integrated likewise.

Finally, the target pdf, f k (k), can be written:

f k (k)=2b π 2 k1+kY+b kZ 2 (kY+b)arctanhkY+b k 2 Z 2 +(kY+b) 2 +2b π 2 k1+kY-b kZ 2 (kY-b)arctanhkY-b k 2 Z 2 +(kY-b) 2 ,k>0uid23

This is the expression we were looking for. The behaviour of this function is represented in Fig. .

Figure 2.

Probability density function of the modulus of the difference of the cot of the orientation of projected segments (Y=0).

Advertisement

5. The disparity gradient

The disparity gradient has been successfully used in the process of establishment of the correspondence relationships in stereo vision systems. Although the probabilistic behaviour of this feature has been used previously [11], [12], the process to derive some of the pdfs related to the disparity gradient has not been detailed. In this section, we will focus on the specific procedure to find different approximations of the probabilistic characterization of the disparity gradient. Thus, we will derive several expressions of the pdf of the disparity gradientDG represents the random variable whereas dg represents a realization of DG.:

f DG (dg)uid26

We will pay attention to the assumptions required to derive the pdfs and to the approximations used in the different cases considered.

5.1. Comments on the disparity gradient

The disparity gradient has been successfully used as a source of information to solve the correspondence problem in stereo systems [13], [14], [5], [15], [16], [17], [12].

Generally speaking, the disparity gradient provides a priori information regarding how the real world scene is projected onto the image planes of a stereo system and, consequently, how different matching points in the projected images must be related in terms of geometrical (disparity related) relationships

The disparity refers to the difference between the coordinates of the projections of a certain point of the 3D world onto the image planes of a stereo system. Obviously, the disparity gradient refers to the rate of change of the disparity between nearby or related points [5].

Furthermore, it has been confirmed that the human visual system shows certain limitations related to the disparity gradient when matching stereo images [18]. More specifically, it was proved that 1 represents the limit of the disparity gradient for most of the subjects evaluated. On the other hand, other experiments were performed by other authors that showed that, under certain conditions, the disparity gradient can be over that threshold but with low probability. In fact, Pollard [19] derived a probability function for the disparity gradient in a stereo system with fixation point.

Additionally, the disparity gradient is able to consider other important constraints often employed for the analysis of three dimensional scenes such as figural continuity, ordering of projected features or continuity of the disparity gradient itself [17], [5].

5.2. Stereo system for the probabilistic analysis of the disparity gradient

In the following sections devoted to the probabilistic analysis of the disparity gradient in a parallel binocular stereo system, the specific geometry that will be considered is shown in Fig. . According to this figure, the locations in the real world of the points A and B, that define a straight segment with its mid-point at (X 0 ,Y 0 ,Z 0 ) and length 2δ, are given by the following expressions:

A=X 0 +δcosβcosα,Y 0 +δcosβsinα,Z 0 -δsinβB=X 0 -δcosβcosα,Y 0 -δcosβsinα,Z 0 +δsinβuid29

Figure 3.

Parallel binocular stereo system for the analysis of the disparity gradient.

Then, the projections of the edge points of the segment onto the right and left image planes are given by:

A r =-f A z (A x -b 2),-f A z A y B r =-f B z (B x -b 2),-f B z B y A l =-f A z (A x +b 2),-f A z A y B l =-f B z (B x +b 2),-f B z B y uid31

In this scenario, the disparity gradient is defined as the quotient between the difference of disparity between the two points observed and their Cyclopean separation [19]:

dg=Differenceofdisparity Cyclopeanseparationuid32

Taking into account that the Cyclopean projections of A and B are given by the following equation:

A r +A l 2andB r +B l 2uid33

and using the disparity vectors associated to the points A and B given by

(A l -A r )and(B l -B r )uid34

respectively. Then the disparity gradient can be written as follows:

dg=2||(A r -B r )-(A l -B l )|| ||(A r -B r )+(A l -B l )||uid35

Now, by substitution of the expressions of A l , B l , A r and B r , multiplying by A z B z , substituting by their expressions in terms of δ, β and Z 0 , after some simplifications and reordering all the terms, the following expression is found:

dg=|bsinβ| ||-X 0 sinβ-Z 0 cosβcosα,-Y 0 sinβ-Z 0 cosβsinα||uid36

This is the main equation that will be used to derive different expressions of the disparity gradient in different scenarios.

The following sections describe the scenarios and the procedures issued to derive the different probability density functions.

5.3. Primitives centred in the world reference system

In our first scenario, we will be able to derive an exact analytical expression of the pdf of the disparity gradient This expression can be considered to be illustrative of the behaviour of dg. Moreover, in the next subsection, we will show how the same expression is found under different conditions and assumptions.

In this first scenario, we will assume that X 0 =0, Y 0 =0 and α=0 (see Fig. ). Then, the expression of the disparity gradient (eq. ()) is readily simplified to give:

dg=b Z 0 |tanβ|uid38

We will assume that the angle of orientation β behaves as a uniform random variable in the range (0,π).

Paying attention to the symmetry of dg, it is possible to pose the problem in a more convenient way. Without loss of generality, the modulus of tanβ in eq. () can be removed by simply allowing the random variable β to be defined as a uniform random variable in (0,π 2). The application of this and other symmetry conditions that will be considered later will allow us to avoid some expressions that involve the calculation of the modulus of certain functions and thus the analysis and some of the expressions involved will remain conveniently more simple.

According to equation (), it is quite simple to obtain the derivative of the disparity gradient with respect to β. Let g(β)=dg, then g ' (β)=b Z 0 cos 2 β. On the other hand, it is possible to obtain β as g -1 (dg)=arctanZ 0 bdg. Thus, finally, the pdf of DG is directly obtained:

f DG (dg)=π 2 b Z 0 1 cos 2 β β=g -1 (dg) =2Z 0 πb 1+tan 2 β β=g -1 (dg) =2Z 0 πb tanarctanZ 0 bdg 2 +1=
f DG (dg)=2 πb Z 0 dg 2 +b Z 0 2 ,dg(0,)uid39

Figure 4.

Probability density function of the disparity gradient when the primitives projected are centred in the world reference system.

Figure 5.

Distribution function of the disparity gradient when the primitives projected are centred in the world reference system.

In this expression (eq. () and Fig. ), a unilateral Cauchy probability density function should be identified. In our scenario, this Cauchy function is tuned by the parameters 0 and b Z 0 [20]. The distribution function can be easily found (See Fig. ):

F DG (dg)=2 πarctanZ 0 bdg,dg(0,)uid42

5.4. Narrow field of view cameras

In this section, another step in the analysis of the behaviour of the disparity gradient will be done. We will consider a binocular stereo system with cameras of narrow field of view satisfying the epipolar constraint. This is a scenario that can be applied in numerous cases. Moreover, we can consider this scenario as a basic model for the analysis of stereo systems and suitable for practical applications.

In this scenario, the disparity gradient is given by:

dg=2||fb A z ,0-fb B z ,0|| ||-2f A z (X 0 +δcosβcosα),-2f A z (Y 0 +δcosβsinα)... ...--2f B z (X 0 -δcosβcosα),-2f B z (Y 0 -δcosβsinα)||uid44

After the substitution of A z and B z by their respective expressions in terms of X 0 , Y 0 , Z 0 , α, β and δ and reordering all the terms the following expression can be found:

dg=b 2 sin 2 β (X 0 2 +Y 0 2 )sin 2 β+Z 0 2 cos 2 β+2Z 0 sinβcosβ(X 0 cosα+Y 0 sinα)uid45

We will derive the desired pdf making use of this equation.

The fact that the cameras of the stereo system have a narrow field of view implies that the coordinates in the real world of the projected objects should satisfy the following condition: Z 0 X 0 ,Y 0 . On the other hand, the angle β should not be equal to π 2 (as a matter of fact, being β a continuous random variable, this conditions represents and event with zero probability).

Under the hypotheses described, removing X 0 and Y 0 from the expression of the disparity gradient, because of the narrow field approximation, and assuming that Z 0 Z 0 2 , the following simplified expression is found:

dgb 2 sin 2 β Z 0 2 cos 2 β=bsinβ Z 0 |cosβ|uid46

In this scenario, the symmetry of the geometry and the behaviour of the random variables α and β allows us to consider the following range for the uniform random variables α and β: (-π 2,π 2) and (0,π 2), respectively. And then, the expression of the disparity gradient can be written as:

dg=bsinβ Z 0 cosβuid47

Now, in order to derive the behaviour of the disparity gradient, we will observe the region in which the random variable DG is smaller than a certain value dg. Then, Prob{DG<dg} is given by the probability that the random variables α and β are such that DG<dg. Let C dg denote the region in the α-β plane that complies with this condition:

Prob{DG<dg}=Prob{(α,β)C dg }uid48

This probability can be easily found by integrating the joint pdf of α and β in the region C dg :

F DG (dg)= C dg f α,β (α,β)dαdβuid49

where, according to the selected hypotheses, the joint pdf required is given by f α,β (α,β)=2 π 2 .

In order to define the region C dg , eq. () must be used in order to obtain the solutions of β:

β=arctandgZ 0 buid50

So, the region in the α-β plane that defines C dg is given by the following relations:

α-π 2,π 2β0,arctandgZ 0 buid51

Thus, it is possible to derive the probability distribution function of the disparity gradient solving the following integral:

F DG (dg)= α=-π 2 α=π 2 β=0 β=arctandgZ 0 b 2 π 2 dβdαuid52

which is given by:

F DG (dg)=2 πarctanZ 0 bdguid53

Then, the probability density function can be readily obtained:

f DG (dg)=2 πb Z 0 dg 2 +b Z 0 2 uid54

Observe that, under different conditions and hypotheses, the same expressions for the behaviour of the disparity gradient as in the case of primitives centred in the world coordinate system (Sec. ) have been obtained. Of course, this fact comes from the assumption that Z 0 X 0 ,Y 0 which asymptotically leads to the more specific case in which X 0 =0 and Y 0 =0.

5.5. General case. Approximate expression

Under general conditions, a close analytic solution for the probability density function or the probability distribution function of the disparity gradient has not been found. So, we will face the derivation of an approximate solution.

To this end, consider the following approximate expression of the disparity gradient in our stereo system (Fig. ):

dg=b X 0 2 +Y 0 2 +Z 0 2 cot 2 β+2Z 0 cotβK(X 0 +Y 0 )uid56

In this expression, obtained after eq. (), the terms (X 0 cosα+Y 0 sinα) have been substituted by K(X 0 +Y 0 ). Note that K should not modify the region in which the disparity gradient is properly defined: DG[0,). Using this idea, it is possible to arrive at the desired goal. Now the procedure is described.

We know that if β0, then dg0. So, we can find a condition to impose on K so that maxDG. To this end, the minimum of the denominator in eq. () can be found in the usual way, deriving the expression in the square root with respect to β and finding the roots:

βX 0 2 +Y 0 2 +Z 0 2 cot 2 β+2Z 0 cotβK(X 0 +Y 0 )=0uid57
-2Z 0 2 cotβcsc 2 β-2Z 0 csc 2 βK(X 0 +Y 0 )=0uid58

Now, since cscβ0 β, the following must be fulfilled:

Z 0 cotβ+K(X 0 +Y 0 )=0uid59

Thus, the following relation is found:

cotβ=-K(X 0 +Y 0 ) Z 0 uid60

Recall that in the minimum the denominator in eq. () must be zero. Substituting cotβ according to the previous expression in the denominator of eq. (), the following must be fulfilled:

X 0 2 +Y 0 2 +Z 0 2 -K(X 0 +Y 0 ) Z 0 2 +2Z 0 -K(X 0 +Y 0 ) Z 0 K(X 0 +Y 0 )=0uid61

which leads to the following expression:

K=X 0 2 +Y 0 2 (X 0 +Y 0 ) 2 uid62

Thus, the approximation of the disparity gradient that will be used is given by:

dgb X 0 2 +Y 0 2 +Z 0 2 cot 2 β+2Z 0 X 0 2 +Y 0 2 cotβuid63

Now, the probability distribution function will be found. Consider C dg as the region in which DG<dg and let C dg (α,β) denote the region in the α-β plane such that DG<dg. Then, again:

F DG (dg)= C dg (α,β) f α,β (α,β)dαdβuid64

(a)

(b)

(c)

(d)

Figure 6.

Probability distribution function of the disparity gradient {1}. General case: simulation results (solid line) and analytic approximation (dashed line).

Since DG does not depend on α (eq. ()), the region C dg (α,β) can be defined as a function of β, exclusively:

F DG (dg)= C dg (β) α f α,β (α,β)dαdβ= C dg (β) 1 πdβuid66

In order to define C dg (β), dg must also be written as a function of β; the following result if easily obtained:

cotβ=-X 0 2 +Y 0 2 Z 0 ±b dgZ 0 uid67

Let β 1 and β 2 represent the two solutions of this equation, then the region C dg (β) is defined by the following intervals:

C dg (β)=(-π 2,min(β 1 ,β 2 ))(max(β 1 ,β 2 ),π 2)uid68

With all this, the desired solution, the probability distribution function of the disparity gradient, is given by (Figs. and ):

F DG (dg)=1-1 πarccot-X 0 2 +Y 0 2 Z 0 -b dgZ 0 -arccot-X 0 2 +Y 0 2 Z 0 +b dgZ 0 uid69

(e)

(f)

(g)

(h)

Figure 7.

Probability distribution function of the disparity gradient {2}. General case: simulation results (solid line) and analytic approximation (dashed line).

Note that this solution is mathematically correct, however some considerations must be taken into account so that F DG (dg) behaves as a proper probability distribution function sec. 2.2[10]. Specifically, the function arccot returns an angular value which, ultimately, can be seen as a periodic function with period π. This means that there is an infinite number of solutions of arccot, although the main solution is often considered to be in the interval (-π 2,π 2). In our specific development, the function derived behaves properly if the solutions of the function arccot are selected in the range (-π,0).

After the probability distribution function (eq. ()), the probability density function (pdf) of the disparity gradient is readily found [9]:

f DG (dg)=1 π2bZdg 2 Z 0 2 +b 2 +dg 2 (X 0 2 +Y 0 2 ) dg 4 Z 0 4 +b 4 +dg 4 (X 0 2 +Y 0 2 ) 2 +2dg 2 Z 0 2 b 2 ... ...+2dg 4 Z 0 2 (X 0 2 +Y 0 2 )-2b 2 dg 2 (X 0 2 +Y 0 2 )uid71

which is a usable expression of the pdf of the disparity gradient that completes the analysis of the probabilistic behaviour of this parameter under the conditions and hypotheses selected.

Advertisement

6. Concluding summary

In this chapter, we have dealt with the probabilistic behaviour of certain relations established between the projection of features onto the image planes of a parallel stereo system. Specifically, we have considered relations between the orientation of projected edgels and the disparity gradient.

The projected edgels are simple features that can be considered in a matching stage [7]. The relation between their orientations constitutes an a priori source of information that, using the models proposed, can be used in the matching processes [21] of stereo systems. The formulae of the relation between the orientation of the projections derived are perfectly suited for application in Bayesian models for stereo matching [22].

The disparity gradient is an important parameter for stereo matching systems [14]. In this chapter, it has been analysed under different conditions to find proper probability density functions usable in a probabilistic context.

The functions derived can be used alone to match random dot stereo pairs [23], [24], [17], [25]. Also, these functions can contribute and collaborate with other matching models in the solution of the correspondence problem in stereo systems. Specifically, Bayesian approaches can be employed to solve the correspondence problem [26] using the proposed models of the disparity gradient [12].

Advertisement

Acknowledgements

This work was supported by the Ministerio de Economía y Competitividad of the Spanish Government under Project No. TIN2010-21089-C03-02 and Project No. IPT-2011-0885-430000.

References

  1. 1. Barlow, H. B., (1978). The efficiency of detecting changes of density in random dot patterns, Vision Research 18: 637–650.
  2. 2. Barlow, H. B., Reeves, B. C., (1979). The versality and absolute efficiency of detecting mirror symmetry in random dot displays, Vision Research 19: 793–793.
  3. 3. Bensrhair, A., Miché, P., Debrie, R., (1992). Binocular stereo matching algorithm using prediction and verification of hypotheses, Proc. ISSPA 92, Signal Processing and Its Applications, pp. 167 – 170.
  4. 4. Burt, P., Julesz, B., (1980). Modifications of the classical notion of Panum's fusional area, Perception 9: 671 – 682.
  5. 5. Cheng, L., Caelli, T., (2004). Bayesian stereo matching, Proc. Conf. Computer Vision and Pattern Recognition Workshop, pp. 1–8.
  6. 6. Dhond, U. R., Aggarwal, J. K., (1989). Structure from stereo - A review, IEEE Transactions on Systems, Man and Cybernetics 19(6): 1489 – 1510.
  7. 7. Faugeras, O., (1993). Three-Dimensional Computer Vision. A Geometric Viewpoint, The MIT Press, Cambridge.
  8. 8. Grimson, W. E. L., (1985). Computational experiments with a feature based stereo algorithm, IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-7(1): 17 – 34.
  9. 9. Kanade, T., Okutomi, M., (1994). A stereo matching algorithm with an adaptive window: Theory and experiment, IEEE Transactions on Pattern Analysis and Machine Intelligence 16(9): 920 – 932.
  10. 10. Law, A. M., Kelton, W. D., (1991). Simulation Modeling & Analysis, second edn, McGraw-Hill International Editions.
  11. 11. Li, Z.-N., Hu, G., (1996). Analysis of disparity gradient based cooperative stereo, IEEE Transactions on Image Processing 5(11): 1493 – 1506.
  12. 12. Marapane, S. B., Trivedi, M. M., (1989). Region-based stereo analysis for robotic applications, IEEE Transactions on Systems, Man and Cybernetics 19: 1447–1464. Special issue on computer vision.
  13. 13. Marapane, S. B., Trivedi, M. M., (1994). Multi-Primitive Hierarchical (MPH) stereo analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence 16(3): 227 – 240.
  14. 14. Mohan, R., Medioni, G., Nevatia, R., (1989). Stereo error detection, correction and evaluation, IEEE Transactions on Pattern Analysis and Machine Intelligence 11(2): 113 – 120.
  15. 15. Papoulis, A., (1984). Probability, Random Variables and Stochstic Processes, second edn, McGraw-Hill.
  16. 16. Peebles, P. Z., (1987). Probability, Random Variables and Random Signal Principles, Electrical Engineering Series, second edn, McGraw-Hill International Editions.
  17. 17. Pollard, S. B., Mayhew, J. E. W., Frisby, J. P., (1985). PMF: A stereo correspondence algorithm using a disparity gradient limit, Perception 14: 449 – 470.
  18. 18. Pollard, S. B., Mayhew, J. E. W., Frisby, J. P., (1991). Implementation details of the PMF algorithm, in J. E. W. Mayhew, J. P. Frisby (eds), 3d Model Recognition from Stereoscopic Cues, The MIT Press, Cambridge, Massachusetts, pp. 33 – 39.
  19. 19. Pollard, S. B., Porrill, J., Mayhew, J. E. W., Frisby, J. P., (1986). Disparity gradient, Lipschitz continuity and computing binocular correspondences, Robotics Research: The Third International Symposium pp. 19 – 26.
  20. 20. Stark, H., Woods, J. W., (1994). Probability, Random Processes and Estimation Theory for Engineers, Prentice-Hall Inc.
  21. 21. Tardón, L. J., (1999). A robust method of 3D scene reconstruction using binocular information, PhD thesis, E.T.S.I. Telecomunicación, Univ. Politécnica de Madrid. In spanish.
  22. 22. Tardón, L. J., Portillo, J., Alberola, C., (1999). Markov Random Fields and the disparity gradient applied to stereo correspondence, Proc. of the IEEE International Conference on Image Processing, ICIP-99, Vol. III, pp. 901 – 905.
  23. 23. Tardón, L. J., Portillo, J., Alberola, C., (2004). A novel markovian formulation of the correspondence problem in stereo vision, IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 34(6): 779 – 788.
  24. 24. Trucco, E., Verri, A., (1998). Introductory Techniques for 3-D Computer Vision, Prentice-Hall.
  25. 25. Zhang, L., Seitz, S. M., (2007). Estimating optimal parameters for MRF stereo from a single image pair, IEEE Transactions on Pattern Analysis and Machine Intelligence 29(2): 331–342.
  26. 26. Zhang, Z., (1998). Determining the epipolar geometry and its uncertainty: A review, International Journal of Computer Vision 27(2): 161–198.

Written By

Lorenzo J. Tardón, Isabel Barbancho and Carlos Alberola-López

Submitted: 05 December 2011 Published: 11 July 2012