Skip to main content

Bounds for the approximation of Poisson-binomial distribution by Poisson distribution

Abstract

Let ( X n k , k=1,2,,n; n=1,2,) be a row-wise triangular array of independent Bernoulli random variables with success probabilities P( X n k =1)=1P( X n k =0)= p n k [0,1], k=1,2,,n; n=1,2, . For every n=1,2, , the random variables S n = k = 1 n X n k have probability distributions with complicated structure and therefore they are used to being approximated by Poisson distribution. Well-known Le Cam’s inequality is established for providing information on the quality of a Poisson approximation. The main aim of this paper is to re-establish the Le Cam-type inequalities via a linear operator. The operator method used in this paper is quite elementary and it also could be applied for the probability distributions of random sums S N n = k = 1 N n X n k in the Poisson approximation, where N n , n=1,2, , are positive integer-valued random variables, independent of all X n k , k=1,2,,n; n=1,2, .

MSC:60F05, 60G50, 41A36.

1 Introduction

Throughout this paper, let ( X n k , k=1,2,,n; n=1,2,) be a row-wise triangular array of independent Bernoulli random variables with success probabilities P( X n k =1)=1P( X n k =0)= p n k [0,1], k=1,2,,n; n=1,2, . The random variables S n = k = 1 n X n k , n=1,2, , are often called the Poisson-binomial random variables. And it is easily seen that the mean, variance, and characteristic function of S n , n=1,2, , are E( S n )= k = 1 n p n k , D( S n )= k = 1 n p n k (1 p n k ), and f S n (t)=E( e i t S n )= k = 1 n (1 p n k + p n k e i t ), respectively.

The probability distributions of S n , n=1,2, , have many applications in various areas of mathematics and statistics such as reliability, survival analysis, survey sampling, econometrics, and so on (the reader is referred to [1, 2] and [3] for full development). However, since the probability distributions of S n , n1, have the complicated structure (see, for instance, [3]), they are used to being approximated by the distribution of Poisson random variables Z λ n with a positive parameter λ n =E( S n )= k = 1 n p n k . More specifically, assume that

lim n λ n =λ(0<λ<+),
(1)

then

S n d Z λ ,as n,
(2)

where, and from now on, the notation d means the convergence in distribution (see, for instance, [4]). Moreover, remarkable Le Cam’s inequality for the Poisson-binomial distribution [5] is widely considered in literature as follows:

k = 0 | P ( S n = k ) P ( Z λ n = k ) | 2 k = 1 n p n k 2
(3)

(we refer the reader to the results of Le Cam [5], Barbour, Holst, and Janson [6], Steele [7], Chen [8], Chen and Liu [1], Neammanee [9], and Ross [10] for more details).

It should be noted that in [6, 7], and [9] various powerful tools (such as the method of matrix analysis, the semi-group method, the coupling method, and the Chen-Stein method) for providing Le Cam’s inequality have been demonstrated. The main objective of this paper is to obtain the bounds for well-known Le Cam’s inequality in (3) using the operator method, introduced by Renyi [4]. In the third section, we use the operator method from [4] to establish the bounds for the approximation of Poisson-binomial distribution by Poisson distribution. The operator method in this paper is quite elementary and it also could be applied for random sums S N n = k = 1 N n X n k , S 0 =0, where N n , n=1,2, are positive integer-valued random variables, independent of all X n k , k=1,2,,n; n=1,2, . This will be taken up in the last section. We refer the reader to the works of Trotter [11], Renyi [4], and Hung [12] for a deeper discussion of this operator method. Based on the operator method, the received results of this paper are analogues of Le Cam’s inequality in classical literature (we refer the reader to Steele [7], Le Cam [5], Chen [8], Neammanee [9], and Wang [3] for a complete treatment of the problem).

2 Preliminaries

In the sequel we will need the operator method, which has been used for a long time in various studies of classical limit theorems for sums of independent random variables (see Trotter [11], Renyi [4], and Hung [12] for the complete bibliography).

We recall some definitions and notations. We denote by K the set of all real-valued bounded functions f(x), defined on the set of non-negative integers Z + ={0,1,2,}. The norm of a function fK is defined by f= sup x Z + |f(x)|.

Definition 2.1 We define a linear operator associated with a positive discrete random variable X, A X :KK, by setting

( A X f)(x):=E ( f ( X + x ) ) = k = 0 f(x+k)P(X=k),fK,x Z + .
(4)

It is to be noticed that the linear operator defined in (4) is actually a discrete form of Trotter’s operator (we refer the readers to Trotter [11], Renyi [4], and Hung [12] for a more general and detailed discussion of this operator method).

We will need some properties of the operator in (4) in the sequel. Let A X , A Y be operators associated with two discrete random variables X and Y for f,gK. Suppose that α and β are two real numbers, then we easily get the following linear property of the operator in (4):

A X (αf+βg)=α A X (f)+β A X (g).

We define the operator ( A X + A Y ) by ( A X + A Y )f= A X f+ A Y f, fK, and the product of two operators A X and A Y is ( A X A Y )f= A X ( A Y f), fK.

It is obvious that

  1. 1.

    A X ff for all fK.

  2. 2.

    A X f+ A Y f A X f+ A Y f for all fK.

  3. 3.

    Suppose that A X and A Y are operators associated with two independent random variables X, Y and fK. Then A X A Y f= A Y A X f= A X + Y f.

In fact, for all fK and x Z + ,

A X A Y f ( x ) = A X ( A Y f ( x ) ) = A X ( k = 0 f ( x + k ) P ( Y = k ) ) = r , k = 0 f ( x + k + r ) P ( Y = k ) P ( X = r ) = l = 0 f ( x + l ) P ( X + Y = l ) = A X + Y f ( x )

by an argument analogous to that used for the proof of A Y A X f= A X + Y f.

  1. 4.

    Suppose that A X 1 , A X 2 ,, A X n are the operators associated with the independent random variables X 1 , X 2 ,, X n . Then A S n = A X 1 A X 2 A X n is the operator associated with the partial sum S n = X 1 + X 2 ++ X n .

  2. 5.

    Suppose that A X 1 , A X 2 ,, A X n and A Y 1 , A Y 2 ,, A Y n are operators associated with independent random variables X 1 , X 2 ,, X n and Y 1 , Y 2 ,, Y n . Moreover, assume that all X i and Y j are independent for i,j=1,2,,n. Then, for every fK,

    A k = 1 n X k f A k = 1 n Y k f k = 1 n A X k f A Y k f.
    (5)

Clearly,

A X 1 A X 2 A X n A Y 1 A Y 2 A Y n = k = 1 n A X 1 A X 2 A X k 1 ( A X k A Y k ) A Y k + 1 A Y n .

It deduces that

A k = 1 n X k f A k = 1 n Y k f k = 1 n A X 1 A X k 1 ( A X k A Y k ) A Y k + 1 A Y n f k = 1 n A Y k + 1 A Y n ( A X k A Y k ) f k = 1 n A X k f A Y k f .
  1. 6.

    It is to be noticed that A X n f A Y n fn A X f A Y f.

  2. 7.

    Suppose that X 1 ,, X n and Y 1 ,, Y n are independent random variables (in each group), and let { N n ,n=1,2,} be a sequence of positive integer-valued random variables independent of all X k and Y k , k=1,2, . Then, for every fK,

    A k = 1 N n X k f A k = 1 N n Y k f n = 1 P( N n =n) k = 1 n A X k f A Y k f.

Lemma 2.1 The equation A X f(x)= A Y f(x) for fK, x Z + , provided that X and Y are identically distributed random variables.

Let A X 1 , A X 2 ,, A X n , be a sequence of operators associated with the independent discrete random variables X 1 , X 2 ,, X n , , and A X be the operator associated with the discrete random variable X. The following lemma states one of the most important properties of the operator A X .

Lemma 2.2 A sufficient condition for a sequence of random variables X 1 , X 2 ,, X n converging in distribution to a random variable X is that

lim n A X n f A X f=0 for all fK.

Proof Since lim n A X n f A X f=0, for all fK, we get

lim n | k = 0 f(x+k) ( P ( X n = k ) P ( X = k ) ) |=0for all fK and x Z + .

If we choose

f(x)={ 1 , if  0 x t , 0 , if  x > t .

Then

lim n | k = 0 t ( P ( X n = k ) P ( X = k ) ) | =0.

It follows that P( X n t)P(Xt)0 as n tends to +∞.

In other words, X n d X as n+. □

3 A bound of Poisson-binomial approximation

Let A X n k , k=1,,n; n=1,2, be the operators associated with the random variables X n k , k=1,,n; n=1,2, , and let A Z p n k , k=1,,n; n=1,2, , be the operators associated with the Poisson random variables with parameters p n k , k=1,,n; n=1,2, . On the assumption that Z λ n is a Poisson random variable with a positive parameter λ n = k = 1 n p n k , we can perform that Z λ n = d k = 1 n Z p n k , where Z p n 1 , Z p n 2 ,, Z p n n are independent Poisson random variables with positive parameters p n 1 , p n 2 ,, p n n , and the notation = d denotes coincidence of distributions. We will now state an analogue of Le Cam’s inequality [5] via the linear operator in (4) as follows.

Theorem 3.1 Let ( X n k , 1kn; n=1,2,) be a row-wise triangular array of independent, Bernoulli random variables with success probabilities P( X n k =1)=1P( X n k =0)= p n k , p n k [0,1], k=1,2,,n; n=1,2, . Let us write S n = k = 1 n X n k and λ n = k = 1 n p n k . We denote by Z λ n the Poisson random variable with the parameter λ n . Then, for all real-valued bounded functions fK, we have

A S n f A Z λ n f2f k = 1 n p n k 2 .
(6)

Proof Applying the inequality in (5), we have

A S n f A Z λ n f k = 1 n A X n k f A Z p n k f.

Moreover, for all fK and for all x Z + , we conclude that

A X n k f ( x ) A Z p n k f ( x ) = r = 0 f ( x + r ) ( P ( X n k = r ) P ( Z p n k = r ) ) = r = 0 f ( x + r ) ( P ( X n k = r ) e p n k p n k r r ! ) = f ( x ) ( 1 p n k e p n k ) + f ( x + 1 ) ( p n k p n k e p n k ) r = 2 f ( x + r ) e p n k p n k r r ! .

Since r = 2 e p n k p n k r r ! =1 e p n k p n k e p n k , for all fK and x Z + , it may be concluded that

| A X n k ( f ) A Z p n k ( f ) | = | f ( x ) ( 1 p n k e p n k ) + f ( x + 1 ) ( p n k p n k e p n k ) r = 2 f ( x + r ) e p n k p n k r r ! | | f ( x ) ( 1 p n k e p n k ) | + | f ( x + 1 ) ( p n k p n k e p n k ) | + | r = 2 f ( x + r ) e p n k p n k r r ! | sup x Z + | f ( x ) | ( e p n k 1 + p n k + p n k p n k e p n k + 1 e p n k p n k e p n k ) 2 f p n k ( 1 e p n k ) 2 f p n k 2 .

Therefore, applying (5), we can assert that

A S n ( f ) A Z λ n ( f ) 2f k = 1 n p n k 2 .

This completes the proof. □

Remark 3.1 According to Theorem 3.1 and assumption (1), using the definition of the norm of the operator A, we get following inequality:

A S n A Z λ 2 ( k = 1 n p n k 2 ) .

The following corollaries are immediate consequences from Theorem 3.1.

Corollary 3.1 Under the stated assumptions of Theorem  3.1, for all k=0,1,2, ,

| P ( S n = k ) P ( Z λ n = k ) | 2 j = 1 n p n j 2 .
(7)

Proof Choose the particular function f(x), x Z + , such that

f(x+m)={ 1 if  m = k , 0 if  m k .

Set y=x+m. Since x,m Z + , it follows that y Z + . Then we have

f= sup x | f ( x ) | = sup y | f ( y ) | =1.

Thus, according to Theorem 3.1, we conclude that

A S n ( f ) A Z λ n ( f ) 2 j = 1 n p n j 2 .
(8)

On the other hand, by choosing the function f(x) as above, we have

A S n f A Z λ n f = sup x | A S n f ( x ) A Z λ n f ( x ) | = sup x | m = 0 f ( x + m ) [ P ( S n = m ) P ( Z λ n = m ) ] | = sup x | f ( x ) [ P ( S n = 0 ) P ( Z λ n = 0 ) ] + + f ( x + k ) [ P ( S n = k ) P ( Z λ n = k ) + ] | = | P ( S n = k ) P ( Z λ n = k ) | .

Applying (8) we can assert that

| P ( S n = k ) P ( Z λ n = k ) | 2 j = 1 n p n j 2 .

The proof is complete. □

Corollary 3.2 Let condition (1) hold. Under the hypotheses of Theorem  3.1, if moreover

lim n max 1 k n p n k =0,
(9)

then the distribution of S n converges to the Poisson distribution with mean λ, i.e., S n d Z λ as n.

Proof

The proof is based on the following observation:

k = 1 n p n k 2 max 1 k n p n k × k = 1 n p n k .

According to the inequality in (6) for all fK and (9), we conclude that

lim n A S n ( f ) A Z λ n ( f ) =0.

As an argument analogous to the one used for the proof of Corollary 3.1, on account of Lemma 2.2, we get

lim n [ P ( S n = k ) P ( Z λ n = k ) ] =0.

Then, on account of (1), we have

lim n P( S n =k)= lim n e λ n ( λ n ) k k ! = e λ λ k k ! ,k=0,1,2.

Thus, the proof is straightforward. □

4 A bound of random Poisson-binomial approximation

Throughout this section, we begin with assuming that N n , n=1,2, , are positive integer-valued random variables independent of all X n k , k=1,2,,n; n=1,2, , which are supposed to obey the relation

N n P +as n+.
(10)

Here and subsequently, P denotes the convergence in probability. For every n=1,2, , we denote by S N n the random sums S N n = k = 1 N n X n k ( S 0 =0 by convention). Therefore, the random sums S N n could be said to be the random Poisson-binomial random variables. In this section, we establish Le Cam-type inequalities related to the Poisson approximation for distributions of random Poisson-binomial variables. It is to be noticed that many various results concerning the random summations have already been included in the textbooks of probability theory; see, e.g., [4, 13, 14]).

Let A X n 1 , A X n 2 ,, A X n N n be operators associated with the independent triangular array of random variables X n 1 , X n 2 ,, X n N n , and let A Z p n 1 , A Z p n 2 ,, A Z p n N n be operators associated with the independent Poisson distributed random variables with positive parameters p n 1 , p n 2 ,, p n N n . According to the properties of the linear operator in (4), we have A S N n = A X n 1 A X n 2 A X n N n and A Z λ N n = A Z p n 1 A Z p n 2 A Z p n N n are the respective operators associated with the random sums S N n = k = 1 N n X n k and Z λ N n = k = 1 N n Z p n k .

Theorem 4.1 Let ( X n k , k=1,2,,n; n=1,2,) be a row-wise triangular array of independent, non-identically distributed Bernoulli random variables with success probabilities P( X n k =1)=1P( X n k =0)= p n k , p n k [0,1], k=1,2,,n; n=1,2, . Moreover, we suppose that N n , n=1,2, are independent positive integer-valued random variables, independent of all X n k , k=1,2,,n; n=1,2, . Then, for all real-valued bounded functions fK and for all x Z + , we have

A S N n ( f ) A Z λ N n ( f ) 2fE ( k = 1 N n p n k 2 ) .

Proof According to the assumptions on the random variables N n , X n k , Z λ n , k=1,2,,n; n=1,2, , we can write

A S N n f(x)= m = 1 P( N n =m) k = 0 f(x+k)P( S m =k),

and

A Z λ N n f(x)= m = 1 P( N n =m) k = 0 f(x+k) e λ m λ m k k ! .

Therefore, by an argument analogous to that used for the proof of Theorem 3.1, for all real-valued function fK, x Z + , we have

A S N n ( f ) A Z λ N n ( f ) = m = 1 P ( N n = m ) ( A X n 1 A X n m ( f ) A Z p n 1 A Z p n m ( f ) ) m = 1 P ( N n = m ) A X n 1 A X n m ( f ) A Z p n 1 A Z p n m ( f ) m = 1 P ( N n = m ) k = 1 m 2 f p n k 2 2 f E ( k = 1 N n p n k 2 ) .

The proof is complete. □

Note that the following remarks are immediate consequences from Theorem 4.1.

Remark 4.1 According to Theorem 4.1 and assumption (1), using the definition of the norm of the operator A, we conclude that

A S N n A Z λ 2E ( k = 1 N n p n k 2 ) .

Remark 4.2 By an argument analogous to that used for the proof of Corollary 3.1, under the stated assumptions of Theorem 4.1, for all k=0,1,2, , we have

| P ( S N n = k ) P ( Z λ N n = k ) | 2E ( k = 1 N n p n k 2 ) .

When the success probability is identical, p n k = p n [0,1], k=1,2,,n; for n=1,2, , we obtain the following remark.

Remark 4.3 Suppose that the N n , n=1,2, are positive integer-valued random variables independent of all independent identically distributed random variables X n k , and assume that P( X n k =1)=1P( X n k =0)= p n [0,1], k=1,2,, N n ; n=1,2, . Then, for all k=0,1,2, , we get the following inequality:

| P ( S N n = k ) P ( Z λ N n = k ) | 2E( N n ) p n 2 .

It is worth noticing that when the positive integer-valued random variables N n , n=1,2, take on the value n with probability one, i.e., P( N n =n)=1, the results concerning the probability distributions of the random sums S N n in the Poisson approximation in this section return to the ones in Section 3.

We conclude this paper with the following comments. The linear operator in this paper introduced by Renyi [4] essentially is a discrete form of Trotter’s operator [11] which has been used in the theory of limit theorems. The proofs of theorems in this paper by the operator method are very elementary and elegant. The received results in this article allow us to think about a new approach method to the Poisson approximation problems for the distributions of the sums of the discrete independent random variables like Poisson-binomial, geometric, and negative binomial variables.

References

  1. Chen SX, Liu JS: Statistical applications of the Poisson-binomial and conditional Bernoulli distributions. Stat. Sin. 1997, 7: 875–892.

    MATH  Google Scholar 

  2. Tejada A, Dekker AJ: The role of Poisson’s binomial distribution in the analysis of TEM images. Ultramicroscopy 2011, 111: 1553–1556. 10.1016/j.ultramic.2011.08.010

    Article  Google Scholar 

  3. Wang YH: On the number of successes in independent trials. Stat. Sin. 1993, 3: 295–312.

    MATH  Google Scholar 

  4. Renyi A: Probability Theory. Akad. Kiadó, Budapest; 1970.

    Google Scholar 

  5. Le Cam L: An approximation theorem for the Poisson binomial distribution. Pac. J. Math. 1960, 10(4):1181–1197. 10.2140/pjm.1960.10.1181

    Article  MATH  MathSciNet  Google Scholar 

  6. Barbour AD, Holst L, Janson S: Poisson Approximation. Clarendon, Oxford; 1992.

    MATH  Google Scholar 

  7. Steele JM: Le Cam’s inequality and Poisson approximations. Am. Math. Mon. 1994, 101(1):48–54. 10.2307/2325124

    Article  MATH  MathSciNet  Google Scholar 

  8. Chen LHY: On the convergence of Poisson binomial to Poisson distribution. Ann. Probab. 1974, 2(1):178–180. 10.1214/aop/1176996766

    Article  MATH  Google Scholar 

  9. Neammanee K: A nonuniform bound for the approximation of Poisson binomial by Poisson distribution. Int. J. Math. Math. Sci. 2003, 2003(48):3041–3046. 10.1155/S0161171203212229

    Article  MATH  MathSciNet  Google Scholar 

  10. Ross SM: Introduction to Probability Models. 9th edition. Elsevier, Amsterdam; 2007.

    Google Scholar 

  11. Trotter HF: An elementary proof of the central limit theorem. Arch. Math. 1959, 10: 226–234. 10.1007/BF01240790

    Article  MATH  MathSciNet  Google Scholar 

  12. Hung TL: On a probability metric based on Trotter operator. Vietnam J. Math. 2007, 35(1):22–33.

    Google Scholar 

  13. Kruglov VM, Korolev VY: Limit Theorems for Random Sums. Moscow University Press, Moscow; 1990. (in Russian)

    MATH  Google Scholar 

  14. Gnedenko BV, Korolev VY: Random Summation: Limit Theorems and Applications. CRC Press, Boca Raton; 1996.

    MATH  Google Scholar 

Download references

Acknowledgements

Dedicated to Professor Nguyen Duy Tien on the occasion of his 70th birthday.

The authors wish to express their gratitude to the referees for valuable remarks and comments improving the previous version of this paper. This work is supported by the Vietnam National Foundation For Science and Technology Development (NAFOSTED, Vietnam), grant 101.01-2010.02.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tran Loc Hung.

Additional information

Competing interests

The authors declare that they have no completing interests.

Authors’ contributions

All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Hung, T.L., Thao, V.T. Bounds for the approximation of Poisson-binomial distribution by Poisson distribution. J Inequal Appl 2013, 30 (2013). https://doi.org/10.1186/1029-242X-2013-30

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1029-242X-2013-30

Keywords