Error function

From LaTeX CAS translator demo
Revision as of 15:45, 4 November 2020 by 130.230.32.77 (talk) (Redirected page to wmf:Privacy policy)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Plot of the error function

In mathematics, the error function (also called the Gauss error function), often denoted by erf, is a complex function of a complex variable defined as:[1][2]

erfz=2π0zet2dt.

This integral is a special (non-elementary) and sigmoid function that occurs often in probability, statistics, and partial differential equations. In many of these applications, the function argument is a real number. If the function argument is real, then the function value is also real.

In statistics, for non-negative values of x, the error function has the following interpretation: for a random variable Y that is normally distributed with mean 0 and variance 1/2, erf x is the probability that Y falls in the range [−x, x].

Two closely related functions are the complementary error function (erfc) defined as

erfcz=1erfz,

and the imaginary error function (erfi) defined as

erfiz=ierf(iz),

where i is the imaginary unit.

Name

The name "error function" and its abbreviation erf were proposed by J. W. L. Glaisher in 1871 on account of its connection with "the theory of Probability, and notably the theory of Errors."[3] The error function complement was also discussed by Glaisher in a separate publication in the same year.[4] For the "law of facility" of errors whose density is given by

f(x)=(cπ)12ecx2

(the normal distribution), Glaisher calculates the chance of an error lying between p and q as:

(cπ)12pqecx2dx=12(erf(qc)erf(pc)).

Applications

When the results of a series of measurements are described by a normal distribution with standard deviation σ and expected value 0, then erf(aσ2) is the probability that the error of a single measurement lies between −a and +a, for positive a. This is useful, for example, in determining the bit error rate of a digital communication system.

The error and complementary error functions occur, for example, in solutions of the heat equation when boundary conditions are given by the Heaviside step function.

The error function and its approximations can be used to estimate results that hold with high probability or with low probability. Given random variable XNorm[μ,σ] and constant L<μ:

Pr[XL]=12+12erf(Lμ2σ)Aexp(B(Lμσ)2)

where A and B are certain numeric constants. If L is sufficiently far from the mean, i.e. μLσlnk, then:

Pr[XL]Aexp(Blnk)=AkB

so the probability goes to 0 as k.

Properties

Plots in the complex plane
Integrand exp(−z2)
erf(z)

The property erf(z)=erf(z) means that the error function is an odd function. This directly results from the fact that the integrand et2 is an even function.

For any complex number z:

erf(z)=erf(z)

where z is the complex conjugate of z.

The integrand f = exp(−z2) and f = erf(z) are shown in the complex z-plane in figures 2 and 3. Level of Im(f) = 0 is shown with a thick green line. Negative integer values of Im(f) are shown with thick red lines. Positive integer values of Im(f) are shown with thick blue lines. Intermediate levels of Im(f) = constant are shown with thin green lines. Intermediate levels of Re(f) = constant are shown with thin red lines for negative values and with thin blue lines for positive values.

The error function at +∞ is exactly 1 (see Gaussian integral). At the real axis, erf(z) approaches unity at z → +∞ and −1 at z → −∞. At the imaginary axis, it tends to ±i∞.

Taylor series

The error function is an entire function; it has no singularities (except that at infinity) and its Taylor expansion always converges, but is famously known "[...] for its bad convergence if x > 1."[5]

The defining integral cannot be evaluated in closed form in terms of elementary functions, but by expanding the integrand ez2 into its Maclaurin series and integrating term by term, one obtains the error function's Maclaurin series as:

erf(z)=2πn=0(1)nz2n+1n!(2n+1)=2π(zz33+z510z742+z9216)

which holds for every complex number z. The denominator terms are sequence A007680 in the OEIS.

For iterative calculation of the above series, the following alternative formulation may be useful:

erf(z)=2πn=0(zk=1n(2k1)z2k(2k+1))=2πn=0z2n+1k=1nz2k

because (2k1)z2k(2k+1) expresses the multiplier to turn the kth term into the (k + 1)st term (considering z as the first term).

The imaginary error function has a very similar Maclaurin series, which is:

erfi(z)=2πn=0z2n+1n!(2n+1)=2π(z+z33+z510+z742+z9216+)

which holds for every complex number z.

Derivative and integral

The derivative of the error function follows immediately from its definition:

ddzerf(z)=2πez2.

From this, the derivative of the imaginary error function is also immediate:

ddzerfi(z)=2πez2.

An antiderivative of the error function, obtainable by integration by parts, is

zerf(z)+ez2π.

An antiderivative of the imaginary error function, also obtainable by integration by parts, is

zerfi(z)ez2π.

Higher order derivatives are given by

erf(k)(z)=2(1)k1πHk1(z)ez2=2πdk1dzk1(ez2),k=1,2,

where H are the physicists' Hermite polynomials.[6]

Bürmann series

An expansion,[7] which converges more rapidly for all real values of x than a Taylor expansion, is obtained by using Hans Heinrich Bürmann's theorem:[8]

erf(x)=2πsgn(x)1ex2(1112(1ex2)7480(1ex2)25896(1ex2)3787276480(1ex2)4)=2πsgn(x)1ex2(π2+k=1ckekx2).

By keeping only the first two coefficients and choosing c1=31200 and c2=3418000, the resulting approximation shows its largest relative error at x=±1.3796, where it is less than 3.6127103:

erf(x)2πsgn(x)1ex2(π2+31200ex23418000e2x2).

Inverse functions

Inverse error function

Given a complex number z, there is not a unique complex number w satisfying erf(w)=z, so a true inverse function would be multivalued. However, for −1 < x < 1, there is a unique real number denoted erf1(x) satisfying

erf(erf1(x))=x.

The inverse error function is usually defined with domain (−1,1), and it is restricted to this domain in many computer algebra systems. However, it can be extended to the disk |z| < 1 of the complex plane, using the Maclaurin series

erf1(z)=k=0ck2k+1(π2z)2k+1,

where c0 = 1 and

ck=m=0k1cmck1m(m+1)(2m+1)={1,1,76,12790,43692520,3480716200,}.

So we have the series expansion (common factors have been canceled from numerators and denominators):

erf1(z)=12π(z+π12z3+7π2480z5+127π340320z7+4369π45806080z9+34807π5182476800z11+).

(After cancellation the numerator/denominator fractions are entries OEISA092676/OEISA092677 in the OEIS; without cancellation the numerator terms are given in entry OEISA002067.) The error function's value at ±∞ is equal to ±1.

For |z| < 1, we have erf(erf1(z))=z.

The inverse complementary error function is defined as

erfc1(1z)=erf1(z).

For real x, there is a unique real number erfi1(x) satisfying erfi(erfi1(x))=x. The inverse imaginary error function is defined as erfi1(x).[9]

For any real x, Newton's method can be used to compute erfi1(x), and for 1x1, the following Maclaurin series converges:

erfi1(z)=k=0(1)kck2k+1(π2z)2k+1,

where ck is defined as above.

Asymptotic expansion

A useful asymptotic expansion of the complementary error function (and therefore also of the error function) for large real x is

erfc(x)=ex2xπ[1+n=1(1)n135(2n1)(2x2)n]=ex2xπn=0(1)n(2n1)!!(2x2)n,

where (2n – 1)!! is the double factorial of (2n – 1), which is the product of all odd numbers up to (2n – 1). This series diverges for every finite x, and its meaning as asymptotic expansion is that, for any N one has

erfc(x)=ex2xπn=0N1(1)n(2n1)!!(2x2)n+RN(x)

where the remainder, in Landau notation, is

RN(x)=O(x12Nex2)

as x.

Indeed, the exact value of the remainder is

RN(x):=(1)Nπ212N(2N)!N!xt2Net2dt,

which follows easily by induction, writing

et2=(2t)1(et2)

and integrating by parts.

For large enough values of x, only the first few terms of this asymptotic expansion are needed to obtain a good approximation of erfc(x) (while for not too large values of x, the above Taylor expansion at 0 provides a very fast convergence).

Continued fraction expansion

A continued fraction expansion of the complementary error function is:[10]

erfc(z)=zπez21z2+a11+a2z2+a31+am=m2.

Integral of error function with Gaussian density function

erf(ax+b)12πσ2e(xμ)22σ2dx=erf[aμ+b1+2a2σ2],a,b,μ,σ

Factorial series

erfcz=ez2πzn=0(1)nQn(z2+1)n¯=ez2πz(1121(z2+1)+141(z2+1)(z2+2))
converges for (z2)>0. Here
Qn=def1Γ(1/2)0τ(τ1)(τn+1)τ1/2eτdτ=k=0n(12)k¯s(n,k),   
zn¯ denotes the rising factorial, and s(n,k) denotes a signed Stirling number of the first kind.[11][12]
erf(z)=2πn=0(2)n(2n1)!!(2n+1)!z2n+1

Numerical approximations

Approximation with elementary functions

  • Abramowitz and Stegun give several approximations of varying accuracy (equations 7.1.25–28). This allows one to choose the fastest approximation suitable for a given application. In order of increasing accuracy, they are:
erf(x)11(1+a1x+a2x2+a3x3+a4x4)4,x0
(maximum error: 5×10−4)
where a1 = 0.278393, a2 = 0.230389, a3 = 0.000972, a4 = 0.078108
erf(x)1(a1t+a2t2+a3t3)ex2,t=11+px,x0    (maximum error: 2.5×10−5)
where p = 0.47047, a1 = 0.3480242, a2 = −0.0958798, a3 = 0.7478556
erf(x)11(1+a1x+a2x2++a6x6)16,x0    (maximum error: 3×10−7)
where a1 = 0.0705230784, a2 = 0.0422820123, a3 = 0.0092705272, a4 = 0.0001520143, a5 = 0.0002765672, a6 = 0.0000430638
erf(x)1(a1t+a2t2++a5t5)ex2,t=11+px    (maximum error: 1.5×10−7)
where p = 0.3275911, a1 = 0.254829592, a2 = −0.284496736, a3 = 1.421413741, a4 = −1.453152027, a5 = 1.061405429
All of these approximations are valid for x ≥ 0. To use these approximations for negative x, use the fact that erf(x) is an odd function, so erf(x) = −erf(−x).
  • Exponential bounds and a pure exponential approximation for the complementary error function are given by [13]
erfc(x)12e2x2+12ex2ex2,x>0erfc(x)16ex2+12e43x2,x>0.
  • The above have been generalized to sums of N exponentials[14] with increasing accuracy in terms of N so that erfc(x) can be accurately approximated or bounded by 2Q~(2x), where
Q~(x)=n=1Nanebnx2.
In particular, there is a systematic methodology to solve the numerical coefficients {(an,bn)}n=1N that yield a minimax approximation or bound for the closely related Q-function: Q(x)Q~(x), Q(x)Q~(x), or Q(x)Q~(x) for x0. The coefficients {(an,bn)}n=1N for many variations of the exponential approximations and bounds up to N=25 have been released to open access as a comprehensive dataset.[15]
  • A tight approximation of the complementary error function for x[0,) is given by Karagiannidis & Lioumpas (2007)[16] who showed for the appropriate choice of parameters {A,B} that
erfc(x)(1eAx)ex2Bπx.
They determined {A,B}={1.98,1.135}, which gave a good approximation for all x0.
  • A single-term lower bound is[17]
erfc(x)2eπβ1βeβx2,x0,β>1,
where the parameter β can be picked to minimize error on the desired interval of approximation.
  • Another approximation is given by Sergei Winitzki using his "global Padé approximations":[18][19]:2–3
erf(x)sgn(x)1exp(x24π+ax21+ax2)
where
a=8(π3)3π(4π)0.140012.
This is designed to be very accurate in a neighborhood of 0 and a neighborhood of infinity, and the relative error is less than 0.00035 for all real x. Using the alternate value a ≈ 0.147 reduces the maximum relative error to about 0.00013.[20]
This approximation can be inverted to obtain an approximation for the inverse error function:
erf1(x)sgn(x)(2πa+ln(1x2)2)2ln(1x2)a(2πa+ln(1x2)2).

Polynomial

An approximation with a maximal error of 1.2×107 for any real argument is:[21]

erf(x)={1τx0τ1x<0

with

τ=texp(x21.26551223+1.00002368t+0.37409196t2+0.09678418t30.18628806t4+0.27886807t51.13520398t6+1.48851587t70.82215223t8+0.17087277t9)

and

t=11+0.5|x|.

Table of values

x erf(x) 1-erf(x)
0 0 1
0.02 0.022564575 0.977435425
0.04 0.045111106 0.954888894
0.06 0.067621594 0.932378406
0.08 0.090078126 0.909921874
0.1 0.112462916 0.887537084
0.2 0.222702589 0.777297411
0.3 0.328626759 0.671373241
0.4 0.428392355 0.571607645
0.5 0.520499878 0.479500122
0.6 0.603856091 0.396143909
0.7 0.677801194 0.322198806
0.8 0.742100965 0.257899035
0.9 0.796908212 0.203091788
1 0.842700793 0.157299207
1.1 0.88020507 0.11979493
1.2 0.910313978 0.089686022
1.3 0.934007945 0.065992055
1.4 0.95228512 0.04771488
1.5 0.966105146 0.033894854
1.6 0.976348383 0.023651617
1.7 0.983790459 0.016209541
1.8 0.989090502 0.010909498
1.9 0.992790429 0.007209571
2 0.995322265 0.004677735
2.1 0.997020533 0.002979467
2.2 0.998137154 0.001862846
2.3 0.998856823 0.001143177
2.4 0.999311486 0.000688514
2.5 0.999593048 0.000406952
3 0.99997791 0.00002209
3.5 0.999999257 0.000000743

Related functions

Complementary error function

The complementary error function, denoted erfc, is defined as

erfc(x)=1erf(x)=2πxet2dt=ex2erfcx(x),

which also defines erfcx, the scaled complementary error function[22] (which can be used instead of erfc to avoid arithmetic underflow[22][23]). Another form of erfc(x) for non-negative x is known as Craig's formula, after its discoverer:[24]

erfc(xx0)=2π0π/2exp(x2sin2θ)dθ.

This expression is valid only for positive values of x, but it can be used in conjunction with erfc(x) = 2 − erfc(−x) to obtain erfc(x) for negative values. This form is advantageous in that the range of integration is fixed and finite. An extension of this expression for the erfc of the sum of two non-negative variables is as follows:[25]

erfc(x+yx,y0)=2π0π/2exp(x2sin2θy2cos2θ)dθ.

Imaginary error function

The imaginary error function, denoted erfi, is defined as

erfi(x)=ierf(ix)=2π0xet2dt=2πex2D(x),

where D(x) is the Dawson function (which can be used instead of erfi to avoid arithmetic overflow[22]).

Despite the name "imaginary error function", erfi(x) is real when x is real.

When the error function is evaluated for arbitrary complex arguments z, the resulting complex error function is usually discussed in scaled form as the Faddeeva function:

w(z)=ez2erfc(iz)=erfcx(iz).

Cumulative distribution function

The error function is essentially identical to the standard normal cumulative distribution function, denoted Φ, also named norm(x) by some software languages[citation needed], as they differ only by scaling and translation. Indeed,

Φ(x)=12πxet22dt=12[1+erf(x2)]=12erfc(x2)

or rearranged for erf and erfc:

erf(x)=2Φ(x2)1erfc(x)=2Φ(x2)=2(1Φ(x2)).

Consequently, the error function is also closely related to the Q-function, which is the tail probability of the standard normal distribution. The Q-function can be expressed in terms of the error function as

Q(x)=1212erf(x2)=12erfc(x2).

The inverse of Φ is known as the normal quantile function, or probit function and may be expressed in terms of the inverse error function as

probit(p)=Φ1(p)=2erf1(2p1)=2erfc1(2p).

The standard normal cdf is used more often in probability and statistics, and the error function is used more often in other branches of mathematics.

The error function is a special case of the Mittag-Leffler function, and can also be expressed as a confluent hypergeometric function (Kummer's function):

erf(x)=2xπM(12,32,x2).

It has a simple expression in terms of the Fresnel integral.[further explanation needed]

In terms of the regularized gamma function P and the incomplete gamma function,

erf(x)=sgn(x)P(12,x2)=sgn(x)πγ(12,x2).

sgn(x) is the sign function.

Generalized error functions

Graph of generalised error functions En(x):
grey curve: E1(x) = (1 − e −x)/π
red curve: E2(x) = erf(x)
green curve: E3(x)
blue curve: E4(x)
gold curve: E5(x).

Some authors discuss the more general functions:[citation needed]

En(x)=n!π0xetndt=n!πp=0(1)pxnp+1(np+1)p!.

Notable cases are:

  • E0(x) is a straight line through the origin: E0(x)=xeπ
  • E2(x) is the error function, erf(x).

After division by n!, all the En for odd n look similar (but not identical) to each other. Similarly, the En for even n look similar (but not identical) to each other after a simple division by n!. All generalised error functions for n > 0 look similar on the positive x side of the graph.

These generalised functions can equivalently be expressed for x > 0 using the gamma function and incomplete gamma function:

En(x)=1πΓ(n)(Γ(1n)Γ(1n,xn)),x>0.

Therefore, we can define the error function in terms of the incomplete Gamma function:

erf(x)=11πΓ(12,x2).

Iterated integrals of the complementary error function

The iterated integrals of the complementary error function are defined by[26]

inerfc(z)=zin-1erfc(ζ)dζi0erfc(z)=erfc(z)i1erfc(z)=ierfc(z)=1πez2zerfc(z)i2erfc(z)=14[erfc(z)2zierfc(z)]

The general recurrence formula is

2ninerfc(z)=in-2erfc(z)2zin-1erfc(z)

They have the power series

inerfc(z)=j=0(z)j2njj!Γ(1+nj2),

from which follow the symmetry properties

i2merfc(z)=i2merfc(z)+q=0mz2q22(mq)1(2q)!(mq)!

and

i2m+1erfc(z)=i2m+1erfc(z)+q=0mz2q+122(mq)1(2q+1)!(mq)!.

Implementations

As real function of a real argument

As complex function of a complex argument

  • libcerf, numeric C library for complex error functions, provides the complex functions cerf, cerfc, cerfcx and the real functions erfi, erfcx with approximately 13–14 digits precision, based on the Faddeeva function as implemented in the MIT Faddeeva Package

See also

Related functions

In probability

References

  1. Andrews, Larry C. (1998). Special functions of mathematics for engineers. SPIE Press. p. 110. ISBN 9780819426161.
  2. Greene, William H.; Econometric Analysis (fifth edition), Prentice-Hall, 1993, p. 926, fn. 11
  3. Glaisher, James Whitbread Lee (July 1871). "On a class of definite integrals". London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science. 4. 42 (277): 294–302. doi:10.1080/14786447108640568. Retrieved 6 December 2017.
  4. Glaisher, James Whitbread Lee (September 1871). "On a class of definite integrals. Part II". London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science. 4. 42 (279): 421–436. doi:10.1080/14786447108640600. Retrieved 6 December 2017.
  5. "A007680 - OEIS". oeis.org. Retrieved 2 April 2020.
  6. Weisstein, Eric W. "Erf". MathWorld. Wolfram.
  7. H. M. Schöpf and P. H. Supancic, "On Bürmann's Theorem and Its Application to Problems of Linear and Nonlinear Heat Transfer and Diffusion," The Mathematica Journal, 2014. doi:10.3888/tmj.16–11.Schöpf, Supancic
  8. Weisstein, E. W. "Bürmann's Theorem". Wolfram MathWorld—A Wolfram Web Resource.
  9. Bergsma, Wicher (2006). "On a new correlation coefficient, its orthogonal decomposition and associated tests of independence". arXiv:math/0604627.
  10. Cuyt, Annie A. M.; Petersen, Vigdis B.; Verdonk, Brigitte; Waadeland, Haakon; Jones, William B. (2008). Handbook of Continued Fractions for Special Functions. Springer-Verlag. ISBN 978-1-4020-6948-2.
  11. Schlömilch, Oskar Xavier (1859). "Ueber facultätenreihen". Zeitschrift für Mathematik und Physik (in Deutsch). 4: 390–415. Retrieved 4 December 2017.
  12. Eq (3) on page 283 of Nielson, Niels (1906). Handbuch der Theorie der Gammafunktion (in Deutsch). Leipzig: B. G. Teubner. Retrieved 4 December 2017.
  13. Chiani, M.; Dardari, D.; Simon, M.K. (2003). "New Exponential Bounds and Approximations for the Computation of Error Probability in Fading Channels" (PDF). IEEE Transactions on Wireless Communications. 2 (4): 840–845. CiteSeerX 10.1.1.190.6761. doi:10.1109/TWC.2003.814350.
  14. Tanash, I.M.; Riihonen, T. (2020). "Global minimax approximations and bounds for the Gaussian Q-function by sums of exponentials". IEEE Transactions on Communications. 68 (10): 6514–6524. arXiv:2007.06939. doi:10.1109/TCOMM.2020.3006902. S2CID 220514754.
  15. Tanash, I.M.; Riihonen, T. (2020). "Coefficients for Global Minimax Approximations and Bounds for the Gaussian Q-Function by Sums of Exponentials [Data set]". Zenodo. doi:10.5281/zenodo.4112978.
  16. Karagiannidis, G. K., & Lioumpas, A. S. An improved approximation for the Gaussian Q-function. 2007. IEEE Communications Letters, 11(8), pp. 644-646.
  17. Chang, Seok-Ho; Cosman, Pamela C.; Milstein, Laurence B. (November 2011). "Chernoff-Type Bounds for the Gaussian Error Function". IEEE Transactions on Communications. 59 (11): 2939–2944. doi:10.1109/TCOMM.2011.072011.100049. S2CID 13636638.
  18. Winitzki, Serge (2003). "Uniform approximations for transcendental functions". Lecture Notes in Comput. Sci. Lecture Notes in Computer Science. 2667. Spronger, Berlin. pp. 780–789. doi:10.1007/3-540-44839-X_82. ISBN 978-3-540-40155-1. (Sect. 3.1 "Error Function of Real Argument erf x")
  19. Zeng, Caibin; Chen, Yang Cuan (2015). "Global Padé approximations of the generalized Mittag-Leffler function and its inverse". Fractional Calculus and Applied Analysis. 18 (6): 1492–1506. arXiv:1310.5592. doi:10.1515/fca-2015-0086. S2CID 118148950. Indeed, Winitzki [32] provided the so-called global Padé approximation
  20. Winitzki, Sergei (6 February 2008). "A handy approximation for the error function and its inverse". Cite journal requires |journal= (help)
  21. Numerical Recipes in Fortran 77: The Art of Scientific Computing (ISBN 0-521-43064-X), 1992, page 214, Cambridge University Press.
  22. 22.0 22.1 22.2 Cody, W. J. (March 1993), "Algorithm 715: SPECFUN—A portable FORTRAN package of special function routines and test drivers" (PDF), ACM Trans. Math. Softw., 19 (1): 22–32, CiteSeerX 10.1.1.643.4394, doi:10.1145/151271.151273, S2CID 5621105
  23. Zaghloul, M. R. (1 March 2007), "On the calculation of the Voigt line profile: a single proper integral with a damped sine integrand", Monthly Notices of the Royal Astronomical Society, 375 (3): 1043–1048, doi:10.1111/j.1365-2966.2006.11377.x
  24. John W. Craig, A new, simple and exact result for calculating the probability of error for two-dimensional signal constellations Archived 3 April 2012 at the Wayback Machine, Proceedings of the 1991 IEEE Military Communication Conference, vol. 2, pp. 571–575.
  25. Behnad, Aydin (2020). "A Novel Extension to Craig's Q-Function Formula and Its Application in Dual-Branch EGC Performance Analysis". IEEE Transactions on Communications. 68 (7): 4117–4125. doi:10.1109/TCOMM.2020.2986209. S2CID 216500014.
  26. Carslaw, H. S.; Jaeger, J. C. (1959), Conduction of Heat in Solids (2nd ed.), Oxford University Press, ISBN 978-0-19-853368-9, p 484
  27. https://pubs.opengroup.org/onlinepubs/9699919799/basedefs/math.h.html
  28. https://www.gnu.org/software/gsl/doc/html/specfunc.html#error-functions

Further reading

External links