Binomial distribution
The binomial distribution counts the number of successes when repeating
Bernoulli trials with success probability , assuming independent identically distributed trials.
Characteristics
| Characteristic | Formula | Description |
|---|---|---|
| Notation | Sometimes or | |
| Parameters | trials; success probability; | |
| Support | All integers from 0 to | |
| Probability mass function | For ; binomial coefficient | |
| Cumulative distribution function | Also (regularized beta function) | |
| Moment-generating function | Product of i.i.d. Bernoulli MGFs | |
| Characteristic function | Fourier transform of the law | |
| Mean | Average number of successes in trials | |
| Variance | Grows with ; maximized at for fixed | |
| Standard deviation | Natural fluctuation scale around | |
| Mode | Two adjacent modes if is an integer | |
| Median | or | Always lies between these two values |
| Skewness | Tends to 0 as (Gaussian regime) | |
| Excess kurtosis | Decays as ; tails thin at large scale | |
| Shannon entropy | — | No simple closed form; numerical computation via the PMF |
| Fisher information | For parameter from one observation | |
| Kullback-Leibler divergence | Same number of trials ; reduces to Bernoulli divergence |
Properties and theorems
| Property / theorem | Formula | Description |
|---|---|---|
| Sum of Bernoulli variables | Canonical construction from Bernoulli | |
Case | Bernoulli is the elementary case | |
Additivity (same ) | indep. | Stable under sums of independent trials |
| Complement of successes | Number of failures; success/failure symmetry | |
| Factorial moments | For ; useful for variance and covariance | |
| Normal approximation | De Moivre-Laplace / CLT; see normal distribution | |
| Continuity correction | Improves Gaussian approximation for moderate | |
| Poisson limit | Rare-event regime; see Poisson | |
| Chernoff bound | Exponential tail bound; useful in ML and finance | |
| Sampling without replacement | — | If trials are not independent (finite urn), the law is hypergeometric, not binomial |
Applications
Defaults and credit risk
Number of defaults among homogeneous credits (common PD): baseline portfolio risk model under independence.
Quality control and compliance
Number of defective items in a batch of size , under a constant defect rate assumption.
Success rates and A/B testing
Number of conversions out of exposures; comparing two proportions across cohorts.
Binomial trees in finance
Multi-period modeling of an underlying (Cox-Ross-Rubinstein): each branch is a Bernoulli trial; the number of up moves is binomial.
Statistical inference
| Concept | Formula | Description |
|---|---|---|
| Observation | , observe successes | Equivalent to Bernoulli trials with successes |
| MLE estimator | Empirical proportion; unbiased for , natural estimator | |
| Estimator variance | Same formula as for observed Bernoulli trials | |
| Exact binomial test | Exact p-value under ; no normal approximation required | |
| Proportion Z-test | Asymptotic approximation; valid when and are large | |
| Clopper-Pearson interval | Exact confidence interval for | |
| Wilson interval | Better behavior than Wald for near 0 or 1 | |
| Conjugate prior (Bayesian) | Posterior after successes in trials |
Important remarks
Inference on from an observed matches that from Bernoulli trials — see Bernoulli.
Prefer the exact test for small or extreme ; the normal approximation simplifies large samples.
Comparing two groups ( vs ) uses a difference-of-proportions test or a independence test.
Rule of thumb: and before using the normal approximation.
Computational methods
| Method | Description | Applications |
|---|---|---|
| Pseudo-random generation | Sum of Bernoulli trials or equivalent algorithm (inversion, BTPE) | Portfolio simulation, stress tests |
| NumPy |
| independent draws from |
| SciPy |
| Exact probabilities, quantiles, simulation |
| Exact test | scipy.stats.binomtest(k, n, p) | Exact p-value for a proportion test |
| Normal approximation |
| Cumulative probabilities for large |
| Confidence intervals |
| Robust estimation of |
Chargement…
References
• Wikipedia, Binomial distribution: https://en.wikipedia.org/wiki/Binomial_distribution
• See also Bernoulli, Poisson, and normal distribution.