In mathematics, a normal number is a real number whose infinite sequence of digits in every base b^{[1]} is distributed uniformly in the sense that each of the b digit values has the same natural density 1/b, also all possible b^{2} pairs of digits are equally likely with density b^{−2}, all b^{3} triplets of digits equally likely with density b^{−3}, etc.
Intuitively this means that no digit, or combination of digits, occurs more frequently than any other, and this is true whether the number is written in base 10, binary, or any other base. A normal number can be thought of as an infinite sequence of coin flips (binary) or rolls of a die (base 6). Even though there will be sequences such as 10, 100, or more consecutive tails (binary) or fives (base 6) or even 10, 100, or more repetitions of a sequence such as tailhead (two consecutive coin flips) or 61 (two consecutive rolls of a die), there will also be equally many of any other sequence of equal length. No digit or sequence is "favored".
While a general proof can be given that almost all real numbers are normal (in the sense that the set of exceptions has Lebesgue measure zero), this proof is not constructive and only very few specific numbers have been shown to be normal. For example, it is widely believed that the numbers √2, π, and e are normal, but a proof remains elusive.
Contents

Definitions 1

Properties and examples 2

Nonnormal numbers 2.1

Properties 2.2

Connection to finitestate machines 3

Connection to equidistributed sequences 4

Notes 5

See also 6

References 7

Further reading 8

External links 9
Definitions
Let Σ be a finite alphabet of b digits, and Σ^{∞} the set of all sequences that may be drawn from that alphabet. Let S ∈ Σ^{∞} be such a sequence. For each a in Σ let N_{S}(a, n) denote the number of times the letter a appears in the first n digits of the sequence S. We say that S is simply normal if the limit

\lim_{n\to\infty} \frac{N_S(a,n)}{n} = \frac{1}{b}
for each a. Now let w be any finite string in Σ^{∗} and let N_{S}(w, n) to be the number of times the string w appears as a substring in the first n digits of the sequence S. (For instance, if S = 01010101..., then N_{S}(010, 8) = 3.) S is normal if, for all finite strings w ∈ Σ^{∗},

\lim_{n\to\infty} \frac{N_S(w,n)}{n} = \frac{1}{b^{w}}
where  w  denotes the length of the string w. In other words, S is normal if all strings of equal length occur with equal asymptotic frequency. For example, in a normal binary sequence (a sequence over the alphabet {0,1}), 0 and 1 each occur with frequency ^{1}⁄_{2}; 00, 01, 10, and 11 each occur with frequency ^{1}⁄_{4}; 000, 001, 010, 011, 100, 101, 110, and 111 each occur with frequency ^{1}⁄_{8}, etc. Roughly speaking, the probability of finding the string w in any given position in S is precisely that expected if the sequence had been produced at random.
Suppose now that b is an integer greater than 1 and x is a real number. Consider the infinite digit sequence expansion S_{x, b} of x in the base b positional number system (we ignore the decimal point). We say that x is simply normal in base b if the sequence S_{x, b} is simply normal^{[2]} and that x is normal in base b if the sequence S_{x, b} is normal.^{[3]} The number x is called a normal number (or sometimes an absolutely normal number) if it is normal in base b for every integer b greater than 1.^{[4]}^{[5]}
A given infinite sequence is either normal or not normal, whereas a real number, having a different baseb expansion for each integer b ≥ 2, may be normal in one base but not in another.^{[6]}^{[7]} For bases r and s with log r / log s rational (so that r = b^{m} and s = b^{n}) every number normal in base r is normal in base s. For bases r and s with log r / log s irrational, there are uncountably many numbers normal in each base but not the other.^{[7]}
A disjunctive sequence is a sequence in which every finite string appears. A normal sequence is disjunctive, but a disjunctive sequence need not be normal. A rich number in base b is one whose expansion in base b is disjunctive:^{[8]} one that is disjunctive to every base is called absolutely disjunctive or is said to be a lexicon. A number normal in base b is rich in base b, but not necessarily conversely. The real number x is rich in base b if and only if the set { x b^{n} mod 1: n∈N } is dense in the unit interval.^{[8]}^{[9]}
We defined a number to be simply normal in base b if each individual digit appears with frequency 1/b. For a given base b, a number can be simply normal (but not normal or bdense), bdense (but not simply normal or normal), normal (and thus simply normal and bdense), or none of these. A number is absolutely nonnormal or absolutely abnormal if it is not simply normal in any base.^{[4]}^{[10]}
Properties and examples
The concept of a normal number was introduced by Émile Borel in 1909. Using the Borel–Cantelli lemma, he proved the normal number theorem: almost all real numbers are normal, in the sense that the set of nonnormal numbers has Lebesgue measure zero (Borel 1909). This theorem established the existence of normal numbers. In 1917, Wacław Sierpiński showed that it is possible to specify a particular such number. Becher and Figueira proved in 2002 that there is a computable absolutely normal number, however no digits of their number are known.
The set of nonnormal numbers, though "small" in the sense of being a null set, is "large" in the sense of being uncountable. For instance, there are uncountably many numbers whose decimal expansion does not contain the digit 5, and none of these are normal.
Champernowne's number

0.1234567891011121314151617...,
obtained by concatenating the decimal representations of the natural numbers in order, is normal in base 10, but it might not be normal in some other bases.
The Copeland–Erdős constant

0.235711131719232931374143...,
obtained by concatenating the prime numbers in base 10, is normal in base 10, as proved by Copeland and Erdős (1946). More generally, the latter authors proved that the real number represented in base b by the concatenation

0.f(1)f(2)f(3)...,
where f(n) is the n^{th} prime expressed in base b, is normal in base b. Besicovitch (1935) proved that the number represented by the same expression, with f(n) = n^{2},

0.149162536496481100121144...,
obtained by concatenating the square numbers in base 10, is normal in base 10. Davenport & Erdős (1952) proved that the number represented by the same expression, with f being any polynomial whose values on the positive integers are positive integers, expressed in base 10, is normal in base 10.
Nakai & Shiokawa (1992) proved that if f(x) is any nonconstant polynomial with real coefficients such that f(x) > 0 for all x > 0, then the real number represented by the concatenation

0.[f(1)][f(2)][f(3)]...,
where [f(n)] is the integer part of f(n) expressed in base b, is normal in base b. (This result includes as special cases all of the abovementioned results of Champernowne, Besicovitch, and Davenport & Erdős.) The authors also show that the same result holds even more generally when f is any function of the form

f(x) = α·x^{β} + α_{1}·x^{β1} + ... + α_{d}·x^{βd},
where the αs and βs are real numbers with β > β_{1} > β_{2} > ... > β_{d} ≥ 0, and f(x) > 0 for all x > 0.
Every Chaitin's constant \ \Omega is a normal number (Calude, 1994). A computable normal number was constructed in (Becher 2002). Although these constructions do not directly give the digits of the numbers constructed, the second shows that it is possible in principle to enumerate all the digits of a particular normal number.
Bailey and Crandall show an explicit uncountably infinite class of bnormal numbers by perturbing Stoneham numbers.^{[11]}
It has been an elusive goal to prove the normality of numbers which were not explicitly constructed for the purpose. It is for instance unknown whether √2, π, ln(2) or e is normal (but all of them are strongly conjectured to be normal, because of some empirical evidence ). It is not even known whether all digits occur infinitely often in the decimal expansions of those constants. In particular, the popular claim "every string of numbers eventually occurs in π" is not known to be true. It has been conjectured that every irrational algebraic number is normal; while no counterexamples are known, there also exists no algebraic number that has been proven to be normal in any base.
Nonnormal numbers
No rational number is normal to any base, since the digit sequences of rational numbers are eventually periodic.^{[12]} (However, a rational number can be simply normal to a particular base: \frac{123,\!456,\!789}{9,\!999,\!999,\!999}=0.\overline{0123456789} is simply normal to base 10.)
Martin 2001 has given a simple example of an irrational absolutely nonnormal number.^{[13]} Let d_{2} = 4 and

d_j = j^{d_{j1} / (j1)} \ ,

\xi = \prod_{j=2}^\infty \left({1  \frac{1}{d_j}}\right) \ .
Then ξ is absolutely nonnormal and a Liouville number; hence a transcendental number.
Properties
Additional properties of normal numbers include:

Every positive number x is the product of two normal numbers. For instance if y is chosen uniformly at random from the interval (0,1) then almost surely y and x/y are both normal, and their product is x.

If x is normal in base b and q ≠ 0 is a rational number, then x \cdot q is normal in base b. (Wall 1949)

If A\subseteq\N is dense (for every \alpha<1 and for all sufficiently large n, A \cap \{1,\ldots,n\} \geq n^\alpha) and a_1,a_2,a_3,\ldots are the baseb expansions of the elements of A, then the number 0.a_1a_2a_3\ldots, formed by concatenating the elements of A, is normal in base b (Copeland and Erdős 1946). From this it follows that Champernowne's number is normal in base 10 (since the set of all positive integers is obviously dense) and that the Copeland–Erdős constant is normal in base 10 (since the prime number theorem implies that the set of primes is dense).

A sequence is normal if and only if every block of equal length appears with equal frequency. (A block of length k is a substring of length k appearing at a position in the sequence that is a multiple of k: e.g. the first lengthk block in S is S[1..k], the second lengthk block is S[k+1..2k], etc.) This was implicit in the work of Ziv and Lempel (1978) and made explicit in the work of Bourke, Hitchcock, and Vinodchandran (2005).

A number is normal in base b if and only if it is simply normal in base b^{k} for every integer k \geq 1. This follows from the previous block characterization of normality: Since the n^{th} block of length k in its base b expansion corresponds to the n^{th} digit in its base b^{k} expansion, a number is simply normal in base b^{k} if and only if blocks of length k appear in its base b expansion with equal frequency.

A number is normal if and only if it is simply normal in every base. This follows from the previous characterization of base b normality.

A number is bnormal if and only if there exists a set of positive integers m_1 where the number is simply normal to bases b^{m} for all m\in\{m_1,m_2,\ldots\}.^{[14]} No finite set suffices to show that the number is bnormal.

The set of normal sequences is closed under finite variations: adding, removing, or changing a finite number of digits in any normal sequence leaves it normal.
Connection to finitestate machines
Agafonov showed an early connection between finitestate machines and normal sequences: every infinite subsequence selected from a normal sequence by a regular language is also normal. In other words, if one runs a finitestate machine on a normal sequence, where each of the finitestate machine's states are labeled either "output" or "no output", and the machine outputs the digit it reads next after entering an "output" state, but does not output the next digit after entering a "no output state", then the sequence it outputs will be normal (Agafonov 1968).
A deeper connection exists with finitestate gamblers (FSGs) and information lossless finitestate compressors (ILFSCs).

A finitestate gambler (a.k.a. finitestate martingale) is a finitestate machine over a finite alphabet \Sigma, each of whose states is labelled with percentages of money to bet on each digit in \Sigma. For instance, for an FSG over the binary alphabet \Sigma = \{0,1\}, the current state q bets some percentage q_0 \in [0,1] of the gambler's money on the bit 0, and the remaining q_1 = 1q_0 fraction of the gambler's money on the bit 1. The money bet on the digit that comes next in the input (total money times percent bet) is multiplied by \Sigma, and the rest of the money is lost. After the bit is read, the FSG transitions to the next state according to the input it received. A FSG d succeeds on an infinite sequence S if, starting from $1, it makes unbounded money betting on the sequence; i.e., if


\limsup_{n\to\infty} d(S \upharpoonright n) = \infty,

where d(S \upharpoonright n) is the amount of money the gambler d has after reading the first n digits of S (see limit superior).

A finitestate compressor is a finitestate machine with output strings labelling its state transitions, including possibly the empty string. (Since one digit is read from the input sequence for each state transition, it is necessary to be able to output the empty string in order to achieve any compression at all). An information lossless finitestate compressor is a finitestate compressor whose input can be uniquely recovered from its output and final state. In other words, for a finitestate compressor C with state set Q, C is information lossless if the function f: \Sigma^* \to \Sigma^* \times Q, mapping the input string of C to the output string and final state of C, is 1–1. Compression techniques such as Huffman coding or Shannon–Fano coding can be implemented with ILFSCs. An ILFSC C compresses an infinite sequence S if


\liminf_{n\to\infty} \frac{C(S \upharpoonright n)}{n} < 1,

where C(S \upharpoonright n) is the number of digits output by C after reading the first n digits of S. Note that the compression ratio (the limit inferior above) can always be made to equal 1 by the 1state ILFSC that simply copies its input to the output.
Schnorr and Stimm showed that no FSG can succeed on any normal sequence, and Bourke, Hitchcock and Vinodchandran showed the converse. Therefore:

A sequence is normal if and only if there is no finitestate gambler that succeeds on it.
Ziv and Lempel showed:

A sequence is normal if and only if it is incompressible by any information lossless finitestate compressor
(they actually showed that the sequence's optimal compression ratio over all ILFSCs is exactly its entropy rate, a quantitative measure of its deviation from normality, which is 1 exactly when the sequence is normal). Since the LZ compression algorithm compresses asymptotically as well as any ILFSC, this means that the LZ compression algorithm can compress any nonnormal sequence. (Ziv Lempel 1978)
These characterizations of normal sequences can be interpreted to mean that "normal" = "finitestate random"; i.e., the normal sequences are precisely those that appear random to any finitestate machine. Compare this with the algorithmically random sequences, which are those infinite sequences that appear random to any algorithm (and in fact have similar gambling and compression characterizations with Turing machines replacing finitestate machines).
Connection to equidistributed sequences
A number x is normal in base b if and only if the sequence {\left( b^k x \right) }_{k=0}^\infty is equidistributed modulo 1,^{[15]}^{[16]} or equivalently, using Weyl's criterion, if and only if

\lim_{n\rightarrow\infty}\frac{1}{n}\sum_{k=0}^{n1}e^{2 \pi i m b^k x}=0 \quad\text{ for all integers } m\geq 1.
This connection leads to the terminology that x is normal in base β for any real number β if the sequence \left({x \beta^k}\right)_{k=0}^\infty is equidistributed modulo 1.^{[16]}
Notes

^ The only bases considered here are natural numbers greater than 1

^ Bugeaud 2012, p. 78

^ Bugeaud 2012, p. 79

^ ^{a} ^{b} Bugeaud 2012, p. 102

^ Adamczewski & Bugeaud 2010, p. 413

^ Cassels 1959

^ ^{a} ^{b} Schmidt 1960

^ ^{a} ^{b} Bugeaud 2012, p. 92

^ x b^{n} mod 1 denotes the fractional part of x b^{n}.

^ Martin (2001)

^ Bailey & Crandall (2002).

^ Murty (2007, p. 483).

^ Bugeaud (2012) p.113

^ Long (1957).

^ Bugeaud 2012, p. 89

^ ^{a} ^{b} Everest et al. 2003, p. 127
See also
References

Adamczewski, Boris; Bugeaud, Yann (2010), "8. Transcendence and diophantine approximation", in Berthé, Valérie; Rigo, Michael, Combinatorics, automata, and number theory, Encyclopedia of Mathematics and its Applications 135, Cambridge:

Agafonov, V. N. (1968), "Normal sequences and finite automata", .

.

.

.

Becher, V.; Figueira, S. (2002), "An example of a computable absolutely normal number", Theoretical Computer Science 270: 947–958, .

.

.

Bourke, C.; Hitchcock, J. M.; Vinodchandran, N. V. (2005), "Entropy rates and finitestate dimension", Theoretical Computer Science 349 (3): 392–406, .

Bugeaud, Yann (2012), Distribution modulo one and Diophantine approximation, Cambridge Tracts in Mathematics 193, Cambridge:

.

.

.

.

.

Dajani, Karma; Kraaikamp, Cor (2002), Ergodic theory of numbers, .

.

.

Khoshnevisan, Davar (2006), "Normal numbers are normal" (PDF), .

Long, C. T. (1957), "Note on normal numbers", .

Martin, Greg (2001), "Absolutely abnormal numbers",

Murty, Maruti Ram (2007), Problems in analytic number theory (2 ed.), Springer, .

.

.

.

.

.

.
Further reading


Quéfflec, Martine (2006), "Old and new results on normality", in Denteneer, Dee; den Hollander, F.; Verbitskiy, E., Dynamics & Stochastics: Festschrift in honor of M. S. Keane, IMS Lecture Notes – Monograph Series 48, Beachwood, Ohio:
External links
This article was sourced from Creative Commons AttributionShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, EGovernment Act of 2002.
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a nonprofit organization.