MATH 362 Lecture Notes Overview
MATH 362 Lecture Notes Overview
1 Notation
k
ź
A1 ˆ A2 ˆ ¨ ¨ ¨ ˆ Ak , or Ai ,
i“1
k
ź
Note: Rk “ R.
i“1
2
MATH 362 Lecture Notes Sequences, lim sup, lim inf
Theorem 2.1: Suppose pan q is a monotonic sequence in R. Then the sequence converges
ô pan q is bounded.
Proof:
Definition 2.2: The extended reals r´8, 8s, consists of the set R together with the symbols
p´8q and p8q. We order this set by defining ´8 ă x ă 8 @ x P R.
Notes:
2. By convention,
• if x is real, then
x x
x ` 8 “ `8, x ´ 8 “ ´8, “ “ 0.
`8 ´8
• if x ą 0 then x ¨ p`8q “ `8, x ¨ p´8q “ ´8.
• if x ă 0 then x ¨ p`8q “ ´8, x ¨ p´8q “ `8.
Proposition 2.3: If A Ă r´8, 8s and A , ∅, then sup A, inf A both exist in r´8, 8s.
Proof: Exercise
3
MATH 362 Lecture Notes Sequences, lim sup, lim inf
Definition 2.4: Let pan q be a sequence of reals with the property that @ M P R, DN P
N s.t. n ě N ñ an ě M. We then write an Ñ `8.
Proposition 2.5: If pan q is a monotone (real) sequence, then an Ñ x for some x P r´8, 8s.
Proof: (Outline) WLOG, a1 ď a2 ď ¨ ¨ ¨ . Show that if pan q is not bounded above, then
an Ñ `8.
Note:
1. mn , Mn P r´8, 8s, @ n.
2. pMn q and pmn q are monotone decreasing and increasing sequences respectively.
Thus, Mn Ñ M for some M P r´8, 8s, and likewise mn Ñ some m. The numbers M, m are
called upper and lower limits of pan q; we use the notation
or, alternatively,
lim sup an “ a˚ and lim inf an “ a˚ .
n n
Notes:
1. As we make precise in Thm. 2.9 (below) one can think of lim sup an as the largest number in
the extended reals that pan q “visits” infinitely often.
2. lim sup an and lim inf an exist for every (real) sequence pan q (Propositions 2.3 and 2.5).
4
MATH 362 Lecture Notes Sequences, lim sup, lim inf
Proposition 2.7: For any sequence pan q in r´8, 8s, lim inf an ď lim sup an .
Theorem 2.8: Let pan q be a sequence of reals (i.e., in R), and suppose L P r´8, 8s. Then
an Ñ L ô lim inf an “ lim sup an “ L.
Theorem 2.9: Let pan q be a real sequence and assume M “ lim sup an P R. Then @ ε ą 0,
(i) DN P N s.t. an ă M ` ε, @ n ě N.
Thus, |an ´ M| ă ε, for infinitely many n. Similar (modified) statements may be made about
lim inf an .
5
MATH 362 Lecture Notes Sequences, lim sup, lim inf
Proof:
(i) If this were not so then there would be some ε ą 0 for which Mn ě M ` ε, @ n,
and this would imply M ě M ` ε. ÑÐ
(ii) If this were not so then there would be some ε ą 0 and some N P N for which
n ě N ñ Mn ď M ´ ε. This would imply M ď M ´ ε. ÑÐ
6
MATH 362 Lecture Notes Some Useful Inequalities
with equality holding if and only if one of u, v is a scalar multiple of the other.
Proof: The inequality (1) holds trivially if one of u, v is the zero vector. Thus, we turn
to the case where u, v are arbitrary (fixed) nonzero vectors.
For any real t,
As this is a quadratic polynomial in t which cannot have two real roots, we know the
discriminant
On the other hand, if | xu, vy | “ |u||v|, then the discriminant we calculated above is 0,
which means the quadratic polynomial |tu ` v|2 has precisely one root, t0 , so
7
MATH 362 Lecture Notes Some Useful Inequalities
Proposition 3.2 allows us to prove a generalization of Schwarz’s Inequality. Note that, in the
statement of the next result, we may take p “ q “ 2, in which case we get the Schwarz Inequality
again.
Proof: Note that if each xi “ 0 or each yi “ 0, then the result is trivial. Thus, we
assume xi ą 0 and y j ą 0 for at least one pi, jq P t1, . . . , ku2 . Set
˜ ¸1{p ˜ ¸1{q
n n
p q
ÿ ÿ
α“ xi , β“ yi ,
i“1 i“1
and note that α, β ą 0. Moreover, the vector x1 :“ α1 x with components x1i satisfies
n n ´ ¯p n
ÿ ÿ xi 1 ÿ p
px1i qp “ “ x “ 1.
i“1 i“1
α αp i“1 i
n n ˆ ˙q
ÿ ÿ xi
py1i qq “ “ 1.
i“1 i“1
β
p q 1 p 1 q
xi yi “ pxi q1{p pyi q1{q ď x ` yi ,
p i q
8
MATH 362 Lecture Notes Some Useful Inequalities
Proof: In the case p “ 1 it is clear that the two sides of (4) are equal. Note, also, that
the result holds trivially in the case i pxi ` yi qp “ 0.
ř
(Theorem 3.3) below, we assume 1{p ` 1{q “ 1 (so p “ pq ´ q). Then, we have
n
ÿ n
ÿ n
ÿ n
ÿ
pxi ` yi qp “ pxi ` yi qpxi ` yi qp´1 “ xi pxi ` yi qp´1 ` yi pxi ` yi qp´1
i“1 i“1 i“1 i“1
˜ ¸1{p « ff1{q ˜ ¸1{p « ff1{q
n
ÿ n
ÿ n
ÿ n
ÿ
p p
ď xi pxi ` yi qpp´1qq ` yi pxi ` yi qpp´1qq (by Thm. 3.3)
i“1 i“1 i“1 i“1
»˜ ¸1{p ˜ ¸1{p fi « ff1{q
n
ÿ n
ÿ n
ÿ
p p
“ – xi ` yi fl pxi ` yi q p
.
i“1 i“1 i“1
“řn ‰1{q
Now divide both ends of the expression by i“1 pxi ` yi qp to obtain (4).
x
Proposition 3.5: The function f pxq “ , x ě 0, is monotonically increasing.
1`x
y 1 1 x
f pyq “ “ 1´ ą 1´ “ “ f pxq.
1`y 1`y 1`x 1`x
Proposition 3.6: For any two real numbers x, y, it is the case that
|x ` y| |x| |y|
ď ` .
1 ` |x ` y| 1 ` |x| 1 ` |y|
9
MATH 362 Lecture Notes Some Useful Inequalities
Proof: First, note that if either x “ 0 or y “ 0 then the result holds trivially. Next, let
assume x, y are both positive real numbers. Then
|x ` y| x`y x y
“ “ `
1 ` |x ` y| 1`x`y 1`x`y 1`x`y
x y |x| |y|
ď ` “ ` .
1`x 1`y 1 ` |x| 1 ` |y|
10
MATH 362 Lecture Notes Metric Spaces
4 Metric Spaces
• Elementary Analysis, the Theory of Calculus, 2nd Ed., by Kenneth A. Ross, Section 13
(i) dpx, xq “ 0, @ x P X
• R
• Rk
Here are several different choices of metrics:
« ff1{2
ÿk
d2 px, yq :“ pxi ´ yi q2 ,
i“1
k
ÿ
d1 px, yq :“ |xi ´ yi |,
i“1
˜ ¸1{p
k
ÿ
dp px, yq :“ |xi ´ yi |p , p ě 1.
i“1
We claim that pRk , d8 q and pRk , dp q, p ě 1 are examples of metric spaces. To show this
requires showing that d8 , dp are metrics on Rk , having the properties described in Definition
4.1. A proof that d2 satisfies the triangle inequality is on pp. 28-29 in Shirali. It requires the
Cauchy-Schwarz inequality. For dp we need the Minkowski inequality.
11
MATH 362 Lecture Notes Metric Spaces
When we talk about Euclidean space Rk , the implied metric is d2 . In instances where we
wish to use some other metric on the vectors in Rk , we will be explicit about which metric
we employ.
Then pX, d0,1 q is a metric space. In particular, this discrete metric is yet another suitable way
to define distance between points in Rk so as to make it into a metric space.
dpx, yq
d1 px, yq :“ .
1 ` dpx, yq
• Let S be a set, and consider the set BpSq of bounded functions f : S Ñ C—that is,
sup | f pxq| ă 8.
xPS
• As a special case of the previous example, we might take S “ ra, bs Ă R. The collection
Cpra, bsq of continuous functions on S is a subset of BpSq (by the Extreme Value Theorem—a
continuous function defined on a closed interval attains minimum and maximum values),
so pCpSq, dq is a metric space, known as the space of continuous functions.
This special case was encountered already, when we discussed the metric space pRk , d8 q
above.
12
MATH 362 Lecture Notes Metric Spaces
It can be shown that dp is a metric on Cpra, bsq, so that pCpra, bsq, dp q is a metric space.
Proof: That this is so for k “ 1 The case k “ 1 is contained in Theorem 10.11 from Ross,
and is proved there. The case k ą 1 is left as an exercise.
13
MATH 362 Lecture Notes Metric Spaces
(iii) An adherent point which is not a limit point is called an isolated point.
Definition 4.5: Suppose that A is a set with subset E. The set AzE (also denoted Ec , the
complement of E in A, when the set A is understood), is given by
Proof: Exercise.
Examples:
14
MATH 362 Lecture Notes Metric Spaces
Theorem 4.8: Suppose that pX, dq is a metric space, Ω Ă X. Ω is open ô XzΩ is closed.
Proposition 4.9 (DeMorgan’s Laws): Suppose tAα u is a (finite or infinite) collection of sub-
sets of a set X. Then
˜ ¸c
ď č
(i) Aα “ Acα
α α
˜ ¸c
č ď
(ii) Aα “ Acα
α α
Proof:
˜ ¸c ˜ ¸c
ď ď č
(i) For x P Aα , x P Acα for each α, showing that Aα Ă Acα .
α α α¸
˜ c
č ď ď č
For x P Acα , x < Aα @ α ñ x < Aα , which shows that Aα Ą Acα .
α α α α
Taken together, these opposing set inclusions imply the result.
(ii) May be proved similarly; also follows from (i). (Verify)
15
MATH 362 Lecture Notes Metric Spaces
(i) E is closed.
(ii) E “ E ô E is closed.
Proof:
3. N “ N.
16
MATH 362 Lecture Notes Metric Spaces
Proof: Follows from Thm. 4.6, and the fact (likely proved in Math 361) that
between every two real numbers there is a rational.
Theorem 4.12:
ď
(i) If tΩα u is a collection of open sets, then Ωα is open.
α
n
č
(ii) If Ω1 , Ω2 , ..., Ωn are open, then Ωm is open.
m“1
č
(iii) If tFα u is a collection of closed sets, then Fα is closed.
α
n
ď
(iv) If F1 , F2 , ..., Fn are closed, then Fm is closed.
m“1
Proof:
ď
(i) Let x P Ωα . Then x P Ωα0 for some (fixed) α0 and, since Ωα0 is open, Dr ą
α ď
0 s.t. Bpx, rq Ă Ωα0 Ă Ωα .
α
n
č
(ii) Let x P Ωm . Then x P Ωm for each m “ 1, . . . , n, and Drm ą 0 s.t. Bpx, rm q Ă Ωm .
m“1
Let r :“ mintrm | 1 ď m ď nu. By construction, r ą 0 and Bpx, rq Ă Ωm for each m,
n
č
and hence, Bpx, rq Ă Ωm .
m“1
(iii) This follows from (i), Theorem 4.8 and Proposition 4.9 (ii). (Verify)
(iv) This follows from (ii), Theorem 4.8 and Proposition 4.9 (i). (Verify)
Examples:
1. Finite intersections of sets p´1{n, 1{nq are open, but the intersection of all such sets n “ 1, 2, . . .
is t0u (a closed set).
2. Each finite union of singletons (single element subsets) of Q is closed, but Q is open (in Q).
17
MATH 362 Lecture Notes Metric Spaces
Theorem 4.13: Let E Ă R be nonempty and bounded above. If E is closed then sup E P E.
Proof: Exercise.
18
MATH 362 Lecture Notes Compactness
5 Compactness
(i) An open cover of a set E in X is a collection tGα u of open subsets of X such that E is
ď
contained in Gα .
α
(ii) A subset K of X is said to be compact if every open cover of K contains a finite subcover
ď n
ď
— that is, whenever K Ă Gα , Dα1 , . . . , αn s.t. K Ă Gα j .
α j“1
Examples:
2. N is not compact in R
8
ď
Proof: N Ă pn ´ 1{2, n ` 1{2q, which has no finite subcover.
n“1
Proof: Let K be a compact subset of a metric space X. We will prove that Kc is open. To
that end, let x P Kc . By the compactness of K, there exists an open cover of K consisting
of finitely many open balls Bpy1 , r1 q, . . . , Bpyn , rn q with each r j ă dpx, y j q{2. Now choose
r ă mintr j | 1 ď j ď nu. Clearly Bpx, rq has empty intersection with K—that is, it is
contained in Kc .
or, alternatively
Proof: Let K be a compact subset of a metric space X. Let a P K1 , and suppose
a < K. Define sets Ωn :“ tx P X | dpa, xq ą 1{nu “ Bpa, 1{nq c . Each Ωn is open, and
19
MATH 362 Lecture Notes Compactness
8
ď
K Ă Ωn “ Xztau, making tΩn u an open cover of K. Since K is compact, there is
1
n´1
ď
a finite subcover. But, @ n P N, Ωm Ă Ωn , so D some ΩN which covers K. Thus
m“1
K X Bpa, 1{Nq “ ∅. ÑÐ
Corollary 5.4: Suppose K is a compact subset of a metric space. Then distptau, Kq “ 0 iff
a P K.
Proof:
(i) The key idea here is that for a P Y, BY pa, rq “ pBX pa, rq X Yq.
ñ: So, let Ω Ă Y be open in Y. For each a P Ω, Dra ą 0 s.t. BY pa, ra q Ă Ω. So,
˜ ¸
ď ď ď
Ω “ BY pa, ra q “ pBX pa, ra q X Yq “ BX pa, ra q X Y.
aPΩ aPΩ aPΩ
ď
Set Ω̃ “ BX pa, ra q, which is open since it is a union of open balls in X.
aPΩ
20
MATH 362 Lecture Notes Compactness
Thus, Ω is open in Y.
(ii) The key idea here is that, for F Ă Y, F1Y “ F1X X Y.
ñ:
` ˘
F closed inY ñ F “ F Y F1Y “ F Y F1X X Y
` ˘
“ F Y F1X X Y “ FX X Y.
So, take F̃ “ FX .
ð: Assume F̃ is closed in X and F “ F̃XY. Let a P F1Y . Then a P F̃1X Ă F̃. Moreover,
a P Y. Thus, a P F̃ X Y “ F, showing that F is closed in Y.
Proof:
K Ă pΩα1 X Yq Y ¨ ¨ ¨ Y pΩαn X Yq .
Thus,
K Ă Ωα1 Y ¨ ¨ ¨ Y Ωαn ,
ñ K Ă Ωα1 Y ¨ ¨ ¨ Y Ωαn .
Thus, K is compact in Y.
Remarks:
21
MATH 362 Lecture Notes Compactness
• The word “compact” could not be replaced by the words “open” or “closed” for the previous
theorem to be true.
Example: If X “ R and Y “ p0, 1s, with d “ |x ´ y|, then p0, 1s is closed in Y, but neither
closed nor open in X.
Proof: Exercise.
Hint: If tΩα u is open cover of ra, bs, let
Proof: Suppose F Ă X, with X compact and F closed. Let tΩα u be an open cover of F.
Then tΩα u Y pXzFq is an open cover of X. X compact ñ X Ă Ωα1 Y ¨ ¨ ¨ Y Ωαn Y pXzFq
ñ F Ă Ωα1 Y ¨ ¨ ¨ Y Ωαn .
Therefore, F is compact.
Corollary 5.9: Suppose F and K are subsets of X. If F is closed and K is compact, then F X K
is compact.
Proof: Exercise.
n
č
Definition 5.10: A collection C of sets has the finite intersection property if C j , ∅ for
j“1
every finite subcollection tC1 , C2 , . . . , Cn u Ă C.
22
MATH 362 Lecture Notes Compactness
Theorem 5.11: Let tKα u be a collection of compact subsets of a metric space X. If tKα u has
č
the finite intersection property, then Kα , ∅.
α
č
Proof: Suppose Kα “ ∅. Then by DeMorgan’s laws,
α
˜ ¸c
č ď
X “ Kα “ Kαc .
α α
Since each Kαc is open (Thm. 5.2), tKαc u is an open cover of X. Choose any Kα0 . Since
compact, there are α1 , . . . , αn for which
Kα0 Ă Kαc 1 Y ¨ ¨ ¨ Y Kαc n
ñ Kαc 0 Ą Kα1 X ¨ ¨ ¨ X Kαn
ñ Kα0 X Kα1 X ¨ ¨ ¨ X Kαn “ ∅. ÑÐ
Corollary 5.12: Suppose tKn u is a sequence of nonempty compact subsets of a metric space
8
č
X s.t. Kn Ą Kn`1 for n “ 1, 2, . . .. Then Kn , ∅.
n“1
Proof: This follows immediately from 5.12 and the fact that closed intervals are
compact (5.7).
Theorem 5.14 (Nested Interval Theorem): Suppose that In “ ran , bn s, that In`1 Ă In , @ n P
N, and that the quantity `pIn q :“ bn ´ an Ñ 0 as n Ñ 8. Then D! c P R s.t.
Ş
n In “ tcu.
Proof: Exercise.
23
MATH 362 Lecture Notes Compactness
k
ź
rai , bi s “ tpx1 , . . . , xk q P Rk | ai ď xi ď bi , 1 ď i ď ku
i“1
k
ź
Proof: For each n “ 1, 2, . . ., write Jn “ ran,i , bn,i s. For each i “ 1, . . . , k the intervals
i“1
8
č
ran,i , bn,i s satisfy the hypotheses of Theorem 5.13, and hence there exists x˚i P ran,i , bn,i s.
n“1
8
č
Thus, x˚ :“ px˚1 , x˚2 , . . . , x˚k q P Jn .
n“1
Proof: We will prove the case k “ 2, but the ideas are easily adapted to a different
dimension k. To this end, assume J “ ra1 , b1 s ˆ ra2 , b2 s. Set
b
δ “ diampJq “ pb1 ´ a1 q2 ` pb2 ´ a2 q2 .
Suppose that J is not compact. Then D an open cover tGα u of J which contains no finite
subcover of J. Let c1 “ pa1 `b1 q{2, c2 “ pa2 `b2 q{2. Then J is the union of four rectangles
all the same size, all of diameter 2´1 δ. By the pigeonhole principle, at least one of these
four rectangles cannot be covered by a finite subcollection of tGα u; call this rectangle
J1 . We may once again subdivide J1 into four rectangles, at least one of which cannot
be covered by a finite subcollection of tGα u; this rectangle we call J2 . Proceeding in like
fashion, we have rectangles J, J1 , J2 , . . . such that
24
MATH 362 Lecture Notes Compactness
(i) J Ą J1 Ą J2 Ą ¨ ¨ ¨ ,
(ii) each Ji cannot be covered by any finite subcollection of tGα u, and
(iii) diampJi q “ 2´i δ.
8
č
(i) and Theorem 5.16 imply that some x˚ exists in Jn . This x˚ P J, so x˚ P Gα0 for some
n“1
α0 . Since Gα0 is open, there is some r ą 0 for which Bpx˚ , rq Ă Gα0 . Let N P N be large
enough so that n ě N implies 2´n δ ă r{4. Then for n ě N, Jn Ă Bpx˚ , rq Ă Gα0 . ÑÐ
(ii) E is compact.
Proof:
(i) ñ (ii): Since E is bounded, it is contained in a k-cell of sufficiently large size. Since closed,
E is compact, by Theorems 5.8 and 5.17.
(ii) ñ (iii): Suppose A Ă E is infinite but has no limit point. By definition, A is closed,
and hence compact (by Theorem 5.8). For each a P A, D rpaq ą 0 such that
pBpa, rpaqqztauq X A “ ∅. The collection tBpa, rpaqq | a P Au is an open cover of A
which has no finite subcover. ÑÐ
(iii) ñ (i): We assume (iii), and suppose that E is not bounded. Thus, E must be an infinite
set, and we may choose, for each n P N, xn P E s.t. |xn | ą n. The sequence pxn q
has no limit point in Rk , let alone in E. ÑÐ
Now, let x0 P E1 . By definition, D a sequence pxn q of distinct points in E for which
xn Ñ x0 . Since S :“ txn | n P Nu is an infinite set, it has a limit point x˚ P E.
We claim that x˚ “ x0 . To prove this, suppose that x˚ , x0 . Then D radii r0 ,
r˚ ą 0 s.t. Bpx˚ , r˚ qXBpx0 , r0 q “ ∅. We select N P N s.t. , for n ě N, xn P Bpx0 , r0 q.
Then Bpx˚ , r˚ q X S Ă Bpx˚ , r˚ q X pSzBpx0 , r0 qq Ă SzBpx0 , r0 q Ă tx1 , . . . , xN´1 u. This
shows that Bpx˚ , r˚ q X S is a finite set. ÑÐ
By the claim, x0 P E. Since x0 is an arbitrarily-chosen limit point of E, E is closed.
25
MATH 362 Lecture Notes Compactness
Notes:
• The equivalence (i) ô (ii) in the previous theorem is usually called the Heine-Borel Theorem.
• “Closed and bounded” was the first defn of compactness (W. Ramey). Let A be an infinite
set and consider metric space pA, d0,1 q. Note: pA, d0,1 q is closed (there are no limit points)
and bounded. Yet, tBpa, 1{2q | a P Au is an open cover of A which contains no finite subcover.
Thus, “closed and bounded” is not an equivalent characterization of compact metric spaces
in general, only compact Euclidean metric spaces.
Another example: The metric space pp0, 1q, |x ´ y|q is closed in p0, 1q and bounded, but not
compact.
• (iii) suggests another possible characterization of compact spaces. This characterization does
hold for general metric spaces, as stated in the following theorem:
Theorem 5.19: A subset E of a metric space pX, dq is compact ô every infinite subset
of E has a limit point contained in E.
We will prove neither of these characterizations. For a reference, see Section 5.1 of Metric
Spaces, by Satish Shirali and Harkrishan L. Vasudeva. Neither of these characterizations
extends to general topological spaces, and so neither serves as an appropriate alternate
definition for the term compact.
26
MATH 362 Lecture Notes Compactness
Theorem 5.22 (Bolzano-Weierstrass): Every bounded infinite subset of Rk has a limit point
in Rk .
27
MATH 362 Lecture Notes The Cantor Set
Proof: Let P Ă Rk be perfect. By defn., P has limit points, and must therefore be an
infinite set. Suppose P “ tx1 , x2 , . . .u is countable. For some r ą 0, let B1 “ Bpx1 , rq.
Having chosen balls B2 , . . . , Bn , let Bn`1 be a ball satisfying these properties:
(i) Bn`1 Ă Bn ,
(ii) xn < Bn`1 , and
(iii) Bn`1 X P , ∅.
(i) How it is constructed — call En the points remaining in r0, 1s after the nth stage of middle-
thirds intervals is removed.
where each x j P t0, 1, 2u (not necessarily unique). E1 contains only those x P r0, 1s
expressible with x1 , 1, E2 contains those numbers in E1 expressible with x2 , 1, and so
on.
(b) r0, 1s “ E0 Ą E1 Ą E2 Ą ¨ ¨ ¨ ,
(c) the En have the finite intersection property, and
(d) each En is the union of 2n disjoint closed intervals, all of length 3´n . Hence, each En is
compact.
8
č
(iii) Cantor set is C :“ En . By Theorem 5.11, C , ∅ and it is compact (because closed). No
n“1
number in C requires a 1 in its ternary expansion (by (a)).
28
MATH 362 Lecture Notes The Cantor Set
(iv) Between any two numbers in r0, 1s, D x whose ternary expansion requires some xk “ 1. Thus,
C contains no interval.
29
MATH 362 Lecture Notes Series
7 Series
Definition 7.1: Given a sequence pa j q of complex numbers, consider the sequence of partial
sums psn q where
ÿn
sn :“ a j.
j“1
As with any sequence, psn q may converge to a complex number s, in which case we call s
ř
the sum of the infinite series j a j , writing
8
ÿ
s “ a j.
j“1
ř
If psn q diverges, then we say the series j aj diverges.
Theorem 7.2: Let pan q be a sequence of complex numbers, with an “ αn ` iβn for each n.
The series n an converges ô both of the real series n αn and n βn converge.
ř ř ř
Proof: Let
n
ÿ n
ÿ n
ÿ
sn “ aj “ αj ` i β j.
j“1 j“1 j“1
Proof: Let psn q denote the sequence of partial sums. Set tn “ sn`1 for all n. We have
that sn Ñ some L, and so tn Ñ L. Thus
an`1 “ sn`1 ´ sn “ tn ´ sn Ñ L ´ L “ 0.
30
MATH 362 Lecture Notes Series
ř8 n
Theorem 7.4 (Geometric series): For 0 ď x ă 1, n“0 x “ p1 ´ xq´1 .
Proof: Show
1 ´ xn`1 1 xn`1
1 ` x ` ¨ ¨ ¨ ` xn “ “ ´ .
1´x 1´x 1´x
But, for 0 ď x ă 1, limn xn “ 0 ñ result.
ř
Theorem 7.5: Suppose an ě 0, @ n P N. Set sn :“ a1 ` ¨ ¨ ¨ ` an . The n an converges ô psn q
is bounded.
Proof: Note that psn q is monotone. The result follows from Theorem 2.1.
n
ÿ
Proof: Let sn :“ ak . By supposition,
k“1
n
ÿ 8
ÿ
sn ď bk ď bk ,
k“1 k“1
where the latter expression is a fixed number. Thus, psn q is a bounded sequence, and
converges by Thm. 7.5.
converges.
Proof:
31
MATH 362 Lecture Notes Series
ř
ñ: Assume that n an converges. Notice that
a2 ď a2 ,
2a4 ď a3 ` a4 ,
4a8 ď a5 ` a6 ` a7 ` a8 ,
n´1 a n
ř ř
etc. By the Comparison Test (Coro. 7.6), n2 2n ă 8. Hence n 2 a2n ă 8 as
well.
ð: This time
a1 ď a1 ,
a2 ` a3 ď 2a2 ,
a4 ` a5 ` a6 ` a7 ď 4a4 ,
..
.
a2n ` a1`2n ` ¨ ¨ ¨ ` a´1`2n`1 ď 2n a2n .
8
ÿ 1
Corollary 7.8 (p-series): The series converges if p ą 1 and diverges if p ď 1.
n“1
np
For p ą 1, this last series is a convergent geometric series ( n rn with |r| ă 1), and the
ř
ř
series n n´p converges by Thm. 7.7.
Now let p “ 1. In this case,
8 8
ÿ ÿ 1
2n a2n “ 2n ¨ “ 1 ` 1 ` 1 ` ¨ ¨ ¨ “ 8.
n“1 n“1
2n
32
MATH 362 Lecture Notes Series
ř
Definition 7.9: Let n an be a complex series.
ř ř
1. If n |an | converges, n an is said to converge absolutely.
ř ř ř
2. If an converges but |an | “ 8, we say that an is conditionally convergent.
converges ô @ ε ą 0, D N P N s.t.
ř
Theorem 7.10: The series j aj
ˇ ˇ
ˇm ˇ
ˇÿ ˇ
ˇ a jˇ ă ε whenever m ě n ě N.
ˇ ˇ
ˇ j“n ˇ
Proof: This is Cauchy criterion for convergence of the sequence of partial sums.
ř
Theorem 7.11 (Absolute convergence test): Let pan q be a complex sequence. If n an con-
ř
verges absolutely, then n an converges.
Then
8
ÿ
|sm ´ sn | “ |am`1 ` am`2 ` ¨ ¨ ¨ ` an | ď |am`1 | ` |am`2 | ` ¨ ¨ ¨ ` |an | ď |ak | ď ε.
k“N
Remarks:
n
ř
1. By the Absolute Convergence Test (Thm. 7.11), if z P C with |z| ă 1, then nz converges.
n diverges by the nth Term Test (Thm. 7.3).
ř
2. Note that, if |z| ą 1 in the above, then nz
Example 1:
33
MATH 362 Lecture Notes Series
2
ř ř
Suppose an ą 0 and n an ă 8. Prove n an ă 8.
Example 2:
ř ř
Suppose an ą 0 and n an ă 8. Prove n 1{p1 ` an q “ 8.
Example 3:
ř ř
Suppose n an converges absolutely, and let psn q denote the sequence of partial sums of n an .
ř
Prove n sn an converges.
ř8
Proof: Let L “ n“1 |an |. We have
Example 4:
ř
Suppose an ą 0 and n an ă 8. Let p be a polynomial of degree ą 0, with pp0q “ 0. Prove
ř
n ppan q converges.
Proof:
Case: ppxq “ xk , for k ě 1.
This case may be argued in the same way the case k “ 2 was (see above).
Case: ppxq “ c1 x ` c2 x2 ` ¨ ¨ ¨ ` ck xk , k ě 1.
Here, we have
|ppan q| ď |c1 |an ` |c2 |a2n ` ¨ ¨ ¨ ` |ck |akn ,
34
MATH 362 Lecture Notes Series
which implies
k 8 8
j
ÿ ÿ ÿ ÿ ÿ
|ppan q| ď |c j | an “ |c1 | an ` ¨ ¨ ¨ ` |ck | akn .
j“1 n“1 n n
ř
Since each of these series converges, n ppan q converges absolutely, and hence con-
verges (Absolute Convergence Test).
b
n an , set α :“ lim sup
n
ř
Theorem 7.12 (Root test): For the series |an |.
n
(i) If α ă 1,
ř
n |an | converges.
(ii) If α ą 1,
ř
n an diverges.
(iii) If α “ 1, no conclusion.
Proof:
(Comparison Test).
(ii) Choose β s.t. 1 ă β ă α. Then |an | ą βn for infinitely many n. But limn βn “ 8,
and so an 9 0, and n an diverges by the nth Term Test.
ř
?n
(iii) In the case an “ 1, @ n, n an “ 8 but α “ 1 “ 1. Similarly, if an “ 1{n, then
ř
ř ?
1{n “ 1{ n n “ 1 (Theorem 9.7(c) in Ross). But if a “ 1{n2 ,
n 1{n “ 8 and p1{nq n
ř 2 2 1{n
?n 2
then n 1{n ă 8 despite the fact that p1{n q “ p1{ nq “ 1.
35
MATH 362 Lecture Notes Series
ř
Corollary 7.14 (Ratio test): Let n an be a complex series with an , 0 @ n.
ˇ ˇ
ˇ an`1 ˇ ř
(i) If lim sup ˇ
ˇ ˇ ă 1, then
n |an | ă 8.
an ˇ
ˇ ˇ
ˇ an`1 ˇ
(ii) If DN P N s.t. @ n ě N, ˇ ˇ ˇ ě 1, then an 9 0 (and ř an diverges).
n
an ˇ
Note: There are no series for which the Ratio Test indicates convergence while the Root Test fails (see
Thm. 7.13). However, for the series
1 1 1 1 1 1 1 1
` ` 2 ` 2 ` 3 ` 3 ` ¨¨¨ ` n ` n ` ¨¨¨ ,
2 3 2 3 2 3 2 3
ˆ ˙n
an`1 3 ? ?
2n 1
lim sup “ lim “ `8, while lim sup n an “ lim 2´n “ ? .
n an nÑ8 2 n nÑ8 2
(i) This follows immediately from Thm. 7.13 and the Root Test.
(ii) Notice that the supposition of (ii) implies that
0 ă |aN | ď |aN`1 | ď . . . ,
and thus Bp0, |aN |{2q contains at most finitely many points of the sequence pan q.
Thus an 9 0.
(i) α ă 1 ñ
ř
|an | ă 8.
(iii) α “ 1 ñ no conclusion.
Proof: (i), (ii) follow from Theorem 2.8 and the Root Test. For (iii), consider the series
1{n and 1{n2 .
ř ř
36
MATH 362 Lecture Notes Series
Theorem 7.16 (Alternating Series Test): Suppose pan q is a monotone decreasing sequence
of positive reals with lim an “ 0. Then
8
ÿ
p´1qn`1 an converges.
n“1
řn k`1 a .
Proof: For each n P N let sn :“ k“1 p´1q k Notice
s2 “ a1 ´ a2 ě 0
s4 “ pa1 ´ a2 q ` pa3 ´ a4 q ě s2
..
.
s2 “ a1 ´ a2 ď a1
s4 “ a1 ` pa3 ´ a2 q´ ď a1
..
.
Example 5:
8
ÿ p´1qn`1
If p ą 0, then converges. For 0 ă p ď 1, this convergence is conditional.
n“1
np
Example 6:
37
MATH 362 Lecture Notes Series
1 1 1
L :“ 1 ´ ` ´ ` ¨¨¨ .
2 3 4
By inspection, L satisfies 1{2 ă L ă 1 (in fact, L “ ln 2). Note that
1 1 1 1 1
L “ ´ ` ´ ` ¨¨¨
2 2 4 6 8
1 1 1 1
“ 0 ` ` 0 ´ ` 0 ` ` 0 ´ ` ¨¨¨ , (0 included between terms)
2 4 6 8
and if we add this to the series whose sum is L, we get
3 1 1 1 1 1 1 1 1
L “ 1` ´ ` ` ´ ` ` ´ ` ¨¨¨ ,
2 3 2 5 7 4 9 11 6
the right-hand side of which is simply a rearrangement of the original series. Thus, it is
possible for a rearrangement
ÿ ÿ
ank , an .
k n
1 1 1
1´ ` ´ ` ¨¨¨
2 3 4
that converges to x.
38
MATH 362 Lecture Notes Series
1 1 1
S1 :“ 1 ` ` ` ¨¨¨ ` ą x.
3 5 N1
Then S1 ´ x ď 1{N1 . Now, let N2 be the smallest even positive integer s.t.
ˆ ˙
1 1 1
S2 :“ S1 ´ ` ` ¨¨¨ ` ă x.
2 4 N2
Then x ´ S2 ď 1{N2 . Now, let N3 be the smallest odd positive integer s.t.
ˆ ˙
1 1 1
S3 :“ S2 ` ` ` ¨¨¨ ` ą x.
2 ` N1 4 ` N1 N3
1 1 1 1 1 1 1 1
1` ` ¨¨¨ ` ´ ´ ´ ¨¨¨ ´ ` ` ¨¨¨ ` ´ ´ ¨ ¨ ¨ “ x.
3 N1 2 4 N2 2 ` N1 N3 2 ` N2
At issue here is that we need the sequence of partial sums of the above rearrangement
to converge to x. All we currently have is that the S j Ñ x, which is a subsequence
of that sequence of partial sums. We finish, however, by observing that each of the
intermediate partial sums is trapped between consecutive S j ’s.
Proof: Exercise.
ř
Corollary 7.20: If an ě 0 then all rearrangements of an yield the same value.
8
ÿ 8
ÿ
Proof: an and ank are both supremums over the same set.
n“1 k“1
39
MATH 362 Lecture Notes Series
ř
Theorem 7.21 (Riemann): Let an be a conditionally convergent series of real numbers,
ř
and x P R. There exists a rearrangement of an that converges to x.
Proof: (Sketch)
ř ř
By assumption, an converges but n |an | diverges. For each n, set
# #
0, if an ă 0, ´an , if an ă 0,
pn :“ and qn :“
an , if an ě 0, 0, if an ě 0,
Notice that
an “ pn ´ qn , and |an | “ pn ` qn .
ř ř
Claim: pn “ 8 and qn “ 8.
ř ř
Suppose this were not so. Then pn ă 8. Since an converges, we would have
ÿ ÿ ÿ ÿ
qn “ ppn ´ an q “ pn ´ an
converges. ÑÐ.
Also,
ÿ
an (convergent) ñ an Ñ 0 ñ pn , qn Ñ 0.
ř ř
Theorem 7.22 (Riemann): Let an be a complex series with |an | ă 8. Then every
rearrangement of the series converges to the same value.
Proof: Note that an “ αn ` iβn for real sequences pαn q, pβn q, and |αn | ď |an | ď |αn | ` |βn |,
ř
|βn | ď |an | ď |αn | ` |βn | for each n. Thus, by the Comparison Test, the series an is
absolutely convergent if and only if each of αn , βn are absolutely convergent. It is,
ř ř
40
MATH 362 Lecture Notes Series
ř ř
Let ank be a rearrangement of an .
ÿ ÿ ÿ ÿ ÿ ÿ
ank “ ppnk ´ qnk q “ pnk ´ qnk “ pn ´ qn (Coro. 7.20)
ÿ ÿ
“ ppn ´ qn q “ an .
ř
1. If |an | ă 8, then order of terms doesn’t matter.
ř
2. If an conditionally convergent, then order always matters. It is useful to explore what
kinds of order changes are significant.
41
MATH 362 Lecture Notes Power Series
8 Power Series
Theorem 8.2: Let α :“ lim sup |cn |1{n , and set R “ α´1 . (If α “ 0, set R “ `8; if α “ `8,
n
set R “ 0.) The power series 8 n
ř
n“0 cn z converges absolutely if |z| ă R and diverges if
|z| ą R.
Lemma 8.3: If psn q is a sequence in r0, 8q, lim sup sn ă 8, and c ě 0, then lim suppcsn q “
cplim sup sn q.
Case: R “ 8
Let z P C. Here
42
MATH 362 Lecture Notes Power Series
Case: R P p0, 8q
For any z P C,
|z|
lim sup |cn zn |1{n “ |z| lim sup |cn |1{n “ .
R
The result follows from the Root Test.
Examples:
Theorem 8.4 (Taylor’s Theorem with Remainder): Suppose f : ra, bs Ñ R, and let n P N.
Suppose also that f pn´1q is continuous on ra, bs and f pnq pxq exists @ x P pa, bq. Then Dc P
pa, bq s.t.
n´1
ÿ f pmq paq f pnq pcq
f pbq “ pb ´ aqm ` pb ´ aqn .
m“0
m! n!
Notes:
43
MATH 362 Lecture Notes Power Series
Now,
Example 7:
x3 x5
sin x “ x ´ ` ´ ¨¨¨ , @ x P R.
3! 5!
44
MATH 362 Lecture Notes Limits and Continuity in Metric Space
Note: As in Calc I, the point p need not be in E (the domain of f ) and, even if
(i) p P E, and
Proof:
45
MATH 362 Lecture Notes Limits and Continuity in Metric Space
Definition 9.3: Suppose f : X Ñ Y, where X, Y are metric spaces, and let a P X. We say f
is continuous at a if @ ε ą 0 D δ ą 0 s.t.
Note: f continuous at a in the previous definition is equivalent to saying f pBpa, δqq Ă Bp f paq, εq.
Proof: Let ε ą 0. g cont. at f paq ñ D δ ą 0 s.t. gpBp f paq, δqq Ă Bpgp f paqq, εq.
f cont. at a ñ D γ ą 0 s.t. f pBpa, δqq Ă Bp f paq, δq. Together, the above imply
pg ˝ f qpBpa, γqq Ă Bppg ˝ f qpaq, εq, showing that g ˝ f is cont. at a.
Definition 9.5: Let X, Y be sets, and f : X Ñ Y. For E Ă Y, the preimage of E is the set
Proof:
46
MATH 362 Lecture Notes Limits and Continuity in Metric Space
Proof:
ñ: Let an Ñ a, and let ε ą 0. f is cont. at a ñ D δ ą 0 s.t. f pBX pa, δqq Ă BY p f paq, εq.
Choose N P N so that an P BX pa, δq whenever n ě N. Thus, f pan q P BY p f paq, εq if
n ě N.
ð: Suppose f is not cont. at a. Then D ε ą 0 s.t. f pBX pa, δqq 1 BY p f paq, εq, @ δ ą 0.
Thus, @ n D an P BX pa, 1{nq s.t. f pan q < BY p f paq, εq. Then an Ñ a, but f pan q 9 f paq.
ÑÐ
Proof: Let tΩα u be an open cover of f pXq. By Thm. 9.6, t f ´1 pΩα qu is an open cover of
X. X is compact ñ D a finite subcover for X—that is,
Thus,
f pXq Ă Ωα1 Y Ωα2 Y ¨ ¨ ¨ Y Ωαn .
47
MATH 362 Lecture Notes Limits and Continuity in Metric Space
Definition 9.10: Let pX, dq, pY, ρq be metric spaces, and f : X Ñ Y. We say that f is uniformly
continuous on X if and only if given any ε ą 0, Dδ ą 0 s.t. ρp f px1 q, f px2 qq ă ε for every x1 ,
x2 P X satisfying dpx1 , x2 q ă δ.
Example 8:
To see this, let ε ą 0, and set δ “ ε{6. For x1 , x2 P r1, 3s, note that
Example 9:
To see this, we first consider what the negation of uniform continuity looks like. Knowing
that the negation of a statement @x, Ppxq employing the universal quantifer takes the form
Dx, Ppxq, we see that we must find an ε ą 0 such that, for every choice δ ą 0, there exist at
least two points x1 “ x1 pδq, x2 “ x2 pδq in R for which |x1 ´ x2 | ă δ, but | f px1 q ´ f px2 q| ě ε.
δ 1 1 δ
Let’s try this for ε “ 1. If we take x1 pδq “ ` and x2 pδq “ , then clearly |x1 ´ x2 | “ ă δ,
2 δ δ 2
yet
δ δ 2 δ2
ˆ ˙ˆ ˙
| f px1 q ´ f px2 q| “ |x1 ´ x2 ||x1 ` x2 | “ ` “ ` 1 ě ε.
2 2 δ 4
The previous example exploited the fact that as x increases, x2 increases at an increasing rate. As
the domain of f extended to ˘8, a gap of 1 (or of any size) between f px1 q and f px2 q could be
despite a shrinking gap between x1 and x2 . As the next theorem indicates, this is impossible for a
continuous function f when the domain is compact.
48
MATH 362 Lecture Notes Limits and Continuity in Metric Space
Since X is compact, the sequence pxi q has a subsequence pxi j q that converges to a P X.
Since dpxi , ξi q Ñ 0, it follows that ξi j Ñ a, too.
Since f is continuous on X, it is continuous at x. Thus, Dδ ą 0 such that
ε
|x ´ a| ă δ ñ | f pxq ´ f paq| ă .
3
Further, DJ ě 1 (integer) such that
Definition 9.12: Suppose T : Rn Ñ Rm is a linear mapping; that is, for each x1 , x2 P Rn and
each pair of real scalars c1 , c2 , T has the property that Tpc1 x1 ` c2 x2 q “ c1 Tpx1 q ` c2 Tpx2 q.
Define the norm of the mapping T, denoted as }T}, to be
|Tpxq|
}T} :“ sup “ max |Tpxq|. (5)
xPRn zt0u |x| |x|“1
ε
Proof: Let ε ą 0, and take δ “ , where the norm }T} is as in Definition 9.12.
1 ` }T}
Then for x1 , x2 P Rn satisfying |x2 ´ x1 | ă δ we have
}T}
|Tpx2 q ´ Tpx1 q| “ |Tpx2 ´ x1 q| ď }T}|x2 ´ x1 | ď ε ă ε.
1 ` }T}
49
MATH 362 Lecture Notes Limits and Continuity in Metric Space
50
MATH 362 Lecture Notes Sequences of Functions
10 Sequences of Functions
ř8
We may similarly define f pxq “ n“1 fn pxq, assuming that the series converges @ x P E.
Notes:
(a) Another way to phrase Q3: Is it true for each a P r0, 1s that
In fact, all three questions are about the validity of interchanging limit processes.
which is discontinuous at x “ 1.
Pointwise limits of continuous functions need not be continuous.
51
MATH 362 Lecture Notes Sequences of Functions
Notice that fn Ñ 0 pointwise on r0, 1s (write limn fn pxq “: f pxq ” 0). But
ż1 ż1
fn pxq dx “ 1, @ n, while f pxq dx “ 0.
0 0
The limit of a sequence of integrals need not be the same as the integral of the pointwise limit of the
sequence of integrands.
?
(d) Suppose fn : R Ñ R is given by fn pxq “ sinpnxq{ n for n “ 1, 2, . . .. Then fn Ñ 0 pointwise
on R. (This convergence is uniform, as we will shortly define.) But
n cospnxq ?
fn1 pxq “ ? “ n cospnxq.
n
?
Thus fn1 p0q “ n Ñ `8 , 01 “ 0.
The pointwise limit of a sequence of functions need not have derivative that is the pointwise limit of
the sequence of derivatives.
| fn pxq ´ f pxq| ă ε, @ x P E,
whenever n ě N.
Examples:
?
1. sinpnxq{ n Ñ 0 uniformly on R.
Proof: Verify.
52
MATH 362 Lecture Notes Sequences of Functions
| fm pxq ´ fn pxq| ă ε, @ x P E.
Proof:
Definition 10.6: Let fn : E Ñ C, and set sn pxq :“ nm“1 fm pxq. We say that 8
ř ř
n“1 fn pxq
converges uniformly on E if psn q converges uniformly on E.
53
MATH 362 Lecture Notes Sequences of Functions
n
ÿ
Proof: For each n let sn pxq :“ fm pxq. It is enough to show that psn q is uniformly
m“1
8
ÿ
Cauchy on E (Thm. 10.5). Let ε ą 0. D N P N s.t. Mn ă ε. If n ą m ě N, then
n“N
Theorem 10.8: Suppose X is a metric space with limit point a P X, and that fn : X Ñ C, @ n.
Assume that fn Ñ f uniformly on Xztau. If lim fn pxq “ Ln P C for n “ 1, 2, . . ., then pLn q
xÑa
converges. Moreover,
lim f pxq “ lim Ln
xÑa nÑ8
(that is,
lim lim fn pxq “ lim lim fn pxqq.
xÑa nÑ8 nÑ8 xÑa
54
MATH 362 Lecture Notes Sequences of Functions
Notes:
Proof:
55
MATH 362 Lecture Notes Sequences of Functions
Theorem 10.13: Suppose fn Ñ f uniformly on ra, bs, and each fn P R on ra, bs. Then f P R
on ra, bs, and
żb żb
f “ lim fn .
a nÑ8 a
Therefore,
UpP, f q ´ LpP, f q ă ε ` 2εpb ´ aq ñ f P Rra, bs.
Now
ˇż ˇ ˇż ˇ
ˇ b żb ˇ ˇ b ˇ
f f ˇ “ ˇ p fn ´ f q ˇ
ˇ ˇ ˇ ˇ
´
ˇ a n
ˇ
a ˇ ˇ a ˇ
żb
ď | fn ´ f |
a
˜ ¸
ď sup | fn ´ f | pb ´ aq,
ra,bs
where the first of these factors goes to zero with n by uniform convergence. Thus,
żb żb
f “ lim fn .
a nÑ8 a
ř8
Corollary 10.14: If n“1 fn converges uniformly on ra, bs and each fn P R on ra, bs, then
ż b ˜ÿ
8
¸
8
ÿ
˜ż
b
¸
fn “ fn .
a n“1 n“1 a
56
MATH 362 Lecture Notes Sequences of Functions
żb ÿ 8 żb żb ÿn żb 8 żb
ÿ
fn “ lim sn “ lim sn “ lim fj “ fn .
a n“1 a n n a n
j“1 a n“1 a
?
Note: We have seen (with fn “ sinpnxq{ n) that fn Ñ f uniformly on E with each fn differentiable does
not necessarily imply fn1 Ñ f 1 uniformly (or otherwise) on E. (In fact, it need not even be the case
that f 1 exists.)
Theorem 10.15: Suppose p fn q is a sequence of functions on ra, bs and that fn1 is continuous
on ra, bs @ n. Suppose, also, that
Proof: Suppose fn1 Ñ g uniformly on ra, bs, and fn px0 q Ñ L. By Coro. 10.9, g P C pra, bsq.
By FTC, żx
fn pxq “ fn px0 q ` fn1 .
x0
Define the limit function ż x0
f pxq “ L ` g.
x
Then
ˇż x ˇ żb
ˇ 1
ˇ
| fn pxq ´ f pxq| ď | fn px0 q ´ L| ` ˇˇ p fn ´ gqˇˇ ď | fn px0 q ´ L| ` | fn1 ´ g|.
x0 a
This is a bound that does not depend on x P ra, bs. Moreover, the first term in this last
expression may be made arbitrarily small (since fn px0 q Ñ L), and so can the integral
term, by Thm. 10.13. In fact, we may choose N P N s.t.
żb
ε ε
| fn px0 q ´ L| ` | fn1 ´ g| ď ` , whenever n ě N, @ x P ra, bs.
a 2 2
Thus, fn Ñ f uniformly on ra, bs. Again, by FTC,
57
MATH 362 Lecture Notes Sequences of Functions
Proof: Define φpxq “ |x|, for |x| ď 1, and extend φ periodically to all of R (picture).
Observe that
m´1
m
ÿ 3m ´ 1
ě 3 ´ 3n “ 3m ´
n“0
3´1
3m 3m
ě 3m ´ “ Ñ 8 as m Ñ 8.
2 2
58
MATH 362 Lecture Notes Sequences of Functions
Proof: WLOG, ra, bs “ r0, 1s, and f p0q “ f p1q “ 0 (Verify). Let
#
f pxq, if 0 ď x ď 1,
f˜pxq :“
0, otherwise.
ş1
By construction, Qn pxq ě 0 for x P r´1, 1s, and ´1 Qn pxq “ 1, @ n. Furthermore, we
have
ż1 ż1 ż 1{ ?n
1
:“ p1 ´ x2 qn dx “ 2 p1 ´ x2 qn dx ě 2 p1 ´ x2 qn dx
cn ´1 0 0
ż 1{ ?n
4 1
ě 2 p1 ´ nx2 q dx “ ? ą ? .
0 3 n n
where, because t is only the dummy variable of integration (and is integrated out), this
last expression is a polynomial in x. So, pPn q is a sequence of polynomials, and is clearly
real if f is real.
59
MATH 362 Lecture Notes Sequences of Functions
ř8 n.
Theorem 10.18: Suppose the radius of convergence R ą 0 for n“0 cn x Define f pxq :“
ř8 n
n“0 cn x for ´R ă x ă R. Then
(i) the series defining f converges uniformly on every compact subset of p´R, Rq.
8
ÿ
(ii) f 1 pxq “ cn nxn´1 , @ x P p´R, Rq.
n“1
Proof:
(i) Let ε ą 0. Then |x| ď R ´ ε ñ |cn xn | ď |cn |pR ´ εqn . But since a power
series converges absolutely within its (open) interval of convergence, we take
Mn “ |cn |pR ´ εqn in the Weierstrass M-test to get the result.
60
MATH 362 Lecture Notes Sequences of Functions
(ii) We know n1{n Ñ 1 as n Ñ 8 ñ lim sup |ncn |1{n “ lim sup |cn |1{n ñ the radii of
convergence for the two series 8
ř n
ř8 n´1 are the same. By part
n“0 cn x and n“1 cn nx
(i), the latter series converges uniformly on each rR ´ ε, R ` εs. By Theorem 10.15,
f 1 pxq equals this series on each rR ´ ε, R ` εs.
Proof: Both series define the same function f pxq as above. Thus
f pkq p0q
ak “ “ bk .
k!
Example 10:
Proof: Each partial sum of the series is bounded on p´1, 1q. Since the uniform limit
of a bounded sequence of functions is bounded, if the series did converge uniformly
we would have that 1{p1 ´ xq was bounded on p´1, 1q, and this is not so.
61
MATH 362 Lecture Notes Sequences of Functions
Proof:
n
ÿ n
ÿ n
ÿ n
ÿ
a m bm “ psm ´ sm´1 qbm “ sm bm ´ sm´1 bm
m“0 m“0 m“0 m“1
n
ÿ n´1
ÿ n´1
ÿ
“ sm bm ´ sm bm`1 “ sn bn ` sm pbm ´ bm`1 q.
m“1 m“0 m“0
řn
Proof: Let sn :“ m“0 cm , s´1 :“ 0. By Thm. 10.21 (with bm “ xm ), we have
n
ÿ n´1
ÿ n´1
ÿ
cm xm “ sn xn ` sm pxm ´ xm`1 q “ sn xn ` p1 ´ xq sm xm , @ x P p´1, 1q.
m“0 m“0 m“0
ř
cn converges, so the sequence psn q is bounded. Since |x| ă 1, when we let n Ñ 8 we
have sn xn Ñ 0. Thus,
8
ÿ ÿ8
f pxq :“ cn xn “ p1 ´ xq sn xn , @ x P p´1, 1q.
n“0 n“0
ř8
Define s :“ n“0 cn , so sn Ñ s. Intuition: For large n (i.e., for n ě some N), sn « s. Then
˜ ¸
N
ÿ 8
ÿ
f pxq « p1 ´ xq sn xn ` sxn
n“0 n“N`1
˜ ¸
N
ÿ
n N`1 1
« p1 ´ xq sn x ` sx
n“0
1´x
N
ÿ
“ p1 ´ xq sn xn ` sxN`1 .
n“0
62
MATH 362 Lecture Notes Sequences of Functions
Taking the limit as x Ñ 1, we get lim f pxq “ s. Finish this out: Choose N and a
xÑ1
neighborhood p1 ´ δ, 1s to make it all work. (See Baby Rudin, Section 8.2)
Example 11:
x2 x3 x4
lnp1 ` xq “ x ´ ` ´ ` ¨¨¨ , in p´1, 1q.
2 3 4
Since
1 1 1
1´ ` ´ ` ¨¨¨
2 3 4
converges (Thm. 7.16, which is the Alternating Series Test), Abel’s Thm. says that it converges
to lnp2q.
ÿ 8
8 ÿ 8 ÿ
ÿ 8
amn “ amn .
m“1 n“1 n“1 m“1
Proof: Set s “ suppm,nqPF amn , where this sup is taken over all finite F Ă N2 . Note
ř
that both
ÿ8 ÿ 8 ÿ8 ÿ 8
amn ě s and amn ě s.
m“1 n“1 n“1 m“1
If s “ `8 then we are done.
ř ř
Suppose s ă 8. We show that m n amn ď s as well. (The proof that the sum with
indices reversed is ď s is similar.) Suppose that D M P N s.t.
M ÿ
ÿ 8
amn ą s.
m“1 n“1
63
MATH 362 Lecture Notes Sequences of Functions
Thus,
M ÿ
ÿ 8 8 ÿ
ÿ 8
amn ď s, for M “ 1, 2, . . . . ñ amn ď s.
m“1 n“1 m“1 n“1
ř ř ř ř ř ř
Corollary 10.25: Suppose amn P C and m n |amn | ă 8. Then m n amn “ n m amn .
Proof: WLOG, each amn is real. Set pmn “ maxtamn , 0u and qmn “ maxt´amn , 0u, @ m, n P
N, so that we have pmn ` qmn “ |amn | and pmn ´ qmn “ amn . The convergence of
ř ř ř ř ř ř
m n |amn | implies the convergence of both m n pmn and m n qmn . Thus
ÿÿ ÿÿ ÿÿ ÿÿ
amn “ ppmn ´ qmn q “ pmn ´ qmn
m n m n m n m n
ÿÿ ÿÿ
“ pmn ´ qmn (by Lemma 10.24)
n m n m
ÿÿ ÿÿ
“ ppmn ´ qmn q “ amn .
n m n m
64
MATH 362 Lecture Notes Sequences of Functions
The bracketed expression is just a constant (depending on m), which proves that f has
a power series expansion centered at x “ a, which then must be the Taylor series. The
only detail left to us is the justification for the exchange of summation in going from
(6) to (7). This switch is permissible if
n
8 ÿ ˆ ˙
ÿ n
|cn | |x ´ a|m |a|n´m
n“0 m“0
m
is finite. But
n
8 ÿ ˆ ˙ 8 n ˆ ˙ 8
ÿ n ÿ ÿ n ÿ n
|cn | m n´m
|x ´ a| |a| “ |cn | |x ´ a|m |a|n´m “ |cn | p|x ´ a| ` |a|q ,
n“0 m“0
m n“0 m“0
m n“0
ř8 n
Proposition 10.28: If f pxq “ n“0 cn x for x P p´R, Rq, then f is analytic in p´R, Rq.
Proof: This is just Theorem 10.26 rephrased so as to use the new definition.
f pxq “ 1 ´ x2 ` x4 ´ x6 ` ¨ ¨ ¨ , if |x| ă 1.
65
MATH 362 Lecture Notes Sequences of Functions
1
“ 1 ´ z2 ` z4 ´ z6 ` ¨ ¨ ¨ , if |z| ă 1, z P C.
1 ` z2
But f pzq is undefined for z “ ˘i. Now f is analytic on R. In fact, the radius of
?
convergence of the Taylor series of f at 1 is 2. To find the Taylor series at 1, we
write
1 a b
2
“ ` (partial fractions),
1`z z`i z´i
and
ˆ ˙˜ ¸
8 ˆ ˙n
1 1 1 1 1 ÿ z´1
“ “ z´1
“ ,
z´i z´1`1´i 1´i 1` 1 ´ i n“0 1 ´ i
1´i
?
which is OK if |pz ´ 1q{p1 ´ iq| ă 1 ñ |z ´ 1| ă 2.
ř
Definition 10.29: Suppose I is countable. If αPI |aα | ă 8 (here aα P C), define
ÿ 8
ÿ
aα :“ aαpnq ,
αPI n“1
where αp1q, αp2q, αp3q, . . . is any ordering of I. (Note: The right hand side is well-defined
by our “absolute convergence–rearrangement” theorem.)
ř
(i) If α aα ă 8, then only countably-many aα ą 0.
Proof: Exercise.
66
MATH 362 Lecture Notes Sequences of Functions
ř
Corollary 10.31: If I1 Ă I2 Ă ¨ ¨ ¨ , Y8 I “ I with I countable, and
n“1 n αPI |aα | ă 8 with
aα P C, then
ÿ ÿ
lim aα “ aα .
nÑ8
αPIn αPI
Theorem 10.32: Suppose f is analytic in p´R, Rq. Set the zero set of f Zp f q :“ tx P
p´R, Rq | f pxq “ 0u. If f ı 0, then Zp f q has no limit point in p´R, Rq. (And, this implies
Zp f q is countable.)
ˇ (
Proof: f is continuous ñ Zp f q is closed in p´R, Rq. Let E :“ Z1 p f q “ x P p´R, Rq ˇ x is limit point of Zp f q .
E is closed in p´R, Rq. Note: E Ă Zp f q.
Claim: E is open in p´R, Rq.
Let a P E. D distinct a1 , a2 , . . . in Zp f q with an Ñ a. By Rolle’s Thm., D a sequence pbn q
with bn Ñ a s.t. f 1 pbn q “ 0, @ n. We have f paq “ 0. f 1 is continuous (since it is analytic),
and f 1 pbn q “ 0 with bn Ñ a, so f 1 paq “ 0. Proceeding similarly, we have f pkq paq “ 0,
@ k P N. But, since f is analytic,
8
ÿ f pkq paq
f pxq “ px ´ aqk “ 0
k“0
k!
for x near a. Thus, the entire interval pa ´ δ, a ` δq Ă E. This proves the claim.
So, E is both closed and open, yet a subset of p´R, Rq, a connected set. This means that
either E “ ∅ or E “ p´R, Rq. Since f ı 0, so E “ ∅.
67
MATH 362 Lecture Notes Measure Theory
11 Measure Theory
If all of the sets in R are subsets of a set X, and if X P R, then R is called an algebra (of
sets). A ring/algebra R is called a σ-ring/σ-algebra if
8
ď
An P R, whenever An P R, n “ 1, 2, . . . .
n“1
Note:
(ii) By repeated application of (i) and Defn. 11.1, it is clear that rings are closed under finite
unions and intersections.
(iv) Given any collection C of sets, there is always a σ-algebra that contains them. Simply let
ď
X“ A, and then take the σ-algebra to be the power set of X. Moreover, it can be shown
APC
that the intersection over all σ-algebras containing C is once again a σ-algebra, the smallest
one containing C.
68
MATH 362 Lecture Notes 11.1 Rings of sets and additive set functions
Note:
• φp∅q “ 0.
řn
• φpA1 Y ¨ ¨ ¨ Y An q “ i“1 φpAi q, if the Ai are disjoint.
• φpA Y Bq ` φpA X Bq “ φpAq ` φpBq.
• If φ is a nonnegative set function, then φpAq ď φpBq, if A Ă B.
• If B Ă A with φpBq ă 8, then φpAzBq “ φpAq ´ φpBq.
(ii) Countable additivity of φ requires that 8 n“1 φpAn q converge absolutely whenever it con-
ř
verges, since unions are the same for all “rearrangements”. (This assumption naturally
applies to all nonnegative set functions φ.)
It also implies that, regardless of whether R is just a ring or a σ-ring, φ is defined on the
smallest σ-ring containing R.
(iii) Countable additivity of φ implies additivity, since every ring R contains the empty set.
Proof: Let
B1 :“ A1 , B2 :“ A2 zA1 , . . . , B j :“ A j zA j´1 , . . . ,
Notice that the B j are disjoint, that An “ B1 Y ¨ ¨ ¨ Y Bn , @ n, and A “ Yn Bn . By the
additivity and σ-additivity of φ, we have
n
ÿ 8
ÿ
φpAn q “ φpB j q and φpAq “ φpBn q.
j“1 n“1
69
MATH 362 Lecture Notes 11.1 Rings of sets and additive set functions
ai ď xi ď bi , i “ 1, 2, . . . , p,
The finite union of intervals is known as an elementary set. We denote the collection of
elementary sets in Rp by E .
Note:
2. The possibility that some ai “ bi in the above is not excluded. Thus, even ∅ is considered an
interval.
Proof: That E is closed under unions should be clear. To show that E is closed
under complementation, suppose A, B P E and write A “ A1 Y ¨ ¨ ¨ Y An , B “
B1 Y ¨ ¨ ¨ Y Bm , with each Ai , B j an interval. Notice that
˜ ¸
ď n
ď
AzB “ Ai zB “ pAi zBq,
i i“1
70
MATH 362 Lecture Notes 11.1 Rings of sets and additive set functions
Thus, (ii) comes down to whether the intersection of two intervals is in E . The
pictures above once again should convince.
To see that E is not a σ-ring it is enough to give a counterexample. In R1 , each
8
ď
interval r2n, 2n ` 1s P E , but r2n, 2n ` 1s < E .
n“1
B1 :“ A1 , (already an interval)
B2 :“ A2 zA1 , (look at pictures of cases—union of disjoint intervals)
B3 :“ A3 zpA1 Y A2 q, (etc.)
..
.
B j :“ A j zpA1 Y ¨ ¨ ¨ Y A j´1 q
..
.
5. Our expression for mpAq is well-defined. That is, given any A P E and any two decomposi-
tions of A into disjoint intervals, the expression for mpAq arising from either decomposition
yields the same result.
Proof: Read excerpt pp. 147–159 from “Excursions into Mathematics”. This deals
only with the p “ 2 case.
71
MATH 362 Lecture Notes 11.1 Rings of sets and additive set functions
Definition 11.5: A nonnegative additive set function φ defined on E is regular if the fol-
lowing holds: To each A P E and to every ε ą 0 there exist sets F, G P E with F closed, G
open, and F Ă A Ă G and
Example 12:
and
αpx`q :“ inftαpyq | x ă yu “ lim αpyq
yÑx`
are defined for each x P R. (In fact, αpx´q “ αpx`q “ αpxq for all but countably many x.)
For the four types of intervals in R1 , define the set function µ in the following way: Set
Note:
1. Have defined m on A P E only. How about mpCq, where C < E is the Cantor middle-thirds
set? C does belong to any σ-ring containing all intervals in R1 . So, extending m to be countably
additive on countable unions of disjoint intervals yields mpCq (see Exercise P29 on Problem
Set 9.)
2. But what of ‘weirder’ sets, like the rationals inside r0, 1s? One attempt (Jordan): extend m to
such sets in the following way:
72
MATH 362 Lecture Notes 11.2 Outer measure
When A has the property that µpaq “ µpAq, Jordan defined the content µpAq of A to
be this common value.
Indeed, µ extends m (i.e., collection of sets having content is a ring that properly contains E ,
and µ and m agree on E ; see HW). This extension of m is still unsatisfactory:
(a) The set of rational points inside a bounded interval does not have content.
(b) There exist open bounded sets which do not have content.
(c) While the sets which have content form a ring, µ is is not countably additive on this
ring.
Definition 11.6: Let µ be additive, regular, nonnegative and finite on E . Let E Ă Rp , and
define the outer measure of E (corresponding to µ) to be
# +
8
ÿ 8
ď
µ pEq :“ inf
˚
µpAn q | each An P E , with An open, E Ă An .
n“1 n“1
Note: m is one such set function which satisfies the requirements of µ in Defn. 11.6. We will use µ˚
when speaking generally, and m˚ (called Lebesgue outer measure) when speaking about the outer
measure corresponding to m.
(i) 0 ď µ˚ pEq ď 8, @ E Ă Rk .
(ii) µ˚ p∅q “ 0.
(iv) µ˚ is extension of µ that generated it per Defn. 11.6 (that is, µ˚ pAq “ µpAq, @ A P E ).
˜ ¸
8
ď ÿ8
(v) µ˚ is σ-subadditive. That is, µ˚ En ď µ˚ pEn q.
n“1 n“1
73
MATH 362 Lecture Notes 11.2 Outer measure
Proof:
(i) Part of what is being asserted is that µ˚ pEq is defined for every subset E of Rp .
This follows from the fact that every subset is eventually contained in the union
of expanding open intervals Jn in Rp of diameter n, centered at the origin. The rest
of the assertion is clear.
(ii) Take each An “ ∅ as one covering of ∅ satisfying Defn. 11.6. Recall that µp∅q “ 0.
(iii) For A Ă B, every countable open covering of B in Defn. 11.6 is also a covering of
A. Since the opposite is not true, µ˚ pAq is an infimum over a larger set than µ˚ pBq.
(iv) Let A P E . For each ε ą 0, the regularity of µ implies that D open G P E s.t. A Ă G
and µpGq ď µpAq ` ε. But µ˚ pAq ď µpGq, showing that µ˚ pAq is a lower bound for
the set pµpAq, 8s. Thus, µ˚ pAq ď µpAq.
Fix ε ą 0. By Defn. 11.6, D a sequence pAn q of open sets in E s.t. A Ă n An
Ť
and 8 n“1 µpAn q ď µ pAq ` ε. Again employing the regularity of µ, we have that
ř ˚
F Ă A1 Y A2 Y ¨ ¨ ¨ Y AN .
So,
N
ÿ 8
ÿ
µpAq ď µpFq`ε ď µpA1 Y¨ ¨ ¨YAN q`ε ď ε` µpAn q ď ε` µpAn q ď µ˚ pAq`2ε.
n“1 n“1
Thus,
˜ ¸
ď 8 ÿ
ÿ 8 8
ÿ 8
ÿ
µ µpAnk q ď µ pEn q ` 2 ε ď ε` µ˚ pEn q.
˚
` ˚ ´n
˘
En ď
n n“1 k“1 n“1 n“1
74
MATH 362 Lecture Notes 11.2 Outer measure
Definition 11.8: For sets A, B we define the symmetric difference A a B to be the set of all
elements contained in either A or B, but not both. That is,
A a B :“ tx P A Y B | x < A X Bu.
dpA, Bq :“ µ˚ pA a Bq, A, B Ă Rp .
When pAn q is a sequence of sets in E (elementary sets) and lim dpA, An q “ 0, we write
nÑ8
An Ñ A, and say that A is finitely µ-measurable. The collection of finitely µ-measurable sets
is denoted by MF pµq.
(i) A a B “ B a A.
(ii) A a A “ ∅.
(iii) A a B Ă pA a Cq Y pC a Bq.
(iv) pA1 a B1 q Y pA2 a B2 q contains ppA1 Y A2 q a pB1 Y B2 qq, ppA1 X A2 q a pB1 X B2 qq, and
ppA1 zA2 q a pB1 zB2 qq.
(vi) dpA, Aq “ 0.
Proof:
75
MATH 362 Lecture Notes 11.2 Outer measure
it follows that
a property we might call subadditivity (or finite subadditivity). Thus, the sigma-
subadditivity of µ˚ implies it is also finitely subadditive. We then have
dpA, Bq “ µ˚ pA a Bq ď µ˚ ppA a Cq Y pC a Bqq (by (iii), and Thm. 11.7 part (iii))
ď µ˚ pA a Cq ` µ˚ pC a Bq (by subadditivity)
“ dpA, Cq ` dpC, Bq.
76
MATH 362 Lecture Notes 11.2 Outer measure
(viii) By part (iv) and monotonicity of µ˚ (Thm. 11.7 part (iii)), each one of the expres-
sions on the left
,
dpA1 Y A2 , B1 Y B2 q /
.
dpA1 X A2 , B1 X B2 q ď µ˚ ppA1 a B1 q Y pA2 a B2 qq
/
dpA1 zA2 , B1 zB2 q
-
Note: Were it not for Proposition 11.10, d would be a metric on PpRp q. To make d a metric on something,
we partition up PpRp q into equivalence classes, calling two sets A and B equivalent if dpA, Bq “ 0.
Then d is a metric on the equivalence classes of PpRp q.
Proof: We have
µ˚ pAq “ dpA, ∅q ď dpA, Bq`dpB, ∅q “ dpA, Bq`µ˚ pBq ñ µ˚ pAq´µ˚ pBq ď dpA, Bq.
77
MATH 362 Lecture Notes 11.2 Outer measure
I. MF pµq is a ring.
Let A, B P MF pµq. We must show that A Y B, AzB P MF pµq. By definition, D
sequences of elementary sets pAn q, pBn q s.t. An Ñ A and Bn Ñ B. To prove MF pµq
is closed under unions, note that
(The inequality comes from Prop. 11.9 (viii).) This shows that An Y Bn Ñ A Y B,
and since each An Y Bn P E , this proves A Y B P MF pµq. Similarly, we have that
“ µ˚ pA Y Bq.
@ n P N, which means ˜ ¸
8
ÿ 8
ď
µ˚ pA j q ď µ˚ An .
j“1 n“1
78
MATH 362 Lecture Notes 11.2 Outer measure
with each pAn X B j q P MF pµq (by I). Since MF pµq is contained in Mpµq, which is
closed under countable unions, each pAn X Bq P Mpµq. Moreover, since
Note:
79
MATH 362 Lecture Notes 11.2 Outer measure
(i) For those A P Mpµq we drop the asterisk notation, denoting the measure of A by µpAq.
(ii) For every µ, the sets of measure zero form a σ-ring. (Note: What is not being said, and not
true, is that the sets of measure zero are the same for each measure µ.)
(iii) For m (Lebesgue measure), every countable set has measure zero. Likewise, mpCq “ 0, even
though the Cantor middle-thirds set is uncountable.
Definition 11.13: A collection tVα u of open subsets of a set X is called a base for X if @ x P X
and every open set G Ă X containing x, D α0 s.t. x P Vα0 and Vα0 Ă G. That is, every open
G is the union of a subcollection of tVα u.
Example 13:
is a base of Rp . Since Rp is, in fact, separable (for instance, the set of all points in Rp with
rational components is dense in Rp and countable) this implies that it has a countable base. The
collection of open balls
tBpq, rq | q P Qp , r P Q X p0, 8qu
Proof: The proof rests on the fact that Rp has a countable base. Instead of the countable
base presented in the last example (open balls centered at points in Qp with rational
radii) we choose a base B consisting of open p-cubes—intervals in Rp whose side-lengths
are all equal—where such a cube is in B iff it is centered on a point of Qd and has rational
80
MATH 362 Lecture Notes 11.2 Outer measure
side length. (Convince yourself that (1) every open G Ă Rp is the union of sets in B,
and that (2) B is countable.) Since every open set in Rp is thus the union of sets in E ,
the claim follows.
and µ pp
Ş Ş
(ii) D a sequence of open sets pGn q with A Ă n Gn n Gn q zAq “ 0.
Ă A and µ pAz p n Fn qq “ 0.
Ť Ť
(iv) D a sequence of closed sets pFn q with n Fn
Proof:
ď 8
ÿ 8
ÿ
pGzAq Ă pGn zAn q and µpGzAq ď µpGn zAn q ď 2´n ε “ ε.
n n“1 n“1
Thus, µ p n Gn q zA “ 0.
Ş
(iii) This follows directly from (i). For, since A P Mpµq, we have that Ac P Mpµq. Thus,
we may apply (i) to get an open set G Ą Ac s.t. µpGzAc q ă ε. Now take F “ Gc .
(iv) Much as (iii) follows from (i), this assertion follows from (ii).
81
MATH 362 Lecture Notes 11.3 Existence of a non-measurable set
Show that Σ is a σ-algebra, that C Ă Σ, and that Σ is contained in every other σ-algebra
that contains C.
Definition 11.18: Take C in Prop. 11.17 to be the collection of all open sets in X. The smallest
σ-algebra containing C is called the Borel algebra, and is denoted BpXq, or simply B when
the underlying space (for us, usually Rp ) is understood. The elements of B are called Borel
sets.
82
MATH 362 Lecture Notes 11.3 Existence of a non-measurable set
a. The cardinality of any two sets is comparable—i.e., one set has cardinality less
than or equal to that of the other set; one set is in one-to-one correspondence
with some subset of the other.
But some mathematicians do not accept it, primarily because, despite its seemingly-
innocuous assertion, it implies some bizarre-sounding statements. These include
b. Zorn’s Lemma (equivalent to AC): Every partially ordered set in which every
chain (i.e. totally ordered subset) has an upper bound contains at least one
maximal element.
(i) A P Mpµq.
83
MATH 362 Lecture Notes 11.3 Existence of a non-measurable set
A ` B :“ ta ` b | a P A, b P Bu.
When B “ tbu (a singleton), we are often sloppy and write A ` b in place of A ` tbu.
x P pGzEq ` c ô x ´ c P GzE
ô x ´ c P G and x ´ c < E
ô x P G ` c and x < E ` c
ô x P pG ` cqzpE ` cq.
Definition 11.22: A measure µ defined for a σ-algebra of subsets of Rp which has the
property asserted in Prop. 11.21 (there, asserted for m, the measure arising from restricting
the Lebesgue outer measure m˚ to Mpmq) is said to be translation invariant.
84
MATH 362 Lecture Notes 11.3 Existence of a non-measurable set
Theorem 11.23: Assuming AC, there exists a non-measurable subset of p0, 1q (i.e., an S Ă
p0, 1q for which S < Mpmq.
Proof: For each x, y P p0, 1q, define a relation „ in the following way: say x „ y if
x ´ y P Q. Then „ is an equivalence relation (verify) and, as such, it partitions p0, 1q
into equivalence classes. Write rxs :“ ty | y „ xu, and let E :“ trxs | 0 ă x ă 1u. Then
rx1 s , rx2 s ñ rx1 s X rx2 s “ ∅. We apply the choice function (from AC) to E, and let
S be the resulting set; that is, S contains exactly one member of each equivalence class
rxs. Let pqn q be an enumeration of Q X p´1, 1q. For each i P N, let Si :“ S ` qi .
Claim 1: Si X S j “ ∅ whenever i , j.
Suppose x P Si X S j . Then x “ ti ` qi “ t j ` q j for some ti , t j P S.
ñ t i ´ t j “ q j ´ qi P Q
ñ ti „ t j
ñ ti “ t j (from our application of the choice function)
ñ qi “ q j
ñ i “ j.
Now, suppose S P Mpmq. By Prop. 11.21, Si P Mpmq and mpSi q “ mpSq, @ i. By Claim 2,
1 ď m p i Si q ď 3. Since m “ m˚ |M is σ-additive,
Ť
˜ ¸
8
ď ÿ8 8
ÿ
m Si “ mpSi q “ mpSq 1.
i“1 i“1 i“1
`Ť8 ˘ `Ť8 ˘
So, if mpSq ą 0 then m i“1 Si “ 8, and if mpSq “ 0, then m i“1 Si “ 0. ÑÐ
Corollary 11.24: Assuming the AC, there exist disjoint E1 , E2 Ă R s.t. m˚ pE1 Y E2 q ă
m˚ pE1 q ` m˚ pE2 q.
85
MATH 362 Lecture Notes 11.4 Lebesgue integration
Proof: Suppose no such disjoint E1 , E2 exist. Then m˚ pE1 YE2 q “ m˚ pE1 q`m˚ pE2 q, @ E1 ,
E2 Ă R with E1 X E2 “ ∅. Using induction, m˚ is finitely additive on the subsets of R.
Since m˚ is an outer measure, it is monotone and σ-subadditive (Thm. 11.7 (iii) and (v)).
Thus, m˚ is σ-additive on PpRq. (The argument used to establish IV in Thm. 11.12 goes
through perfectly well here, assuming that the disjoint pAn q come from PpRq instead
of MF pmq.)
Ť
Taking S, Si as in Thm. 11.23, we have p0, 1q Ă i Si Ă p´1, 2q. But
m˚ pp0, 1qq “ 1
˜ ¸
8
ď
ď m˚ Si (by monotonicity)
i“1
8
ÿ
“ m˚ pSi q (by σ-additivity)
i“1
8
ÿ
“ m˚ pSq 1 (Prop. 11.21)
i“1
ď m˚ pp´1, 2qq
“ 3. ÑÐ
Definition 11.25: Let X , ∅ be a set. The combination pX, Mq is called a measurable space if
M is a σ-algebra consisting of subsets of X.
Definition 11.26: Let f : X Ñ r´8, 8s, where pX, Mq is a measurable space. The function
f is called measurable if the set tx | f pxq ą au P M, @ a P R.
Note:
86
MATH 362 Lecture Notes 11.4 Lebesgue integration
(ii) If X in Defn. 11.26 is a metric space, then every continuous f : X Ñ r´8, 8s is measurable.
If M “ B (i.e., if our σ-algebra is the Borel algebra), then a measurable f is called Borel
measurable. So, every continuous f is Borel measurable.
(i) tx | f pxq ą au P M, @ a P R.
(ii) tx | f pxq ě au P M, @ a P R.
(iii) tx | f pxq ă au P M, @ a P R.
(iv) tx | f pxq ď au P M, @ a P R.
8 " *
č 1
Proof: tx | f pxq ě au “ x | f pxq ą a ´ ,
n“1
n
so (i) implies (ii), since this is a countable intersection of measurable sets. Likewise,
showing that (iii) implies (iv). Finally, (iv) implies (i), since
Proof: This result is stated in the context of a measurable space pX, Mq, with f : X Ñ
r´8, 8s assumed to be measurable in the sense of Definition 11.26. Let a P R be fixed.
We have
ˇ ˇ
tx : | f pxq| ă au “ x ˇ f pxq ă a X x ˇ f pxq ą ´a .
( (
87
MATH 362 Lecture Notes 11.4 Lebesgue integration
ˇ ( ˇ (
Since f is measurable, the sets x ˇ f pxq ă a and x ˇ f pxq ą ´a are in M. Since rings
are closed under intersections, the set tx : | f pxq| ă au is in M as well. The choice of a is
arbitrary, so by Theorem 11.27, | f | is measurable.
Then g and h are measurable. Similar statements may be made about inf fn pxq and
n
lim inf fn pxq.
Corollary 11.30: (i) If f , g are measurable, then maxt f, gu and mint f, gu are measurable.
In particular, the functions defined by
Proof:
(i) Take f1 “ f and fn “ g for n “ 2, 3, . . . in Thm. 11.29. Then mint f, gu “ inf fn and
maxt f, gu “ sup fn .
(ii) Under the assumption of convergence, lim sup fn “ lim fn .
88
MATH 362 Lecture Notes 11.4 Lebesgue integration
Thus,
8
ď
tx | hpxq ą au “ tx | p f pxq, gpxqq P Ga u “ tx | p f pxq, gpxqq P In u.
n“1
Note:
ˇ (
1. In the canonical decomposition (8) of simple s, one has yi , y j for i , j, Ai “ x ˇ spxq “ yi “
s´1 ptyi uq, and Ai XA j “ ∅ for i , j. Unless otherwise mentioned, you may assume expressions
used in the following of the form (8) are canonical.
89
MATH 362 Lecture Notes 11.4 Lebesgue integration
2. One may verify that a simple s expressed in canonical form (8) is measurable if and only if
Ai P M for i “ 1, 2, . . . , m.
3. If we take as our measure space pR, Mpmqq (the reals with the Lebesgue measurable sets
Mpmq) and define s “ χS , where S is the nonmeasurable set of Theorem 11.23, then s is a
simple function which is not measurable.
Theorem 11.33: Let pX, Mq be a measurable space, and f : X Ñ r´8, 8s. There exists a
ptwise
sequence psn q of simple functions such that sn ÝÑ f as n Ñ 8. If f is measurable, then
the simple functions sn may be chosen to all be measurable as well. If f ě 0, then psn q may
be chosen to be a monotone increasing sequence.
Proof: First, suppose ranp f q Ă r0, 8s, and for each n “ 0, 1, 2, 3, . . . and each k “
1, 2, . . . , n2n ` 1, define sets
" * ˆ„ ˙˙ ˆ„ n ˙
k´1 k k´1 k n2 ` 1
Enk :“ x | n ď f pxq ă n “ f ´1
, , and Fn :“ f ´1
, `8 .
2 2 2n 2n 2n
90
MATH 362 Lecture Notes 11.4 Lebesgue integration
II. x is in Fn .
Note that
n2n ` 1 n2n`1 ` 2
" * " *
ˇ ˇ
Fn “ x f pxq ě
ˇ “ x f pxq ě
ˇ
2n 2n`1
# + ¨pn`1q2n`1 `1 " ˛
pn ` 1q2 n`1 `1 ˇm´1
*
ˇ ď m
“ x ˇ f pxq ě n`1
Y˝ x ˇ n`1 ď f pxq ă n`1 ‚
2 2 2
m“n2n`1 `3
¨ n`1
˛
pn`1q2
ď `1
“ Fn`1 Y ˝ En`1,m ‚ , (9)
m“n2n`1 `3
where the sets in (9) are among those used to define sn`1 ; on these sets we have
$
n2n`1 ` 2
, x P En`1,n2n`1 `3 ,
’
’
’
’
’ 2n`1
..
’
’
’
.
’
’
&
sn`1 pxq “ pn ` 1q2n`1
’
’ , x P En`1,pn`1q2n`1 `1 ,
’
’
’
’ 2n`1
pn ` 1q2n`1 ` 1
’
’
, x P Fn`1 .
’
’
%
2n`1
Thus, for x P Fn ,
n2n`1 ` 2 n2n ` 1
sn`1 pxq ě “ “ sn pxq .
2n`1 2n
Thus, Claim 2 is proved.
1
| f pxq ´ sn pxq| ă Ñ 0 as n Ñ 8.
2n
91
MATH 362 Lecture Notes 11.4 Lebesgue integration
On the other hand, if f pxq “ `8, then x < Enk @ n and k. Thus, for each n,
n2n ` 1
sn pxq “ ą n Ñ 8 as n Ñ 8.
2n
To complete the proof (for f as general as stated in the theorem), we note that we
have proved the existence of a sequences of simple functions psn q converging to f `
(measurable if f is measurable), and ptn q converging to f ´ . The sequence psn ´ tn q is
made up of simple functions, too, and converges to f “ f ` ´ f ´ .
Note:
It may seem strange to define 0¨8 “ 0. However, one verifies without difficulty
that with this definition the commutative, associative and distributive laws hold in
r0, 8s without restriction.
92
MATH 362 Lecture Notes 11.4 Lebesgue integration
3. For measurable f : X Ñ r0, 8s, the integral in Defn. 11.34 is called the Lebesgue integral of f
ş
over A. This number exists for all such f , though it is entirely possible that A f dµ “ 8.
Proof:
ş
(i) The set of numbers over which A f dµ is the supremum is contained in the set
ş
over which A g dµ is the supremum.
(ii) If s is a simple function with 0 ď s ď f , then by the monotonicity of µ, IA psq ď IB psq.
ş
The result follows from the definition of A f dµ.
(iii) For c “ 0, the result follows from the fact that only s ” 0 is simple between zero
and c f . For c , 0 we note that cs is simple for each simple s, and that IA pcsq “ cIA psq.
93
MATH 362 Lecture Notes 11.4 Lebesgue integration
Thus,
ż
c f dµ “ c suptIA psq | s simple, 0 ď s ď f u
A
“ suptcIA psq | s simple, 0 ď s ď f u
“ suptIA pcsq | s simple, 0 ď s ď f u
“ suptIA ptq | t simple, 0 ď t ď c f u
ż
“ c f dµ.
A
(iv) Let s be simple with 0 ď s ď f . Let ranpsq “ ty1 , . . . , yn u where the yi are distinct,
and Ei :“ tx | spxq “ yi u. If A “ ∅, then
n
ÿ
IA psq “ yi µp∅q “ 0.
i“1
94
MATH 362 Lecture Notes 11.4 Lebesgue integration
with the yi distinct and Ai “ tx | spxq “ yi u, and similarly for z j , B j . We first prove the
countable additivity of φ. Let pEk q be a sequence of disjoint sets in M, with E “ k Ek .
Ť
Then
ÿn ÿn 8
ÿ
φpEq “ yi µpE X Ai q “ yi µpEk X Ai q (by σ-additivity of µ)
i“1 i“1 k“1
ÿ n
8 ÿ 8
ÿ
“ yi µpEk X Ai q “ φpEk q.
k“1 i“1 k“1
while ż ż
s dµ ` t dµ “ yi µpEi j q ` z j µpEi j q,
Eij Eij
95
MATH 362 Lecture Notes 11.4 Lebesgue integration
Proof: Note that f is measurable by Coro. 11.30(ii). Next, Thm. 11.35(i) and the
supposition that fn pxq ď fn`1 pxq at each x P X together imply that the sequence of
˘8
numbers X fn dµ n“1 is monotone increasing, and so approaches some limit α P r0, 8s.
`ş
ş ş
Moreover, fn pxq ď f pxq for each x, implying that X fn dµ ď X f dµ for each n. Thus,
α ď X f dµ.
ş
To get the other inequality, let s be simple with 0 ď s ď f , c P p0, 1q, and define
En :“ tx | fn pxq ě cspxqu, n “ 1, 2, . . . .
Ť
Note that each En P M, E1 Ă E2 Ă E3 Ă ¨ ¨ ¨ , and X “ n En . Also,
ż ż ż
fn dµ ě fn dµ ě IEn pcsq “ c s dµ, (10)
X En En
The choice of c P p0, 1q is arbitrary, so α ě IX psq. Since true for each simple s with
0 ď s ď f , it follows that α ě X f dµ.
ş
Note: By Thm. 11.35 (vi), the above theorem is equally true if the region X over which we are integrating
is replaced by E P M. That is, we have the following corollary (which some texts call Lebesgue’s
Monotone Convergence Theorem):
96
MATH 362 Lecture Notes 11.4 Lebesgue integration
There is a similar ability to replace, in the next result and many others which follow it, integrals
over the entire measure space X with integrals over a more limited region E P M. We will not
routinely point out instances in which similar replacements can be made, but leave it to the reader
to check for specific theorems of interest.
Proposition 11.39: Let pX, M, µq be a measure space, and suppose f , g are functions from
X into r0, 8s. Then ż ż ż
p f ` gq dµ “ f dµ ` g dµ.
X X X
Proof: Let psn q, ptn q be sequences of nonnegative measurable simple functions con-
verging pointwise, respectively, to f and g, and such that 0 ď sn ď sn`1 ď f ,
0 ď tn ď tn`1 ď g. For x P X define rn pxq “ sn pxq ` tn pxq. Then the sequence of
functions rn converges pointwise to p f ` gq, with 0 ď sn ` tn ď sn`1 ` tn`1 ď f ` g. We
have
ż ż ż
p f ` gq dµ “ lim rn dµ “ lim rn dµ (by Prop. 11.37)
X X n n X
ż ˆż ż ˙
“ lim psn ` tn q dµ “ lim sn dµ ` tn dµ (by Prop. 11.36)
n X n X X
ż ż
“ lim sn dµ ` lim tn dµ (again by the Monotone Convergence Thm.)
n X n
żX ż
“ f dµ ` g dµ.
X X
Using induction with this proposition serving as the base case, we can deduce that for measurable
functions f1 , f2 , . . . , fn (finitely many of them) mapping X into r0, 8s,
¨ ˛
ż ÿn n ż
ÿ
˝ f j dµ “
‚ f j dµ. (11)
X j“1 j“1 X
The following theorem extends this result to countable sums of nonnegative measurable functions.
97
MATH 362 Lecture Notes 11.4 Lebesgue integration
ÿ 8
8 ÿ 8 ÿ
ÿ 8
ai j “ ai j .
i“1 j“1 j“1 i“1
Theorem 11.42 (Fatou’s lemma): Suppose pX, M, µq is a measure space, and fn : X Ñ r0, 8s
is measurable for each n P N. Then
ż ´ ¯ ż
lim inf fn dµ ď lim inf fn dµ.
X nÑ8 nÑ8 X
• each gk is measurable,
• 0 ď g1 ď g2 ď ¨ ¨ ¨ ,
• gk pxq Ñ lim inf f pxq as k Ñ 8, and
nÑ8
ż ż
• gk ď fk , so gk dµ ď fk dµ.
X X
98
MATH 362 Lecture Notes 11.4 Lebesgue integration
Ť
Proof: Let pEn q be a disjoint sequence of sets in M, and let E “ n En . Then
ż ż ˜ÿ 8
¸
ÿ8 ż ÿ8
φpEq “ f χE dµ “ f χEn dµ “ f χEn dµ “ φpEn q,
X X n“1 n“1 X n“1
(12)
For general measurable g : X Ñ r0, 8s, we apply Thm. 11.33 to get a sequence of
ptwise
measurable simple functions psn q with 0 ď s1 ď s2 ď ¨ ¨ ¨ ď sn ÝÑ g. We note that
ptwise
0 ď s1 f ď s2 f ď ¨ ¨ ¨ ď sn f ÝÑ g f , and hence the Monotone Convergence Theorem
(Thm. 11.37) applied to both ends of (12) gives that
ż ż
g dφ “ g f dµ.
X X
Definition 11.44: Let pX, M, µq be a measure space. We say that a measurable function
f : X Ñ r´8, 8s is Lebesgue integrable (or summable) with respect to µ if
ż
| f | dµ ă 8.
X
The collection of all Lebesgue integrable functions is denoted L pµq, or L 1 pµq. We some-
times write just L in place of L pmq.
99
MATH 362 Lecture Notes 11.4 Lebesgue integration
Note: If both of the integrals on the right-hand side in (13) are finite, then
ż ż ż
`
| f | dµ “ f dµ ` f ´ dµ,
X X X
by Thm. 11.40, and f P L pµq. On the other hand, if f P L pµq, then the inequalities f ` ď | f | and
f ´ ď | f | show that each of f ` , f ´ P L pµq, by Thm. 11.35 (i).
Proof: That pα f ` βgq is measurable follows from Thm. 11.31. To see that it is in L pµq,
we have
ż ż ż ż
|α f ` βg| dµ ď p|α|| f | ` |β||g|q dµ “ |α| | f | dµ ` |β| |g| dµ ď 8,
X X X X
using Thm. 11.35 and Prop. 11.39, and the assumption that f , g P L pµq.
ż ż ż
Claim 1: p f ` gq dµ “ f dµ ` g dµ.
X X X
h` ´ h´ “ h “ f ` g “ f ` ´ f ´ ` g` ´ g´ ,
or
h` ` f ´ ` g´ “ f ` ` g` ` h´ .
100
MATH 362 Lecture Notes 11.4 Lebesgue integration
By Thm. 11.40,
ż ż ż ż ż ż
h` ` f´ ` g´ “ f` ` g` ` h´ ,
X X X X X X
and since each of these integrals is finite, we may rewrite this expression as
ż ż ż ż ż ż
h` ´ h´ “ f` ´ f´ ` g` ´ g´ .
X X X X X X
Since the Claim 2 holds for β, g in place of α, f , and Claim 1 holds for pα f q, pβgq in place
of f , g, the theorem is proved.
Theorem 11.47: Let pX, M, µq be a measure space, f : X Ñ r´8, 8s. If f P L pµq, then
ˇż ˇ ż
ˇ ˇ
ˇ f dµˇ ď | f | dµ.
ˇ ˇ
X X
Proof: We have
ż ż ż ż ż ż
` ´ ` ´
f dµ “ f dµ ´ f dµ ď f dµ ` f dµ ď | f | dµ.
X X X X X X
Similarly,
ż ż ż ż ż ż
´ ` ` ´
´ f dµ “ f dµ ´ f dµ ď f dµ ` f dµ ď | f | dµ.
X X X X X X
101
MATH 362 Lecture Notes 11.4 Lebesgue integration
| fn pxq| ď gpxq, @ x P X, n “ 1, 2, . . . ,
then f P L pµq,
ż ż ż
lim | fn ´ f | dµ “ 0, and lim fn dµ “ f dµ.
nÑ8 X nÑ8 X X
Proof: f is measurable and | f | ď g (since it is the pointwise limit of the fn ’s, and each
| fn | ď g). Thus, f P L pµq. Since | fn ´ f | ď 2g, we may apply Fatou’s Lemma (11.42) to
the sequence of functions p2g ´ | fn ´ f |q to get
ż ż
lim inf p2g ´ | fn ´ f |q dµ ď lim inf p2g ´ | fn ´ f |q dµ.
X nÑ8 nÑ8 X
102
MATH 362 Lecture Notes 11.4 Lebesgue integration
0 “ x0 ă x1 ă x2 ă ¨ ¨ ¨ ă xk “ b,
with xk “ pk{2n qb for k “ 1, . . . , 2n . Let Mnk , mnk denote the least upper bound and
greatest lower bound, respectively, of f on the kth subinterval xk´1 ď x ď xk . Note
that maxt|mnk |, |Mnk |u ď M, for each n, k. We obtain corresponding upper and lower
(Darboux) sums
n
2 2 n 2 n
ÿ b b ÿ b ÿ
Un “ Mnk n “ n Mnk and Ln “ n mnk .
k“1
2 2 k“1 2 k“1
Returning for the moment to a fixed n with its corresponding partition, let us define
functions
f n pxq “ Mnk , when xk´1 ď x ă xk ,
again with f pbq “ f pbq. These f n , f are simple functions, and it is easy to see that
n n
their (Lebesgue) integrals coincide with the upper/lower Darboux sums:
ż ż
f n dm “ Un and f dm “ Ln .
r0,bs r0,bs n
f 1 ě f 2 ě f 3 ě ¨ ¨ ¨ ě f,
and, hence, there is a pointwise limit function f “ limn f n , with f pxq ě f pxq, for each
x P ra, bs. Similarly, there is a limit function f “ limn f with f pxq ď f pxq, for a ď x ď b.
n
If we take gpxq “ M for x P ra, bs, then g is Lebesgue-integrable on ra, bs (with integral
Mpb ´ aq), and | f n pxq| ď gpxq on ra, bs. So,
ż ż ´ ¯ ż ż
lim Un “ lim f n dm “ lim f n dm “ f dm ě f dm,
n n r0,bs r0,bs n r0,bs r0,bs
where the 2nd equality holds by the LDCT (Thm. 11.48). Similarly,
ż ż ´ ¯ ż ż
lim Ln “ lim f dm “ lim f dm “ f dm ď f dm.
n n r0,bs n r0,bs n n r0,bs r0,bs
103
MATH 362 Lecture Notes 11.4 Lebesgue integration
and since the same (Riemann) integral value is at both ends of the inequality, every
ş
value in between (including the Lebesgue integral r0,bs f dm of f ) is the same.
Answers:
ptwise
(i) One defect we have already seen. When fn ÝÑ f on E “ ra, bs, it need not be the case that
şb şb
a fn Ñ a f . We’ve already seen the counterexample
$ „
1 1
& npn ` 1q, if x P , ,
fn pxq :“ n`1 n ,
0, elsewhere.
%
ş1
which converges pointwise to the zero function on r0, 1s, despite 0 fn “ 1, @ n. But this
sequence p fn q is not uniformly bounded, and one might wonder if we restrict our attention
şb şb
to uniformly bounded sequences whether a fn Ñ a f . The answer is “no”, as seen by letting
pxn q be an enumeration of the rational numbers in r0, 1s, and defining
#
1, if x P tx1 , x2 , . . . , xn u,
fn pxq :“
0, otherwise.
Then #
ptwise 1, if x P r0, 1s with x rational,
fn ÝÑ f, where f pxq :“
0, otherwise.
But here the problem is somewhat different. It’s not that f has an integral which is unequal
şb
to limn a fn . Rather, it seems that the definition of the Riemann integral itself is to blame, not
being sufficiently general to allow f to be integrable in the Riemann sense of this term.
(ii) When first investigating metric spaces, we discussed several concrete examples. Several took
Euclidean space Rp as the collection of objects, but differed in their choice of metric. Vectors
in Rp are really functions with discrete (finite) domains. To extend these ideas to functions
defined on intervals ra, bs, we took (or, at least, could have taken)
ˆż ˙1{p
dp p f, gq :“ p
| f ´ g| dµ . (14)
ra,bs
At the time we asserted this is a metric on Cpa, bq, for each p ě 1, where we assumed
the integral was a Riemann integral. If we employ the Lebesgue integral in Equation (14)
and allow f , g to be measurable functions (not simply continuous ones) which are Lebesue-
integrable, then dp is a metric except for the fact that there are unequal functions f , g for which
104
MATH 362 Lecture Notes 11.5 Littlewood’s Principles
ˇ
dp p f, gq “ 0. So, we define the equivalence relation f g precisely when µ x ˇ f pxq , gpxq “ 0
(
(iii) We next obtain a continuous-domain analog for Euclidean space with the 8-norm. For
f : X Ñ r´8, 8s we define the essential supremum of f to be
ˇ
} f }8 :“ inf c : µp x ˇ | f pxq| ą c q “ 0 .
( (
We say that f has compact support if suppp f q is a compact set. For a subset S Ă Rp , we
denote the collection of continuous functions on S with compact support by Cc pSq.
105
MATH 362 Lecture Notes 11.5 Littlewood’s Principles
In the book Lectures on the Theory of Functions, from 1944, Littlewood stated the three principles of
measure theory named for him. He said
Most of the results of [the theory] are fairly intuitive applications of these ideas, and
the student armed with them should be equal to most occasions when real variable
theory is called for. If one of the principles would be the obvious means to settle the
problem if it were ’quite’ true, it is natural to ask if the ’nearly’ is near enough, and for
a problem that is actually solvable it generally is.
106