12limits Notes
12limits Notes
12 Proofs in calculus
We now move onto sequences and series. These are important in their own right, but they
also help lay the foundation for limits, continuity of functions, derivatives, integrals etc. And
most importantly they introduce the idea of convergence.
If we have time then we might look at limits of functions too.
• 21 , 14 , 61 , . . . is the sequence 2n
1
1
Maths220 — Limits and series
With not too much effort (basically some careful case analysis) we can prove
Definition. Let x ∈ R
• the ceiling of x is the smallest integer greater than or equal to x, denoted dxe.
Now to define the limit of a sequence we have to make this idea of “closer and closer”
more precise. So let us think of our example an = 1 + 1/n — we think that this goes to 1.
So what we mean is that the distance between an and 1 will become very small as n → ∞.
So we can (in some sense) have a dialog with the sequence. We can pick an arbitrary
little window around 1 — say (1 − , 1 + ) where is some very small positive number. We
can then ask “How big do I have to make n so that all the remaining terms in the sequence
lie in this little window?”
So for our sequence 1 + 1/n the distance between an and 1 is simply
So if we want this distance to be smaller than (so that an ∈ (1 − , 1 + ), then we need to
pick n so that
So if we take n very big, so that n > 1/ then the distance will be small enough. More
precisely, let N be an integer bigger than 1/. Then if n > N we will have
Now no matter how small we make we know we can always make N big enough so all the
remaining terms of our sequence lie in (1 − , 1 + ).
This is convergence. More generally. . .
for every real > 0 there exists a positive integer N such that if n is an
integer with n > N then |an − L| < .
So no matter how we choose epsilon, we can find such an N so all the subsequent terms
are no further than from L.
2
Maths220 — Limits and series
• If {an } converges to L then L is called the limit of the sequence, and we write limn→∞ an =
L, or an → L.
• If a sequence does not converge to any real number, then we say that the limit diverges.
One must be very careful to get the order of the quantifiers correct in this expression.
Think of it a bit like a dialogue.
• Suppose we think sn → σ.
• Choose any > 0 — when is the sequence closer than ?
• Given that choice of all the terms in the sequence after N are closer to σ than .
If we go back to our example (1 + 1/n) we are pretty sure it is converging to 1. But let
us prove this
Result. The sequence (1 + 1/n) converges to 1.
So convergence proofs are examples like surjective proofs where we need to somehow know
the answer before we write down the proof. “Given there is an N such that blah blah”. So
we have some scrap work to do.
So we think an → 1 and to prove it we need to find N given epsilon so that |an − 1| < .
So what does this formula give us?
n 1 2n − (2n − 1) 1
| − |=| |=| |
2n + 1 2 2(2n + 1) 4n + 2
Proof. Let N = d 41 e. Then for all n > N , 4n + 2 > 4N > 1 . Thus
n 1 1
| − |= <
2n + 1 2 4n + 2
n
Thus 2n+1
→ 1/2.
3
Maths220 — Limits and series
But this tells us L < L which does not make sense. This gives the contradiction. Note that
we don’t have to use = 1/2, any 0 < ≤ 1 will do. Also note that we can use the triangle
inequality: 2 = |(1−L)+(L+1)| ≤ ||1−L|+|1+L| < 1/2+1/2 = 1 to get the contradiction.
Proof. Assume to the contrary that the sequence converges, so (−1)n → L for some real
number L. Now pick = 1/2. Since the sequence converges, there is some number N , so
that if n > N then |(−1)n − L < 1/2.
Let k > N be an even number, then |(−1)k − L| = |1 − L| < 1/2. Hence 1/2 < L < 3/2.
Similarly, let ` > N be an odd number then |(−1)` − L| = |1 + L| < 1/2. Hence −3/2 < L <
−1/2.
This implies that −3/2 < L < −1/2 < 1/2 < L < 3/2, and so L < L which gives a
contradiction. Thus the sequence does not converge.
Exercise. Prove that the sequence {n} does not converge.
Proof. Assume that the sequence does converge to a number L. Now let = 1/2. Then there
exists some N such that if n > N then |n − L| < 1/2. Hence we have
Hence we have n − 1/2 < L < n + 1/2 < L < n + 3/2, so L < L — which is a contradiction.
Hence the sequence does not converge.
4
Maths220 — Limits and series
Now - sequences don’t always diverge in the same way. Some (like the previous example)
just bounce around and don’t settle down to a limit. Others, just get bigger and bigger. In
this case we can say something more than just “it diverges”
Definition. A sequence {an } diverges to infinity (an → ∞) iff for every M > 0 there is some
positive integer N such that if n > N then an > M .
Result. Let the sequence {an } be given by a2n = n, a − 2n − 1 = 1. Then {an } does not
converge, and does not converge to nifinity.
A couple of theorems
These are not in the text but they are useful.
First a quick and useful lemma:
This “trick” (adding and subtracting the same term) turns out to be quite useful and we
will use it a few times before we are done. Now a quick word about boundedness.
Definition. A sequence {an } is bounded when the set {a1 , a2 , a3 , . . . } is a bounded subset
of the reals. (i.e. ∃M > 0 s.t. |an | < M, ∀n ∈ N)
ie - write down the set of all the terms in the sequence — if that set is bounded then we
say the sequence is bounded. Now here is a nice result.
Now let M = max{|a1 |, |a2 |, . . . , |aN |, |L| + 1}. Then we have |ak | ≤ M for all k. Hence the
sequence is bounded.
5
Maths220 — Limits and series
So when n > max{N1 , N2 } we have |an − L| < and |an − K| < . Thus
|K − L| = |(K − an ) − (L − an )|
≤ |K − an | + |L − an |
2
< 2 = |K − L|
3
This is contradiction, so we must have K = L.
The following is a useful result for sequences that always increase (clearly there is a similar
result for sequences that always decrease).
Theorem. Let {an } be a sequence that is bounded and an ≤ an+1 for all n ∈ N. Then {an }
converges.
Proof. Let an be a bounded sequence so that an ≤ an+1 for all n ∈ N. Now let S =
{a1 , a2 , a3 . . . }. By assumption this is a bounded subset of R, and so by the completeness
axiom it has a supremum. Let L = sup S. We will show that an → L.
Let > 0. Then since L − is smaller than L it is not an upper bound for S (since L is
the best upper bound). Thus there is some ak ∈ S so that L − < ak ≤ L. Let n > k, then
since the sequence is increasing, we must have ak ≤ an , and since L is an upper bound for S
we must also have
L − < ak ≤ an ≤ L < L + .
Limit laws
This is not in the text. However, there are very similar results given for limits of
functions (like you did in first year calculus, but now with rigor) — see Chapter
12.4 of the text.
So in a couple of the examples we have done, it is pretty fiddly to prove convergence. The
purpose of this section is to give us some more general machinery to work out limits piece
by piece. It turns out that limits are fairly robust and provided the pieces converge and stay
away from bad places (like 0 and ∞) we can really mess around with limits quite a bit and
still be rigorous. In particular we can commute “taking the limit” with various operations
like addition, multiplication and division. This makes life much easier.
6
Maths220 — Limits and series
Theorem. Let (sn ) and (tn ) be convergent sequences with sn → s and tn → t. Then
(a) lim(sn + tn ) = s + t.
(b) if k ∈ R then lim(ksn ) = ks and lim(k + sn ) = k + s.
(c) lim(sn tn ) = st.
(d) lim(sn /tn ) = s/t provided t 6= 0 and tn 6= 0 for all n.
The proof is fairly straightfoward and we will do a good chunk of it. But before we prove
this, let us apply it to that previous example
4n2 −3
Lemma. The sequence sn = 5n2 −2n
→ 4/5.
We need to break the sequence down into nice convergent pieces. We can’t take 4n2 − 3
and 5n2 − 2n since they both diverge. On the other hand we can write
4n2 − 3 1/n2 4 − 3/n2
sn = =
5n2 − 2n 1/n2 5 − 2/n
Now the numerator is 4 − 3/n2 which clearly converges to 4. Similarly the denominator
converges to 5. The ratio of the limits is then 4/5 as required.
2
Proof. Write sn = 4−3/n
5−2/n
. By part (d) of the above theorem, the limit of the ratio is the
ratio of the limits (and the denominator is nowhere 0). Again, by part (a) of the theorem,
the limit of the sum is the sum of the limits, so 4 − 3/n2 → (lim 4) + lim(−3/n2 ) = 4 + 0 = 4.
Similarly the denominator 5 − 2/n converges to 5 + 0 = 5. Hence sn → 4/5.
We prove the various parts of the theorem by creative use of inequalities and the triangle
inequality.
For example we need to show that |sn + tn − (s + t)| is small. So we can massage this a little
using the triangle inequality to get
Similarly for the limit of the product we need to show that |sn tn − st| is small so we write
Since sn converges, it is bounded. Thus we need to pick n big enough to make these terms
very small.
Finally to do the ratio, it suffices to show that lim(1/tn ) = 1/t. This requires us to show
that
1 1 t − tn
| − |=| |<
tn t ttn
For n big, we know that tn ≈ t, so we will have something like |t − tn | < |t|2 . We have to
make this a big more rigorous.
7
Maths220 — Limits and series
Proof of Theorem. (a) Let > 0. Since sn → s and tn → t there exists N1 and N2 such that
n > N1 ⇒ |s − sn | < /2 n > N2 ⇒ |t − tn | < /2
So now take N = max{N1 , N2 } then if n > N we have
|sn + tn − (s + t)| = |(sn − s) + (tn − t)| ≤ |sn − s| + |tn − t|
<
as required.
(b) Can derive the first from (a) and the second from (c).
(c) Since (sn ) convergent, it is bounded by M1 . Now let M = max{M1 , |t|}. Thus we have
|sn tn − st| = |sn (tn − t) + t(sn − s)| ≤ |sn ||tn − t| + |t||sn − s|
≤ M |tn − t| + M |sn − s|
Hence we need to choose n big enough that both |.| are really small — smaller than
/2M .
Now since both sequences are convergent there exist N1 , N2 such that
n > N1 ⇒ |s − sn | < /2M n > N2 ⇒ |t − tn | < /2M
Let N = max{N1 , N2 }, then if n > N we have
|sn tn − st| ≤ M |tn − t| + M |sn − s| < .
Hence the limit of the product is the product of the limits.
(d) Since sn /tn = sn (1/tn ), we can prove (d) from (c) provided we show that lim(1/tn ) = 1/t.
Thus given > 0 we have to show that
1 1 t − tn
| − |=| |<
tn t ttn
|t − tn | < |ttn |
We know that this denominator is never zero, and that for big n it will be approximately
t2 . There is N1 such that if n > N1 then |t − tn | < |t|/2. This implies that for n > N1
|tn | = |tn − t + t| ≥ |tn − t| − |t| < |t|/2
So when n > N1 we have |tn t| > |t|2 /2.
Now there exists N2 such that if n > N2 then |t − t2 | < |t|2 /2. Let N = max{N1 , N2 }
then if n > N we have
11 2
| | < 2 |t − tn | <
tn t |t|
as required.
8
Maths220 — Limits and series
Bounds
Let us be a bit more precise about bounds and maximums and minimums.
Definition. Let S ⊆ R.
Proof. Assume B has an upper bound of m. Then every b ∈ B satisfies b ≤ m. Since every
a ∈ A is also an element of B we also have a ≤ m. Hence m is also an upper bound for
A.
Now, just because a set has an upper bound, it does not mean that it has a maximum —
consider (0, 1) — upper bound of 2 (for example), but no maximum. Now clearly the number
1 has a special status here — it is going to be the best upper bound. Best in what sense?
Best in the sense that it is the tightest upper bound — we cannot find any smaller number
that is still going to be a bound. Such “least upper bounds” have a special name.
• If S is bounded above then its least upper bound is called the supremum of S, and is
denoted sup S.
9
Maths220 — Limits and series
• Similarly if S is bounded below then is greatest lower bound is called the infimum of
S and is denoted inf S.
So while (0, 1) does not have a max or min, it does have a sup and inf.
sup(0, 1) = 1 inf(0, 1) = 0
On the other hand if a set does have a max then it must be equal to the sup (why?) and
similarly for the inf.
Some examples here
• S = ∩∞
n=1 (1 − 1/n, 1 + 1/n) = {1} — sup, max, inf, min = 1,1,1,1
So here is the important thing that separates the reals from the rationals
10
Maths220 — Limits and series
(c) For each x > 0 there is an n ∈ N such that 0 < 1/n < x.
• Assume (a) is false. Then there is some z ∈ R such that there is no n > z. This z is
an upper bound for N. But this contradicts the Archimedian property, so (a) must be
true.
• Let y = 1 in (b) — this gives nx > 1, so x > 1/n. Since n > 0, it also follows that
1/n > 0.
• Suppose that N is bounded above by some number z. Then for all n ∈ N we have n < z.
Equivalently 1/n > 1/z for all natural numbers n. Set x = 1/z and this contradicts
(c). Hence (c) implies the Archimedean property.
√
Before we get to the main result of this section — that 2 ∈ R, let us look at a very
imporant property of the reals and rational numbers that we touched on a little when we did
cardinality. We use this property all the time when we approximate a real number by the
first few terms of its decimal expansion.
Theorem. The set Q is dense in the set R. That is, if x < y are real numbers then there is
a rational number r such that x < r < y.
We need to find some rational number between x and y. How can we do this? We start
by stretching the real line (by multiplying by some integer b) so that the distance between
x and y becomes bigger than 1. This means that we know there is an integer point in there
somewhere a. Letting everything snap back down will give the fraction we want — a/b.
Proof. Assume x > 0. Now 1/(y − x) > 0, and so by the Archimedian property we know
there is some natural number b > 1/(y − x) > 0. This means by − bx > 1. Hence the interval
from bx to by must contain an integer — this will be a homework problem.
One can extend this (using the fact we will prove in a moment) to show that between any
two reals there is also an irrational number.
We use the fact there is a rational number between any two reals and that multiplying a
rational number by an irrational one gives another irrational number (why?)
√ √
Proof.
√ We rely on the fact (soon to be proved) that 2 ∈ R. Consider the numbers
√ x/ √2<
y/ 2. By the previous theorem√ there is a rational
√ number q such that x/ 2 < q < y/ 2.
Multiplying everything by 2 gives x < q 2 < y. Thus there is an irrational number
between x and y.
11
Maths220 — Limits and series
√
Let us now prove our last result for this section —- that 2 is a real number — that is,
that the completeness axiom implies its existence.
Theorem. Let p be a prime number. There exists a real number x such that x2 = p.
Proof. Let S = {r ∈ R s.t. r > 0, r2 < p}. Clearly we want (sup S)2 = p, so we first have to
show the supremum exists.
• If S 6= ∅ and S is bounded above then by the completeness axiom the supremum exists.
• If r ∈ S then r2 < p. But p < p2 so r2 < p2 and so r < p. Hence we have a (real
number) upper bound for the set namely p.
We wish to show that x2 = p. We will do this by assuming x2 < p and x2 > p and showing
that each of these gives a contradiction. These two cases are nearly identical, so we only do
the first one.
Assume x2 < p — in order to get a contradiction we will show that this implies that there
is another (rational) number between x2 and p — contradicting the assumption that x is the
supremum.
• We want to choose some small number so that (x + )2 < p — this would give us
another real number between x2 and p.
• Since is small we can bound x2 + (2x + ) < x2 + (2x + 1). Now if we find so that
x2 + (2x + 1) < p then we will have our desired .
p − x2
<
2x + 1
the RHS is a real number > 0, so we know there is some rational number between it
and 0 — call it .
√ So — this proof is not especially pleasant, but it does illustrate an important point —
2 really is a real number.
12
Maths220 — Limits and series
12.2 Series
The study of sequences of numbers leads naturally to the study of the sum of a sequence of
numbers — series. Actually this is perhaps the other way around — series are very important
in mathematics and we study sequences to build some tools and ideas to study series.
So we wish to get some idea of how to treat infinite sums of numbers — we need these
for calculus and many other parts of mathematics. But what does an infinite sum mean?
1 + 2 + 3 + 4 + . . . =?
1/1 + 1/2 + 1/3 + 1/4 + . . . =?
1/12 + 1/22 + 1/32 + 1/42 + . . . = π 2 /6
1/1 · 2 + 1/2 · 3 + 1/3 · 4 + 1/4 · 5 + . . . = 1
1
1 + r + r2 + r3 + · · · = |r| < 1
1−r
How can we tell if these sums make any sense? The first clearly does not. Why?
Definition. • Let {an } be a sequence of real numbers. We denote the sum
n
X
am + am+1 + · · · an = ak
k=m
• We use the sequence {an } to define the sequence of partial sums {sn } by
n
X
sn = ak = a1 + a2 + · · · + an
k=1
P∞
• The
P sequence of partial sums {sn } is referred to as the infinite series or series n=1 an =
n≥1 an .
P
• If the sequence {sn } converges to a real number s then we say that the series n≥1 an
is convergent and write
∞
X
an = s
n=1
13
Maths220 — Limits and series
1
P
Lemma (12.7). The series n≥1 n(n+1) = 1.
This is an example of a “telescoping series”. The terms have a very nice (hidden) form
an = bn − bn+1 — so many pairs of terms cancel nicely.
1 1 1
Proof. We can write n(n+1)
= n
− n+1
and hence the sequence of partial sums are given by
1 1 1
sn = + + ··· +
1·2 2·3 n(n + 1)
1 1 1 1 1 1 1 1
= − + − + − + ··· + −
1 2 2 3 3 4 n n+1
1
=1−
n+1
Now sn → 1 and hence the series converges to 1.
Similarly one can do
∞
X 3 1
=
n=1
9n2 + 3n − 2 2
1 1
since the summand is 3n−1 − 3n+2 .
It is (with a few exceptions) pretty hard to work out the actual limit of a series — we
can do telescoping ones and geometric ones (shortly), but everything else is pretty hard.
1
Lemma. If |r| < 1 then the series n≥0 rn = 1−r
P
.
Again we write down the partial sums and see what their limit is
Proof. We can write
sn = 1 + r + r 2 + · · · + r n
rsn = r + r2 + r3 · · · + rn+1
(1 − r)sn = 1 − rn+1
1−rn+1
and so sn = 1−r
. Now if |r| < 1 then rn+1 → 0 and sn → 1/(1 − r) as required.
What happens when |r| = 1 and |r| > 1? The sequence diverges (for different reasons).
Let us look at a couple of divergent examples
P P
Lemma. The series n≥1 n and n≥1 1/n diverge.
The first of these is pretty obvious, but let us do it anyway to get the idea of how to
write this down. The second one is less obvious — it diverges extremely slowly, but there is
a beautiful proof by Oresme in the 14th century. We have to group together the terms of the
series in a clever way.
Proof. • We write sn = 1 + 2 + · · · + n = n(n + 1)/2. The sequence of partial sums is
not bounded and so diverges. Hence the series diverges.
14
Maths220 — Limits and series
• To show that the second series diverges we note that the sequence of partial sums is
increasing and then find a lower bound for the partial sums.
∞
X 1 1 1
= 1 + + + ···
n=1
n 2 3
1 1 1 1 1 1 1 1 1
=1+ + + + + + + + + ··· + + ···
2 3 4 5 6 7 8 9 16
1 1 1 1 1 1 1 1 1
≥1+ + + + + + + + + ··· + + ···
2 4 4 8 8 8 8 16 16
Hence s2k ≥ 1 + k/2. Thus sn → +∞ and so the series diverges.
one needs more machinary — namely calculus and Taylor series. You have all seen things
like
in order for these expressions to make sense we need to know for what values of x they
converge. Unfortunately we don’t have time in this course to study this type of series —
power series, but they help us to define new mathematical functions so that we are not stuck
with cos, exp etc.
Adding and multiplying series
P P
Theorem. Let k ∈ R, an = s and bn = t then
X X
(an + bn ) = s + t (kan ) = ks
We can prove this very easily by writing down the partial sums and using our theorem
about adding sequences.
The following is a reasonably obvious result — if a series converges then the summands
had better become smaller and smaller.
P
Theorem. If an converges then an → 0.
Contrapositive — if an 6→ 0 then the series does not converge.
P
Proof. If an converges then the partial sums converge to some limit sn → s. Now sn −
sn−1 = an . Since the limit of the sum is the sum of the limits, we have sn → s and sn−1 → s
so (sn − sn−1 ) = an → 0.
Note that the converse is false — harmonic series. This is a good way to test if something
does not converge, but it is not so useful for telling if something does converge (a bit like
“convergent sequence is bounded”).
So let us now turn to some tests for convergence.
15
Maths220 — Limits and series
Convergence tests
There are many different tests of convergence — we will only touch on a couple of important
ones. Some of them parallel the test of sequence convergence we did.
P P
Theorem (comparison test). Let an and bn be infinte series with 0 ≤ an ≤ bn for all
n. Then
P P
(a) If bn converges then so does an .
P P
(b) If an = +∞ then bn = +∞.
The proof of this follows easily by considering the sequences of partial sums and using
some of our sequence convergence results.
Proof. • Since the summands are non-negative, theP sequence of partial sums form increas-
P
ing sequences. Further, the sequence of partial an is bounded above by b = bn .
Since the sequence is bounded and increasing it converges.
P
• The P sequence of partial sums bn is bounded below by the sequence of partial sums
of an . Since this second sequence diverges to infinty, it follows that the first must
too.
P √
We can use this result to prove, quite easily, that n≥2 1/(n − 2) diverges and that
2
P
1/(n + 1) converges.
P One is bounded below by the harmonic series, and the other is
bounded above by 1/n(n + 1).
P P
Definition.
P If the series
P |a n | converges then the series an is said to converge absolutely.
If |an | diverges but an converges, then the series is said to be conditionally convergent.
We won’t do the proof of this as we need “Cauchy convergence” which is actually equiv-
alent to the definition of convergence we have done but makes the proof much easier.
This is perhaps the most useful series convergence test. We state it slightly differently
from the text as we have not done limsups and liminfs.
P
Theorem (ratio test). Let an be a series of non-zero terms, and let rn = an+1 /an .
3. If lim |rn | = 1 then the root test does not give information.
Note that the last case covers series such as an = n and an = 1/n2 .
Proof. • Let lim |rn | = L < 1. Now pick L < c < 1. Since rn → L it follows that there
exists N such that if n ≥ N then |rn | = |an+1 /an | < c. By induction |aN +k | < ck |aN |.
Hence ∞
P P∞ k |aN |
n=N |an | < k=0 c |aN | = 1−c . Adding the finite number of terms shows that
the series converges absolutely and hence converges.
16
Maths220 — Limits and series
• If rn → L > 1 then |an+1 | > |an | for n sufficiently large. Hence an 6→ 0 and so the
series cannot converge.
P n13 +2n
This theorem proves that 3n
converges (for example).
A similar theorem is the root test which we won’t do. But we do the integral test:
17