M Jeeninga Fractional Calculus
M Jeeninga Fractional Calculus
M Jeeninga Fractional Calculus
Natuurwetenschappen
An Introduction to
Differintegrals and
Fractional Calculus
Student: M. Jeeninga
2
An Introduction to Differintegrals and
Fractional Calculus
Mark Jeeninga
s1961497
June 24, 2013
1 Introduction
In this paper we attempt to introduce differintegrals and fractional calculus to
undergraduates. After a brief history of fractional calculus and some basic def-
initions we will introduce the concept of differintegrals. Next we look at the
Grünwald-Letnikov and Riemann-Liouville differintegrals and see what their
construction is based on and what connects them. We will check whether some
regular rules for differentiation still apply for the Riemann-Liouville differinte-
gral. We conclude by calculating fractional integrals and fractional derivatives
of some basic functions.
Though the nature of this paradox is unclear, a relatively small group of mathe-
maticians started working on extending the regular methods of integration and
differentiation for non-integer orders. Fractional calculus started to mature over
the last 300 years. Over the course of time many different definitions for frac-
tional derivatives and integrals arose from different perspectives. Some even
seemed inconsistent with each other.
3
1.2 Preliminary Definitions
This paper will concern two common formulas for integration and differentia-
tion. We will be extending these formulas to non-integer order. We will address
these two formulas in a moment. The first one will be the backward difference
derivative and gives rise to the Grünwald-Letnikov differintegral. The second
one is the Cauchy formula for repeated integration and gives rise to the Riemann-
Liouville differintegral.
4h f (t) = f (t + h) − f (t)
5h f (t) = f (t) − f (t − h)
From this we can construct the forward difference derivative (FDD) and the
backward difference derivative (BDD):
d 4h f (t) f (t + h) − f (t)
(FDD) dt f (t) = lim = lim (1)
h→0 h h→0 h
d 5h f (t) f (t) − f (t − h)
(BDD) dt f (t) = h→0
lim = lim (2)
h h→0 h
Applying the FDD n times to a function f (t) we find
n
X n
4nh f (t) = 4h 4h · · · 4h f (t) = (−1)k f (t + (n − k)h)
| {z } k
n k=0
Note that 4h f (t) = 5h f (t + h) and from the above formulas it follows that
4
1.2.2 Cauchy formula for repeated integration
Rt
Integral of a function f (t) is denoted by a f (ν)dν. Integrating f (t) twice is
given by Z Z t ν1
f (ν2 )dν2 dν1
a a
If we use integration by parts we find
Z t Z ν1 Z t Z ν1
f (ν2 )dν2 dν1 = 1· f (ν2 )dν2 dν1
a a a a
h i Z ν1 ν1 =t Z th i
= − (t − ν1 ) f (ν2 )dν2 − − (t − ν1 ) f (ν1 )dν1
a ν1 =a a
Z t
= (t − ν1 )f (ν1 )dν1
a
5
A different representation of the Gamma function can be found in Krantz 1999,
p.156
(n + 1)z n!
Γ(z) = lim
n→∞ z(z + 1) · · · (z + n)
2 Differintegrals
In fractional calculus, a differintegal is an operator that connects differentia-
tion and integration. The operation of differentiation or integration using a
differintegral is called differintegration. It is important to note that there are
many ways to define a differintegral, as we shall see later on. In this section we
will discuss the Grünwald-Letnikov differintegral (represented by a Dtγ ) and the
Riemann-Liouville Differintegral (represented by a Dγt ).
a and t are called the terminals of the differintegral. We will get to them
later.
2.1.1 Differentiation
Consider the real valued function f (t). Let f (t) be p times differentiable. Using
the BDD, the p-th derivative of f is given by
p
d p
1 X k p
dt f (t) = lim (−1) f (t − kh)
h→0 hp k
k=0
6
Next we define the operator Q:
n
1 X k p
Qph,n f (t) := p (−1) f (t − kh) (8)
h k
k=0
where p, n, k ∈ N and h ∈ R.
p
since k = 0 for k > p.
2.1.2 Integration
We will now show that for negative p this generalisation corresponds to regular
integration. Note that binomial coefficient can be expressed as
n n! n(n − 1)(n − 2) · · · (n − k + 1)
= =
k k!(n − k)! k!
We will define
n n(n + 1) · · · (n + k − 1)
:= (9)
k k!
Plugging in negative values for n in the binomial coefficient we get
−n −n(−n − 1) · · · (−n − k + 1)
=
k k!
n(n + 1) · · · (n + k − 1)
= (−1)k
k!
k n
= (−1)
k
(−q)
Would we fix n and q and take the limit h → 0 we would find limh→0 fh,n = 0,
which is not very interesting. Instead we let n be defined by the relation nh =
t − a, such that n → ∞ as h → 0. As stated before, a and t are called the
terminals, and we will soon see that these form the region of integration. We
will denote all this as by
−q
a Dt f (t) := lim Q−q
h,n f (t)
h→0
nh=t−a
7
If we pick q = 1 we find
n
−1
X 1
a Dt f (t) = lim Q−1
h,n f (t) = lim h f (t − kh)
h→0 h→0 k
nh=t−a nh=t−a k=0
n
X Z t−a
= lim h f (t − kh) = f (t − τ )dτ
h→0 0
nh=t−a k=0
Z t
= f (ν)dν
a
Proof Suppose we have for q = r that (10) holds. We will show that it follows
that (10) also holds for q = r + 1. We have
n
−(r+1) (r+1)
X r+1
a Dt f (t) = lim h f (t − kh) (11)
h→0 k
nh=t−a k=0
Rt
Say f (−1) (t) = a
f (τ )dτ , then
1 h (−1) i
f (t) = lim f (t) − f (−1) (t − h)
h→0 h
Equivalently,
1 h (−1) i
f (t − kh0 ) = lim f (t − kh0 ) − f (−1) (t − kh0 − h)
h→0 h
8
r+1
Where we put = 0.
−1
Rt
Note that f (−1) (a) = 0 since f (−1) (t) = a f (τ )dτ . Using the above in (12),
along with nh = t − a, we get
n
−(r+1)
X r+1
a Dt f (t) = lim hr f (−1) (t − kh) − f (−1) (t − (k + 1)h)
h→0 k
nh=t−a k=0
n
r + 1 (−1)
X
= lim hr f (t − kh)
h→0 k
nh=t−a k=0
n
r + 1 (−1)
X
− f (t − (k + 1)h)
k
k=0
n n
X r (−1) X r + 1 (−1)
= lim hr f (t − kh) + f (t − kh)
h→0 k k−1
nh=t−a k=0 k=0
n
X r + 1 (−1)
− f (t − (k + 1)h)
k
k=0
n n
r (−1) r + 1 (−1)
X X
= lim hr f (t − kh) + f (t − kh)
h→0 k k−1
nh=t−a k=0 k=1
n
X r + 1 (−1)
− f (t − (k + 1)h)
k
k=0
n n−1
X
X r r + 1 (−1)
= lim hr f (−1) (t − kh) + f (t − (k + 1)h)
h→0 k k
nh=t−a k=0 k=0
n
X r + 1 (−1)
− f (t − (k + 1)h)
k
k=0
n
r (−1) r + 1 (−1)
X
r
= lim h f (t − kh) − f (t − (n + 1)h)
h→0 k n
nh=t−a k=0
r + 1 (−1)
= a Dt−r f (−1) (t) − lim hr f (t − (n + 1)h)
h→0 n
nh=t−a
−r (−1) r r+1
= a Dt f (t) − lim h f (−1) (t − nh − h)
h→0 n
nh=t−a
−r (−1) r r+1
= a Dt f (t) − lim h f (−1) (t − (t − a) − h)
h→0 n
nh=t−a
r + 1 (−1)
= a Dt−r f (−1) (t) − lim hr f (a − h)
h→0 n
nh=t−a
r+1
= a Dt−r f (−1) (t) − f (−1) (a) lim hr
h→0 n
nh=t−a
−r (−1)
= a Dt f (t) −0
9
From this we deduce that
Z t
−(r+1) 1
a Dt f (t) = a Dt−r f (−1) (t) = (t − ν)r−1 f (−1) (ν)dν
(r − 1)! a
Z t Z ν
1
= (t − ν)r−1 f (τ )dτ dν
(r − 1)! a a
1 t
Z
= (t − ν)r f (ν)dν
r! a
We have shown that for integer values of γ, a Dtγ f (t) corresponds to derivatives of
f when γ is positive and antiderivative of f when γ is negative. It also follows
from this definition that for γ = 0, a Dt0 f (t) = f (t). We now simply extend
this definition for non-integer order differintegrals by allowing non-integer γ in
the formula, substituting the Gamma function for the binomial product. The
existence of the limit is proved in [2] p.52-55.
Note that when γ is positive f (t) needs to be at least m times differentiable,
where m ≥ γ. When γ is negative, f (t) needs to be integrable.
10
Using this repeatedly in (8) we get
n
(p) k p
X
p
h · fh,n (t) = (−1) f (t − kh)
k
k=0
(Equation (14))
n n
X p−1 X p−1
= (−1)k f (t − kh) + (−1)k f (t − kh)
k k−1
k=0 k=0
n n
X p−1 X p−1
= (−1)k f (t − kh) + (−1)k f (t − kh)
k k−1
k=0 k=1
n n−1
X p−1 X p−1
= (−1)k f (t − kh) + (−1)k+1 f (t − (k + 1)h)
k k
k=0 k=0
n−1 h
k p−1 n p−1
X i
= (−1) f (t − kh) − f (t − (k + 1)h) + (−1) f (t − nh)
k n
k=0
n−1
k p−1 n p−1
X
= (−1) 5h f (t − kh) + (−1) f (a)
k n
k=0
(Repeat once more)
n−2
X p−2 h i
= (−1)k 5h f (t − kh) − 5h f (t − (k + 1)h)
k
k=0
p−2 p−1
+ (−1)n−1 5h f (t − (n − 1)h) + (−1)n f (a)
n−1 n
n−2
X p−2
= (−1)k 52h f (t − kh)
k
k=0
n−1 p − 2 n p−1
+ (−1) 5h f (a + h) + (−1) f (a)
n−1 n
(After m times, m ≤ p ≤ n)
n−m m−1
k p−m n−l p − 1 − l
X X
m
= (−1) 5h f (t − kh) + (−1) 5lh f (a + lh)
k n−l
k=0 l=0
(Using identity (5))
n−m m−1
X p−m X
n−l p − 1 − l
= (−1)k 5m
h f (t − kh) + (−1) 4lh f (a)
k n−l
k=0 l=0
11
(n+1)z n!
Using equations (10), (4), (3) and the identity Γ(z) = limn→∞ z(z+1)···(z+n) , we
find that
t m−1
f (l) (a)(t − a)−p+l
Z
p 1 X
a Dt f (t) = (t − ν)m−p−1 f (m) (ν)dν +
Γ(−p + m) a Γ(−p + l + 1)
l=0
(15)
We omit the full proof of this statement. All details of this construction can be
found in [2] p.52-55.
For this representation we see that f (t) needs to be at least m times differen-
tiable.
γ −3 −2 −1 0 1 2 3
Lets interpret the rules above. First we take a move to the left, then we move
to the right. We can take arbitrary size steps to the left on our time line, but
only integer steps to the right. Thus, to calculate a fractional derivative of f ,
we first have to move a certain amount to the left and subsequently move with
integer steps to the right.
For example, would we like to know the result for γ = 3/2, we first have to take
a half step to the left and subsequently two steps to the right.
γ −3 −2 −1 0 1 2 3
Obviously, this can be done in multiple ways, like taking one and a half steps to
the left and three steps to the right. In order to make the fractional derivative
unique we require the step to the left to be between 0 and -1, thus of size less
than 1.
12
2.2.1 Fractional Integral
The Riemann-Liouville definition of the fractional integral is given by
Z t
−q 1
D
a t f (t) = (t − ν)q−1 f (ν)dν
Γ(q) a
where q ∈ R+ and where we put a D0t f (t) = f (t). For details on why we can
put a D0t f (t) = f (t), see [2] p.65.
Applying the theorem above to our definition of the fractional integral, we find
that for q > 1
Z t
(t − t)q−1
d 1
(t − ν)q−1 f (ν)dν = ·1−0
dt Γ(q) a Γ(q)
Z t
1 d
+ (t − ν)q−1 f (ν)dν
Γ(q) a dt
Z t
1
= (t − ν)q−2 f (ν)dν
Γ(q − 1) a
13
In general, for q > 1 and m ≥ 1,
m Z t Z t
d 1 q−1 1
(t − ν) f (ν)dν = (t − ν)q−1−m f (ν)dν
dt Γ(q) a Γ(q − m) a
Or in notation
d m −q
= a Dm−q
dt a Dt f (t) t f (t), q > 1 and m ≥ 1 (16)
d m Z t
d m −q dt
(t − ν)q−1 f (ν)dν
dt a Dt f (t) =
Γ(q) a
d m−1 Z t h
i
dt d q−1 q−1
=
Γ(q) dt (t − ν) f (ν)dν + lim (t − ν) f (ν)
ν→t
a
d
m−1 Z th i
= dt − dνd
(t − ν)q−1 f (ν)dν + lim (t − ν)q−1 f (ν)
Γ(q) a ν→t
(integration by parts)
d m−1 Z t h
i
= dt
(t − ν)q−1 f (1) (ν)dν
Γ(q) a
ν=t
−(t − ν)q−1 f (ν) + lim (t − ν)q−1 f (ν)
ν→t
ν=a
d m−1 Z t
= dt
(t − ν)q−1 f (1) (ν)dν + (t − a)q−1 f (a)
Γ(q) a
d m−1 Z t
(t − a)q−m f (a)
= dt
(t − ν)q−1 f (1) (ν)dν +
Γ(q) a Γ(q − m + 1)
(repeat once more)
d m−2 Z t
(t − a)q−m+1 f (1) (a) (t − a)q−m f (a)
= dt
(t − ν)q−1 f (2) (ν)dν + +
Γ(q) a Γ(q − m + 2) Γ(q − m + 1)
(after m times)
Z t m−1
X (t − a)q−m+l f (l) (a)
1 q−1 (m)
= (t − ν) f (ν)dν + (17)
Γ(q) a Γ(q − m + l + 1)
l=0
m−1
(t − a)q−m+l f (l) (a)
=a D−q
X
(m)
t f (t) + (18)
Γ(q − m + l + 1)
l=0
14
Theorem 2.2 Let f (t) be an m times differentiable function. Then
d m −q −q (m)
dt a t f (t) = a Dt f
D (t) if and only if f (l) (a) = 0 for 0 ≤ l ≤ m−1.
If we recall our time line example, the above statement implies that it doesn’t
matter whether we step to the left or to right first if and only if f (l) (a) = 0 for
0 ≤ l ≤ m − 1, provided that f (t) is m times differentiable.
We can conclude that a Dγt f (t) = a Dtγ f (t) for all γ ∈ R, provided that f (t) is
integrable and m times differentiable.
3 Backwards Compatibility
It should be stressed once more that there are many different approaches to
extending integrals and derivatives to non-integer order. In the literature the
Riemann-Liouville definition is the most used version of the differintegral oper-
ator and the most commonly accepted fractional integral and fractional deriva-
tive. Therefore we will be using the RL differintegral throughout the end of the
paper.
In this section we will check whether the RL differintegral follows the regu-
lar rules of the differentiation and integration. We will start by checking under
which conditions we can interchange fractional integration and fractional differ-
entiation. We will also discuss linearity and the product rule.
15
3.1 Integral and Derivative Compositions
k l l k (k+l)
d d d d d
From calculus we know that dt k dtl f (t) = dtl dtk f (t) = dt(k+l) f (t), provided
that f (t) is k + l times differentiable. In this section we will check under which
conditions compositions of fractional derivatives and integrals still commute and
are still interchangeable.
We see that
−q1 −(q1 +q2 )
a Dt [a D−q
t
2
f (t)] = a D−q
t
2
[a D−q
t
1
f (t)] = a Dt f (t) (19)
16
3.1.2 Derivative of an Integral
We will be looking at the fractional derivative of a fractional integral.
Let p1 =: m1 − q1 , where m1 ∈ Z+ and q1 ∈ (0, 1), and let q2 ∈ Z+ .
p1 −q2 d m1 −q1 −q2
a D t [a D t f (t)] = dt a Dt a Dt f (t)
Using (19) to combine the integrals and (16) to reduce the order of the integral
such that it is inside (0, 1), we see that
d m1 −q1 −q2 d m1 −(q1 +q2 )
dt a Dt a Dt f (t) = dt a Dt f (t)
d
m 1 d
q3 −(q 1 +q 2 ) −q 3 d
m1 +q 3 −(q1 +q2 ) −q3
= dt dt a Dt f (t) = dt a Dt f (t)
d m3 −q3 m3 −q3 p1 −q2
= dt a Dt f (t) = a Dt f (t) = a Dt f (t) (20)
If we apply theorem 2.2 to this formula, and subsequently (18), we see that
−q1 d m2 −q2 d m2
−q1 −q2
a Dt dt a Dt f (t) = dt a Dt a Dt f (t)
⇐⇒
d l −q2
dt a Dt f (t) =0 at t = a, 0 ≤ l ≤ m2 − 1
⇐⇒
l−1 q−l+k (k)
−q (l)
X (t − a) f (a)
a Dt f (t) + =0 at t = a, 0 ≤ l ≤ m2 − 2
Γ(q − l + k + 1)
k=0
Now we can use (20) on the right hand side of the equation such that we find
−q1
a Dt [a Dpt 2 f (t)] = a Dtp2 −q1 f (t) (21)
17
3.1.4 Derivative of a Derivative
Let p1 =: m1 − q1 and p2 =: m2 − q2 , where m1 , m2 ∈ Z+ and q1 , q2 ∈ (0, 1).
Using (21) and (16) we see that
p1 p2 d m1 −q1
[a Dpt 2 f (t)]
a Dt [a Dt f (t)] = dt a Dt
d m1 p2 −q1
= dt a Dt f (t)
= a Dpt 1 +p2 f (t)
3.2 Linearity
From the linearity of the integral it follows that a D−q
t is linear.
Z t
−q 1
a Dt (cf (t) + dg(t)) = (t − ν)q−1 (cf (ν) + dg(ν))dν
Γ(q) a
Z t Z t
1 q−1 1
=c (t − ν) f (ν)dν + d (t − ν)q−1 g(ν)dν
Γ(q) a Γ(q) a
= c a D−q −q
t f (t) + d a Dt g(t)
In a similar fashion
p d m −q
a Dt (cf (t) + dg(t)) = dt a Dt (cf (t) + dg(t))
h i
d m
c a D−q −q
= dt t f (t) + d a Dt g(t)
d m −q d m −q
= c dt a Dt f (t) + d dt a Dt g(t)
= c a Dpt f (t) + d a Dpt g(t)
18
n
Since k = 0 for k > n we can extend the summation for any r ≥ n:
r h
d n
X n d k
ih
d n−k
i
dt (f (t) · g(t)) = dt f (t) dt g(t)
k
k=0
The reasoning behind why we may define the Leibniz rule for fractional deriva-
tives this way are given in [2] p.91-97.
The chain rule can also be expanded for non-integer orders, but we omit it here
due to its complexity. Those who are interested can find it in [2] p.97-98.
19
Plots for 0 Dα
tt
3/2
, with t ∈ [0, 5] and α ∈ [−3, 0]
α Ct−α
0 Dt C=
Γ(1 − α)
1
An important property of the reciprocal gamma function Γ(z) is that it equals
zero if z is an integer less or equal to zero. From this it follows that the derivative
of a constant is zero whenever the order α is an integer greater than zero,
and non-zero in between these integer values. Though the first outcome is
exactly what we expected due to the construction of our differintegral, the
second outcome is rather surprising.
α
Plots for −∞ Dt 1, with t ∈ [0, 5] and α ∈ [0, 5]
20
4.3 The Exponential Function
Let f (t) = ert with r ∈ C, and a = −∞. An RL differintegral where a = −∞
is known as a Weyl differintegral.
d m Z t
α
a Dt f (t) = −∞ Dα rt
t e =
dt
(t − ν)q−1 erν dν
Γ(q) 0
α 2t
Plot for −∞ Dt e , with t ∈ [−3, 5] and α ∈ [0, 4]
21
α α
Plots for −∞ Dt sin(t) and −∞ Dt cos(t), with t ∈ [0, 4π] and α ∈ [0, 4]
et − e−t et + e−t
sinh t = cosh t =
2 2
For the hyperbolic sine function
et − e−t 1
α α −t
−∞ Dt sinh t = −∞ Dα
t = α t
−∞ Dt e − −∞ Dt e
2 2
1 t α −t
1
= e − (−1) e = et − eiπα e−t
2 2
1 i π α −i π α t π
−t
1 π π π
= e 2 e 2 e −e 2 e i α
= e 2 e 2 α − e−(t−i 2 α)
i α t−i
2 2
π
= ei 2 α sinh(t − i π2 α) = iα sinh(t + 2i
π
α)
d d
In addition, since dt sinh t = cosh t and dt cosh t = sinh t, the differintegrals
above give rise to the following identities:
for all k ∈ Z.
22
α
Plots for the real part of −∞ Dt sinh(t) with t ∈ [−10, 10] and α ∈ [0, 8]
α
Plots for the imaginary part of −∞ Dt sinh(t) with t ∈ [−10, 10] and α ∈ [0, 8]
α
Plots for the real part of −∞ Dt cosh(t) with t ∈ [−10, 10] and α ∈ [0, 8]
23
α
Plots for the imaginary part of −∞ Dt cosh(t) with t ∈ [−10, 10] and α ∈ [0, 8]
5 Discussion
We have seen different methods to extend regular integration and differentiation
to non-integer orders. Using the forward difference derivative and the Cauchy
formula for repeated integration we have defined the Grünwald-Letnikov and
Riemann-Liouville differintegrals. Although the differintegrals are rather differ-
ent, they give the same result, provided some conditions are met.
The RL differintegral is linear in the argument and the orders add up nicely
under the right conditions. Furthermore, we have calculated differintegrals of
some basic functions using the RL differintegral.
24
Or, taking the inverse Laplace transform of both sides
Z t Z ν1 Z νn−1
1
f (νn )dνn · · · dν1 = L−1 n L{f (t)} (s)
···
s
| a a {z a }
n
With the concept of fractional order derivatives came also the notion of frac-
tional differential equations: differential equations using differintegal operators.
I was wondering whether there are cases in which it would be viable to split an
ordinary differential equation into derivatives of fractional order.
25
References
[1] Miller, K.S. and Ross, B.
An Introduction to the Fractional Calculus and Fractional Differential Equa-
tions
Isbn 9780471588849
Wiley, 1993
[2] Podlubny, I.
Fractional Differential Equations: An Introduction to Fractional Derivatives,
Fractional Differential Equations, to Methods of Their Solution and Some
of Their Applications
Isbn 9780080531984
Elsevier Science, 1998
[3] Das, S.
Functional Fractional Calculus
Isbn 9783642205453
Springer-Verlag Berlin Heidelberg, 2011
26