Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd
Upload
160 views

Lecture 1. Digital Signal Processing - Basics

This document summarizes a lecture on digital signal processing fundamentals. It introduces digital signals and sampling theory. It also covers the Fourier transform, discrete Fourier transform, and discrete cosine transform. The discrete cosine transform is important for lossy audio and image compression like MP3 and JPEG. It represents images and signals as a sum of cosine functions. The lecture assigns homework to implement the discrete cosine transform on images and represent transform coefficients.

Uploaded by

Diu Thanh
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
160 views

Lecture 1. Digital Signal Processing - Basics

This document summarizes a lecture on digital signal processing fundamentals. It introduces digital signals and sampling theory. It also covers the Fourier transform, discrete Fourier transform, and discrete cosine transform. The discrete cosine transform is important for lossy audio and image compression like MP3 and JPEG. It represents images and signals as a sum of cosine functions. The lecture assigns homework to implement the discrete cosine transform on images and represent transform coefficients.

Uploaded by

Diu Thanh
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 19

Fundamentals of Multimedia Signal Processing

Lecture 1
Digital Signal Processing: Basics
Hoang Van Xiem, Ph.D.
xiemhoang@gmail.com

Hanoi, 2018
Outline

1. DSP: Introduction
2. Fourier Transform
3. Discrete Cosine Transform (DCT)
4. DCT in Image and Video Coding: A case study

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


2
DSP: Introduction

 Digital Signal: a sequence of numbers that


represent samples of a continuous variable in a domain
such as time, space, or frequency.

Audio signal Image signal Digital Image signal

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


3
DSP: Introduction

 Signal Sampling: To convert a continuous signal form


into a discrete signal form and assign an appropriate
digital value for the obtained form.
 Discretization
 Quantization

 Nyquist–Shannon sampling theorem states that a signal can be


exactly reconstructed from its samples if the sampling frequency is
greater than twice the highest frequency component in the signal

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


4
Fourier Transform

 Target: To decompose a signal (time domain) into the


frequencies (frequency domain)

 Formulation:

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


5
Discrete Fourier Transform

 Target: To convert a finite sequence of equally-


spaced samples of a function into a same-length
sequence of equally-spaced samples of the discrete-
time Fourier transform (DTFT), which is a complex-
valued function of frequency

 Formulation:

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


6
Exercises

1
 Let N = 4; 𝑥 = 2−𝑖
−𝑖
−1 + 2𝑖
Compute the Fourier transform (X) of x ?

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


7
Solution

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


8
Discrete Cosine Transform (DCT)

 DCT: expresses a finite sequence of data points in


terms of a sum of cosine functions oscillating at
different frequencies

 DCTs are important to numerous applications in


science and engineering, from lossy
compression of audio (e.g. MP3)
and images (e.g. JPEG) (where small high-frequency
components can be discarded).

 DCT is a Fourier-related transform similar to


the discrete Fourier transform (DFT), but using only real
numbers
Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing
9
Discrete Cosine Transform (DCT)

 DCT: expresses a finite sequence of data points in


terms of a sum of cosine functions oscillating at
different frequencies

 DCTs are important to numerous applications in


science and engineering, from lossy
compression of audio (e.g. MP3)
and images (e.g. JPEG) (where small high-frequency
components can be discarded).

 DCT is a Fourier-related transform similar to


the discrete Fourier transform (DFT), but using only real
numbers
Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing
10
DCT in video coding: Transform coding

 Block – wise transform coding


 Orthonormal transform
 DCT – Type II
 Thresholding Coding
 DCT coding artifact

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


11
Block – wise transform coding

@B. Girod, EE398A Image and Video Compression

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


12
Orthonormal transform

 Forward transform

 Inverse transform

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


13
DCT – Type II

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


14
Thresholding coding

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


15
DCT coding artifact

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


16
Homework

 Xây dựng chương trình mô phỏng phép biến đổi DCT


ứng dụng trên xử lý ảnh
 Biểu diễn giá trị hệ số DCT sau biến đổi cho một vài
khối hình 8x8

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


17
Lecture References

1. Wikipedia.com

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


18
Recap

 Homework assignment: 15%


 Project: 30%
 Mid. Exam: 20%
 Fin. Exam: 35%

Hoang Van Xiem, Ph.D., VNU-UET Multimedia Signal Processing


19

You might also like