Streaming video over internet

1) video compression
-To achieve efficiency
- classified into two categories: scalable and non-scalable video coding
- scalable video capable of coping with bandwidth fluctuations in the internet
2) Application layer QoS control
- to cope with varying network conditions and different quality requested by users various
application-layer QoS control techniques have been proposed.
- this layer includes congestion control and error control.
- congestion control: prevent packet loss and reduce delay
- error control:Improve video presentation quality in the presence of packet loss.
- error control include forward error control (FEC) ,retransmission,error-resilient encoding and
error concealment mechanisms
4) continuous media distribution services:
-To provide quality multimedia presentations adequate network support is crucial. this support
can reduce transport delay and packet loss ratio.
- built on top of the ip protocol continuous media distribution services are able to achieve QoS
and efficiency for streaming video and audio over the best effort internet .
- Continuous MDS include network filtering,application-level multicast, and content
replication.

4) Streaming servers
- used for streaming services
- to offer quality streaming services
- It requires processing multimedia data under timing constraints and supports interactive
control operations such as pause/resume,fast forward and fast backward. play ,loop video
- streaming servers need to retrieve media components in a synchronous fashion
- streaming server typically consists of three subsystems,namely a communicator eg
transport protocols,an operating system,and a storage system

5) Media synchronization mechanism.

- It is the major feature that distinguishes multimedia applications from other traditional data
applications.
- with this we can present various media streams in the same way as they were originally
captured.
- eg movements of the speaker's lips and match the played-out audio.

6) Protocols for streaming media

- They are designed to be standardized for communication between clients and streaming
servers.
- protocols for streaming media provide such services as network addressing,transport, and
session control.
- classified into three categories : Network-layer protocol such as IP,transport protocol such as
user datagram protocol(UDP), and session control protocol such as real time streaming protocol
(RTSP).

This paper is devoted to the exposition of the above six areas.

1) Video Compression
-raw video consumes a large amount of bandwidth.
- compression usually employed to achieve transmission efficiency.
 - various compression approaches and requirements imposed by streaming applications on
the video encoder and decoder.
- Scalable and non-scalable video coding compression technique
#About scalable and non scalable video compression details ::
Discrete cosine Transform : is used in lossy image compression because it has very
strong energy compaction.
--large amount of information stored in low frequency component and rest having very small
data which can be stored using very less number of bits(almost 2 or 3 bits)

-quantization : is a lossy compression technique achieved by compressing a range of values to

a single quantum. reducing the number of colors required to represent a digital image reduces
its file size.
color quantization.
--- we will match the length of encoding to information content of the data
-- higher probability -> shorter encoding
---lower probability ->longer encodings
-- lossless image compress to reduce coding redundancy.
- eg huffman coding
- A non -scalable video encoder generated one compressed bit-Stream
- in contrast Scalable video encoder compresses a raw video into multiple sub-streams. one of
them provides visual quality and the other provides visual enhancement substreams. the
complete bit stream provides the highest quality
- degrade quality or smaller size or lower frame rate the scalability of quality ,image sizes or
frame rates are called SNR .
- FGS encoder compresses a raw video into two substreams: base layer bit stream and
enhancement bit stream FGS uses bitplane coding to represent enhancement stream.

-- various requirements imposed by streaming applications on the video encoder and decoder

• Bandwidth:
- To achieve acceptable perceptual quality, a streaming application typically has a minimum
bandwidth requirement. However, the current internet does not provide a bandwidth reservation
to support this requirement . It is used for congestion control which happens when the network
is heavily loaded.
• Delay:
- streaming video requires a bounded end to end delay so that packets can arrive at hte
receiver in time to be decoded and displayed .
- if the packet does not come in time buffering .
- a video packet that arrives beyond its delay bound is useless and can be regarded as lost.
- since the internet introduces time varying delay to provide continuous playout a buffer at the
receiver is usually introduced before decoding .
• loss:
- packet loss is inevitable in the internet and packet loss can damage pictures .which
displeasing to human eyes. to get rid of these packet loss multiple description coding is such a
compression technique was introduced.
• Video cassette recorder (VCR) like function.
- VCR like functions like stop,pause/resume,fast forward and random access
*Decoding complexity.
- devices like cellular phones PDA require low power consumption therefore streaming video
applications running on these devices must be simple . low decoding complexity is desirable.
3)APPLICATION LAYER QoS CONTROL
The main objective of this layer is to avoid congestion and maximize video quality in the
presence of packet loss.
- The application layer QoS control technique uses congestion control and error control
techniques .It does not require any Qos support from the network.
-Congestion Control
congestion means the excessive flow of data to the node that it can handle
- busty loss and excessive delay have devastating effects on video presentation quality and they
are usually caused by network congestion.
- congestion control helps in packet loss and delay .
- it takes place in the form of rate control in video streaming.
- rate control attempts to minimize the possibility of network congestion by matching the video
stream to the available network bandwidth.

Rate control

-rate control is a technique used to determine the sending rate of video traffic based on the
estimated available bandwidth in a network.
Existing rate control schemes can be classified into three categories : source based ,receiver
based and hybrid rate control
• Source based rate control:
-- Under the source based rate control the sender is responsible for adapting the video
transmission.
-- feedback is employed
-- based on feedback the sender could regulate the rate of the video stream
-- Service flexibility is high in unicast and low in single channel multicast. bandwidth efficiency is
high in single channel multicast and low in unicast which is a trade off between efficiency and
flexibility.
** Receiver based rate control ;
-- receivers regulate the receiving rate of video stream by adding channels while sender does
not participate in rate control.
-- typically it is used in receiver based rate control used in multicasting scalable video.
-- two approaches probe based and model based approach.
-- probe based rate control consists of : if there is no congestion then it increases its receiving
rate otherwise the newly added layer is dropped. & when congestion is detected a receiver
drops a layer or leaves a channel which results in the reduction of its receiving rate.
**Hybrid rate control
-- receivers regulate the receiving rate of video streams by adding/dropping channels while
sender also adjusts the transmission rate of each channel based on feedback from receivers.
A.2 Rate Shaping
-- To match the rate of pre-compressed video bit stream to the target rate constraint.
-- It requires in source based rate control.
-- this is because the stored video may be precompressed at a certain rate which may not
match the available bandwidth in the network.
There are many types of filters such as coded filter, frame-dropping filter,layer-dropping
filter,frequency filter,and re quantization filter.
-- frame dropping filter is used to reduce data rate of a video stream by discarding a number of
frames and transmitting the remaining frames at a lower rate.
-- low pass filtering is to discard the DCt coefficients of the higher frequencies .-- color reduction.
Chromatic information on video
B) Error control
B1) FEC
-- To add redundant information so that the original message can be reconstructed in the
presence of packet loss.
--3 categories of FEC Channel coding, Source Coding-based FEC and joint Source./channel
coding
**Channel coding is typically used in terms of block codes. first video stream chopped into
segments each of which is packetized into k packets.
-- then for each segment a block code is applied to the k packets to generate an n packet block.
**SFEC also adds redundant information to recover from loss.
-- Joint source/channel coding is an approach to optimal rate allocation between source coding
and channel coding.
B2) Delay-constrained retransmission
--it is usually dismissed as a method to recover lost packets in real time video since a
retransmitted packet may miss its play out time.
-- It is clear that the objective of the delay-constrained retransmission is to suppress request of
retransmission that will not arrive in time for display
B3) error resilient encoding
-- The main objective of error resilient encoding is to enhance robustness of compressed video
to packet loss.
-in includes re synchronization marking, data partitioning and data recovery.
--video transmission over the internet the boundary of a packet already provides a
synchronization point in the variable length coded bit stream at the receiver side.
--packet loss may be the cause of the loss of all the motion data and its associated shape and
texture data mechanisms re synchronization marking, data partitioning and data .
-- we present multiple description coding(MDC) which is promising for robust internet video
transmission.
- in mdc raw video sequence is compressed into multiple streams.

B4) Error Concealment

-- it executes to enhance robustness of compressed video before packet loss actually happens
-- it is used when a packed loss has already happened .
-- it is employed by receiver to conceal the lost data and make presentation less displeasing
-- two types of approach spatial and temporal interpolation.
-- spatial missing pixel values are reconstructed.
-- temporal lost data is reconstructed from data from previous frames.

IV) CONTINUOUS MEDIA DISTRIBUTION SERVICES

-- Network support can reduce transport delay and packet loss ratio
-- Streaming video and audio are classified as continuous media because they consist of a
sequence of media quanta. Such as audio and video frames.
-- The main aim is to provide !oS and Achieving efficiency for streaming video/audio over the
best internet.
-- It includes network filtering , application level multicast and content replication.
A) Network Filtering
--aimed at maximizing video quality during network congestion.
-- if the server is too busy it provides a filter to discard packets which the isp makes node
unknown about that packets.
-- frame dropping filters.
-- if the packet loss is higher than the threshold then the client will say increase the frame drop
rate
--frame dropping filters adv. improved video quality,bandwidth efficiency.
--how frame dropping includes improved video quality: upstream is larger available bandwidth to
a downstream link with smaller available bandwidth this could help improve video quality ---- the
filter understands the format of the media stream and can drop packets in a way that gracefully
degrades the streams quality instead of corrupting the flow outright.
B) Application level multicast
-- point to point applications like email, file transfer and web browsing fail to effectively support
large scale content delivery like streaming media multicast.
==Ip multicast was proposed which is used to provide efficient multipoint packet delivery.
== There are still many barriers in deploying ip multicast . these problems Include
scalability,network management, deployment and support for the higher functionality. to address
these issues an applic. level multicast mechanism proposed
=== It aims to build a multicast service on top of the internet.
== it enables content delivery service providers.
== ad.scalability,network management,support for congestion control,
C) Content replication
==scalability of media delivery system is content/media eplicato.
==it takes two forms,caching and mirroring.
==above cahi. and mirr. helps to reduce bandwidth consumption ,reduced load on streaming
servers,reduced latency for clients,increased availability.
== Mirroring: original file placed in main server and duplicate copies of original placed on
duplicate servers. in this way client retrieve from nearest servers.
== mirro. best performance ,low latency.
==caching.: make local copies of contents that clients retrieve. == different clients will load many
of the same contents .
== chahiyeko content local machine batw tanne
== yesma kunia client le request garyo vne tellai cache ma rakhdinx tyo video strea lai ani client
ma puryaux feri tei arule request garema suruma chache server ma herx ani paxi na vaye main
server ma gayera teslai chache server ma update garx

V) STREAMING SERVERS
==chahiyeko samayema kunai media file lai process garne kam garcha kuna pani client lai
==fast forward fast backward furthermore play, stop resume.
== synchronous fashion ma retrieve garnu parney hunx
1. Communicator
=== it involves the application layer and transport protocols implemented on the server.
== through this client can communicate with a server and retrieve multimedia contents in a
continuous and synchronous manner.
2. Operating System
=== different from traditional os an os for streaming services need to satisfy real time
requirements for streaming applications.
3. Storage system.
=continuous media storage and retrieval.
A. Real time OS
A.1 process mgmt
== specified scheduling policy such that all process can meet their requirements.
== real time scheduling techniques to solve real time scheduling problems two basic algorithms
for multimedia systems :
== earliest deadline first(EDF), rate monotonic scheduling.
== in earliest deadline: each tas is assigned a deadline and task are processed in the order of
increasing deadlines.
==in monotonic scheduling each task is assigned a static priority according to its request rate.
the task with shortest period (ie highest rate)gets the highest priority, and with the longest period
or the (lowest rate) gets lowest priority.
== both are preemptive.
A2 Resource mgmt
==CPUs ,memory and storage devices.
==it involves admission control and resource allocation.
== before admitted new client multimedia server must proform admission control test to decide
whether new connection can be admitted without violating performance guarantees already
committed to existing connections
==if connection is accepted the resource manager allocates resources required to meet the
QoS for the new connection.
== admission control can be classified: deterministic admission control and statistical admission
control
== deterministic admission control algorithms provide hard guarantees to client while statistical
guarantees to clients at least fixed percentage of media units are ensure to be met.
== deterministic ad. simplicity and strict assurance quality; lim. lower utilization of server.
== deterministic resource allocation schemes make reservations for the worst case.
== statistical resource allocation schemes achieve higher utilization by allowing temporary
overload and small percentage of Qos violations.

A3 File mgmt
==access and control function for file storage and retrieval.
== two approaches. organization of files on disks remains as it is for discrete data( file is not
scattered across several disks), necessary real time support through special disk scheduling
algorithms and enough buffer
== first come first serve and Scan do not provide real time guarantees.
==SCAM EDF ,Grouped sweeping Scheduling(GSS).dynamic circular Scan (DC-SCAN )
== They provide continuous media throughput and meet real time requirements imposed by
continuous media.
B Storage Mgmt
==Increase throughput with data striping.
==increase capacity with tertiary and hierarchical storage.
== SAN and NAS based architecture have following advantages over traditional storage:
simplification of storage mgmt by centralizing storage ,scalability and fault tolerance

VI. MEDIA SYNCHRONIZATION

== distance learning the presentation of slides should be synchronized with the commenting
audio stream.
==it includes maintaining the temporal relationship within one data stream and between various
media streams .three level of synchronization
1. Inter-stream synchronization
== lowest layer of continuous media or time dependent data such as video or audio is the
media layer.
== Media layer is logical data unit such as video and audio fame.
== it adheres to strict temporal constraints to ensure acceptable user perception at playback
== synchronization at this layer is referred as intra stream synchronization.
== it maintain the logical data units.
== without this synchronization the presentation of the stream may be interrupted by pauses or
gaps.
2. Inter-Stream synchronization
-==the second layer of time dependent data is the stream layer .
== which maintains the temporal relations among different continuous media.
== without this synchronization skew between the streams may become intolerable.
==user could be annoyed if they notice that movements of the lips a speaker do not correspond
to the presented audio.
3. inter-object synchronization.
== The highest layer of multimedia it manages inter stream and time independent data such
as text and still images.
== The main objective os tp start amd stop the presentation of the time independent data within
a tolerable time interval
== synchronization mechanisms can be either preventive or corrective due to no real time
support for network, delays ,jitter,insufficient bandwidth .
== disk reading scheduling algorithms,network transport protocol ,os and synchronization
schedulers. to preventive mechanisms to reduce minimize synchronization error.
==disk reading scheduling is the process organizing and coordinating and retrieval of data from
storage.
== network protocols provide maintaining synchronization during transmission over the internet
== os precise control of timing constraints by using EDF or rate monotonic scheduling
== synchronization errors are unavoidable since the internet introduces random delay, which
destroys the continuity of the media stream by incurring gapps and jitters during data
transmission. Therefor certain compensation at the receiver necessary when synchronization
errors occur.
An example of corrective mechanisms is the stream synchronization protocol SSP intentional
delay is used to recover from network delay variations.
== media synchronization is one of the key issues in the design of media streaming services .

VII. PROTOCOLS FOR STREAMING VIDEO

==
1.Network-layer protocol.
=== it provides basic network service support such as network addressing. Te Ip serves as the
network layer protocol for the internet protocols for internet video streaming
2. Transport protocol:
== it provides end to end network transport functions for streaming application.
== it include UDP , TCP, real time transport protocol RTP, real time control protocol (RTCP)
*payload type identification, source identification, QoS feedback, participant identification,
control packets scaling, inter media synchronization, minimal session control information
== udp and tcp protocols support such functions as multiplexitnmng
3. session control protocol:
==it defines the messages and procedures to control the delivery of the multimedia data during
an established session.
media retrieval , adding media to an existing session

VII. SUMMARY
== major approaches and mechanisms for internet video streaming.
== The objective is not to provide and exhaustive review of existing approaches and
mechanisms but instead to give the reader a perspective on the range of options available nad
the associated trade off among performance functionality and complexity.
future directions as follows :
1. Video compression
Scalable video coding. The primary objective on going research on scalable video coding are to
achieve high compression efficiency,high flexibility(bandwidth scalability) and low complexity.
== due to conflicting nature of efficiency flexibility,and complexity each scalable video coding
scheme seeks a trade off among the three factors .
===designers of video streaming service need to choose an appropriate scalable video coding
scheme which meets the target efficiency and flexibility at an affordable cost complexity.
== promising direction scalable video coding is to integrate several video coding techniques to
deal with Qos fluctuations in the networks.
== scalable video coding is capable of coping bandwidth variation,error resilient encoding,cand
deal with packet loss , delay cognizant video coding.
==the rate dimension corresponds to a partition layer by bit rates the delay dimension to a
partition by delay tolerance and loss dimension to a partition by error resilience.
Pros:
2. Application layer QoS control
==congestion control and error control
– – TCP like rate control for the further investigation how to trade off responsiveness to
detecting reacting to congestion with smooth fluctuation in visual quality
==combine FEC with retransmission
3. continuous media distribution services.
Major topic for research how to built a scalable ,efficient ,cost effective and incremental
deployable infrastructure for continuous media distribution.
4. streaming servers
== how to design efficient and reliable storage and retrieval of multimedia objects on disk arrays
,how to efficiently support VCR like inter active control. How to design highly scalable
multimedia servers. In variety of environments from video on demand server to integrated
multimedia file systems,. How to design fault tolerant storage systems with desirable features
5. media synchronization
== how to achieve syn. In multicast video while efficiently supporting VCR like interactive
functions have not been adequately addressed
6. protocols for streaming media
How to take caches into account, how to efficiently support pause resume operations in caches.
How to provide security in the protocols