Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 286 views

    Thrift Protobuf

    Uploaded by

    Sajeevanie Mariyan Fernando
    Protocol Buffers and Apache Thrift are both frameworks for serializing structured data but Protocol Buffers is optimized for performance while Thrift also supports RPC. Protocol Buffers is maintained by Google and supports binary serialization, while Thrift is maintained by Apache and supports binary and JSON serialization. Protocol Buffers generally has better performance than Thrift for serialization and deserialization of objects in Java based on benchmarks.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd

    Thrift Protobuf

    Uploaded by

    Sajeevanie Mariyan Fernando
    286 views12 pages
    Protocol Buffers and Apache Thrift are both frameworks for serializing structured data but Protocol Buffers is optimized for performance while Thrift also supports RPC. Protocol Buffers is maintained by Google and supports binary serialization, while Thrift is maintained by Apache and supports binary and JSON serialization. Protocol Buffers generally has better performance than Thrift for serialization and deserialization of objects in Java based on benchmarks.

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    PPTX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Protocol Buffers and Apache Thrift are both frameworks for serializing structured data but Protocol Buffers is optimized for performance while Thrift also supports RPC. Protocol Buffers is maintained by Google and supports binary serialization, while Thrift is maintained by Apache and supports binary and JSON serialization. Protocol Buffers generally has better performance than Thrift for serialization and deserialization of objects in Java based on benchmarks.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    286 views12 pages

    Thrift Protobuf

    Uploaded by

    Sajeevanie Mariyan Fernando
    Protocol Buffers and Apache Thrift are both frameworks for serializing structured data but Protocol Buffers is optimized for performance while Thrift also supports RPC. Protocol Buffers is maintained by Google and supports binary serialization, while Thrift is maintained by Apache and supports binary and JSON serialization. Protocol Buffers generally has better performance than Thrift for serialization and deserialization of objects in Java based on benchmarks.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as PPTX, PDF, TXT or read online from Scribd
    Download as pptx, pdf, or txt
    of 12

    GOOGLE PROTOCOL BUFFERS VS APACHE THRIFT

    What are we looking for?

    Lightweight /Scalable cross-language services Why not JSON or XML?


    XML

    is verbose by design

    Since

    XML is a text format and it uses tags to delimit the data, XML files are nearly always larger than comparable binary formats

    XML

    and JSON use UTF-8 encoding which are larger than binary when sent across the wire.
    <?xml version="1.0" encoding="UTF-8" ?> JSON "version": "1.0", "encoding": "UTF-8",
    Xml

    Basic Information
    Protocol Buffers

    Thrift

    Open sourced by Google Maintained by Google Serialization API Write a proto file to define message and then use compiler to generate classes for target language Supports Binary serialization

    Open sourced by Facebook Maintained by Apache Incubator Serialization and RPC API Write a thrift file to define message and then use compiler to generate classes for target language Supports Binary and JSON serialization

    Language Support
    Protocol Buffers

    Thrift

    C++ Java Python Community Supported


    C# Ruby Perl Objective C Etc.

    C++ Java Python PHP Ruby Erlang Perl Haskell C# Cocoa Smalltalk OCaml

    Primitive Types Supported


    Protocol Buffers

    Thrift

    Double Float Unsigned int32/64

    Signed int32/64
    Bool String Bytes Repeated properties (lists) Enumerations

    Bool Byte Signed int32/64 Double (64-bit floating point) String List<type> Set<type> Map<type1, type2> Enumerations Exceptions Constants

    Message Definition
    package tutorial; option java_package = com.example.tutorial";

    Protocol Buffers

    option java_outer_classname = AddressBookProtos"; message Person { required string name = 1; required int32 id = 2;

    optional string email = 3;


    enum PhoneType { MOBILE = 0; HOME = 1; WORK = 2; } message PhoneNumber { required string number = 1; optional PhoneType type = 2 [default = HOME]; } repeated PhoneNumber phone = 4;

    Message Definition

    Thrift

    namespace java tutorial namespace csharp Tutorial enum PhoneType { MOBILE = 1, HOME = 2, WORK = 3 } struct PhoneNumber { 1: string number, 2: PhoneType type = 2 } struct Person { 1: string name, 2: i32 id, 3: string email, 4: set<PhoneNumber> phone } struct AddressBook { 1: list<Person> person }

    RPC Implementation
    Protocol Buffers

    Thrift

    Not Applicable

    ZeroMQ is a possible RPC implementation that has cross language support

    Cross language RPC built into the APIs RPC interfaces reference Thrift types Json and Binary Protocols

    service Calculator extends shared.SharedService { void ping(), i32 add(1:i32 num1, 2:i32 num2) throws (1:InvalidOperation ouch) }

    Create .thrift file and gen Java code Write java code struct dns_record {
    1: string key, 2: string value, 3: string type = 'A', 4: i32 ttl = 86400, 5: string first, 6: string last } Service TestDns { dns_record test(1:string q); }

    <thrift_root>/bin/thrift gen java tim.thrift code will be generated in gen-java/*.java // new object dns_record dr = new dns_record(key, value, type, ttl, first, last) // serialize TSerializer serializer = new TSerializer(new TBinaryProtocol.Factory()); TDeserializer deserializer = new TDeserializer(new TBinaryProtocol.Factory()); byte[] bytes = serializer.serialize(dr);

    Create .proto file and gen Java code Write Java code
    package dns; message DnsRecord { required string key = 1; required string value = 2; required string first = 3; required string last = 4; optional string type = 5 [default = "A"]; optional int32 ttl = 6 [default = 86400]; } message DnsResponse { repeated DnsRecord records = 1; }

    bin/protoc java_out . tim.proto


    // protocol buffer need a builder to create object Dns.DnsRecord.Builder b = Dns.DnsRecord.newBuilder(); b.setKey("key"); b.setValue("value..."); b.builder(); byte[] bytes = dr.toByteArray(); Dns.DnsRecord dr2 = Dns.DnsRecord.parseFrom(bytes);

    Performance in Java
    Protocol Buffers

    Thrift

    Get object

    : 8,170 msec

    Get object

    : 14,394msec

    Serdes protobuf: 33,054 msec

    Serdes thrift : 37,671msec Objs per second: 265,456

    Objs per second: 302,535


    Total bytes : 829,997,866

    Total bytes

    : 1,130,000,000

    From the result, Protocol Buffers is 1.1 times faster than Thrift!

    Thank You
    Group Members 2010/mcs/051 2010/mcs/037 2010/mcs/075 2010/mcs/007 2010/mcs/046 2010/mcs/056 2010/mcs/068 2010/mcs/072 2010/mcs/076 Saman Perera Kamal Mettananda Hansaka Wickramasinghe Yasindu Dambadeniya B S Dilshan Perera L Prashanthan Gayanath Senanayake W Sriwathsan Darshana Wijegunarathna

    You might also like