Dynacache in WebSphere Portal Server

IBM Exceptional Web Experience
Conference 2012 - Americas
May 21 – 24, 2012 Austin, Texas

TECH-P30
Build and Deliver Increased Web Experience Platform
Performance with IBM WebSphere Extreme Scale

Benjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM

©2012 IBM Corporation

Session Overview

TECH-P30
Build and Deliver Increased Web Experience Platform Performance
with IBM WebSphere Extreme Scale
Benjamin Parees, Software Engineer, XC10 Caching Appliance Development, IBM
WebSphere Portal can make extensive use of the WebSphere dynamic cache feature for
performance optimization. IBM WebSphere eXtreme Scale & WebSphere DataPower XC10
Appliance augment these services by providing a more powerful elastic cache solution that can
extend both scale and performance improvement to meet increasing business web platform
presentation demands. Attend this session to learn how WebSphere Portal and Web Content
Manager (Version 7 and higher releases) can leverage WebSphere eXtreme Scale & WebSphere
DataPower XC10 Appliance to greatly increase total cache capacity and eliminate redundant content
rendering. This combination can achieve a potential reduction in response time, greater application
server throughput, and facilitates faster startup time for new WebSphere Portal servers added to a
cluster. Perhaps just as impressive is the fact this can be accomplished with relatively simple
configuration changes. This session will deliver the technical capabilities and business benefits of
extending yourWebSphere Portal solution to leverage WebSphere eXtreme Scale capabilities for
dynamic cache management needed by many organizations today.

© 2012 IBM Corporation
2

Exceptional Web Experience Conference 2012 - Americas

Agenda

● Motivation
● Overview of DynaCache and the Portal Advanced Cache
● Review Performance Results
● Configuration Overview
● eXtreme Scale and XC10 Background

3


Market Drivers
• The competition is only a click away in today's
web-facing world.

• Response times are critical to giving customers
a good experience and generating revenue.

• Customer sessions are becoming more critical.

• The cost of attracting new customers to your
web site for enrollment is significant.

• Losing the data that they have entered will likely
create a negative impression and result much
higher abandonment rates

4


Market Drivers

5


Elastic Caching minimizes the impact of
Transaction Overload
Web Server Tier App Server Tier Elastic Cache Back-end Systems
Database Tier

Improve Performance,
Scalability & Availability

Highly Scalable Web
Applications

Data-intensive
Applications
Extreme Performance

WebSphere
IBM HTTP Server DB2 UDB
Application Server
6


Applications using DynaCache

Each JVM has a private disk based
cache to support caches much
larger than possible with a memory
only conventional cache

2 tier cache: JVM has a small local
cache, then the disk file.

Cached content is redundant across
JVMs

7


Portal Advanced Cache
● DynaCache instance used to store rendered content
● Specifically content pulled from a Web Content Manager database
● Configuration used
Site level caching (rendered content)
30 day expiration
Do not clear cache on startup

8


News Portlet Deployment - Failure

!#*! DynaCache
W e lc o m e ,
WPS disk-offload
U s e r!

DynaCache
WPS disk-offload

… too slow!

DynaCache
During a recent ‘News’ application promotion, the WPS disk-offload
customer response to the new portlet overwhelmed the
web-site. The web-site became painfully slow under the
significant load. The result, not a happy customer…
DynaCache
WPS disk-offload

9


Scalability: Off-loading Dynamic cache to WXS/XC10
Much larger cache capacity
 WebSphere Portal JVMs run
more efficiently
– Lower local memory
requirements
– Faster start-up time
Improved consistency of
performance
– Improved cache and
environment stability
– High availability of cached
data

10

10

News Portlet Deployment - Success

Elastic cache

W e lc o m e ,
U s e r!
WPS

W XS
WPS

During a recent ‘News’ application promotion, the
WPS
customer response to the new portlet was very high. With WXS DynaCache Grid
However, with addition of an elastic cache the web-site configured, disk-offload is no
was able to handle the significant increase in load. The longer required
customers did not perceive any slow down of the web-
site. The result, happy customers and a successful
content promotion…
WPS

11


Fast start-up when adding more capacity – on the fly
Elastic cache

WPS
W e lc o m e ,
U s e r!

WPS

W XS

WPS

New WebSphere Portal servers can be
brought on-line quickly to meet increased
WPS
capacity needs. When start-up is complete,
the new server has immediate access to a
warm cache provided by eXtreme Scale.

WPS

New Server
12


Maintain consistent user experience during site maintenance

Elastic cache

WPS
W e lc o m e ,
U s e r!

WPS

W XS

WPS

If a WebSphere Portal server needs to be
restarted after applying an iFix, eXtreme
WPS
Scale can provide up to 54% improvement
in time to reach steady-state

WPS Down for maintenance
13


Scenario Details
● Two Portal Servers with Web Content Manager ● 300 concurrent users simulating Wiki/Blog accesses
● Single WCM DB Server ● Web Content Manager DB content: 50 gigs
● Two XC10 Caching Appliances
● Advanced Cache maximum entries

Using App Server heap: 5000 per server

Offloading to XC10: 1,000,000 shared available (Observed ~9 gigs)

WPS+
WCM 2 XC10 Collective

Proxy

WPS+
WCM
WCM DB

14


Portal Customer Experience – Steady State Comparison
●
Enabling WebSphere Content Manager Cache Offload Performance
Advanced Cache using an offloaded
eXtreme Scale/XC10 grid cache
●
With WXS/XC10 average throughput in our
100
steady state/concurrent user scenario was
consistently faster than with Default 90 No WCM
Advanced
Advanced Cache 80 Cache
42% improvement over no Advanced WCM Advanced
70
Cache in our scenario Cache Offloaded
to XC10
60
24% throughput improvement over
50
default cache implementation using Throughput(requests/second)
Application Server JVM heap in our
scenario
●
Using the Default Advanced Cache 100
implementation requires available
Default WCM
Application Server heap, offloading the 90
Advanced
cache to WXS/XC10 does not require heap 80 Cache
WCM Advanced
70 Cache Offloaded
to XC10
●
Performance is based on measurements and 60
projections using standard IBM benchmarks in a
50
controlled environment. Actual performance in a user's Throughput(requests/second)
environment may vary.

15


Portal Customer Experience – Steady State Comparison
●
With WXS/XC10 average steady state Cache Offload Performance
response-times are consistently faster than
with Default WebSphere Content Manager 16
Advanced Cache 14
No WCM
5.5 second improvement over no 12
Advanced
Cache
Advanced Cache in our scenario WCM
10 Advanced
3.4 second improvement over default 8 Cache
Offloaded to
cache implementation using 6 XC10
Application Server JVM heap in our
4
scenario Response Time(seconds)

●
Performance is based on measurements and 16
projections using standard IBM benchmarks in a
14 Default WCM
controlled environment. Actual performance in a user's
Advanced
environment may vary. 12 Cache
WCM
10 Advanced
8 Cache
Offloaded to
6 XC10

4
Response Time(seconds)

16


Reducing Portal warm-up time – Cold Start Results
●
With WXS/XC10 average throughput of a Cache Offload Performance
newly started server is consistently faster
than with Default WebSphere Content
Manager Advanced Cache
90
54% throughput improvement in our
scenario 80 Default
70 Advanced
Cache
60
●
With WXS/XC10 average response-times are Advanced
consistently faster than with Default 50 Cache
Offloaded
Advanced Cache 40 to XC10
4 second improvement observed in our 30
scenario Throughput(requests/second)

●
With WXS/XC10 response times improve
faster due to quicker cache hydration 16

14
Default
●
Performance is based on measurements and projections 12 Advanced
using standard IBM benchmarks in a controlled Cache
environment. Actual performance in a user's environment 10 Advanced
may vary. Cache
8 Offloaded to
XC10
6

4
Response Time(seconds)

17


Summary of Primary Benefits

●
WCM Advanced Cache implemented through the DynaCache, stores fully rendered pages
that do not have to be pulled out of WCM DB. Today customers can enable Advanced
Cache in the app server’s heap space. Technical goal is to avoid trips back to the WCM
database to avoid building these pages. WXS plugin allows you to store the DynaCache
content in a remote grid, so that the data being inserted into DynaCache does not consume
app server heap space.
1. Caching is of highest importance with WCM. Complex WCM components can be very CPU
intensive
2. WXS grid can store more data, have a larger hit percentage than DynaCache and reduce trips to
WCM DB which is more expensive. (More consistent Response times)
3. Benefits customers who are heaped constrained (no DynaCache) can leverage the Advanced
Cache by not committing memory on their Portal server. The WXS scenario does not consume
memory on the Portal server.
4. Shared cache, each portal JVM does not have to warm its cache on server restarts
5. Eliminates invalidation chatter.. critical in the farm topology

18


Client Usage: eCommerce Retailer

Catalog page cache
One of the largest ecommerce sites
1k page views/sec –
Bef or e: Existing WebSphere Commerce Server
customer.
Faster startup –
Per JVM catalog cache lead to lots of memory wastage
and cache warming problems on cluster start as well as
JVM restarts
JVM restarts are nondisruptive –
Af t er :
–
Moving to a shared cache using WXS, speeds cluster
Cache consistency start time by 60%
–
customer response times see no impact from JVM
restarts.
–
Memory is dramatically reduced.
–
Catalog consistency is better (time based promotions)
–
Less CPU used

19


Configuration Steps
● Install eXtreme Scale client on WebSphere Portal
● Point WebSphere to grid endpoints (XC10)
● Create a new grid
● Update the DynaCache instance settings
● Restart the server instance

20


Product Versions

Plus APAR PM63259 (targeted for Portal
CF14 and Web Content Manager CF31)

21


Catalog Service Configuration

22


Creating a new grid
1 Select the cache type

2 Click + to create a new cache

3 Type the name

4 Click OK

23


Cache Instance Configuration

24


DynaCache Instance Configuration

25


So, what are eXtreme Scale and XC10
anyway?

26


A distributed caching platform.
It takes the free memory across a number of Java™
Virtual Machines (JVM™) and marshals them into one New York San Francisco

logical cache.

London Shanghai

It can be used as a
platform for building
powerful Extreme
Can be used as a form of in Transaction Processing
memory database to manage (XTP) / Data Grid
Scales from simple in-
process topologies to application state. applications.
powerful distributed
topologies.

27


Modern Application Infrastructure Topology

Web Ser ver Tier App Ser ver Tier Elast ic Dat a Gr id Dat abase Tier

1
XC10
DataPower XC10 for simple
data oriented scenarios:
• HTTP Session Replication
• Elastic Dynacache
• Web Side Cache
• REST Cache

2
eXtreme Scale for maximum
flexibility covering data and
WebSpher e application oriented scenarios
DB2 UDB
Applicat ion Ser ver

28


IBM WebSphere eXtreme Scale
• Proven mature product:
– Fourth major release of product with V7.1
– Public References
– Private References
– Used at some of the largest web sites/companies in
the world

• Lightweight runtime footprint (20MB jar)

• Integrates with all versions of WebSphere and
almost any Java-based application container or
Java Virtual Machine

• Proven multi-data center capabilities

• Proven low-latency access to data

29


IBM WebSphere DataPower XC10 V2

 New Form Factor (2U)
 Larger Cache (240 GB)
 Better Performance (Faster SSD, Use of RAM)
 Improved monitoring (SNMP Support)
 Support for non-Java Applications (REST Gateway)
 Grid Capping

30


Scale out with Ease
• 240 GB (new in 2.0) elastic cache
for your business-critical applications
• Scales elastically without
application downtime
• Linear, predictable scaling at
predictable cost
• Quickly and easily increase cache
capacity as needs grow
• Unbinds cache from application
server memory constraints

31


Innovative Elastic Caching Solutions
“Data Oriented”
Session management
Elastic DynaCache
DataPower XC10 Appliance Web side cache
• Drop-in cache solution
Worldwide cache
optimized and hardened for
data oriented scenarios Data buffer
• High density, low footprint
Event Processing eXtreme Scale
improves datacenter
efficiency Petabyte analytics • Ultimate flexibility across a
broad range of caching
In-memory OLTP scenarios
• In-memory capabilities for
In-memory SOA application oriented
scenarios
“Application Oriented”

Elastic caching for linear scalability
High availability data replication
Simplified management, monitoring and administration
32


Utilizing WebSphere DataPower XC10 for DynaCache

Clients can attach to the ‘cache’
using the network

No dependency on a large file
system cache.

No disk dependency, no SAN
required.

Network Cache is as large as the
memory in the ‘grid’.
XC10 Collective

Each record is stored once in
the grid and shared by all
clients.

33


Elastic Dynamic Cache service support
• No new code required
• WebSphere DataPower XC10 and WebSphere eXtreme Scale
provide client code and a plug-in for WebSphere Application Server
applications to support Dynamic Cache API
• Allows applications deployed to WebSphere servers to use
WebSphere DataPower XC10 or WebSphere eXtreme Scale as a
“drop-in” cache, instead of storing cache data in local memory or
multiple instances of a disk cache

34

34 DataPower XC10 Overview

Traditional Cache Operation

Invalidation chatter
App

App A

Invalidation chatter
App A EIS

App A

App A

■ Cache capacity determined by individual JVM Size.
■ Size of each cache = M
■ # JVMs = N
■ To t a l c a c h e = M
■ Invalidation load per server increases as cluster grows.
■ Cold start servers hit the database.

35


Extreme Scale based Cache Operation

App

App A B’

App B A’ Cache is
Cache is
5x larger!
4x larger!
App C D’

App D C’

■ Cache capacity determined by total cluster size
■ Size of each cache = M
■ # JVMs = N
■ Total Cache = M x N
■ No invalidation chatter EIS
■ Linearly scalable
■ Less load on database and no cold start spikes

36


One more use case...
HTTP Session Persistence

37


HTTP Session data cache
●
No new code required
●
Extension of legacy session management caching
mechanism in WebSphere Application Server
●
Extensions to WebSphere Application Server
administrative console to support WebSphere
DataPower XC10 session management caching
and WebSphere eXtreme Scale session
management caching
●
WebSphere Application Server connects
seamlessly to the WebSphere DataPower XC10
appliance or WebSphere eXtreme Scale
– Client code must be installed on WebSphere
Application Server systems
●
Easily configure WebSphere applications to store
HTTP session data to a data cache on the
WebSphere DataPower XC10 appliance through
the WebSphere Application Sever administrative
console
●
Replaces other session replication mechanisms
(memory-to-memory replication)
●
Removes the need for Database traditionally used
for persistence
●
Enables HTTP session failover between
WebSphere Application Server cells

38

38 DataPower XC10 Overview

Session Caching for WebSphere Portal

39


Farming: Shared installations & Session caching
•Ability to share the profile & persist session
Manage the life cycles of HTTP sessions that are associated with the application
Improve QoS and Lower Memory footprint
Better guarantees of session availability during server failover
Topology spans multiple data centers across different physical locations

Elastic Cache
DataPower XC10

40


For More Information
WebSphere eXtreme Scale and XC10 User Wiki
http://www.ibm.com/developerworks/wikis/display/extremescale/Home
IBM Customer Experience Suite, WebSphere Portal and Web Content
Manager Software and Solutions
http://www-01.ibm.com/software/info/customerexperience/
http://www-3.ibm.com/software/genservers/portal/
WebSphere Portal and IBM Web Content Manager Information Center
http://www.ibm.com/developerworks/websphere/zones/portal/proddoc.html
IBM Web Experience Fast Track Offerings
http://www-01.ibm.com/software/genservers/portal/fasttrack/
WebSphere Portal Business Solutions Catalog
https://greenhouse.lotus.com/catalog/home_full.xsp?fProduct=WebSphere
%20Portal

41


Your Feedback is Important!


Please visit www.ibmconf.com to enter your feedback from your
wireless device, any laptop or one of our evaluation kiosks

Ask a Room Monitor for a paper form if preferred and leave it with a
Room Monitor or at Registration

Thank you!

42


© IBM Corporation 2012. All Rights Reserved.

The information contained in this publication is provided for informational purposes only. While efforts were made to
verify the completeness and accuracy of the information contained in this publication, it is provided AS IS without
warranty of any kind, express or implied. In addition, this information is based on IBM’s current product plans and
strategy, which are subject to change by IBM without notice. IBM shall not be responsible for any damages arising
out of the use of, or otherwise related to, this publication or any other materials. Nothing contained in this publication
is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or
licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM
software.

References in this presentation to IBM products, programs, or services do not imply that they will be available in all
countries in which IBM operates. Product release dates and/or capabilities referenced in this presentation may
change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to
be a commitment to future product or feature availability in any way. Nothing contained in these materials is intended
to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific
sales, revenue growth or other results.

IBM, the IBM logo, Lotus, Lotus Notes, Notes, Domino, Quickr, Sametime, WebSphere, UC2, PartnerWorld and
Lotusphere are trademarks of International Business Machines Corporation in the United States, other countries, or
both. Unyte is a trademark of WebDialogs, Inc., in the United States, other countries, or both.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe
Systems Incorporated in the United States, and/or other countries.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries,
or both.

Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel Centrino, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered
trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company,
product, or service names may be trademarks or service marks of others.
. 43


IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal
without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or
legal obligation to deliver any material, code or functionality. Information about potential future
products may not be incorporated into any contract. The development, release, and timing of any
future features or functionality described for our products remains at our sole discretion.
.

44


Dynacache in WebSphere Portal Server

More Related Content

Dynacache in WebSphere Portal Server