Microsoft Financial Services

Developer Conference 2004

What’s New in SQL
Server 2005?

Roger Wolter
Program Manager
SQL Server Engine
Microsoft Corporation
SQL Server “Yukon”
The scalable, secure, enterprise-class data management platform

 Scalability, availability, security advancements

Enterprise Data  Storage of all data types, formats
Management  Focus on ease-of-use

 Leverage existing development skills

 Share data across any platform
Programmability
 Provide end-to-end development tools

 Scalable, comprehensive solution

Business
 Real time decision making tools
Intelligence
 Extend information to employees, partners
Manageability - Tools
 New: SQL Server Workbench
 New Rich GUI
 Visual Studio Based UI
 Support all SQL Server components
 New: Management Objects (SMO)
 Managed code, new design patterns
 New: SQLCMD
 High Performance CMDLine
 New: SQLMail Replacement
 SMTP Support, Cluster Support, Asynchronous
 Improved: SQLAgent

Manageability
 Dynamic Server Configuration
 Goal: No Server restarts
 E.g. CPU Affinity doesn’t require re-start
 Events
 Async events on DDL
 Can be surfaced as WMI events
 Triggers on DDL
 Dedicated Admin Connection
 DBA access to Server regardless of load
 No restart to kill runaway session
Manageability
 New Metadata Catalogue
 More complete Information
 Read Only
 Dynamic Management Views
 Views of Internal State
 >25 New Views in Yukon
Availability
Improving repair
 Backup improvements
 All datatypes (full text indices, cubes ...)
 Filegroup granularity for simple recovery
 Data backups don’t block Log backups
 Fine-grained Online Repairs
 Media reliability (CheckSums)
 Backup Media Mirroring
 Online Restore
 Restore/recovery improvements
 Online: Page, file, filegroup granularity
 Much shorter outage at software upgrade
Recovery - Resource
Redo committed Undo incomplete xactions
database
Partitions
 Partition Tables + Indices by range
 Transparent to applications
 Can add, drop, split, merge partitions
in seconds.
 Create new filegroup F
 Create empty version of the table F.T (no keys)
 Heap load F.T
 Index F.T
 Now add F.T to online table T (takes a second)

Table T Table T

A B C D E F F
Availability: Mirrored Systems
 How do you deal with catastrophe
 Fire, flood, storm, earthquake, power/net breakdown?
 Data center move
 Sabotage, Gremlins?
 Cluster failover can take minutes Witness
 What if I want 5 -9s? (5 minutes/year)
 Mirrored Systems
Two independent systems Primary Mirror
 Replicas of one another
 Continuous SQL log shipping
 Mirror tracks primary
 Witness breaks ties
 Easy to configure and admin
Database Mirroring
Witness

 Database failover –
Failed
Repaired
Instant standby Primary
Primary
New
Mirror
Primary

 Very fast … < 3 seconds

 Automatic or manual
 Automatic re-sync after failover
 Automatic and transparent
client redirect
 No single point of failure
 No special hardware; standard computers
and storage
 Minimal impact to transaction throughput
Availability
 Online Index build
 Build index in background (table always up)
(also works for rebuild/drop)
 No table lock – good for foreign keys too
 Not for XML Indexes
 Database View: Read-only copy of DB
Security
 Catalog and Metadata security
 See only what you have access to
 User / Schema separation
 Password Policy enforcement
 Password strength, expiration
 Certificate Based Authentication
 All permissions grantable
Full-Text Search
 Performance improvements in Yukon
 Indexing Performance:
 Building Full-Text indexes is two orders of magnitude
faster
 Query Performance:
 Query performance has also improved considerably
(Full-Text queries are 30-50% faster)
 Sort by rank setting now allows extremely fast
FREETEXT-based queries
 Scalability
 Yukon Full-Text Search is capable of handling
large amounts of data
 Tested up to 2,000,000,000 rows of data
 Time to index scales nearly linearly with size of data
TSQL Enhancements
 Snapshot Isolation
 Readers don’t wait for writers
 Conflict detection
 Recursive Queries
 Pivot and Unpivot
 Included Index columns
 Synonyms
CLR
 Infrastructure, Integration
 Memory, threads, SQL type library
 Functions, Procedures, Triggers
 User defined Types, Aggregates

 In-Proc Data Access (perf)

 Symmetric data access
 Mid-tier/data tier deployment decision
 Tight integration with Visual Studio
 Authoring, debugging, profiling
Authoring/Debugging/Deploying
 New Visual Studio project type in
“Whidbey” for “Yukon” managed code
 Server debug integration
 Set breakpoints anywhere
 Full debugger visibility
 Single step support:
 Between languages: T-SQL, C#, VB, & C++
 Between deployment tiers:
 E.g. Mid-tier, through SQL Server stored proc call &
back to mid-tier
Data Access
API Enhancements: ADO .NET V2
 Multiple active result sets (MARS)
 Query notifications – for cache invalidation
 Functional parity with ADO (ADOX, etc)
 Asynchronous client access
 XML Data type support
 User Defined Type (UDT) support
SQL Web Services
 Native SOAP access
HTTP.SYS
 Standards based access to
SQL Server
 No client dependency
 Improved Interop
 New “HTTP ENDPOINT”
object
 Configure connection info http://myserver/sql
 Configure authentication Port: 80
 Expose Functions & SPs Integrated Auth
WebMethod
 Expose TSQL Batches
= myDb.dbo.mySP
 Configure WSDL
HTTP Endpoint
 Leverages kernel-mode
listener
XML Support
 XML Datatype
 Columns, Variables, Parameters
 Typed or Untyped
 XML Schema Collections
 XML Indexes
 Indexes on tags, values & paths
 Understood by Optimizer
 XQuery
 Query Instance or Column
 Insert, Update, Delete Extensions
 Nodes() Method
SQL Service Broker
 Platform for building Asynchronous, loosely
coupled database applications
 Queues are now database objects
 Queue locking reduces conflicts and deadlocks
 Dialogs give unprecedented message ordering
assurance
 Ordered across transactions, input applications and
output applications
 New DDL and DML for messaging
 Use the same API’s and tools as SQL
 Activation - the right number of readers running
 Reliable messaging for scale out
SQL Service Broker
 Built into the database
 Single database connection for messaging and
other database operations
 No two-phase commits for transactional
messaging
 Remote Receives from Transactional Queues
 Stored Procedure Activation
 Backup and failover of messages
 Messages have the same integrity guarantees as
other database data - Clusters, Database Mirroring,
etc.
 Shared management platform with database
 Backup, space management, security
Data Types
 Varchar(1-8000), Nvarchar(1-4000),
Varbinary(1-8000)
 Maximum column length still 8,000 bytes
 Rows can now exceed page size
 Varchar(max), Nvarchar(max),
Varbinary(max)
 Can hold greater than 8000 characters / bytes
 Same programming model as limited types
 XML – A full-fledged data type
 UDTs – User-defined Data Types using CLR
Oracle Publishing
Transactional Replication
 Designed specifically for Oracle Publishers
 v8+ on any operating system
 Administered like SQL Server, from SQL Server
 No Oracle side software install necessary
 Requires minimal knowledge of Oracle
 Leverages existing SQL Server skills
 Standard Transactional and Snapshot Publications

Yukon Subscribers
Distributor
HTTPS Synchronization
Merge Replication

Subscriber IIS Publisher/Distributor

-InternetUrl
Replisapi.dll
https://myserver.mydomain.com

Firewall
Other replication changes
 Stand alone replication monitor
 DDL on published objects supported
seamlessly while replicating
 New data types supported
 XML, CLR, varchar/varbinary(max) etc.
 Merge performance improved 2-4x
 New security architecture
 Reporting Services Architecture
Browser Office Custom App

Report Control
Report Processing

Rendering Data Proc.

Web UI Security Services

Data Sources
(SQL, OLE DB, XML/A, (NT, Passport,
XML Web Service Interface Custom)
ODBC, Oracle, Custom)
Report Server

Report Processing

Data Processing Security

Scheduling and
Rendering
Delivery
Output Formats Delivery Targets
(HTML, Excel, (E-mail, SharePoint,
SQL Server Catalog Custom)
PDF, Custom)
 Notification Services Architecture
Subscription Management Application

Subscribers
Data Events Subscriber Devices Notifications External
Subscriptions
Changes Delivery

Event Provider Generator Distributor

File System Email
XSLT
Watcher SQL XSLT File
Event
SQL Server Provider Match CF HttpExt
provider Host Rule .NET Alerts *
Custom CF
Custom EP Custom DP
Data Transformation Svcs
 Major investment
 New ETL pipeline
 Complex data routing
 Scale and performance
 DW & BI Savvy
 Rich transformations
 Integrations with Analysis Services
 Enhanced designer and control flow
 DTS Yukon Architecture
Standard Custom
transforms transforms

Data Source Data

Adapters Destination
Adapters

XML
Sequences
Package
Loops
Task
s XML
Package

Event
Handler
s

Wizards DTS Designer Command Line

Analysis Services
 Unified Dimensional Model
 Integrating relational and OLAP views
 Pro-active caching
 Bringing the best of MOLAP to ROLAP
 Advanced Business Intelligence
 KPIs, MDX scripts, translations, currency…
 Web services
 Native XML/A
Data Mining
 Significant investment
 Important, new algorithms
 Association rules, time series, regression
trees, sequence clustering, neural nets,
Naïve Bayes
 Embedded, integrated, complete
Get what you need
With an MSDN Universal Subscription

Visit the MSDN Table

Learn more
&
Enter a drawing!
© 2004 Microsoft Corporation. All rights reserved.
This presentation is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.