Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
SlideShare a Scribd company logo
a software division of
a software division of
Webinar: Automated Testing of Power BI Reports
Chris Thompson
Senior Solutions Architect
Mike Calabrese
Senior Solutions Architect
Power BI Testing
•About QuerySurge
•BI report testing challenges
•QuerySurge’s BI Tester solution
•Power BI Wizard demo
a software division of
QuerySurge™ a software division of
Agenda
Enterprise Apps /
ERP systems
Data Warehouse
Data Migration
Data Mart
ETL
Data Warehouse
ETL
Source Data
Mainframe
Business Intelligence
& Analytics
C-level executives are using BI &
Analytics to make critical business
decisions with the assumption
that the underlying data is fine
ETL
We know it is not
Big Data Lake
Typical data
issue areas
The Executive Office and Critical Data
QuerySurgeTM
Uses Cases
Data Warehousing Big Data initiatives DevOps/DataOps pipelines
Data Migrations BI & Analytics efforts Enterprise Apps & ERP support
Supported Business Initiatives
200+ Customers in 30 Countries (sample list)
Banking Insurance Consumer Pharma Financial Tech Healthcare
200+ Customers in 30 Countries (sample list)
Automotive Energy Gov’t &
Pub. Services
Higher
Education
Manufacturers Media &
Telecom
Professional
Services
Where QuerySurge fits into your data strategy
a software division of
a software division of
QuerySurge™ a software division of
QuerySurge connects
to any 2 points
at one time
Compares every data set to
find anomalies
…and provides
Data Validation Analytics
How QuerySurgeTM
Works
Source Data Target Data
• Databases
• Data Warehouses
• Flat Files & Excel
• JSON files
• Web Services
• Mainframe files
• Big Data Stores
(Hadoop & NoSQL)
• Data Warehouses
• Business Intelligence
reports
Source
Data
Target
Data
Data Warehouse
ETL
Data Mart
ETL
Source Data Big Data lake BI & Analytics
Testing Point #1 Testing Point #2 Testing Point #3
Data Tester: Tests data movement based on Mapping Requirements
Testing Point #4
Tester tests BI
Reports
ETL Developer: Codes data movement based on Mapping Requirements
BI User extracts
data for reports
Data Process: Developer & Tester
Web-based…
Supported OS...
Connects through…
…to 200+ JDBC compliant data sources
Installs on...
…the Cloud
…a VM
…a Bare Metal Server
a software division of
QuerySurge™ a software division of
QuerySurgeTM
Environment
QuerySurge
Controller
QuerySurge Server
DB Server (MySQL)
App Server (Tomcat)
QuerySurge Agents
(Ships with 10 Agents)
Supported Technologies: 200+ data stores
QuerySurge supports all the data stores below (and more) as either a source or target.
Supported Technologies
Databases
Access
Azure Analysis Services
Azure Synapse
Btrieve
DB2
EnterpriseDB
Exasol
Greenplum
Impala
Informix
JDBC-ODBC Bridge
MariaDB
MySQL
Nonstop SQL
Oracle
PostgreSQL
SAP Business One
SAP HANA
SAP Hybris C4C
SQL Analysis Services
SQL Server
SingleStore
Sybase
Sybase IQ
Teradata
xBase
Files & APIs
Amazon S3
Avro
Box
CSV
DigitalOcean
Dropbox
FTP
Google Cloud Storage
Google Drive
HDFS
IBM Cloud Object Storage
JSON
LDAP
Microsoft Dataverse
Microsoft OneDrive
OData
Parquet
Power BI XMLA
REST
RSS
SAS Data Sets
SAS xpt
SFTP
Twilio
Wasabi
XML
Accounting
ADP
Avalara AvaTax
Blackbaud FE NXT
Dynamics GP
Dynamics NAV
Exact Online
FreshBooks
Freshdesk
MYOB AccountRight
QuickBooks
QuickBooks Online
QuickBooks POS
Reckon
SAP Concur
Sage 200
Sage 50 UK
Sage Cloud Accounting
Sage Intacct
TSheets
TaxJar
Workday
Xero
Zoho Books
eCommerce
ADP
Amazon Marketplace
Authorize.Net
BigCommerce
Blackbaud FE NXT
EDGAR Online
Magento
Open Exchange Rates
PayPal
Paylocity
Quandl
SAP Fieldglass
ShipStation
Shopify
Square
Stripe
Wave Financial
WooCommerce
X-Cart
Zuora
eBay
eBay Analytics
Amazon Athena
Amazon DynamoDB
Apache Drill
Apache Hadoop
Avro
Azure Data Catalog
Azure Data Lake
Storage
Azure Table
BigInsights
BigQuery
Cassandra
Cloudant
Cloudera
CockroachDB
Cosmos DB
CouchDB
Couchbase
Databricks
Dremio
Elasticsearch
Google Data Catalog
Google Spanner
GraphQL
HBase
HPCC Systems
HarperDB
Hive
IBM Cloud SQL Query
Kafka
MarkLogic
MongoDB
Parquet
Phoenix
Power BI XMLA
Presto
Redis
Redshift
SAS Data Sets
SAS xpt
Snowflake
Spark
TigerGraph
Vertica
Big Data & NoSQL Marketing
CRM
Workday
Marketing
Act-On
Adobe Analytics
Bing Ads
Facebook
Facebook Ads
Google Ad Manager
Google Ads
Google Analytics
Google Campaign Manager
HubSpot
Instagram
LinkedIn
LinkedIn Ads
Magento
MailChimp
Marketo
Oracle Eloqua
Oracle Sales
Pinterest
SAP BusinessObjects BI
Salesforce Chatter,Einstein,
Marketing,Pardot
SendGrid
Snapchat Ads
Splunk
SurveyMonkey
Twitter
Twitter Ads
YouTube Analytics
BI Reports
Microsoft Power BI
Tableau
IBM Cognos
Microstrategy
Oracle OBIEE
SAP Business Objects
Collaboration
AWS Management
Active Directory
Airtable
Alfresco
Asana
Autify
Azure DevOps
Azure Management
Basecamp
Bugzilla
Confluence
DocuSign
Email
Evernote
Excel
Excel Online
Excel Services
Gmail
Google Calendar
Google Contacts
Google Sheets
HCL Domino
Jira
Jira Service Desk
Kintone
Microsoft Exchange
Microsoft Planner
Microsoft Project
Microsoft Teams
Office 365
OneNote
QuickBase
Raisers Edge NXT
SAP BusinessObjects BI
SAP SuccessFactors
SharePoint
Slack
Smartsheet
Trello
WordPress
Xero WorkflowMax
Zendesk
QuerySurge™ a software division of
a software division of
QuerySurge™ a software division of
BI Report Testing Challenges
BI Report Testing: the Challenge
Most Common Use Cases
1) Compare visualization (and underlying numbers) on
BI report to backend data store(s)
2) Compare one report to another report
3) Ensure reports have been updated correctly
4) Compare to trends & normal business operations
i.e. normal sales by day
a software division of
QuerySurge™ a software division of
It only takes 1 or 2 people saying “I don’t trust the data”
to invalidate a report. That can tank a whole project.
- CIO Magazine
The Most Common Data Validation Method
a software division of
QuerySurge™ a software division of
Most Common Validation Methods
• “Stare & Compare”
• Standard functional automation tools (i.e. Selenium)
Challenge of Testing BI Reports
• BI testing is mostly a manual process
• Increases the workload for testers making it prone
to mistakes.
QuerySurge BI Tester
Provides a successful approach to solving the problem
of testing the data embedded in BI solutions
a software division of
a software division of
QuerySurge™ a software division of
QuerySurge BI Tester
a software division of
QuerySurge supports BI Testing for
the following Business Intelligence solutions:
a software division of
QuerySurge™ a software division of
QuerySurge Power BI Wizard
a software division of
QuerySurge™ a software division of
Power BI Wizard
• No code solution for testing data within
Power BI visualizations
• Quickly and easily create queries against
Power BI reports
• Ability to pass slicer settings to Power BI
report - allowing for filter testing and
validation
QuerySurge Power BI Wizard
Microsoft
Power BI report
QuerySurge
Design Time Run
QuerySurge
Runtime Dashboard
Data Failures
Found (red)
QuerySurge BI Tester
a software division of
QuerySurge™ a software division of
a software division of
QuerySurge Demo
a software division of
QuerySurge™ a software division of

More Related Content

Automated Testing of Microsoft Power BI Reports

  • 1. a software division of a software division of Webinar: Automated Testing of Power BI Reports Chris Thompson Senior Solutions Architect Mike Calabrese Senior Solutions Architect Power BI Testing
  • 2. •About QuerySurge •BI report testing challenges •QuerySurge’s BI Tester solution •Power BI Wizard demo a software division of QuerySurge™ a software division of Agenda
  • 3. Enterprise Apps / ERP systems Data Warehouse Data Migration Data Mart ETL Data Warehouse ETL Source Data Mainframe Business Intelligence & Analytics C-level executives are using BI & Analytics to make critical business decisions with the assumption that the underlying data is fine ETL We know it is not Big Data Lake Typical data issue areas The Executive Office and Critical Data
  • 4. QuerySurgeTM Uses Cases Data Warehousing Big Data initiatives DevOps/DataOps pipelines Data Migrations BI & Analytics efforts Enterprise Apps & ERP support Supported Business Initiatives
  • 5. 200+ Customers in 30 Countries (sample list) Banking Insurance Consumer Pharma Financial Tech Healthcare
  • 6. 200+ Customers in 30 Countries (sample list) Automotive Energy Gov’t & Pub. Services Higher Education Manufacturers Media & Telecom Professional Services
  • 7. Where QuerySurge fits into your data strategy a software division of a software division of QuerySurge™ a software division of
  • 8. QuerySurge connects to any 2 points at one time Compares every data set to find anomalies …and provides Data Validation Analytics How QuerySurgeTM Works Source Data Target Data • Databases • Data Warehouses • Flat Files & Excel • JSON files • Web Services • Mainframe files • Big Data Stores (Hadoop & NoSQL) • Data Warehouses • Business Intelligence reports Source Data Target Data
  • 9. Data Warehouse ETL Data Mart ETL Source Data Big Data lake BI & Analytics Testing Point #1 Testing Point #2 Testing Point #3 Data Tester: Tests data movement based on Mapping Requirements Testing Point #4 Tester tests BI Reports ETL Developer: Codes data movement based on Mapping Requirements BI User extracts data for reports Data Process: Developer & Tester
  • 10. Web-based… Supported OS... Connects through… …to 200+ JDBC compliant data sources Installs on... …the Cloud …a VM …a Bare Metal Server a software division of QuerySurge™ a software division of QuerySurgeTM Environment QuerySurge Controller QuerySurge Server DB Server (MySQL) App Server (Tomcat) QuerySurge Agents (Ships with 10 Agents)
  • 11. Supported Technologies: 200+ data stores QuerySurge supports all the data stores below (and more) as either a source or target. Supported Technologies Databases Access Azure Analysis Services Azure Synapse Btrieve DB2 EnterpriseDB Exasol Greenplum Impala Informix JDBC-ODBC Bridge MariaDB MySQL Nonstop SQL Oracle PostgreSQL SAP Business One SAP HANA SAP Hybris C4C SQL Analysis Services SQL Server SingleStore Sybase Sybase IQ Teradata xBase Files & APIs Amazon S3 Avro Box CSV DigitalOcean Dropbox FTP Google Cloud Storage Google Drive HDFS IBM Cloud Object Storage JSON LDAP Microsoft Dataverse Microsoft OneDrive OData Parquet Power BI XMLA REST RSS SAS Data Sets SAS xpt SFTP Twilio Wasabi XML Accounting ADP Avalara AvaTax Blackbaud FE NXT Dynamics GP Dynamics NAV Exact Online FreshBooks Freshdesk MYOB AccountRight QuickBooks QuickBooks Online QuickBooks POS Reckon SAP Concur Sage 200 Sage 50 UK Sage Cloud Accounting Sage Intacct TSheets TaxJar Workday Xero Zoho Books eCommerce ADP Amazon Marketplace Authorize.Net BigCommerce Blackbaud FE NXT EDGAR Online Magento Open Exchange Rates PayPal Paylocity Quandl SAP Fieldglass ShipStation Shopify Square Stripe Wave Financial WooCommerce X-Cart Zuora eBay eBay Analytics Amazon Athena Amazon DynamoDB Apache Drill Apache Hadoop Avro Azure Data Catalog Azure Data Lake Storage Azure Table BigInsights BigQuery Cassandra Cloudant Cloudera CockroachDB Cosmos DB CouchDB Couchbase Databricks Dremio Elasticsearch Google Data Catalog Google Spanner GraphQL HBase HPCC Systems HarperDB Hive IBM Cloud SQL Query Kafka MarkLogic MongoDB Parquet Phoenix Power BI XMLA Presto Redis Redshift SAS Data Sets SAS xpt Snowflake Spark TigerGraph Vertica Big Data & NoSQL Marketing CRM Workday Marketing Act-On Adobe Analytics Bing Ads Facebook Facebook Ads Google Ad Manager Google Ads Google Analytics Google Campaign Manager HubSpot Instagram LinkedIn LinkedIn Ads Magento MailChimp Marketo Oracle Eloqua Oracle Sales Pinterest SAP BusinessObjects BI Salesforce Chatter,Einstein, Marketing,Pardot SendGrid Snapchat Ads Splunk SurveyMonkey Twitter Twitter Ads YouTube Analytics BI Reports Microsoft Power BI Tableau IBM Cognos Microstrategy Oracle OBIEE SAP Business Objects Collaboration AWS Management Active Directory Airtable Alfresco Asana Autify Azure DevOps Azure Management Basecamp Bugzilla Confluence DocuSign Email Evernote Excel Excel Online Excel Services Gmail Google Calendar Google Contacts Google Sheets HCL Domino Jira Jira Service Desk Kintone Microsoft Exchange Microsoft Planner Microsoft Project Microsoft Teams Office 365 OneNote QuickBase Raisers Edge NXT SAP BusinessObjects BI SAP SuccessFactors SharePoint Slack Smartsheet Trello WordPress Xero WorkflowMax Zendesk
  • 12. QuerySurge™ a software division of a software division of QuerySurge™ a software division of BI Report Testing Challenges
  • 13. BI Report Testing: the Challenge Most Common Use Cases 1) Compare visualization (and underlying numbers) on BI report to backend data store(s) 2) Compare one report to another report 3) Ensure reports have been updated correctly 4) Compare to trends & normal business operations i.e. normal sales by day a software division of QuerySurge™ a software division of It only takes 1 or 2 people saying “I don’t trust the data” to invalidate a report. That can tank a whole project. - CIO Magazine
  • 14. The Most Common Data Validation Method a software division of QuerySurge™ a software division of Most Common Validation Methods • “Stare & Compare” • Standard functional automation tools (i.e. Selenium) Challenge of Testing BI Reports • BI testing is mostly a manual process • Increases the workload for testers making it prone to mistakes.
  • 15. QuerySurge BI Tester Provides a successful approach to solving the problem of testing the data embedded in BI solutions a software division of a software division of QuerySurge™ a software division of
  • 16. QuerySurge BI Tester a software division of QuerySurge supports BI Testing for the following Business Intelligence solutions: a software division of QuerySurge™ a software division of
  • 17. QuerySurge Power BI Wizard a software division of QuerySurge™ a software division of Power BI Wizard • No code solution for testing data within Power BI visualizations • Quickly and easily create queries against Power BI reports • Ability to pass slicer settings to Power BI report - allowing for filter testing and validation
  • 18. QuerySurge Power BI Wizard Microsoft Power BI report QuerySurge Design Time Run QuerySurge Runtime Dashboard Data Failures Found (red)
  • 19. QuerySurge BI Tester a software division of QuerySurge™ a software division of
  • 20. a software division of QuerySurge Demo a software division of QuerySurge™ a software division of