20190615 hkos-mysql-troubleshootingandperformancev2

The document describes how to perform point-in-time recovery (PITR) with MySQL to restore data to a past state. It requires binary logs to be enabled and backups kept along with binlogs. The procedure involves restoring the last backup, finding the binlog position, and replaying binlog events from that position up to the desired point in time. An example demonstrates restoring data after an accidental update, identifying the binlog position to recover to using SHOW BINLOG EVENTS.

MySQL 8.0 adds a lot of new Unicode collations. Why use unicode, what are collations and how to migrate to utf8mb4.

This document outlines the agenda and steps for a hands-on tutorial on MySQL InnoDB Cluster and Group Replication. The agenda includes preparing the workstation by setting up virtual machines, an overview of MySQL InnoDB Cluster and Group Replication, migrating from a master-slave topology to Group Replication, monitoring Group Replication, and application interaction with Group Replication. The first lab demonstrates the current master-slave setup. The migration plan involves installing MySQL InnoDB Cluster on a new server, restoring a backup, setting up asynchronous replication on the new server, adding it to the Group Replication group, pointing the application to a new node, and stopping asynchronous replication after catch up.

This document provides an introduction to MySQL InnoDB Cluster, which is MySQL's solution for high availability and scaling. It discusses how Group Replication, the heart of MySQL InnoDB Cluster, allows data to be written simultaneously across cluster nodes while maintaining consistency through techniques like conflict detection and resolution. The document also explains how Group Replication provides automatic recovery from failures and makes high availability easy for users to setup and manage.

The document discusses using MySQL as a document store by leveraging its support for JSON data and the X Plugin & X Protocol. It outlines the requirements for doing so, including supporting JSON data types, CRUD operations, an extended protocol, and the MySQL Shell. Examples are provided of migrating data from MongoDB to MySQL and performing queries and CRUD operations on the JSON documents.

The document discusses MySQL InnoDB Cluster, which provides high availability and scaling features for MySQL. It uses Group Replication under the hood, which allows data to be written simultaneously across cluster nodes while maintaining consistency. By default, MySQL InnoDB Cluster runs in Single Primary Mode, where one node acts as the primary/writable node and others act as hot standbys through an automated leader election process.

The document discusses innovations and new features in MySQL from versions 5.7 to 8.0. Key points include: - MySQL 5.7 introduced performance improvements, security enhancements, and JSON support. MySQL InnoDB Cluster provided out-of-the-box high availability. - MySQL 8.0 focuses on boosting developer productivity with features like common table expressions, window functions, and improved handling of hot rows. It also makes scaling easier through improved observability and parallel replication. - The vision is to deliver a fully-integrated solution with relational and document storage, built-in high availability, and scale-out capabilities through sharding and replication. This will be achieved in steps, with Group Re

Introduction to MySQL InnoDB Cluster, the native MySQL HA solution. This session was delivered at Percona Live Europe 2017 in Dublin

The document provides an overview of using Python to connect to and query a MySQL database configured for high availability. It discusses MySQL replication, group replication, and connectors that enable multi-host connections. It also demonstrates connecting to MySQL from Python, executing queries, handling errors, and implementing a simple web application using Flask that connects to MySQL to call a stored procedure.

Spring and Cassandra are two of the leading technologies for building cloud native applications. In this talk by the project leads for Spring Data and the Cassandra Java Driver, we’ll cover the recent improvements in the latest and greatest versions of Spring Boot, Spring Data Cassandra, Cassandra 4.0 and the Cassandra Java driver. Whether you’re a novice, intermediate, or expert developer, this content will help you get started or migrate your existing application to the latest innovations. We’ll illustrate these new concepts with code samples and snippets that you can find on GitHub to help you get things done faster with these tools.

The document discusses upcoming changes and new features in MySQL 5.7. Key points include: - MySQL 5.7 development has focused on performance, scalability, security and refactoring code. - New features include online DDL support for additional DDL statements, InnoDB support for spatial data types, and cost information added to EXPLAIN output. - Benchmarks show MySQL 5.7 providing significantly higher performance than previous versions, with a peak of 645,000 queries/second on some workloads.

Percona Live Hands-on Tutorial on MySQL InnoDB Cluster : How to migrate from master-slave setup to better HA with MySQL InnoDB Cluster

Elastic scalability, the ability to quickly adapt to changing demands for resources, is critical to running modern applications. Both over- and underallocation of resources have an impact on a business’s bottom line. OpenStack is a cloud operating system that achieves elastic scalability by managing the allocation of compute, storage, and network resources. MySQL Fabric is a new member of the community enabling large database systems to be managed easily, providing support for handling high availability and sharding. In this session, you will learn how to leverage OpenStack and MySQL Fabric to build a system in which resources can be added on demand, providing elastic scalability, sharding, and high availability as a single system.

The document discusses several new features and improvements in MySQL 8.0, including a transactional data dictionary, persisted server configuration, MySQL roles for access control, common table expressions and window functions for developers, and continued enhancements for JSON, UUID, security, replication, and GIS. It also outlines the goals for MySQL InnoDB Cluster to provide an integrated high availability and scaling solution.

This document provides an overview and agenda for a presentation on database sharding. It discusses how sharding can help with scaling databases to handle increasing load. It describes the key components of a sharded database solution like shards, switches, and state stores. It also covers important aspects of implementing sharding like transaction handling, mapping sharding keys, and handling queries across sharded tables.

The document discusses migrating data from MySQL to Cassandra. It provides an overview of MySQL and its capabilities as a relational database. It then discusses big data and NoSQL databases like Cassandra that are suited for large, distributed datasets. The document outlines the steps to use Sqoop to import data from MySQL tables into Cassandra tables, maintaining the row keys. It provides references for further information on MySQL, Cassandra, and migrating between the two databases.

This document provides an overview of MySQL 5.7's new and improved GIS capabilities. It begins with introductions to geographic information systems and common GIS concepts. It then outlines the key new features in MySQL 5.7, such as its integration of Boost.Geometry for geometry representations and comparisons. The document also provides examples of how GIS data can be imported and analyzed using MySQL, and concludes with suggestions for further enhancements to MySQL's GIS functionality.

You are an IT manager or Oracle DBA, comfortable and successful with your knowledge of how to keep an Oracle database up and running. One day, you find out you’ll now be supporting a popular MySQL database application. No one in your team has MySQL expertise and you have no budget to hire. This slides covers the different use cases for MySQL and Oracle Database, as well as the tools to manage both databases. Additionally, the presentation spotlights top MySQL solutions for high availability, disaster recovery, and high-level security to protect your databases and business. You’ll also see the advantages of managing a MySQL database side by side with an Oracle database in the Oracle Public Cloud with the push-button ease of the MySQL Cloud Service.

This is an in-depth introduction to MySQL Performance Tuning. We will review best practices, the most important configuration options, discuss the initial MySQL configuration file, monitoring, and more! Learn how to find the queries most in need of optimization using performance reports in MySQL Workbench, MySQL Enterprise Monitor, or through the sys schema.

This document discusses how Oracle Enterprise Manager can be used to manage MySQL databases. It provides an overview of how MySQL Enterprise Monitor and Oracle Enterprise Manager integrate to provide monitoring of MySQL performance metrics, configuration monitoring, replication monitoring, query analysis, security management, and other capabilities from a single dashboard. It also discusses how to install and set up both MySQL Enterprise Monitor and the Oracle Enterprise Manager MySQL plugin.

A presentation of a Kafka, Spark, Redis based streaming Solution shown in Oracle Code 2017 Bangalore event

This document provides an overview and agenda for a presentation on Python and the MySQL Document Store. The presentation introduces JSON and how MySQL works with JSON documents, the MySQL Document Store and X DevAPI, and provides code examples for interacting with document collections using Connector/Python, including creating a collection, adding, finding, modifying, and removing documents.

presentation video: https://www.youtube.com/watch?v=mhravU1HL4k One of the lesser-known features coming with JDK 9 is experimental support for ahead-of-time (AOT) compilation. Compiling Java bytecode into ready-to-execute machine code before runtime means that many applications may benefit from quicker startup and, in the case of multiple JVM instances, even lower memory consumption. In this demo-heavy session, you will see what advantages AOT has to offer and, perhaps even more importantly, what its limitations are. You will also get the opportunity to see Java’s new AOT compilation in action and leave with the knowledge needed to experiment on your own later. Although Java’s AOT is not yet ready for production use, this is a great chance to get a sneak peek at one of HotSpot’s most exciting new technologies.

Priscila Galvao, a MySQL Solutions Engineer, presented on disaster recovery options for MySQL data. The presentation discussed how backup is the first step but not sufficient on its own for protection against disasters. It introduced disaster recovery plans and options like cloud backup and disaster recovery to Oracle Cloud's MySQL service in active-standby or active-active configurations. Benefits highlighted included conserving resources, faster response times, flexibility, security, and support.

GraphPipe is an open source protocol and collection of software designed to simplify machine learning model deployment and decouple it fromframework-specific model implementations.

Come to this session and experience a deep-dive into what you really need to know to may your DBA career thrive in an autonomous-driven world. Create cloud-scale automation; assess, score, and remediate IT and business compliance violations , get real-time insights into log data to find anomalies and ensure early detection of potential problems; and enable rapid detection, investigation, and remediation of the range of security threats across databases Features around the self-driving, self-securing, and self-repairing capabilities available across data management, application development, analytics, security and management. how DBAs can easily configure log collection and efficiently analyze logs from their database environment to rapidly troubleshoot problems. See how to use simple analysis to easily find errors across different log sources. Experience the power of machine learning techniques to rapidly identify anomalies that can lead to a problem’s root cause and eliminate finger-pointing. To use machine learning techniques to identify performance issues , steady windows for maintenance activities.

We are entering a new era in the database with the introduction of the Oracle Autonomous Database. AI and Machine Learning are center stage to most projects and assist in making complex decisions which was not possible before. Most data science projects don’t get beyond the data scientist and rarely operationalize their predictive models. there are new toolsets and methods available everyday which make this an extremely dynamic space. There are different categories of users who want to use the algorithms , the toolsets but don't know where to start. Whether you are a data scientist who wants to play with data and build your own models or make use of the database features with the built in models or use the specific AI services within a specific vertical such as Insurance or Healthcare . We will take a glimpse at Oracle's Machine Learning Zeppelin-based notebooks for Oracle Autonomous Data Warehouse Cloud to how Oracle uses AIOps and Applied Machine learning for its own operations and the Oracle AI Platform Cloud Service to provided an all rounded view of what Oracle is upto in this space

The document discusses machine learning and provides an introduction to key concepts. It describes common machine learning algorithms like classification, clustering, and regression. It also discusses neural networks and how they are modeled after the brain. The document outlines tools that can be used for machine learning projects and highlights features of Oracle's machine learning and autonomous data warehouse products.

MySQL Group Replication is a new plugin that implements an exciting extension to the proven and long standing MySQL Replication technology. It leverages advanced distributed protocols to ultimately provide to the end user features such as data replication, high availability, split brain protection and automation. It can be deployed in single-primary mode (default), in which primary fail-over is handled gracefully and automatically, or in multi-master mode, in which row level conflicts are detected and handled automatically as well. Regardless of the deployment mode, the end result is that this new addition provides a consistent and dependable replicated state machine, thus effectively enabling a fault-tolerant MySQL database service. At the end of the presentation, you will be able to understand how it works, the use cases it address, its limitations and also its roadmap ahead. Moreover, you will get to know how it fits in the overall high availability roadmap at MySQL.

The document discusses performance improvements in MySQL 5.7 compared to previous versions. Key points include: - MySQL 5.7 is up to 3 times faster than MySQL 5.6 and 6 times faster than 5.5 according to benchmarks. Faster performance is achieved through improvements to the InnoDB storage engine, new optimizer cost model, and other enhancements. - New features in 5.7 like parallel replication, native JSON support, and InnoDB spatial indexing improve performance for specific use cases like replication, JSON querying, and GIS searching. - The MySQL Router was introduced as a way to route connections and transactions for increased performance, high availability, and scalability.

This document discusses various topics related to MySQL administration including access control, diagnostic data, log files, and backups. It provides examples of how to configure user accounts and privileges using commands like CREATE USER, ALTER USER, GRANT, and REVOKE. It also explains how to view diagnostic information using SHOW commands, the INFORMATION_SCHEMA, and the SYS schema. Finally, it covers MySQL's different log files and various options for logical and physical backups.

MySQL 5.7 is GA! Here is the news about many of the new features that we can use in MySQL's latest version.

The document is a presentation on streaming solutions for real-time problems using Apache Kafka, Kafka Streams, and Redis. It begins with an introduction and overview of the technologies. It then presents a sample monitoring application using metrics from multiple machines as a use case. The presentation demonstrates how to implement this application using Kafka as the event store, Kafka Streams for processing, and Redis as the state store. It also shows how to deploy the application components on Oracle Cloud.

This document provides an overview of MySQL server performance tuning. It discusses laying the foundation for performance tuning by examining the server, OS, network and filesystem. It also covers examining current server settings and status variables, and tuning various aspects of MySQL like InnoDB, MyISAM, queries and session settings. The document aims to provide guidance on areas to optimize to improve MySQL server performance.

Introduction to, and highlights about, MySQL, from the perspective of an Oracle DBA. Contains many pointers and references for further study.

MySQL's NDB Cluster is a partitioned distributed database engine that is entirely build around a parallel virtual machine with an event driven asynchronous design. Using this design NDB can execute even single queries in parallel and scales linearly handling terabytes of sharded data in a real-time fashion.

MySQL InnoDB cluster provides a complete high availability solution for MySQL. MySQL Shell includes AdminAPI which enables you to easily configure and administer a group of at least three MySQL server instances to function as an InnoDB cluster. Each MySQL server instance runs MySQL Group Replication, which provides the mechanism to replicate data within InnoDB clusters, with built-in failover. MySQL Router can automatically configure itself based on the cluster you deploy, connecting client applications transparently to the server instances.

The document discusses the MySQL Operator for Kubernetes, which allows users to run MySQL clusters on Kubernetes. It provides an overview of how the operator works using the Kopf framework to create Kubernetes custom resources and controllers. It describes how the operator creates deployments, services, and other resources to set up MySQL servers in a stateful set, a replica set for routers, and monitoring. The document also provides instructions for installing the MySQL Operator using Kubernetes manifests or Helm.

Using MySQL Shell toolbox with Python Shell API, XDevAPI, Admin API, Utilitiy Supporting JS, SQL and Python

The document discusses MySQL high availability options including: 1) Asynchronous and semi-synchronous replication for high availability deployments. 2) MySQL InnoDB Cluster which uses Group Replication, MySQL Router, and MySQL Shell to provide an integrated high availability solution. 3) Examples of deploying MySQL InnoDB Cluster in single and multi-data center configurations for high availability and disaster recovery.

This document discusses deploying MySQL InnoDB Cluster for high availability. It provides an overview of MySQL InnoDB Cluster and compares it to other MySQL and Oracle high availability solutions. It then covers topics like MySQL InnoDB Cluster architecture, example deployments, configuration settings for replication, failover consistency, network reliability and adding replicas. Finally, it discusses MySQL Router configuration and using MySQL Shell and MySQL Enterprise Backup for management and recovery.

The document discusses the MySQL Document Store, which allows storing and querying JSON documents in MySQL databases. It introduces the components of the MySQL Document Store, including the MySQL server, JSON data type, X Plugin, X Protocol, X DevAPI, MySQL Shell and connectors. The X DevAPI provides a modern CRUD interface for working with document collections and documents. Documents can be accessed and queried using both the NoSQL-style X DevAPI and traditional SQL.