This document provides an overview of Virtual SAN (VSAN) including:
- VSAN aggregates local flash and HDDs across ESXi hosts into a shared datastore for VMs. It provides software-defined storage that is integrated with VMware's stack.
- VSAN's goals are to provide compelling TCO through reduced CAPEX/OPEX and be the software-defined storage for all VMware products through strong integration.
- The document discusses VSAN architecture, deployment, scaling, performance, resiliency, and management.
This document provides an overview and update on the latest NSX network virtualization capabilities from VMware. It discusses both current NSX features such as physical network integration, encapsulations, service chaining, and multi-site network virtualization as well as potential future directions. Key points covered include using Geneve as a tunneling protocol, handling elephant flows, and challenges around multi-site network virtualization across geographically dispersed data centers.
VMworld Europe 2014: What’s New in End User Computing: Full Desktop Automatio...VMworld
This document discusses integrating VMware's cloud orchestration and desktop virtualization products. It begins with an agenda for the presentation and then discusses the goal of using cloud and automation to enable organizations. It describes how integrating vCloud Automation Center (vCAC) and VMware Horizon View can provide workflow control, approval tracking, and self-service for end users and delegated administrators. The rest of the document covers prerequisites, configuring workflows in vCenter Orchestrator, lessons learned, and frequently asked questions about the integration.
A day in the life of a VSAN I/O - STO7875Duncan Epping
This document provides an overview and summary of a VMworld session about Virtual SAN I/O. The session covers Virtual SAN concepts, the I/O flow of reads and writes in Virtual SAN, failure scenarios and how Virtual SAN handles them, and new features like deduplication and compression. The document includes diagrams demonstrating how data is distributed and replicated across hosts in a Virtual SAN cluster. It also provides details on how reads, writes, and failures are handled at a technical level in Virtual SAN. In the conclusion, it recommends three ways for attendees to get started with Virtual SAN: a hands-on lab, 60-day free evaluation, or working with a VMware partner on an assessment.
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld
The document discusses the future of software-defined storage in 3 years. It predicts that storage media will continue to advance with higher capacities and lower latencies using technologies like 3D NAND and NVDIMMs. Networking and interconnects like NVMe over Fabrics will allow disaggregated storage resources to be pooled and shared across servers. Software-defined storage platforms will evolve to provide common services for distributed data platforms beyond just block storage, with advanced data placement and policy controls to optimize different workloads.
Five common customer use cases for Virtual SAN - VMworld US / 2015Duncan Epping
This session was presented by Lee Dilworth and Duncan Epping at VMworld in the US in 2015. Five common customer use cases of the last 12-18 months are discussed in this deck.
Virtual SAN (VSAN) is a hypervisor-converged storage solution from VMware that radically simplifies storage. It pools server-attached flash, SSD, and HDD storage and manages it through storage policies from the vSphere client. VSAN is integrated with vSphere and provides high performance, resilience against hardware failures, and linear scalability. It can reduce both capital and operating expenses compared to traditional external storage arrays.
This document provides an overview and introduction to VMware Virtual SAN (VSAN). It discusses the VSAN architecture which uses SSDs for caching and HDDs for storage. It also covers how VSAN can be configured through storage policies assigned at the VM level. The document outlines how VSAN provides a software-defined storage solution that is hardware agnostic and can elastically scale storage performance and capacity by adding servers and disks.
VMworld Europe 2014: Taking Reporting and Command Line Automation to the Next...VMworld
The document provides an overview and introduction to PowerCLI 5.8 R1. It discusses new features such as enhanced storage policy based management cmdlets, improved OVF/OVA deployment capabilities, updated reporting functionality for vSphere, SRM and vCloud, and integration options using REST APIs, files and CMDB integration. Examples are provided for storage policies, statistics toolbox and desired state configuration. The presentation encourages developing scripts iteratively from initial ideas to reusable functions and emphasizes learning from external resources.
This document provides an overview of VMware's EVO:RAIL hyper-converged infrastructure appliance. It discusses how EVO:RAIL delivers unique capabilities and value by starting from vSphere and Virtual SAN. It also outlines EVO:RAIL's key features, use cases, pricing and packaging, and roadmap for future versions including preview information about EVO:RAIL 2.0.
This document provides an overview of VMware Virtual SAN 6.0, including:
- Virtual SAN can be deployed with a hybrid or all-flash architecture to provide high performance.
- Virtual SAN is embedded in the vSphere kernel for simple management and integration.
- Virtual SAN 6.0 provides 4x performance, 2x scale, and new features like snapshots and encryption.
- Case studies show Virtual SAN can reduce storage costs by 60% and management time by 90%.
VMware Virtual SAN 6.0 includes the following new features and improvements:
1. Increased performance and scalability with support for up to 64 hosts and 9,000 components per host. Virtual machines can now have VMDKs up to 62TB in size.
2. Enhanced all-flash and hybrid architectures with new caching architectures that deliver up to 90,000 IOPS per host.
3. Usability improvements like default storage policies, visualization of storage utilization in policies, and a resynchronization status dashboard.
4. Failure resilience enhancements such as fault domains that account for failures across racks, and proactive rebalancing to leverage new nodes.
VMworld Europe 2014: Customer Panel - Going Beyond Server VirtualizationVMworld
This document provides an overview of new VMware technologies for small and midsize businesses and outlines the agenda for the presentation, including:
1. Solutions beyond server virtualization
2. A customer panel discussing how they virtualized, automated, and connected their infrastructure
3. A question and answer session
4. Next steps
The presentation notes that 65 million servers worldwide are already virtualized and that VMware aims to simplify IT for small and midsize businesses through automating management, enabling connectivity and access from any device, and virtualizing servers and desktops.
STO7535 Virtual SAN Proof of Concept - VMworld 2016Cormac Hogan
This document provides an overview of tools that can help administrators successfully conduct a Virtual SAN proof of concept. It discusses the Virtual SAN Health Check plugin, capacity views, performance service, HCIbench, and Virtual SAN Observer for monitoring and validating Virtual SAN configurations. Validation scenarios covered include successfully deploying Virtual SAN, deploying VMs on VSAN storage, VM availability during host and storage failures, and measuring rebuild activity.
VMworld 2015: Site Recovery Manager and Policy Based DR Deep Dive with Engine...VMworld
Policy based management greatly simplifies the work of IT Administrators making it easy to ensure that applications and VMs receive the resources, protection and functionality required. Learn about the latest enhancements of Site Recovery Manager in this space, which represent a huge step towards providing policy based DR. In this session we'll dive deep into how this approach works and how to work with them.
This document provides an overview of the MRSCAPS design framework and how it can be applied to analyze VMware Virtual SAN (VSAN). It discusses VSAN considerations for each element of MRSCAPS: manageability using the vSphere console and health check plugin; recoverability through backups and replication; security with additional encryption options; cost based on licensing models; availability leveraged through storage policies and HA; performance through hardware optimizations and flash configurations; and scalability to large clusters and additional hosts. The presentation includes screenshots and concludes with a Q&A session.
The popularity of Virtual SAN is growing daily. Server admins are finally free to aggregate storage in their servers to create a shared storage system that scales with their compute needs. The underlying key to making it all work is networking. All Virtual SAN data flows through it, and correct selection and configuration of networking components will mean the difference between disruptive success or dramatic failure. This session will give deep insight in the do's and don'ts of Virtual SAN networking. Best practices for physical and virtual switch configuration and performance testing will be discussed. Virtual SAN 5.5 and 6.0 will be covered, and the networking differences discussed. Methods of troubleshooting network issues will be covered. For those configuring a Virtual SAN network for the first time, for labs or enterprise scale, this session is a must-see.
VMworld 2014: Virtual SAN Architecture Deep DiveVMworld
This document provides an overview of VMware's Virtual SAN architecture. It discusses Virtual SAN's goals of being easy to manage, providing compelling TCO, and being strongly integrated with VMware products. It describes how Virtual SAN aggregates local flash and HDDs to provide a shared datastore. It also covers topics like Virtual SAN's distributed architecture, scaling capabilities, storage policies, deployment considerations, resiliency features, and monitoring tools.
VMware - Virtual SAN - IT Changes EverythingVMUG IT
Virtual SAN is a hyper-converged storage platform that is built into the ESXi hypervisor. It aggregates locally attached flash and disk drives from each ESXi host in a cluster to provide a shared datastore. Virtual SAN provides dynamic capacity and performance scaling. It utilizes storage policies to provide per-VM storage service levels from the single shared datastore. Virtual SAN simplifies storage management by automating control of storage capacity, performance, and availability based on application needs.
Virtual SAN is VMware's hyper-converged infrastructure storage solution that is integrated with vSphere. It provides a software-defined, distributed storage platform that offers policy-based placement and management of virtual machine storage. Version 6.1 introduced new features like stretched clusters for disaster recovery between sites, support for high-density flash devices, and health monitoring and troubleshooting tools through integration with vRealize Operations. Future enhancements may include RAID 5 and 6 functionality over the network to improve storage efficiency as well as data deduplication and compression.
VMware: Enabling Software-Defined Storage Using Virtual SAN (Technical Decisi...VMware
VMware Virtual SAN is a software-defined storage solution that is built into vSphere and pools flash-based devices and magnetic disks from standard servers into a shared datastore. It delivers high performance, is highly resilient with zero data loss even during hardware failures, and provides a simplified storage management experience through storage policies applied at the virtual machine level. Virtual SAN supports a variety of use cases including virtual desktop infrastructure, test/development environments, and business critical applications through its scale, performance, integration with VMware technologies, and interoperability with solutions such as Horizon View, vSphere Replication, and OpenStack.
This document provides an overview of Virtual SAN design and architecture. It discusses Virtual SAN components such as disk groups, datastores, and objects. It describes how data is distributed across disks groups and hosts using techniques like striping and mirroring. It also covers storage policies and how they determine the layout and number of components for distributed objects. Use cases like all-flash configurations, ROBO solutions, and stretched clusters are explained at a high level.
VMworld 2013: Lowering TCO for Virtual Desktops with VMware View and VMware V...VMworld
VMworld 2013
Jad Chamcham, VMware
Narasimha Krishnakumar, VMware, view, vsan, tco
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
Virtual san hardware guidance & best practicessolarisyougood
This document provides guidance on building and designing Virtual SAN hardware solutions. It discusses considerations for components like boot devices, flash-based devices, and capacity sizing. It also provides an overview of Virtual SAN certified hardware platforms and best practices for designing a balanced and fault-tolerant configuration.
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld
VMworld 2013
Eric Deadwyler, IBM
Joseph Russell, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
VMworld 2013
Christos Karamanolis, VMware
Kiran Madnani, VMware
James Streit, Thomson Reuters
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
The document discusses OnApp's distributed block storage platform built on Xen. It aims to provide affordable enterprise-level storage for cloud providers using commodity hardware. The platform utilizes integrated storage drives within hypervisors managed by storage VMs. Content is replicated across drives and servers for high performance and resilience without a single point of failure. The distributed design allows for scaling of IOPS and capacity without the high costs of traditional SANs.
VMworld 2014: Software-Defined Data Center through Hyper-Converged Infrastruc...VMworld
The document discusses hyper-converged infrastructure solutions from VMware called EVO:RAIL and EVO:RACK. EVO:RAIL provides a hyper-converged appliance that is pre-integrated with VMware software to simplify deployment and management of software-defined data centers. EVO:RACK is a technology preview of a hyper-converged infrastructure solution for data center scale deployments using standard rack-mounted servers. The solutions are available through qualified partners and aim to make it faster and easier to setup and operate a software-defined data center.
What is coming for VMware vSphere?
Delivered at VMUG DK/UK/BE in November 2014. Session is all about vSphere futures, what can be expected in the near future.
VMworld 2013: VMware Virtual SAN Technical Best Practices VMworld
This document provides an overview of VMware Virtual SAN (VSAN) technical best practices. It discusses VSAN's key components, hardware considerations, use cases, management, and demo. VSAN is a software-defined storage solution that clusters direct-attached host storage and provides a virtual SAN datastore. It has integrated management with vSphere and uses capabilities and policies to enable VM-centric storage provisioning and automation. The document demonstrates how to configure VSAN, create VM storage policies, and deploy VMs according to policies and capabilities.
VMworld 2013: Cisco, VMware and Hyper-converged Solutions for the Enterprise....VMworld
VMworld 2013
Roger Barlow, Cisco
Kishan Ramaswamy, Cisco
Alex Jauch, VMware
Learn more about VMworld and register at http://www.vmworld.com/index.jspa?src=socmed-vmworld-slideshare
This document summarizes an event hosted by Assyrus Srl about the evolution of enterprise storage. It discusses VMware Virtual SAN, a hyperconverged storage solution that aggregates locally attached storage from ESXi hosts. It also covers Microsoft Storage Spaces, which allows storage to be created from various types of internal and attached disks. The document provides examples of how Dell has implemented and supported both Virtual SAN and Storage Spaces on its PowerEdge servers and PowerVault storage enclosures to provide hyperconverged infrastructure solutions.
This document provides an overview of the EVO:RAIL hyper-converged infrastructure appliance that is powered entirely by VMware technologies. It discusses that EVO:RAIL simplifies how customers buy, deploy, and operate their software-defined data centers. Key features highlighted include its simple deployment and ongoing management through the EVO:RAIL engine, which configures vCenter, ESXi, Virtual SAN, and Log Insight. The appliance allows customers to deploy their first virtual machine within 15 minutes of powering it on. The document also introduces EVO:RACK, a data center-scale hyper-converged cloud infrastructure solution that is targeted for larger use cases like IaaS, VDI, and big
- vSphere 5.0 introduces several new platform enhancements including support for 2TB of host memory, 160 logical CPUs, and 512 VMs per host. ESXi now runs exclusively as the hypervisor.
- Storage features are improved with VMFS-5, which supports volumes over 2TB and faster operations. Storage DRS allows for initial placement and load balancing of VMs across datastores.
- Networking features include support for multiple vMotion NICs for faster migration. The new web client allows remote administration from any browser.
The Unofficial VCAP / VCP VMware Study GuideVeeam Software
Veeam® is happy to provide the VMware community with new, unofficial study guides prepared by VMware certified professionals Jason Langer and Josh Coen.
Free VCP5-DCV Study Guide
In this 136-page study guide Jason and Josh cover all seven of the exam blueprint sections to help prepare you for the VCP exam.
Free VCAP5-DCA Study Guide
For those currently holding their VCP certification and want to take it up a notch, Jason and Josh have you covered with the 248-page VCAP5-DCA study guide. Using this study guide along with hands-on lab time will help you in the three and a half hours, lab-based VCAP5-DCA exam.
Similar to VMworld Europe 2014: Virtual SAN Architecture Deep Dive (20)
VMworld 2016: vSphere 6.x Host Resource Deep DiveVMworld
1. This document provides an overview and agenda for a presentation on vSphere 6.x host resource deep dive topics including compute, storage, and network.
2. It introduces the presenters, Niels Hagoort and Frank Denneman, and provides background on their expertise.
3. The document outlines the topics to be covered under each section, including NUMA, CPU cache, DIMM configuration, I/O queue placement, driver considerations, RSS and NetQueue scaling for networking.
VMworld 2016: Troubleshooting 101 for HorizonVMworld
This document provides an overview of troubleshooting tools and techniques for Horizon. It begins with introductions and disclaimers. It then covers defining problems, identifying symptoms, gathering additional information, determining possible causes, identifying the root cause, resolving problems, and documenting solutions. Common troubleshooting tools are discussed, including ESXCLI commands, vSphere CLI commands, and log file locations and contents. Methods for collecting log files from Horizon components like desktops, clients, and servers are also provided.
VMworld 2016: Advanced Network Services with NSXVMworld
NSX provides network virtualization and security services including distributed firewalling, load balancing, and VPN connectivity. It reproduces traditional network and security functions in software throughout the virtual infrastructure for improved performance, agility, and security compared to physical appliances. Over 1700 customers use NSX across various industries, with growth of 100% year-over-year. NSX services can be distributed across hypervisors for massive scalability. The platform also integrates with security and application delivery partners to enhance its native capabilities.
VMworld 2016: How to Deploy VMware NSX with Cisco InfrastructureVMworld
This document provides an overview of how to deploy VMware NSX with Cisco infrastructure, including:
- NSX has minimal requirements of 1600 MTU and IP connectivity and is agnostic to the underlying network topology.
- When using Cisco Nexus switches, VLANs must be configured for various traffic types and SVIs created with consistent IP subnets. Jumbo MTU is required across all links.
- NSX is also compatible with Cisco ACI fabrics using Fabric Path or DFA topologies, with the VXLAN VLAN spanning multiple pods/clusters across the fabric.
VMworld 2016: Enforcing a vSphere Cluster Design with PowerCLI AutomationVMworld
This document discusses enforcing vSphere cluster designs using PowerCLI automation. It provides an overview of vSphere cluster design basics like HA and DRS configurations. It then discusses crafting declarative configurations to define the desired infrastructure state. Infrastructure as code principles are reviewed for managing configurations outside the endpoints. The presentation introduces the Vester project for declaratively configuring vSphere clusters using PowerCLI.
Horizon 7 introduces several new features including just-in-time desktops that instantly provision desktops and applications when users log in using VMware's instant clone technology. It also features smart policies that dynamically change desktop configurations based on user location or device. Infrastructure updates improve scalability and failover capabilities. The user experience is enhanced with support for 3D graphics, new protocols like Blast Extreme for optimized mobile access, and expanded capabilities for hosted applications and RDS desktops.
VMworld 2016: Virtual Volumes Technical Deep DiveVMworld
Virtual Volumes provide a more efficient operational model for external storage management in vSphere. They integrate storage capabilities directly into virtual machines at the individual disk level through Storage Policy-Based Management. This simplifies operations by removing the need for static LUN/volume provisioning and allows storage services to be applied non-disruptively on a per-virtual machine basis according to policies. A key component is the VASA Provider, which is used to publish an array's storage capabilities and manage the creation of VM-level objects called Virtual Volumes on behalf of vSphere.
VMworld 2016: The KISS of vRealize Operations! VMworld
This presentation introduces new features in vRealize Operations 6.3 that simplify operations management. It begins with an overview of the vRealize Operations architecture and dashboard. New features are then demonstrated, including a recommended actions page, cluster resource dashboard, data collection notifications, workload balancing through rebalancing containers, guided remediation through alerts, integration with vRealize Log Insight, capacity management of clusters and projections, and extensibility with management packs. Finally, related VMworld sessions are listed that provide further information on capacity planning, troubleshooting, intelligent operations management, log insight, and network insight.
VMworld 2016: Getting Started with PowerShell and PowerCLI for Your VMware En...VMworld
This document provides an overview and introduction to PowerShell and PowerCLI for managing VMware environments. It discusses what PowerShell and PowerCLI are, important terminology like modules and functions, how to set them up and configure profiles, and examples of how to start coding with PowerShell including gathering data, writing logic statements, and using cmdlets safely. The presenters are introduced and an agenda is provided covering these topics at a high level to get started with PowerShell and PowerCLI.
VMworld 2016: Ask the vCenter Server Exerts PanelVMworld
This document is a disclaimer stating that the presentation may include features still under development and not committed to be delivered in final products. Any features discussed are subject to change based on technical feasibility and market demand, and pricing and packaging have not been determined for any new technologies presented. The document is confidential.
VMworld 2016: Virtualize Active Directory, the Right Way! VMworld
Virtualizing Active Directory domain controllers provides benefits like increased availability, scalability, and manageability. However, there are some technical challenges to address like ensuring proper time synchronization. This presentation provides best practices for virtualizing domain controllers including using host-guest affinity rules, disabling time synchronization settings, and ensuring the ESXi host clock is correct. It also introduces new "safety" features in Windows Server 2012 like VM GenerationID that help address issues from restoring or reverting snapshots like USN rollback.
VMworld 2016: Migrating from a hardware based firewall to NSX to improve perf...VMworld
Iain Leiter from A.T. Still University discussed their organization's migration from a hardware-based firewall to NSX to improve performance and compliance. Some key advantages of NSX include distributed firewalling for high performance and scalability, pay-as-you-grow flexibility, and advanced security features like microsegmentation. Their deployment process involved installing NSX, defining security groups, building security policies using syslog data from "recon rules", and applying a common services policy. Discoveries included many backdoors, application architecture issues, and the security benefits of microsegmentation.
VMworld 2015: Troubleshooting for vSphere 6VMworld
The document provides an overview of troubleshooting tools and techniques for vSphere 6. It discusses gathering diagnostic information, identifying potential causes, and resolving problems. The vSphere ESXi Shell and vCLI commands can be used to troubleshoot issues locally or remotely via SSH. An example troubleshooting process is provided to demonstrate defining a vMotion failure problem, gathering logs, testing connectivity, and resolving an incorrect VMkernel interface IP address.
VMworld 2015: Monitoring and Managing Applications with vRealize Operations 6...VMworld
This year VMware vSphere 6 combined with vRealize Operations 6.1 (vR Ops 6) adds critical features to increase technical agility in the infrastructure, and reduce Mean time to Repair. With a new Automated remediation action framework in vR Ops, vSphere 6’s ability to vMotion Physical Raw Device mappings (RDMs), and a complete Management Pack Ecosystem for monitoring Infrastructure to applications, administrators have the tools needed to get to maintain 5 9’s uptime, shorten Mean Time to Repair (MTTR), and predict capacity requirements as and when the business requires.. This session will be a deep technical explanation, and live demonstration of these tools. It will give administrators a solid understanding of how they can use these tools to monitor and manage their application clusters, keep applications running during Infrastructure maintenance, and get deep holistic visibility into the entire Application ecosystem, from Storage to Networking.
VMworld 2015: Advanced SQL Server on vSphereVMworld
Microsoft SQL Server is one of the most widely deployed “apps” in the market today and is used as the database layer for a myriad of applications, ranging from departmental content repositories to large enterprise OLTP systems. Typical SQL Server workloads are somewhat trivial to virtualize; however, business critical SQL Servers require careful planning to satisfy performance, high availability, and disaster recovery requirements. It is the design of these business critical databases that will be the focus of this breakout session. You will learn how build high-performance SQL Server virtual machines through proper resource allocation, database file management, and use of all-flash storage like XtremIO. You will also learn how to protect these critical systems using a combination of SQL Server and vSphere high availability features. For example, did you know you can vMotion shared-disk Windows Failover Cluster nodes? You can in vSphere 6! Finally, you will learn techniques for rapid deployment, backup, and recovery of SQL Server virtual machines using an all-flash array.
VMworld 2015: Virtualize Active Directory, the Right Way!VMworld
Active Directory Domain Services (ADDS) allows organizations to deploy a scalable and secure directory service for managing users, resources and applications. Virtualization of ADDS has been supported for many years now, however has required careful management to avoid pitfalls around replication, time management, and access. Windows Server 2012 provides greater support for virtualization by including virtualization-safe features and support for rapid domain controller deployment.
VMworld 2015: Building a Business Case for Virtual SANVMworld
This presentation discusses building a business case for VMware Virtual SAN. It provides an overview of Virtual SAN and its benefits for customers like choice, integration, cost savings and performance. A case study is presented of how Dominos Pizza implemented Virtual SAN which resulted in roughly 40% lower costs compared to a traditional storage array. The presentation concludes by demonstrating the Virtual SAN assessment tool and various ways customers can try Virtual SAN.
Not content to simply describe the Virtual Volume (VVOL) framework, this session instead examines practical use cases: How different configurations and workloads benefit from VVOLs. Learn how Storage Policy Based Management (SPBM) couples with VVOLs to provide VM configuration options not previously available. We demonstrate a handful of real-life scenarios, specifically covering how VVOLs benefits oversubscribed systems, disaster recovery preparation and multi-tenant requirements for customers. Specific configuration options and constraints are covered in detail, including how they work with underlying storage.
VMworld 2015: Virtual Volumes Technical Deep DiveVMworld
This document provides a technical deep dive on virtual volumes. It begins with an overview of the challenges with today's LUN-centric storage architectures, such as complex provisioning, wasted resources, and lack of granular control. It then introduces an application-centric model using virtual volumes that provides dynamic storage service levels, fine-grained control at the VM level, and common management across arrays. The rest of the document details the management plane, data plane, consumption model using storage policy-based management, virtual machine lifecycles, snapshots, and offloading operations with virtual volumes.
Details of description part II: Describing images in practice - Tech Forum 2024BookNet Canada
This presentation explores the practical application of image description techniques. Familiar guidelines will be demonstrated in practice, and descriptions will be developed “live”! If you have learned a lot about the theory of image description techniques but want to feel more confident putting them into practice, this is the presentation for you. There will be useful, actionable information for everyone, whether you are working with authors, colleagues, alone, or leveraging AI as a collaborator.
Link to presentation recording and transcript: https://bnctechforum.ca/sessions/details-of-description-part-ii-describing-images-in-practice/
Presented by BookNet Canada on June 25, 2024, with support from the Department of Canadian Heritage.
Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Em...Erasmo Purificato
Slide of the tutorial entitled "Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Emerging Trends" held at UMAP'24: 32nd ACM Conference on User Modeling, Adaptation and Personalization (July 1, 2024 | Cagliari, Italy)
In this follow-up session on knowledge and prompt engineering, we will explore structured prompting, chain of thought prompting, iterative prompting, prompt optimization, emotional language prompts, and the inclusion of user signals and industry-specific data to enhance LLM performance.
Join EIS Founder & CEO Seth Earley and special guest Nick Usborne, Copywriter, Trainer, and Speaker, as they delve into these methodologies to improve AI-driven knowledge processes for employees and customers alike.
Fluttercon 2024: Showing that you care about security - OpenSSF Scorecards fo...Chris Swan
Have you noticed the OpenSSF Scorecard badges on the official Dart and Flutter repos? It's Google's way of showing that they care about security. Practices such as pinning dependencies, branch protection, required reviews, continuous integration tests etc. are measured to provide a score and accompanying badge.
You can do the same for your projects, and this presentation will show you how, with an emphasis on the unique challenges that come up when working with Dart and Flutter.
The session will provide a walkthrough of the steps involved in securing a first repository, and then what it takes to repeat that process across an organization with multiple repos. It will also look at the ongoing maintenance involved once scorecards have been implemented, and how aspects of that maintenance can be better automated to minimize toil.
How Netflix Builds High Performance Applications at Global ScaleScyllaDB
We all want to build applications that are blazingly fast. We also want to scale them to users all over the world. Can the two happen together? Can users in the slowest of environments also get a fast experience? Learn how we do this at Netflix: how we understand every user's needs and preferences and build high performance applications that work for every user, every time.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/07/intels-approach-to-operationalizing-ai-in-the-manufacturing-sector-a-presentation-from-intel/
Tara Thimmanaik, AI Systems and Solutions Architect at Intel, presents the “Intel’s Approach to Operationalizing AI in the Manufacturing Sector,” tutorial at the May 2024 Embedded Vision Summit.
AI at the edge is powering a revolution in industrial IoT, from real-time processing and analytics that drive greater efficiency and learning to predictive maintenance. Intel is focused on developing tools and assets to help domain experts operationalize AI-based solutions in their fields of expertise.
In this talk, Thimmanaik explains how Intel’s software platforms simplify labor-intensive data upload, labeling, training, model optimization and retraining tasks. She shows how domain experts can quickly build vision models for a wide range of processes—detecting defective parts on a production line, reducing downtime on the factory floor, automating inventory management and other digitization and automation projects. And she introduces Intel-provided edge computing assets that empower faster localized insights and decisions, improving labor productivity through easy-to-use AI tools that democratize AI.
Coordinate Systems in FME 101 - Webinar SlidesSafe Software
If you’ve ever had to analyze a map or GPS data, chances are you’ve encountered and even worked with coordinate systems. As historical data continually updates through GPS, understanding coordinate systems is increasingly crucial. However, not everyone knows why they exist or how to effectively use them for data-driven insights.
During this webinar, you’ll learn exactly what coordinate systems are and how you can use FME to maintain and transform your data’s coordinate systems in an easy-to-digest way, accurately representing the geographical space that it exists within. During this webinar, you will have the chance to:
- Enhance Your Understanding: Gain a clear overview of what coordinate systems are and their value
- Learn Practical Applications: Why we need datams and projections, plus units between coordinate systems
- Maximize with FME: Understand how FME handles coordinate systems, including a brief summary of the 3 main reprojectors
- Custom Coordinate Systems: Learn how to work with FME and coordinate systems beyond what is natively supported
- Look Ahead: Gain insights into where FME is headed with coordinate systems in the future
Don’t miss the opportunity to improve the value you receive from your coordinate system data, ultimately allowing you to streamline your data analysis and maximize your time. See you there!
Kief Morris rethinks the infrastructure code delivery lifecycle, advocating for a shift towards composable infrastructure systems. We should shift to designing around deployable components rather than code modules, use more useful levels of abstraction, and drive design and deployment from applications rather than bottom-up, monolithic architecture and delivery.
GDG Cloud Southlake #34: Neatsun Ziv: Automating AppsecJames Anderson
The lecture titled "Automating AppSec" delves into the critical challenges associated with manual application security (AppSec) processes and outlines strategic approaches for incorporating automation to enhance efficiency, accuracy, and scalability. The lecture is structured to highlight the inherent difficulties in traditional AppSec practices, emphasizing the labor-intensive triage of issues, the complexity of identifying responsible owners for security flaws, and the challenges of implementing security checks within CI/CD pipelines. Furthermore, it provides actionable insights on automating these processes to not only mitigate these pains but also to enable a more proactive and scalable security posture within development cycles.
The Pains of Manual AppSec:
This section will explore the time-consuming and error-prone nature of manually triaging security issues, including the difficulty of prioritizing vulnerabilities based on their actual risk to the organization. It will also discuss the challenges in determining ownership for remediation tasks, a process often complicated by cross-functional teams and microservices architectures. Additionally, the inefficiencies of manual checks within CI/CD gates will be examined, highlighting how they can delay deployments and introduce security risks.
Automating CI/CD Gates:
Here, the focus shifts to the automation of security within the CI/CD pipelines. The lecture will cover methods to seamlessly integrate security tools that automatically scan for vulnerabilities as part of the build process, thereby ensuring that security is a core component of the development lifecycle. Strategies for configuring automated gates that can block or flag builds based on the severity of detected issues will be discussed, ensuring that only secure code progresses through the pipeline.
Triaging Issues with Automation:
This segment addresses how automation can be leveraged to intelligently triage and prioritize security issues. It will cover technologies and methodologies for automatically assessing the context and potential impact of vulnerabilities, facilitating quicker and more accurate decision-making. The use of automated alerting and reporting mechanisms to ensure the right stakeholders are informed in a timely manner will also be discussed.
Identifying Ownership Automatically:
Automating the process of identifying who owns the responsibility for fixing specific security issues is critical for efficient remediation. This part of the lecture will explore tools and practices for mapping vulnerabilities to code owners, leveraging version control and project management tools.
Three Tips to Scale the Shift Left Program:
Finally, the lecture will offer three practical tips for organizations looking to scale their Shift Left security programs. These will include recommendations on fostering a security culture within development teams, employing DevSecOps principles to integrate security throughout the development
How RPA Help in the Transportation and Logistics Industry.pptxSynapseIndia
Revolutionize your transportation processes with our cutting-edge RPA software. Automate repetitive tasks, reduce costs, and enhance efficiency in the logistics sector with our advanced solutions.
Quantum Communications Q&A with Gemini LLM. These are based on Shannon's Noisy channel Theorem and offers how the classical theory applies to the quantum world.
VMworld Europe 2014: Virtual SAN Architecture Deep Dive
2. Disclaimer
• This presentation may contain product features that are currently under development.
• This overview of new technology represents no commitment from VMware to deliver these
features in any generally available product.
• Features are subject to change, and must not be included in contracts, purchase orders, or
sales agreements of any kind.
• Technical feasibility and market demand will affect final delivery.
• Pricing and packaging for any new technologies or features discussed or presented have not
been determined.
CONFIDENTIAL 2
3. Virtual SAN: Product goals
1. Targeted customer: vSphere admin
2. Compelling Total Cost of Ownership (TCO)
– CAPEX: capacity, performance
– OPEX: ease of management
3. The Software-Defined Storage for VMware
– Strong integration with all VMware products and
features
CONFIDENTIAL 3
Virtual SAN
vSphere
4. •Software-based storage built in
ESXi
•Aggregates local Flash and HDDs
•Shared datastore for VM
consumption
•Converged compute + storage
•Distributed architecture, no single
point of failure
•Deeply integrated with VMware
stack
What is Virtual SAN?
esxi-01 esxi-02 esxi-03
vSphere
VSAN
5. Virtual SAN Scale Out
esxi-01 esxi-02 esxi-03
esxi-01 esxi-02 esxi-03 esxi-04
7. Single Virtual SAN datastore scalability
Cluster: 3 - 32 nodes; up to 5 SSDs, 35 HDDs per host
Capacity: 4.4 Petabytes
Performance: 2M IOPS – 100% reads
640K IOPS – 70% reads
8. vSphere + Virtual SAN
8
Simple to set resiliency goals via
policy
Enforced per VM and per vmdk
Zero data loss in case of disk,
network or host failures
High availability even during
network partitions
Automatic, distributed data
reconstruction after failures
Interoperable with vSphere HA and
Maintenance Mode
Virtual SAN Is Highly Resilient Against Hardware Failures
9. Virtual SAN (VSAN) is NOT a Virtual Storage Appliance (VSA)
9
– Virtual SAN is fully integrated with vSphere (ESXi & vCenter)
– Drivers embedded in ESXi 5.5 contain the Virtual SAN smarts
– Kernel modules: most efficient I/O path
• Minimal consumption of CPU and memory
• Specialized I/O scheduling
• Minimal network hops, just one storage and network stack
– Eliminate unnecessary management complexity (appliances)
Virtual SAN – Embedded into vSphereVirtual SAN – Not a VSA
VSA
10. Simple cluster configuration & management
One click away!!!
– Virtual SAN configured in Automatic mode, all empty local disks are claimed by Virtual SAN for the
creation of the distributed vsanDatastore.
– Virtual SAN configured in Manual mode, the administrator must manually select disks to add the the
distributed vsanDatastore by creating Disk Groups.
10
11. No overprovisioning
Less resources, less time
Easy to change
Legacy
5. Consume from pre-allocated bin
4. Select appropriate bin
3. Expose pre-allocated bins
2. Pre-allocate static bins
1. Pre-define storage configurations
1. Define storage policy
2. Apply policy at VM creation
VSAN
VSAN Shared
Datastore
Resource and data services are
automatically provisioned and
maintained
✖ Overprovisioning (better safe than sorry!)
✖ Wasted resources, wasted time
✖ Frequent Data Migrations
Simplified Provisioning For Applications
11
12. Virtual SAN Storage Policies
12
Storage Policy Use Case Value
Object space reservation Capacity
Default 0
Max 100%
Number of failures to tolerate
(RAID 1 – Mirror)
Availability
Default 1
Max 3
Number of disk stripes per object
(RAID 0 – Stripe)
Performance
Default 1
Max 12
Flash read cache reservation Performance
Default 0
Max 100%
Force provisioning Disabled
13. How To Deploy A Virtual SAN Cluster
13
Component Based
…using the VMware Virtual SAN
Compatibility Guide (VCG) (1)
Choose individual components …
SSD or PCIe
SAS/NL-SAS/ SATA
HDDs
Any Server on
vSphere Hardware
Compatibility List
HBA/RAID Controller
Virtual SAN Ready Node
40 OEM validated server configurations
ready for Virtual SAN deployment (2)
Note: 1) Components must be chosen from Virtual SAN HCL, using any other components is unsupported – see Virtual SAN VMware Compatibility Guide
Page
2) VMware continues to update/add list of the available Ready Nodes, please refer to Virtual SAN VMware Compatibility Guide Page for latest list
Maximum Flexibility Maximum Ease of Use
Hyper-Converged Infrastructure
A Hyper-Converged
Infrastructure Appliance
(HCIA) for the SDDC
Each EVO:RAIL HCIA is pre-built on
a qualified and optimized
2U/4 Node server platform.
Sold via a single SKU by qualified
EVO:RAIL partners (3)
Software + Hardware VMware EVO:RAIL
15. Virtual SAN Disk Groups
• Virtual SAN organizes storage devices in disk groups
• A host may have up to 5 disk groups
• A disk group is composed of 1 flash device and 1-7 magnetic disks
• Compelling cost model:
– HDD – Cheap capacity: persist data, redundancy for resiliency
– Flash – Cheap IOPS: read caching and write buffering
15
disk group disk group disk group disk group
Each host: 5 disk groups max. Each disk group: 1 SSD + 1 to 7 HDDs
disk group
HDD HDDHDDHDDHDD
16. Flash Devices
All writes and the vast majority of reads are served by flash storage
1. Write-back Buffer (30%)
– Writes acknowledged as soon as they are persisted on flash (on all replicas)
2. Read Cache (70%)
– Active data set always in flash, hot data replace cold data
– Cache miss – read data from HDD and put in cache
A performance tier tuned for virtualized workloads
– High IOPS, low $/IOPS
– Low, predictable latency
.
16
Achieved with modest
capacity: ~10% of HDD
17. Magnetic Disks (HDD)
Capacity tier: low $/GB, work best for sequential access
Asynchronously retire data from Write Buffer in flash
Occasionally read data to populate Read Cache in flash
Number and type of spindles still matter for performance when…
Very large data set does not fit in flash Read Cache
High sustained write workload needs to be destaged from flash to HDD
SAS/NL-SAS/SATA HDDs supported
Different configurations per capacity vs. performance requirements
17
18. Storage Controllers
SAS/SATA Storage Controllers
Pass-through or “RAID0” mode supported
Performance using RAID0 mode is controller dependent
Check with your vendor for SSD performance behind a RAID-controller
Management headaches for “volume” creation
Storage Controller Queue Depth matters
Higher storage controller queue depth will increase performance
Validate number of drives supported for each controller
18
19. Virtual SAN Network
• New Virtual SAN traffic VMkernel interface.
– Dedicated for Virtual SAN intra-cluster communication and data replication.
• Supports both Standard and Distributes vSwitches
– Leverage NIOC for QoS in shared scenarios
• NIC teaming – used for availability and not for bandwidth aggregation.
• Layer 2 Multicast must be enabled on physical switches.
– Much easier to manage and implement than Layer 3 Multicast
19
Management Virtual Machines vMotion Virtual SAN
Distributed Switch
20 shares 30 shares 50 shares 100 shares
uplink1 uplink2
vmk1 vmk2vmk0
21. VSAN network VSAN network VSAN network VSAN networkVSAN network
disk group
HDD
disk group
HDD
disk group
HDD
disk group
HDD
disk group
HDD
Object and Components Layout
21
R1
R0 R0
R0
Availability policy refelcted
on number of replicas
Object “components”
may reside in different
disks and/or hosts
Performance policy may include a
stripe width per replica
Virtual SAN Storage Objects
foo2.vmdk
foo1.vmdk
/vmfs/volumes/vsanDatastore/foo/
foo.vmx, .log, etc
The VM Home directory object is
formatted with VMFS to allow a VM’s
configuration files to be stored on it.
Mounted under the root dir vsanDatastore
VMFS
22. Advantages of objects
CONFIDENTIAL 22
• A storage platform designed for SPBM
– Per VM, per VMDK level of service
– Application gets exactly what it needs
• Higher availability
– Per object quorum
• Better scalability
– Per VM locking, no issues as #VMs grows
– No global namespace transactions
Storage Policy Wizard
SPBM
object
VSAN object
manager
virtual disk
Datastore Profile
24. Anatomy of a Write
VM running on host H1
H1 is owner of virtual disk object
Number Of Failures To Tolerate = 1
Object has 2 replicas on H1 and H2
1. Guest OS issues write op to virtual disk
2. Owner clones write op
3. In parallel: sends “prepare” op to H1
(locally) and H2
4. H1, H2 persist op to Flash (log)
5. H1, H2 ACK prepare op to owner
6. Owner waits for ACK from both
‘prepares’ and completes I/O
7. Later, owner commits batch of writes
vSphere
Virtual SAN
H3H2H1
6
5
5
2
virtual disk
3
1
4 4
77
25. Destaging Writes from Flash to HDD
Data from committed writes accumulate
on Flash (Write Buffer)
• From different VMs / virtual disks
Elevator algorithm flushes written data to
HDD asynchronously
• Physically proximal batches of data
per HDD for improved performance
• Conservative: overwrites are good;
conserve HDD I/O
• HDD write buffers are flushed, before
discarding writes from SSD
vSphere
Virtual SAN
H3H2H1
virtual disk
26. Anatomy of a Read
1. Guest OS issues a read on virtual disk
2. Owner chooses replica to read from
• Load balance across replicas
• Not necessarily local replica (if one)
• A block always read from same replica;
data cached on at most 1 SSD;
maximize effectiveness
3. At chosen replica (H2): read data from
SSD Read Cache, if there
4. Otherwise, read from HDD and place data
in SSD Read Cache
• Replace ‘cold’ data
5. Return data to owner
6. Complete read and return data to VM
vSphere
Virtual SAN
H3H2H1
virtual disk
1
2
3
6
4
5
27. Virtual SAN Caching Algorithms
• VSAN exploits temporal and spatial
locality for caching
• Persistent cache by the replica (Flash)
• Not by the client! Why?
• Improved flash utilization in cluster
• Avoid data migration with VM migration
• DRS: 10s of migrations per day
• No latency penalty
• Network latencies: 5 – 50 usec (10GbE)
• Flash latencies with real load: ~1 msec
• VSAN supports in-memory local cache
• Memory: very low latecy
• View Accelerator (CBRC)
vSphere
Virtual SAN
H3H2H1
virtual disk
29. Magnetic Disk Failure: Instant mirror copy
• Degraded - All impacted components on the failed HDD instantaneously re-created on other
disks, disk groups, or hosts.
vsan network
vmdkvmdk witness
esxi-01 esxi-02 esxi-03 esxi-04
vmdk
new mirror copy
Instant!
Disk failure, instant mirror copy of impacted component
raid-1
30. Flash Device Failure: Instant mirror copy
• Degraded – Entire disk group failure. Higher reconstruction impact. All impacted components
on the disk group instantaneously re-created on other disks, disk groups, or hosts.
vsan network
vmdkvmdk witness
esxi-01 esxi-02 esxi-03 esxi-04
vmdk
new mirror copy
Instant!
Disk failure, instant mirror copy of impacted component
raid-1
31. Host Failure: 60 Minute Delay
• Absent – Host failed or disconnected. Highest reconstruction impact. Wait to ensure not
transient failure. Default delay of 60 min. After that, start reconstructing objects and components
onto other disk, disk groups, or hosts.
vsan network
vmdkvmdk witness
esxi-01 esxi-02 esxi-03 esxi-04
vmdk
new mirror copy
Instant!
Disk failure, instant mirror copy of impacted component
raid-1
32. Virtual SAN 1 host isolated – HA restart
vsan network
vmdkvmdk witness
esxi-01 esxi-02 esxi-03 esxi-04
isolated!
HA restart
raid-1
vSphere HA restarts VM
33. Virtual SAN partition – With HA restart
vsan network
vmdkvmdk witness
esxi-01 esxi-02 esxi-03 esxi-04
Partition 1 Partition 2
HA restart
vSphere HA restarts VM in Partition 2, it owns > 50% of components!
raid-1
34. Maintenance Mode – planned downtime
3 Maintenance mode options:
Ensure accessibility
Full data migration
No data migration
35. Virtual SAN Monitoring and Troubleshooting
• vSphere UI
• Command line tools
• Ruby vSphere Console
• VSAN Observer
CONFIDENTIAL 35
36. 36
Enabled/configured in two clicks
Policy-based management
Self-tuning and elastic
Deep integration with VMware
stack
VM-centric tools for monitoring &
troubleshooting
Radically Simple
Flash acceleration
Up to 2M IOPS from 32 nodes
Low, predictable latencies
Minimal CPU, RAM consumption
Matches the VDI density of all
flash array
High Performance Lower TCO
Eliminates large upfront
investments (CAPEX)
Grow-as-you-go (OPEX)
Flexible choice of industry
standard hardware
Does not require specialized skills
Virtual SAN Key Benefits