Data Amp 2017 - Optimize your data strategy from on ... - Microsoft

Widely available unstructured data. Deliver powerful insights over big data. Massive data growth. Build data into all your apps. 50ZB. 1010. 0101. 001...

1 downloads 614 Views 4MB Size
New opportunities in a changing data landscape Massive data growth

50ZB

Widely available unstructured data

Analytics driving digital transformation

1010 0101 0010

{} Build data into all your apps

Deliver powerful insights over big data

Modernize your apps with built-in analytics

The time to adapt to disruption is shrinking A hundred years ago, the average lifespan of a company listed on the S&P 500 index was 67 years

In the 2020s, 75% of the S&P 500 will be new companies

67

25

15

Years

Years

Years

1920

Source: BBC

1930

1940

1950

1960

1970

1980

1990

2000

2010's

2020's

Enable business agility

Business leaders are focused on disruption

Re-imagine business processes Disrupt with new business models

Differentiate with customer experience

Securing and integrating many database systems

But harnessing technology to disrupt isn’t easy

Investing to modernize legacy applications Delivering on increasing performance/price demands Providing predictive analytics

The complete modern data estate DATA SOURCES

DATA MANAGEMENT

DATA INSIGHTS

Structured OLTP

Operational data

LOB

Unstructured Graph Social IoT

Business intelligence

Data warehousing

Big data processing

Media

SECURITY

FLEXIBILITY

Secure data, access, application

Choice of platform, language, location

Data integration

ERP

Data virtualization

MOBILE

Advanced Analytics & AI

SQL Server

POWERING YOUR DATA ESTATE

Power your entire data estate with SQL Server 2017 DATA SOURCES

DATA MANAGEMENT

Structured

DATA INSIGHTS Business intelligence

Operational data

OLTP

An industry leader four years in a row

MOBILE

Leader in TPC-E

Data virtualization

Graph Social IoT Media

$480

Data warehousing

$120

Scale to petabytes Big data processing

T-SQL query over any data

#1

#1 performance in TPC-H

1010 0101

#2

#3

SSIS

Microsoft Tableau

PB

Data integration

Unstructured

PolyBase

ERP LOB

$2,230

Analytics at a fraction of the cost on any device

{}

Advanced Analytics

1M predictions per second

Support for R and Python

R

SECURITY

FLEXIBILITY

Least vulnerable over the last 7 years Any language, any platform, anywhere

Vulnerabilities (2010-2016)

150 + 100 50 0

SQL Server

SAP HANA

PostgreSQL

IBM DB2

Oracle

.NET JAVA Azure

MySQL

3rd

The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. National Institute of Standards and Technology Comprehensive Vulnerability Database update 2017. TPC-H non-clustered results as of 2017 respectively. http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster

Oracle

Power your entire data estate with SQL Server 2017 DATA SOURCES

DATA MANAGEMENT

Structured

DATA INSIGHTS Business intelligence

Operational data

OLTP

An industry leader four years in a row

MOBILE

Leader in TPC-E

Data virtualization

Graph Social IoT Media

Data warehousing

T-SQL query over any data

1010 0101

{}

FLEXIBILITY

Any language, any platform, anywhere

Vulnerabilities (2010-2016)

Least vulnerable over the last 7 years

#3

Advanced Analytics

1M predictions per second

Powered by R SQL Server 2017

150 +

SECURITY

#2

SSIS

#1

#1 performance in TPC-H

Scale to petabytes Big data processing

$480 $120 Microsoft Tableau

PB

Data integration

Unstructured

PolyBase

ERP LOB

$2,230

Analytics at a fraction of the cost on any device

Support for R and Python

100 50 0

SQL Server

SAP HANA

PostgreSQL

IBM DB2

Oracle

.NET JAVA Azure

MySQL

3rd

The above graphics were published by Gartner, Inc. as part of a larger research document and should be evaluated in the context of the entire document. The Gartner document is available upon request from Microsoft. Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner's research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose. National Institute of Standards and Technology Comprehensive Vulnerability Database update 2017. TPC-H non-clustered results as of 2017 respectively. http://www.tpc.org/tpch/results/tpch_perf_results.asp?resulttype=noncluster

Oracle

Engage market-leading solutions for every workload Advanced analytics, business intelligence, OLTP, data warehousing SQL Server 2017

z

INTELLIGENT

TRUSTED

FLEXIBLE

Solve new problems faster with enhanced data integration across your data estate

Enjoy security and unmatched TCO with fewer products and services powering your data estate

Enable innovation through technology—any language, any data, any size, any platform

Demo

Install SQL Server on Linux in <60 seconds Restore a backup file from Windows

DATA MANAGEMENT // OPERATIONAL DATA

Industry-leading performance with SQL Server 2017 Real-time operational analytics with hybrid transactional-analytical processing (HTAP) In-memory ColumnStore

• Speed analytics and reduce storage needs with ColumnStore compression

ETL

0100101010110 Challenge to manage massive credit card data

• Combine for real-time operational analytics (HTAP) • Speed query performance without tuning using new Adaptive Query Processing

In-memory OLTP

Pair active data with In-Memory OLTP table for quick access

• Improve transactional performance with row-based in-memory OLTP

Speed performance by compressing data in Inmemory Columnstore

Faster queries and processing enables realtime detection of errors

• Maintain performance when making app changes with Automatic Plan Correction

NEW*

NEW*

DATA MANAGEMENT // OPERATIONAL DATA

Mission critical availability on any platform Always On cross-platform capabilities

• Always On availability groups for Linux and Windows for HA and DR NEW*

• Enables Testing • Enables Migrations

• Flexibility for HA architectures

• Ultimate HA with OS-level redundancy and failover • High Availability • Offload Backups • Scale BI Reporting

• Load balancing of readable secondaries

NEW*

Demo

Always On Availability Group on Linux

DATA MANAGEMENT // DATA WAREHOUSING

Petabyte-scale data warehousing #1 performance and value for TPC-H 1TB benchmark non-clustered SQL Server 2017 on Red Hat Enterprise Linux and HPE Proliant hardware

GREAT VALUE

GREAT PERFORMANCE

HPE server with SQL Server 2016 on Microsoft Windows

• Achieve petabyte data warehouse scale on Windows and Linux

$/QUERY PER HOUR ($/QPHH)

717,101

QUERY PER HOUR (QPHH)

678,492

• Most efficient query processing with 1TB world record benchmark

HPE server with SQL Server 2017 on Red Hat Enterprise Linux

NEW*

$0.64

HPE server with SQL Server 2016 on Microsoft Windows

$0.61

HPE server with SQL Server 2017 on Red Hat Enterprise Linux

Read the performance brief at hpe.com/servers/benchmarks. Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Red Hat, Red Hat Enterprise Linux, and the Shadowman logo are registered trademarks of Red Hat, Inc. Linux is a registered trademark of Linus Torvalds. Intel and Xeon are trademarks of Intel Corporation in the U.S. and other countries. TPC and TPC-H are trademarks of the Transaction Processing Performance Council. TPC-H results show the HPE ProLiant DL380 Gen9 with a result of 717,101 QphH @ 1000GB and $0.61/QphH USD with system availability as of 10-19-2017 (results published 04-19-2017; see http://www.tpc.org/xxxx); the HPE ProLiant DL380 Gen9 with a result of 678,492 QphH @1000GB and $0.64/QphH @ 1000GB with system availability as of 07-31-2016 (results published 03-24-2016; see tpc.org/3320). The TPC believes that comparisons of TPC-H results published with different scale factors are misleading and discourages such comparisons. Please see tpc.org for up-to-date information. Competitive claims valid as of 04-19-2017.

• #1 price/performance in 1TB, 10TB and 30 TB TPC-H nonclustered benchmark

• Reference architectures from major hardware partners

DATA SOURCES

The power to query over any type of data Graph data support

• Bring graph data support to your relational data to store and analyze new types of relationships

Eric Mears

NEW*

Michelle Burns

Andy Smith Mary Jones

Quarterly business review

Denny Usher

Bill Brown Rachel Hogan

Product dev project IT assessment

Managers Associates Projects

HR team can determine which staff are working on which projects

• Query data stored in Hadoop with PolyBase • Hadoop combined with SQL Server provides value and insight from data lakes

Demo

Graph support in SQL Server 2017

DATA INSIGHTS // BUSINESS INTELLIGENCE

Bring your data to life with reporting anywhere • Mobile Reporting—online and offline—on iOS, Windows, Android mobile devices • Updated Report Viewer a free developer component

NEW*

DATA INSIGHTS // BUSINESS INTELLIGENCE

Analyze diverse data with powerful modelling Create tabular models from modern data sources & perform additional transformations Modern data sources

SSAS

Visualize Excel

Churn

MailChimp MySQL

NEW*

Sentiment

Facebook

Transform

Files

Data analysis Revenue

SSRS Power BI reports

Azure Blob RedShift

Get customer social data on favorite cruises

Combine latest ship occupancy rates with historic results

Compile KPIs

Compare responses to two cruise itineraries

• Modern connectors for big data sources, additional databases, Azure stores, and diverse modern data sources

Itinerary B is more successful – launch route

• Fast time to insights with rich data transformations and mashups NEW*

• In-memory performance

DATA INSIGHTS // ADVANCED ANALYTICS

Real-time intelligence with machine learning built-in In-database analytics with R and Python

• In-database analytics with R and now Python enables users to push intelligence to where data lives NEW*

Data from 8M vehicle loans

Predicts loan defaults

1M

Age, original balance, interest rate, loan remaining months, credit score

Business user

predictions per sec

R

Store

Visualize

Predictions

ColumnStore Prepare for analytics

Python

In-memory OLTP

Power BI dashboard

• Parallelized and at scale

• Industry-leading innovation in artificial intelligence to discover insights faster • Advanced machine learning algorithms with GPUs

Demo

Python support in SQL Server 2017

SECURITY

Protect your data at all times on Windows and Linux Always Encrypted Client side Search for single customer record

• Most secure platform, with the least vulnerabilities in the NIST vulnerability database

Server side Sensitive data remains encrypted inside SQL Server

Query

• Encrypt data at rest and in motion with Always Encrypted on new driver libraries

Enhanced SQL Server Library

Result set with unencrypted data

• Conceal sensitive information with Dynamic Data Masking Data set

CIPHERTEXT

Customer

Credit card #

Exp.

Tim Irish

1x7fg655se2e 4839-2939-1919-3987

7/19

Customer

Credit card #

Exp.

Denny Usher

0x7ff654ae6d 4949-8003-8473-1930

5/17

Denny Usher

0x7ff654ae6d 4949-8003-8473-1930

5/17

Alicia Hodge

0y8fj754ea2c 9000-4899-1600-1324

4/18

Column master key

Column encryption key

• Control access to database rows based on user characteristics with Row-Level Security • File-level protection with Transparent Data Encryption

FLEXIBILITY

Power of SQL Server on the platform of your choice Windows

Linux

• Linux distributions including RedHat Enterprise Linux (RHEL), Ubuntu, and SUSE Enterprise Linux (SLES) • Docker: Windows & Linux containers • Windows Server / Windows 10 Linux/Windows container

• Package-based installation, Yum Install, Apt-Get, and Zypper

Microsoft Azure POWERING YOUR DATA ESTATE IN THE CLOUD

Power your data estate with Azure DATA SOURCES

DATA MANAGEMENT

Structured

DATA INSIGHTS Business intelligence

Operational data

OLTP

Azure SQL Database

MOBILE

Power BI

Azure Document DB

ERP

Azure Analysis Services

Data warehousing

LOB

Azure SQL Data Warehouse Data virtualization

Graph Social IoT Media

SECURITY

FLEXIBILITY

Advanced Analytics & AI

Data integration

Unstructured

Big data processing

Azure HDInsight

Azure Data Lake

More certifications than any other cloud provider

Any language, any platform, anywhere

.NET JAVA Azure

3rd

Azure Machine Learning Azure Stream Analytics Azure Cognitive Services

Power your data estate with Azure DATA SOURCES

DATA MANAGEMENT

Structured

DATA INSIGHTS Business intelligence

Operational data

OLTP

Azure SQL Database

MOBILE

Power BI and Power BI Embedded

Azure Document DB

ERP

Azure Analysis Services

Data warehousing

LOB

Azure SQL Data Warehouse Data virtualization

Graph Social IoT Media

SECURITY

FLEXIBILITY

Advanced Analytics & AI

Data integration

Unstructured

Big data processing

Azure HDInsight

Azure Data Lake

Azure Stream Analytics

Powered by Azure Data Services

More certifications than any other cloud provider

Any language, any platform, anywhere

Azure Machine Learning

.NET JAVA Azure

3rd

Azure Cognitive Services

38

Azure regions More than AWS and Google combined

>90%

of Fortune 500 use Microsoft Cloud

Engage market-leading solutions for all workloads Advanced analytics, business intelligence, OLTP, data warehousing Azure Data Services

z

INTELLIGENT

TRUSTED

FLEXIBLE

Engage customers with dynamic interactions using artificial intelligence capabilities

Rely on the leading compliance coverage and more certifications than any other cloud provider

Work in your choice of language, employ any data, and easily incorporate open-source tools

DATA MANAGEMENT // OPERATIONAL DATA

Infinite scale with Azure SQL Database Increased productivity

Faster time to market

Lower TCO

Reduced risks

75% faster app deployment cycles

53% less expensive than on-prem/hosted

71% fewer cases of unplanned downtime

DB management hours

Azure SQL Database

Other

47% staff hours reclaimed for other tasks “Now, those people can do development and create more revenue opportunities for us.”

“We can get things out faster with Azure SQL Database”

“To be able to do what we’re doing in Azure, we’d need an investment of millions.”

“The last time we had downtime, a half a day probably lost us $100k”

Demo

Azure SQL Database: Intelligent database in the cloud

DATA MANAGEMENT // OPERATIONAL DATA

Azure DocumentDB for unstructured data Limitless scale

Guaranteed availability

Effortless maintenance

Enhanced productivity

Leading TCO

Scale up and down on the fly with unlimited storage and throughput

Rest easy with 99.99 availability and four well-defined consistency levels

Avoid handling schema or partitions with a fully managed Azure service

Save dev resources with familiar SQL syntax, REST APIs and SDKs

Spend less by dodging dev/ops expenses and buying only what you need

DATA MANAGEMENT // DATA WAREHOUSING

Fully managed Azure SQL Data Warehouse Elastic scale & performance

End-to-end platform built for the cloud

Market leading price/ performance

• Scales to petabytes of data with MPP processing • Resize compute nodes <1 minute • Faster time to insight than other SMP offerings • Designed for on-demand workload

• Integrated with Azure platform and other Microsoft services • Enables hybrid solutions • Built on SQL Server experience & technology

• • • • •

Simple compute & storage billing Pay for what you need High performance without rewriting apps Low cost for latent data Infrastructure, management and support provided

DATA MANAGEMENT // BIG DATA

Power intelligent action with Azure HDInsight and Azure Data Lake • Get the most of your data with Azure Data Lake storage and Azure HDInsight analytics service together YARN

• Store big data of any size and type on Azure Data Lake

YARN

Data Lake Analytics

HDInsight

On-demand analytics job service

Managed clusters

HDFS

• Analyze big data with familiar open-source tools with Hadoop on HDInsight

• Rest assured with leading SLA Data Lake Store No limits data lake

DATA INSIGHTS // BUSINESS INTELLIGENCE

Experience your data with Power BI Any data, any way, anywhere MICROSOFT CLOUD

INTELLIGENCE

Stream Analytics

NON-MICROSOFT CLOUD Machine Learning

ON-PREMISE DATA

Statistical analysis

• 5,000,000+ subscribers from 200,000+ organizations • Live dashboards provide a 360º view of your business • Track your data in real-time with support for streaming data • Drill through to underlying reports to explore in more detail • Pin new visualizations and KPIs to monitor performance NEW*

Intelligent apps

DATA INSIGHTS // ADVANCED ANALYTICS & AI

Transform data into action with Cortana Intelligence Suite Data sources

People

Apps

Apps

Sensors & devices

Data

Cortana Intelligence

Intelligence

Automated systems

Action

Microsoft Data Platform CONSISTENT DATA PLATFORM FOR POWERFUL HYBRID SCENARIOS

Microsoft Data Platform CONSISTENT DATA PLATFORM FOR POWERFUL HYBRID SCENARIOS

Easy migration to cloud Always On Availability Groups in Azure

Scale out Business Intelligence Hybrid Business Analytics Backup and Disaster Recovery

FLEXIBILITY

Consistent data platform across on-premises and cloud • Develop once and deploy anywhere PaaS

• Common tools for development and management

• Common T-SQL surface area • Simple cloud migration IaaS

On-premises

• Single vendor for support

FLEXIBILITY

Run SQL Server anywhere Any platform, any cloud

• Run the world’s leading data platform on any environment • Works on any operating system including Windows, Linux, Docker • Runs on any cloud including Azure, 3rd party hosting providers

SQL Server 2017

Azure

3rd

• Use on-prem licenses in the cloud with License Mobility, a Software Assurance benefit

FLEXIBILITY

Easy cloud migration Database migration service preview

• Azure SQL Database preview with instance-level control for greater security and flexibility NEW*

• Database migration service helps move your data from legacy databases to SQL Server in an Azure VM or Azure SQL Database NEW*

01010010 10100101 11101001

• Sign up for private preview

POWERING YOUR ENTIRE DATA ESTATE

SQL Server 2017

Azure

Microsoft data platform

INTELLIGENT

TRUSTED

FLEXIBLE

Power your data estate anywhere DATA SOURCES

DATA MANAGEMENT

Structured

DATA INSIGHTS

Operational data

ON-PREM CLOUD

Business intelligence

Power BI

OLTP

SQL Server

MOBILE

Azure SQL Database

Azure Document DB

SQL Server Reporting Services and Mobile BI

ERP

Data warehousing

LOB

Advanced Analytics & AI

Data virtualization

Graph Social IoT Media

SECURITY

FLEXIBILITY

Azure SQL Data Warehouse

SQL Server Analysis Services and R built-in Data integration

SQL Server Data Warehouse

Unstructured

Big data processing

Apache Hadoop

Azure Data Lake

Azure HDInsight

Least vulnerable data platform, with more certifications than any other cloud provider

Any language, any platform, anywhere

.NET JAVA Azure

3rd

Azure Machine Learning Azure Stream Analytics Azure Cognitive Services