Jean-Pierre Riehl, Fabien Adato - Cortana Analytics - Global Azure Bootcamp 2016 Paris

http://GUSS.Pro @GUSS_FRANCE

Cortana Analytics, de nouveaux patterns pour vos plateformes de donnéesJean-Pierre Riehl / Fabien Adato


Rejoignez la communautéWebcasts, Conférences, Afterworks

La communauté Data Microsoft

@GUSS_FRANCE

/GUSS /GUSS.FR Save the Date

Samedi 25 juin 2016Campus SUPINFOTour Montparnasse, Paris


PréconférenceCortana Analytics, une plate-forme de données moderne

Vendredi 24 juin 2016En préambule du SQLSaturday Paris

Jean-Pierre Riehl – FRMVP DataPlatform depuis 2008

@djeepy1

Fabien Adato – FRConsultant Data Science

@fabienAD


Qui sommes nous ?

Jean-Pierre Riehl

Practice Manager Data & BI

MVP SQL ServerChapter Leader– GUSS

@djeepy1http://blog.djeepy1.net

Fabien AdatoConsultant Data Science

@fabienADhttp://fadata-blog.com


Get

Model

Analyze

?Store


Nouvelles questionsNouveaux challengesNouveaux outils

Self-Service BI

Agilité Big Data IoT


Cloud-First ?


Nouvelles architectures ?


Cortana Analytics SuiteTransform data into intelligent action

DATA INTELLIGENCE ACTION

Business ScenariosRecommendations,

customer churn,forecasting, etc.

Perceptual IntelligenceFace, vision

Speech, text

Personal Digital Assistant

Cortana

Dashboards and Visualizations

Power BI

Machine Learning

and Analytics

Azure Machine Learning

Azure HDInsight (Hadoop)

Azure Stream Analytics

Business apps

Custom apps

Sensors and devices

People

Automated Systems

Big Data Stores

Azure SQL Data Warehouse

Information Management

Azure Data Factory

Azure Data Catalog

Azure Event Hub

Data Collection ToolsData Collection Tools

Azure Data Lake Store

Azure Data Lake Analytics


Boite à outils « Cloud »HDInsight

Azure Data Lake

Azure SQL DWH

HADOOP

Azure DocumentD

BAzure SQL

IaaS

Power BI

Azure Data Catalog


Azure Data FactoryAzure

Stream Analytics


HDInsight

Azure Data Lake

HADOOP


Azure Data FactoryAzure

Stream Analytics

Boite à outils « Cloud »……Une sélection


HDInsight et l’écosystème HADOOP


HDInsight : le monde Big DataH

DIn

sigh

t

Azure Blob

HDFS

Sqoop

Oozie

Azure UX

SDK Azure

WebHcat/ Templeto

nRDP

YarnHive Pig HCatalog AmbariMap/

Reduce StormHBase

HDInsightHADOOP

+ R Server, Spark, etc.


Azure Data Lake


A hyper scale repository for big data analytic workloads

Introducing Azure Data Lake

• Hadoop File System compatible with HDFS™• Integrated with HDInsight, Revolution R, Hortonworks, Cloudera• Based on YARN

• Petabyte-sized files• No size limits to data in single account•Massive throughput to increase performance

• AAD based access control• Data management

Devices


Analytics

Storage

HDInsight(“managed clusters”)


Azure Data Lake Storage

Azure Data Lake

U-SQL


demoAZURE DATA LAKE




Azure Machine Learning• Data Mining 2.0

– De nombreux model de classification, régression et clustering disponibles : Réseau de neurones, arbre de décision, Support vector machine…

• Données en entrée– HDInsight (Hive)– Azure SQL– Azure Tables– Données locales (fichiers)



Azure Machine Learning• Support de R et Python• Requêtable par Web Service

– Azure ML API

• ML Studio Principe de la paillasse de laboratoire– Démarrage immédiat



demoAZURE MACHINE LEARNING


Azure Data Factory


Azure Data FactoryData Supply Chain• Ingest• Transform• Publish• Monitor

Azure Data Factory

Data Pipelines


Azure Data Factory• Sources / Destinations

– Données OnPrem (SQL Server)– Azure Blob / Azure Tables– SQL Azure

• Transformation– Map/Reduce– Hive/Pig– Custom Activities : C#

Azure Data Factory


demoAZURE DATA FACTORY




Azure Stream Analytics• Permet d’analyser des flux temps réel

– Millions d’événements / seconde– 365 jours de rétention (ou 20To)

• Basé sur Event Hub• Syntaxe SQL• Export vers SQL Azure/Blob/Power

BI/ADL…

Azure Stream

Analytics

SELECT Category, COUNT(*) FROM Input TIMESTAMP BY EntryTimeGROUP BY Category, SlidingWindow(minute, 5)


demoAZURE STREAM ANALYTICS


Algorithmes


Rise of Analytics...


Skynet

Paul le poulpe

VS


Intelligence Galleryhttps://gallery.cortanaintelligence.com/Cognitive Services (ex: Project Oxford)https://www.microsoft.com/cognitive-services/http://how-old.net/ - https://www.captionbot.ai/Cortana Intelligence Serviceshttps://www.microsoft.com/en-us/server-cloud/cortana-intelligence-suite/Deep Learning Frameworkhttp://blogs.microsoft.com/next/2016/01/25/microsoft-releases-cntk...

Microsoft investit dans l’intelligence artificielle

https://gallery.cortanaintelligence.com/



https://www.microsoft.com/cognitive-services/



http://how-old.net/

https://www.captionbot.ai/

https://www.microsoft.com/en-us/server-cloud/cortana-intelligence-suite/

https://www.microsoft.com/en-us/server-cloud/cortana-intelligence-suite/

http://blogs.microsoft.com/next/2016/01/25/microsoft-releases-cntk-its-open-source-deep-learning-toolkit-on-github/








Architecture ?


Cortana Analytics SuiteTransform data into intelligent action

DATA INTELLIGENCE ACTION

Business ScenariosRecommendations,

customer churn,forecasting, etc.

Perceptual IntelligenceFace, vision

Speech, text

Personal Digital Assistant

Cortana

Dashboards and Visualizations

Power BI

Machine Learning

and Analytics


Azure HDInsight (Hadoop)


Business apps

Custom apps

Sensors and devices

People

Automated Systems

Big Data Stores

Azure SQL Data Warehouse

Information Management

Azure Data Factory

Azure Data Catalog

Azure Event Hub

Data Collection ToolsData Collection Tools

Azure Data Lake Store



Un nouveau métier :Data Architect

Presentations & Public Speaking

Jean-Pierre Riehl, Fabien Adato - Cortana Analytics - Global Azure Bootcamp 2016 Paris