View
127
Download
0
Category
Preview:
Citation preview
http://GUSS.Pro @GUSS_FRANCE
Cortana Analytics, de nouveaux patterns pour vos plateformes de donnéesJean-Pierre Riehl / Fabien Adato
http://GUSS.Pro @GUSS_FRANCE
Rejoignez la communautéWebcasts, Conférences, Afterworks
La communauté Data Microsoft
@GUSS_FRANCE
/GUSS /GUSS.FR Save the Date
Samedi 25 juin 2016Campus SUPINFOTour Montparnasse, Paris
http://GUSS.Pro @GUSS_FRANCE
PréconférenceCortana Analytics, une plate-forme de données moderne
Vendredi 24 juin 2016En préambule du SQLSaturday Paris
Jean-Pierre Riehl – FRMVP DataPlatform depuis 2008
@djeepy1
Fabien Adato – FRConsultant Data Science
@fabienAD
http://GUSS.Pro @GUSS_FRANCE
Qui sommes nous ?
Jean-Pierre Riehl
Practice Manager Data & BI
MVP SQL ServerChapter Leader– GUSS
@djeepy1http://blog.djeepy1.net
Fabien AdatoConsultant Data Science
@fabienADhttp://fadata-blog.com
http://GUSS.Pro @GUSS_FRANCE
Get
Model
Analyze
?Store
http://GUSS.Pro @GUSS_FRANCE
Nouvelles questionsNouveaux challengesNouveaux outils
Self-Service BI
Agilité Big Data IoT
http://GUSS.Pro @GUSS_FRANCE
Cloud-First ?
http://GUSS.Pro @GUSS_FRANCE
Nouvelles architectures ?
http://GUSS.Pro @GUSS_FRANCE
Cortana Analytics SuiteTransform data into intelligent action
DATA INTELLIGENCE ACTION
Business ScenariosRecommendations,
customer churn,forecasting, etc.
Perceptual IntelligenceFace, vision
Speech, text
Personal Digital Assistant
Cortana
Dashboards and Visualizations
Power BI
Machine Learning
and Analytics
Azure Machine Learning
Azure HDInsight (Hadoop)
Azure Stream Analytics
Business apps
Custom apps
Sensors and devices
People
Automated Systems
Big Data Stores
Azure SQL Data Warehouse
Information Management
Azure Data Factory
Azure Data Catalog
Azure Event Hub
Data Collection ToolsData Collection Tools
Azure Data Lake Store
Azure Data Lake Analytics
http://GUSS.Pro @GUSS_FRANCE
Boite à outils « Cloud »HDInsight
Azure Data Lake
Azure SQL DWH
HADOOP
Azure DocumentD
BAzure SQL
IaaS
Power BI
Azure Data Catalog
Azure Machine Learning
Azure Data FactoryAzure
Stream Analytics
http://GUSS.Pro @GUSS_FRANCE
HDInsight
Azure Data Lake
HADOOP
Azure Machine Learning
Azure Data FactoryAzure
Stream Analytics
Boite à outils « Cloud »……Une sélection
http://GUSS.Pro @GUSS_FRANCE
HDInsight et l’écosystème HADOOP
http://GUSS.Pro @GUSS_FRANCE
HDInsight : le monde Big DataH
DIn
sigh
t
Azure Blob
HDFS
Sqoop
Oozie
Azure UX
SDK Azure
WebHcat/ Templeto
nRDP
YarnHive Pig HCatalog AmbariMap/
Reduce StormHBase
HDInsightHADOOP
+ R Server, Spark, etc.
http://GUSS.Pro @GUSS_FRANCE
Azure Data Lake
http://GUSS.Pro @GUSS_FRANCE
A hyper scale repository for big data analytic workloads
Introducing Azure Data Lake
• Hadoop File System compatible with HDFS™• Integrated with HDInsight, Revolution R, Hortonworks, Cloudera• Based on YARN
• Petabyte-sized files• No size limits to data in single account•Massive throughput to increase performance
• AAD based access control• Data management
Devices
http://GUSS.Pro @GUSS_FRANCE
Analytics
Storage
HDInsight(“managed clusters”)
Azure Data Lake Analytics
Azure Data Lake Storage
Azure Data Lake
U-SQL
http://GUSS.Pro @GUSS_FRANCE
demoAZURE DATA LAKE
http://GUSS.Pro @GUSS_FRANCE
Azure Machine Learning
http://GUSS.Pro @GUSS_FRANCE
Azure Machine Learning• Data Mining 2.0
– De nombreux model de classification, régression et clustering disponibles : Réseau de neurones, arbre de décision, Support vector machine…
• Données en entrée– HDInsight (Hive)– Azure SQL– Azure Tables– Données locales (fichiers)
Azure Machine Learning
http://GUSS.Pro @GUSS_FRANCE
Azure Machine Learning• Support de R et Python• Requêtable par Web Service
– Azure ML API
• ML Studio Principe de la paillasse de laboratoire– Démarrage immédiat
Azure Machine Learning
http://GUSS.Pro @GUSS_FRANCE
demoAZURE MACHINE LEARNING
http://GUSS.Pro @GUSS_FRANCE
Azure Data Factory
http://GUSS.Pro @GUSS_FRANCE
Azure Data FactoryData Supply Chain• Ingest• Transform• Publish• Monitor
Azure Data Factory
Data Pipelines
http://GUSS.Pro @GUSS_FRANCE
Azure Data Factory• Sources / Destinations
– Données OnPrem (SQL Server)– Azure Blob / Azure Tables– SQL Azure
• Transformation– Map/Reduce– Hive/Pig– Custom Activities : C#
Azure Data Factory
http://GUSS.Pro @GUSS_FRANCE
demoAZURE DATA FACTORY
http://GUSS.Pro @GUSS_FRANCE
Azure Stream Analytics
http://GUSS.Pro @GUSS_FRANCE
Azure Stream Analytics• Permet d’analyser des flux temps réel
– Millions d’événements / seconde– 365 jours de rétention (ou 20To)
• Basé sur Event Hub• Syntaxe SQL• Export vers SQL Azure/Blob/Power
BI/ADL…
Azure Stream
Analytics
SELECT Category, COUNT(*) FROM Input TIMESTAMP BY EntryTimeGROUP BY Category, SlidingWindow(minute, 5)
http://GUSS.Pro @GUSS_FRANCE
demoAZURE STREAM ANALYTICS
http://GUSS.Pro @GUSS_FRANCE
Algorithmes
http://GUSS.Pro @GUSS_FRANCE
Rise of Analytics...
http://GUSS.Pro @GUSS_FRANCE
Skynet
Paul le poulpe
VS
http://GUSS.Pro @GUSS_FRANCE
Intelligence Galleryhttps://gallery.cortanaintelligence.com/Cognitive Services (ex: Project Oxford)https://www.microsoft.com/cognitive-services/http://how-old.net/ - https://www.captionbot.ai/Cortana Intelligence Serviceshttps://www.microsoft.com/en-us/server-cloud/cortana-intelligence-suite/Deep Learning Frameworkhttp://blogs.microsoft.com/next/2016/01/25/microsoft-releases-cntk...
Microsoft investit dans l’intelligence artificielle
http://GUSS.Pro @GUSS_FRANCE
Architecture ?
http://GUSS.Pro @GUSS_FRANCE
Cortana Analytics SuiteTransform data into intelligent action
DATA INTELLIGENCE ACTION
Business ScenariosRecommendations,
customer churn,forecasting, etc.
Perceptual IntelligenceFace, vision
Speech, text
Personal Digital Assistant
Cortana
Dashboards and Visualizations
Power BI
Machine Learning
and Analytics
Azure Machine Learning
Azure HDInsight (Hadoop)
Azure Stream Analytics
Business apps
Custom apps
Sensors and devices
People
Automated Systems
Big Data Stores
Azure SQL Data Warehouse
Information Management
Azure Data Factory
Azure Data Catalog
Azure Event Hub
Data Collection ToolsData Collection Tools
Azure Data Lake Store
Azure Data Lake Analytics
http://GUSS.Pro @GUSS_FRANCE
Un nouveau métier :Data Architect
Recommended