BI, Big Data, Data Analytics, and Data Visualization

SQW07 Big Data Technologies: What, Where and How to Run Them on Azure


2:00pm - 3:15pm

Level: Introductory

Andrew Brust

Senior Director, Market Strategy and Intelligence


Big Data and technologies around it, like Apache Hadoop and Apache Spark, aren't mere curiosities anymore. In fact, these technologies are becoming standard in corporate IT environments. But that doesn't mean you know them yet – you're busy with operational database concerns, after all. Plus, even if you have the skills, the technology is changing at such a rapid clip, that a check-in is warranted.

In this talk, we'll start from the beginning but then rapidly accelerate to modern day-and-date. You'll learn what Big Data really is, how to work with the core technologies around it, and then get up-to-speed on all the new ecosystem companion technologies, including discussions of Kafka, Flink and TensorFlow, and direct demo exposure to Tez, Spark SQL and even a little Python.

What you learn will help you work with Big Data technology in any environment, and you'll take away specific knowledge of how to get everything running on Azure HDInsight. We'll also cover tie-ins to SQL Server, Visual Studio, Powershell and even the new Bash on Windows feature of Windows 10.