Month: May 2018

Azure Weekly

Azure Weekly: May 21, 2018 – Lots of Announcements from //Build 2018

Do you find it difficult to keep up-to-date on the frequent updates and changes in the Microsoft Azure cloud? If so, Build Azure Weekly is the solution you’ve been looking for! Build Azure Weekly is a weekly newsletter that includes all the latest Microsoft Azure Service Updates from the week in addition to links to many other blog articles, podcasts and videos from all over the Internet.

If you want to receive the newsletter in your email every week, then you’ll absolutely want to Subscribe!

The Weeks Top Links

Here are some of the most notable links from the week:

Azure Service Updates

Here’s a list of the Microsoft Azure Service Updates from over the past week:

Monthly Sponsor

If you haven’t checked out what Opsgility has to offer yet, please click the link below and go check out the awesome training offered!

Are you looking for a clear and outlined path to learn Microsoft Azure? No matter if you’re a Developer, IT Pro, or Architect, Opsgility has courses that will help you learn how to build and implement solutions within Microsoft Azure more affectively and efficiently. The on-demand and instructor-led courses from Opsgility offer maximum flexibility to learn how you learn best, and to help your team grow into the cloud experts you need them to be in an efficient manner.

Opsgility is the leading Microsoft cloud technology trainer for developers and IT professionals, built around an esteemed network of industry experts and technical authors that includes Microsoft MVPs and Microsoft Insiders in more than 10 countries.

Get started today with Microsoft Dev Essentials and get 3 months Free of Opsgility on-demand streaming service! Read More

Azure Weekly

Azure Weekly: May 7, 2018 – First-class Support for CloudEvents on Azure

Do you find it difficult to keep up-to-date on the frequent updates and changes in the Microsoft Azure cloud? If so, Build Azure Weekly is the solution you’ve been looking for! Build Azure Weekly is a weekly newsletter that includes all the latest Microsoft Azure Service Updates from the week in addition to links to many other blog articles, podcasts and videos from all over the Internet.

If you want to receive the newsletter in your email every week, then you’ll absolutely want to Subscribe!

First-class Support for CloudEvents on Azure

In addition to the default event schema of Azure Event Grid, Microsoft has added support for events using the CloudEvents JSON schema. CloudEvents is an open standard specification for describing event data in a common way, and Microsoft Azure is the first cloud provider to release support for CloudEvents!

The CloudEvents specification has been contributed to by many organizations; including Microsoft, Amazon, Google, VMWare, and more. The CloudEvents schema simplifies interoperability by providing a common event schema for publishing, and consuming cloud based events. This enables uniform tooling, a standard way for routing and handling events, and universal ways of deserializing the outer event schema. With this common CloudEvents schema, you can more easily integrate work across platforms!

The Azure documentation contains some documentation how to use CloudEvents with Azure Event Grid.

The Weeks Top Links

Here are some of the most notable links from the week:

Azure Service Updates

Here’s a list of the Microsoft Azure Service Updates from over the past week:

Monthly Sponsor

If you haven’t checked out what Opsgility has to offer yet, please click the link below and go check out the awesome training offered!

Are you looking for a clear and outlined path to learn Microsoft Azure? No matter if you’re a Developer, IT Pro, or Architect, Opsgility has courses that will help you learn how to build and implement solutions within Microsoft Azure more affectively and efficiently. The on-demand and instructor-led courses from Opsgility offer maximum flexibility to learn how you learn best, and to help your team grow into the cloud experts you need them to be in an efficient manner.

Opsgility is the leading Microsoft cloud technology trainer for developers and IT professionals, built around an esteemed network of industry experts and technical authors that includes Microsoft MVPs and Microsoft Insiders in more than 10 countries.

Get started today with Microsoft Dev Essentials and get 3 months Free of Opsgility on-demand streaming service! Read More

CertificationData Sciencedatabase

70-776: Perform Big Data Engineering on Microsoft Cloud Services Certification Exam (20776)

The 70-776 Performing Big Data Engineering on Microsoft Cloud Services certification exam tests and validates your expertise in designing analytics solutions and building operationalized solutions on Microsoft Azure. This exam covers data engineering topics around Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics.

Exam Target Audience

The 70-776 Performing Big Data Engineering on Microsoft Cloud Services certification exam is targeted towards Big Data Professionals. This exam is centered around designing analytics solutions and building operationalized solutions on Microsoft Azure. The primary Azure service areas covered on this Big Data exam are: Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics.

Candidates with experience and familiarity with the capabilities and features of batch data processing, real-time processing, and operationalization technologies are the targeted audience for this exam. These candidates will be able to apply Microsoft cloud technologies to solution designs, and implement big data analytics solutions.

Skills Measured

Here is a list of the skills and objectives measured on this exam. The percentages on the high level objective areas represents the percentage of the exam that is focused on that objective area.

  • Design and Implement Complex Event Processing By Using Azure Stream Analytics (15-20%)
    • Ingest data for real-time processing
      • Select appropriate data ingestion technology based on specific constraints; design partitioning scheme and select mechanism for partitioning; ingest and process data from a Twitter stream; connect to stream processing entities; estimate throughput, latency needs, and job footprint; design reference data streams
    • Design and implement Azure Stream Analytics
      • Configure thresholds, use the Azure Machine Learning UDF, create alerts based on conditions, use a machine learning model for scoring, train a model for continuous learning, use common stream processing scenarios
    • Implement and manage the streaming pipeline
      • Stream data to a live dashboard, archive data as a storage artifact for batch processing, enable consistency between stream processing and batch processing logic
    • Query real-time data by using the Azure Stream Analytics query language
      • Use built-in functions, use data types, identify query language elements, control query windowing by using Time Management, guarantee event delivery
  • Design and Implement Analytics by Using Azure Data Lake (25-30%)
    • Ingest data into Azure Data Lake Store
      • Create an Azure Data Lake Store (ADLS) account, copy data to ADLS, secure data within ADLS by using access control, leverage end-user or service-to-service authentication appropriately, tune the performance of ADLS, access diagnostic logs
    • Manage Azure Data Lake Analytics
      • Create an Azure Data Lake Analytics (ADLA) account, manage users, manage data sources, manage, monitor, and troubleshoot jobs, access diagnostic logs, optimize jobs by using the vertex view, identify historical job information
    • Extract and transform data by using U-SQL
      • Schematize data on read at scale; generate outputter files; use the U-SQL data types, use C# and U-SQL expression language; identify major differences between T-SQL and U-SQL; perform JOINS, PIVOT, UNPIVOT, CROSS APPLY, and Windowing functions in U-SQL; share data and code through U-SQL catalog; define benefits and use of structured data in U-SQL; manage and secure the Catalog
    • Extend U-SQL programmability
      • Use user-defined functions, aggregators, and operators, scale out user-defined operators, call Python, R, and Cognitive capabilities, use U-SQL user-defined types, perform federated queries, share data and code across ADLA and ADLS
    • Integrate Azure Data Lake Analytics with other services
      • Integrate with Azure Data Factory, Azure HDInsight, Azure Data Catalog, and Azure Event Hubs, ingest data from Azure SQL Data Warehouse
  • Design and Implement Azure SQL Data Warehouse Solutions (15-20%)
    • Design tables in Azure SQL Data Warehouse
      • Choose the optimal type of distribution column to optimize workflows, select a table geometry, limit data skew and process skew through the appropriate selection of distributed columns, design columnstore indexes, identify when to scale compute nodes, calculate the number of distributions for a given workload
    • Query data in Azure SQL Data Warehouse
      • Implement query labels, aggregate functions, create and manage statistics in distributed tables, monitor user queries to identify performance issues, change a user resource class
    • Integrate Azure SQL Data Warehouse with other services
      • Ingest data into Azure SQL Data Warehouse by using AZCopy, Polybase, Bulk Copy Program (BCP), Azure Data Factory, SQL Server Integration Services (SSIS), Create-Table-As-Select (CTAS), and Create-External-Table-As-Select (CETAS); export data from Azure SQL Data Warehouse; provide connection information to access Azure SQL Data Warehouse from Azure Machine Learning; leverage Polybase to access a different distributed store; migrate data to Azure SQL Data Warehouse; select the appropriate ingestion method based on business needs
  • Design and Implement Cloud-Based Integration by using Azure Data Factory (15-20%)
    • Implement datasets and linked services
      • Implement availability for the slice, create dataset policies, configure the appropriate linked service based on the activity and the dataset
    • Move, transform, and analyze data by using Azure Data Factory activities
      • Copy data between on-premises and the cloud, create different activity types, extend the data factory by using custom processing steps, move data to and from Azure SQL Data Warehouse
    • Orchestrate data processing by using Azure Data Factory pipelines
      • Identify data dependencies and chain multiple activities, model schedules based on data dependencies, provision and run data pipelines, design a data flow
    • Monitor and manage Azure Data Factory
      • Identify failures and root causes, create alerts for specified conditions, perform a redeploy, use the Microsoft Azure Portal monitoring tool
  • Manage and Maintain Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics (20-25%)
    • Provision Azure SQL Data Warehouse, Azure Data Lake, Azure Data Factory, and Azure Stream Analytics
      • Provision Azure SQL Data Warehouse, Azure Data Lake, and Azure Data Factory, implement Azure Stream Analytics
    • Implement authentication, authorization, and auditing
      • Integrate services with Azure Active Directory (Azure AD), use the local security model in Azure SQL Data Warehouse, configure firewalls, implement auditing, integrate services with Azure Data Factory
    • Manage data recovery for Azure SQL Data Warehouse, Azure Data Lake, and Azure Data Factory, Azure Stream Analytics
      • Backup and recover services, plan and implement geo-redundancy for Azure Storage, migrate from an on-premises data warehouse to Azure SQL Data Warehouse
    • Monitor Azure SQL Data Warehouse, Azure Data Lake, and Azure Stream Analytics
      • Manage concurrency, manage elastic scale for Azure SQL Data Warehouse, monitor workloads by using Dynamic Management Views (DMVs) for Azure SQL Data Warehouse, troubleshoot Azure Data Lake performance by using the Vertex Execution View
    • Design and implement storage solutions for big data implementations
      • Optimize storage to meet performance needs, select appropriate storage types based on business requirements, use AZCopy, Storage Explorer and Redgate Azure Explorer to migrate data, design cloud solutions that integrate with on-premises data

You can also view the full objectives list for the 70-776 Performing Big Data Engineering on Microsoft Cloud Services certification exam on the official 70-776 exam page at Microsoft.com.

Training Material

There are not very many study / training materials designed specifically for the 70-776 Perform Big Data Engineering on Microsoft Cloud Services certification exam. As example, Microsoft Press has not published any Exam Ref or Guide books for this exam yet (at the time of writing this.) However, there is still plenty of material available from various sources, both Free and Paid, that range from official product documentation from Microsoft, other articles and videos from Microsoft, as well as training from companies like Opsgility and their SkillMeUp service.

Another interesting resource to utilize is the following recording of the 70-776 Cert Exam Prep session given by James Herring at Microsoft Ignite 2017:

Happy Studying!!

Azure Weekly

Azure Weekly: May 1, 2018 – Build Conference Next Week!

Do you find it difficult to keep up-to-date on the frequent updates and changes in the Microsoft Azure cloud? If so, Build Azure Weekly is the solution you’ve been looking for! Build Azure Weekly is a weekly newsletter that includes all the latest Microsoft Azure Service Updates from the week in addition to links to many other blog articles, podcasts and videos from all over the Internet.

If you want to receive the newsletter in your email every week, then you’ll absolutely want to Subscribe!

Microsoft Build Conference Next Week!

Next week, May 7, 2018, is when Microsoft’s Build Conference kicks off this year! You may have noticed by watching the Build Azure Weekly newsletter / blog post the last few weeks there have been a ton of new feature and service announcements recently. It appears the different product teams are gearing up for Build releases and announcements. In addition to the recent announcements, we will likely see quite a few new announcements and product releases made either directly at Build during the keynote talks, or online surrounding the event. This is something that generally happens every year at the event.

There are some great “Featured” speakers lined up for the Build Conference, which include the following. Rather than list job titles, the following lists topic areas, just as the official Microsoft Build information does.

  • Satya Nadella, Intelligent Cloud & Intelligent Edge
  • Scott Guthrie, Cloud & Artificial Intelligence
  • Joe Belfiore, Windows
  • Scott Hanselman, Visual Studio & .NET
  • Elaine Chang, Intelligent Bots
  • Mark Russinovich, Cloud & Microsoft Azure
  • Cindy Alvarez, UX Design
  • Aaron Gustafson, Progressive Web App Development

If you are not able to attend Build in-person next week, you can attend virtually through the Microsoft Build Live stream online for Free!

The Weeks Top Links

Here are some of the most notable links from the week:

Azure Service Updates

Here’s a list of the Microsoft Azure Service Updates from over the past week:

Monthly Sponsor

If you haven’t checked out what Opsgility has to offer yet, please click the link below and go check out the awesome training offered!

Are you looking for a clear and outlined path to learn Microsoft Azure? No matter if you’re a Developer, IT Pro, or Architect, Opsgility has courses that will help you learn how to build and implement solutions within Microsoft Azure more affectively and efficiently. The on-demand and instructor-led courses from Opsgility offer maximum flexibility to learn how you learn best, and to help your team grow into the cloud experts you need them to be in an efficient manner.

Opsgility is the leading Microsoft cloud technology trainer for developers and IT professionals, built around an esteemed network of industry experts and technical authors that includes Microsoft MVPs and Microsoft Insiders in more than 10 countries.

Get started today with Microsoft Dev Essentials and get 3 months Free of Opsgility on-demand streaming service! Read More