AZURE SYNAPSE ANALYTICS

Azure Synapse was formerly known as SQL DW can be discussed as a limitless analytics service provided by azure which empowers enterprise data warehouse and Big Data Analytics services.

Enabling the users to query data on their own terms using either serverless o demand or provisioned resources which is at scale. It pushes the capabilities to bring two worlds together with a unified experience to ingest, prepare ad to manage also with server data for immediate BI and Machine Learning capabilities.

Key Components of a Big Data Solution

source : - https://docs.microsoft.com/en-us/azure/sql-data-warehouse/media/sql-data-warehouse-overview-what-is/data-warehouse-solution.png

The data warehouse is the key component of a cloud-based, end to end big data solution and In a Cloud Data solution the data is ingested into big data stores from a variety of sources when in a BigData store, Hadoop Spark and Machine Learning algorithm prepare ad train the data, but when the data is complex analysis, SQL analytics uses PolyBase to query the big Data Store.

[ Polybase uses standard T-SQL queries to bring the data into SQL Analytics Table ]

The storing capability of SQL Analytics is in relational tables and columnar storage, which reduces the data storage cost and improves query performance. Once data is stored one ca run analytics at massive scale as compared to traditional database systems, analysis queries.

Azure Synapse has four components :

• SQL Analytics: Complete T-SQL based analytics -( SQL pool -pay per DWU provisioned), (pay per TB processed)
• Apache Spark
• Data Integration
• Studio