DataData is required to comprehend previous events, forecast potential future outcomes, identify patterns and anomalies, and get the understanding required to make quicker and better decisions. However, you must first gather, store, transform, integrate, and prepare your data before you can accomplish any of those things.
Azure Data Factory: What is it?
Let’s quickly review Azure Data Factory’s past before examining what it is now.
Azure Data Factory- V1
On October 28, 2014, Data Factory in Azure entered public preview. On August 6, 2015, it was made generally available. It was a rather restricted tool for processing time-sliced data back then. It excelled at that aspect, but it was unable to match the sophisticated and feature-rich SQL Server Integration Services (SSIS).
The graphical view was improved in the early days of ADF, but there was still a lot of JSON manipulation required when developing solutions in Visual Studio and even though the diagram display was improved, there was a great deal of JSON manipulation required. Just a few years ago, the world was totally different.
On September 25, 2017, ADF v2 entered public preview. Because it had so many brand-new features and functionalities, it was referred to as the “v2” version. Your current SQL Server Integration Services (SSIS) solutions could now be lifted and moved to Azure.
But more crucially, you could now run pipelines on a wall-clock schedule in addition to regular intervals, perform incredible things like looping and branching, and more. WHOA!
Although we may now laugh about it, at the time it was a major statement. When the new visual tools were made available in public preview on ADF v2, became much better on January 16th, 2018, YES TO DRAG AND DROP! On June 27th, 2018, all of these brand-new, gleaming features went generally available.
ADF v2 is the same as ADF:
Because of this, I now refer to “Azure Data Factory” as “Azure Data Factory v2” and omit the “v2” from the name. Most of the time, I act as though ADF v1 doesn’t exist.