DP 203: Data Engineering on Microsoft Azure
- 3k Enrolled Learners
- Weekend
- Live Class
The Lambda architecture is an accommodation of speed layer and batch layer, where the data goes to both layers redundantly to get processed. The combination of both is called Lambda Architecture.
First, the data comes to data center, then to both the layers. As it goes to the batch layer where the data can be persisted into HDFS, then the workflow is run in periodic intervals.
In the speed layer, the data is passed in real time as it goes through different functions. Then, the query gets executed in batch or speed layer computer view. It is important to note that the servicing layer is the place, where the data is stored in some form in NoSQL or HDFS.
Once the data is processed in Hadoop platform, we can keep the data in HDFS or NoSQL.
The query could use NoSQL layers or use HIVE to run query over the dataset. Thus, the service layers serve the queries.
Got a question for us? Mention them in the comments section and we will get back to you.
Related Posts:
What is Apache Storm all about?
edureka.co
thanks for your tutorials
Thanks!! Feel free to go through our other posts as well.