Data Pipeline use cases

Data Pipeline

There are plenty of use cases when AWS data pipelines could save a fortune and speed up business decisions. Firstly, it is serverless that means you do not have anything on your server if you do not want to. Everything is starting entirely on AWS side and you pay only per execution.

  1. Analyse daily users’ behaviour through extracting data from logs
  2. Analyse transactions for payment system
  3. Analyse stock exchange reports. And many more

So, datapipeline allows you to spin up entire infrastructure needed for Hadoop cluster. Run all logic you desire to process your data with and shut down. Main steps are:

Continue reading “Data Pipeline use cases”