Why Big Data is pushing us towards Machine learning

As an Engineer Manager with more than 20 years of experience I have seen many changes that completely disrupted different areas: “Web 2.0”, “Cloud computing”, “Mobile-first”, “Big Data”, etc. The new kid on the block is “Machine learning” and it is definitely at its peak, one example is perfectly described by CB Insights on how startups coinedContinue reading “Why Big Data is pushing us towards Machine learning”

Building a data lake in S3 using an event-driven serverless architecture

This article is about the journey from: A data warehouse to a data lake. Batch to near real-time processing. Availability to query all data from the same repository (raw and processed). Let’s start by understanding some terms. Wikipedia defines Data Warehouses as:“…central repositories of integrated data from one or more disparate sources. They store current and historicalContinue reading “Building a data lake in S3 using an event-driven serverless architecture”

Design a site like this with WordPress.com
Get started