As an Engineer Manager with more than 20 years of experience I have seen many changes that completely disrupted different areas: “Web 2.0”, “Cloud computing”, “Mobile-first”, “Big Data”, etc. The new kid on the block is “Machine learning” and it is definitely at its peak, one example is perfectly described by CB Insights on how startups coinedContinue reading “Why Big Data is pushing us towards Machine learning”
Category Archives: Uncategorized
Building a data lake in S3 using an event-driven serverless architecture
This article is about the journey from: A data warehouse to a data lake. Batch to near real-time processing. Availability to query all data from the same repository (raw and processed). Let’s start by understanding some terms. Wikipedia defines Data Warehouses as:“…central repositories of integrated data from one or more disparate sources. They store current and historicalContinue reading “Building a data lake in S3 using an event-driven serverless architecture”