data-platform Featured Key Learnings on Using Apache HUDI in building Lakehouse Architecture @ Halodoc In this blog, we will go through Apache HUDI in detail and how it helped us in building a transactional data lake. We will also highlight some of the challenges in general people faced while building the lake house and how we overcome using Apache HUDI.
data-platform Featured Lake House Architecture @ Halodoc: Data Platform 2.0 In this blog, we will go over our new architecture, components involved and different strategies to have a scalable Data Platform.
data-platform Featured Data Platform 2.0 - Part I In this blog we walk you through some of the challenges/limitations we faced in our existing Data Platform and new features we added to ensure a more robust and reliable data platform.
machine-learning Featured Build end-to-end machine learning workflows with Kubernetes and Apache Airflow In this blog, we'll discuss how we leveraged Apache Airflow and Kubernetes allowing us to move beyond CRONTAB and manage our batch inference workloads.
data-enginnering Featured End-to-end data pipeline to query Clevertap events data using Athena/Redshift Spectrum In this blog, we provided insights on why and how we built an end-to-end data pipeline to query S3 data via Spectrum/Athena.
data-enginnering Velocity: Real-Time Data Pipeline at Halodoc This blog shows why and how Halodoc built Velocity, a Real-Time Data Pipeline.