Data Engineering Automation Strategies for Monitoring and Self-healing of Data Pipelines This blog highlights how we use automation to enhance the reliability and cost efficiency of our data processes.
Data Archival Data Lake Archival Strategy for Cost-Efficient Cloud Storage At Halodoc, we use AWS’ Simple Cloud Storage (S3) to store our raw, processed, and backup data, as well as the source for the bulk load into our data warehouse.
data-enginnering Slow Changing Dimension Type 2 for Hybrid Model of Dimensional Modelling SCD2 is a useful feature for operational and analysis use cases that gives our users the ability to capture all the different versions of a data point