We've introduced a new safety mechanism for our materialization pipeline to better protect data consistency. While we've always had safeguards in place during the sync process, this new system provides an additional layer of protection and control for developers against unexpected data changes.
With materialization halting, you can specify thresholds for the amount of data added, updated, or deleted to trigger a "pause". This allows you to review and approve changes before they are applied to the final dataset.
Pipeline Updates
- Added Materialization Halting: The system will now automatically halt materialization processes if the data changes exceed defined safety thresholds.
Dashboard Updates
- Standardized buttons, tooltips, toasts, modals, and sheets for better visual consistency. This is part of a larger effort to improve the overall user experience of the Edlink dashboard and make our product more consistent and intuitive to use.