We've redesigned our reconciliation strategy. When you make fundamental changes to your source data, for example, updating a value for a past date or removing columns in a spreadsheet, our new strategy ensures your instant and custom data feed metrics automatically update to align with those changes.
This article includes:
- How reconciliation used to work
- How reconciliation works now
- Can I reset my older metrics to use the new reconciliation strategy?
- Why didn't my metric update?
How reconciliation used to work
Metrics could auto-update but it depended on when the change to the source data occurred and the type of data service that was being used. Most services had a reconciliation window of 2 days but this varied.
If you made a change to the data that was being used for a metric, and the change occurred in the last two days of the previously successful data ingestion (the reconciliation window) then the metric would update based on the changes you made. If the changes occurred before the reconciliation window ( > 2 days) then the metric would not reflect the changes. When this happened, you had to manually update the metric by either creating a new metric or by editing the existing metric and deleting and replacing its stored historical data.
How reconciliation works now
No more worrying about data service imposed reconciliation limits! Our new strategy moves past those limitations to ensure changes in your data are automatically transmitted to your data feed metrics.
How do we do it? When we refresh your data feed metrics, we compare the entire existing data for the metric with the current refresh window to detect any changes in your data. If there are changes, we ingest the differences and your metrics are automatically updated to match the current information in the source data.
Note: Our new reconciliation strategy applies to all instant and custom data feed metrics that were added to your account starting on April 1, 2022 (the release date of our new strategy).
Can I reset my older metrics to use the new reconciliation strategy?
As mentioned above, the new reconciliation strategy took effect on April 1, 2022. If you want to apply it to metrics that were created prior to that date, you can edit the metric and choose the "Delete and replace data" option. Go here to learn more.
Why didn’t my metric update?
When doing comparisons to reconcile your metric, we compare the refreshed range of data to the existing data. For example, on refresh, if the minimum date is June 2, 2022 and the maximum date is June 21, 2022, we do a day-by-day comparison from June 2, 2022 to June 21, 2022. If you remove an entire day of data and the deleted day is outside of the range, it will not be registered as a deleted date. To fix this (and ensure the date is registered as “deleted”) pad the refresh range with data, such that the deleted day falls between the minimum and maximum refresh date range.