Structure Drift
How we detect when vendors change their feed structure
What is structure drift?
Vendors change their changelog structure without warning. An RSS feed might switch to HTML, or a vendor might add new fields to their feed. When this happens, our parser needs to adapt.
How we detect drift
We hash the structure of each changelog source (the set of fields we extract, not the content). If the hash changes, we know the vendor changed their feed structure. This is stored in the structure_hash field on the ChangelogSource record.
What happens when drift is detected
When structure drift is detected, we mark the source as degraded and log the change. We continue fetching the changelog, but entries may be incomplete until we update the parser.
Degraded sources do not consume a slot on your plan and are not billed. See Health and Billing for details.
How we fix drift
We update parsers nightly for degraded sources. Most drift is cosmetic (a vendor adding a new field we do not need), so the source often recovers automatically once we adjust the adapter.