This seems like it is a timestamp rollover issue. We have see this happen before when UDP stream timestamps are rolled-over after relatively short periods of time. It is curious that it would be happening after 24 hours as i would assume we’d detect the rollover in that case.
Could you confirm the measurement of the timestamps coming from your encoder? Is it milliseconds? Also, do you know if the timestamp rollover is set to happen every 24 hours (as your observations are suggesting)?