Hi @keyinora,
Thanks for reaching out with your feedback!
The issue you’re describing is a known challenge in visual testing, often referred to as “flakiness.” These false positives can occur due to deviations in the rendering process of a website.
The following causes are known to produce flakiness:
- Cumulative Layout Shift (CLS): Analyse if your website has shifting elements during the loading process that cause CLS. Check your entire page, not just above the fold, and see if you can reduce the CLS.
- Animations: Elements that animate after the page has loaded cause similar issues in visual tests. If applicable, you may adjust the animations, or hide those elements from VRTs via CSS selectors in our exclusion feature.
We’re also currently developing a solution to reduce these kinds of alerts. One approach we’re considering is implementing threshold control. This would allow you to set a tolerance level for visual changes, so you’d only get alerts for changes that exceed this threshold. The tricky part is ensuring that this threshold doesn’t make you miss genuine, important changes.
I understand this can be a pain point, and I appreciate your patience as we work on refining it. In the meantime, if there’s anything specific you’d like us to look into or if you have further questions, please don’t hesitate to let us know. Your feedback is invaluable in helping us improve.
Best
Steffen
