Title | | » | Nightly tutorial tests should not always re-download data sets - makes us too vulnerable to temporary outages |
Assigned To | Guest | » | Brian Pratt |
Type | | » | Defect |
Area | | » | Skyline |
Priority | | » | 3 |
Instead:
Don't do the tutorials directory wipe as we used to do in SkylineNightly
per tutorial test:
Download data if none present already, as we do already
If a tutorial fails, re-download data alongside existing copy of data and compare.
If data has changed, replace it and retry the test. If it hasn't changed, just treat it as a normal failure.