Issue 703: Nightly tutorial tests should not always re-download data sets - makes us too vulnerable to temporary outages

issues
Status:open
Assigned To:Brian Pratt
Type:Defect
Area:Skyline
Priority:3
Milestone: 
Opened:2019-12-06 by Brian Pratt
Changed:2019-12-06 by Brian Pratt
Resolved:
Resolution:
Closed:
2019-12-06 Brian Pratt
Title»Nightly tutorial tests should not always re-download data sets - makes us too vulnerable to temporary outages
Assigned ToGuest»Brian Pratt
Type»Defect
Area»Skyline
Priority»3
Instead:

Don't do the tutorials directory wipe as we used to do in SkylineNightly

per tutorial test:
  Download data if none present already, as we do already
  If a tutorial fails, re-download data alongside existing copy of data and compare.
  If data has changed, replace it and retry the test. If it hasn't changed, just treat it as a normal failure.