Issue 701: Malfunctioning of the reintegration tool

issues
Status:closed
Assigned To:Guest
Type:Defect
Area:Skyline
Priority:3
Milestone:4.3
Opened:2019-12-05 08:06 by nicolas pythoud
Changed:2021-12-01 12:58 by Brendan MacLean
Resolved:2019-12-05 09:01 by Brendan MacLean
Resolution:By Design
Related:700
Closed:2021-12-01 12:58 by Brendan MacLean
Related Issues
2019-12-05 08:06 nicolas pythoud
Title»Malfunctioning of the reintegration tool
Assigned ToGuest»Brendan MacLean
Type»Defect
Area»Skyline
Priority»3
Related»700
I cannot seem to find the update botton you are talking about. Here is the screenshot of the mprophet model.
 
 mprophetModel.png

2019-12-05 09:01 Brendan MacLean
resolve as By Design
Statusopen»resolved
Assigned ToGuest»Brendan MacLean
Related»700
That is a pretty messed up model. With a mProphet model like that I am not surprised that the default model does better. Your model has perfect separation of targets and decoys, but that clearly (especially from your example) is just an overtraining illusion. Since the default model has no ability to overtrain, as it is fixed, it does better.

You should not use mProphet with a model like this, and Skyline gives you all the tools you should need to see that the model has gone awry.

First step is to go back to the Advanced Peak Picking tutorial and understand how to figure out why certain scores are disabled. You really want to find a way to get the Library and Retention Time scores enabled. They are 2 of the most important scores, and I wouldn't recommend using a model without them.

If all you need is q values on your peaks, you could also try switching from "mProphet" to the "Default" score and clicking the "Train" button for that to calibrate the default score to your decoys and so achieve a model that can assign "Detection Q Value" and "Detection Z Score" to your peaks without actually altering the relative contributions of the scores in the default score (which helps to avoid overtraining). We are planning on making this more automatic in Skyline in the future so that the default score assigns q values and z scores in any document containing decoys.

So, up to you. You can continue working on your mProphet model until it seems more likely to be valid. I doubt a reviewer who understood mProphet models would let this one get by in a manuscript. Or you can try using Default score trained to give you q values.

2019-12-05 09:07 Brendan MacLean
Not sure what is going on with the Issues list that you can't update your own bug. I need to look into that.

However, this is really a support request. Please switch to using the support board for further discussion, and wait until we identify any work to be done on the Skyline side to open an issue report.

2019-12-05 09:08 Brendan MacLean
Related700»700

2021-12-01 12:58 Brendan MacLean
close
Statusresolved»closed
Assigned ToBrendan MacLean»Guest