https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&feed=atom&action=history Optimisation - Revision history 2024-03-29T07:14:49Z Revision history for this page on the wiki MediaWiki 1.39.6 https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=4132&oldid=prev Kay: /* Re-INTEGRATEing with the correct spacegroup, refined geometry and fine-slicing of profiles */ 2020-06-29T16:14:38Z <p><span dir="auto"><span class="autocomment">Re-INTEGRATEing with the correct spacegroup, refined geometry and fine-slicing of profiles</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 17:14, 29 June 2020</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l22">Line 22:</td> <td colspan="2" class="diff-lineno">Line 22:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  egrep -v &#039;JOB|REIDX&#039; XDS.INP &gt; XDS.INP.new</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  egrep -v &#039;JOB|REIDX&#039; XDS.INP &gt; XDS.INP.new</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;! JOB=XYCORR INIT COLSPOT IDXREF DEFPIX INTEGRATE CORRECT&quot; &gt; XDS.INP</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;! JOB=XYCORR INIT COLSPOT IDXREF DEFPIX INTEGRATE CORRECT&quot; &gt; XDS.INP</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;JOB=INTEGRATE CORRECT&quot; &gt;&gt; XDS.INP</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;JOB=<ins style="font-weight: bold; text-decoration: none;">DEFPIX </ins>INTEGRATE CORRECT&quot; &gt;&gt; XDS.INP</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_ALPHA/BETA=13 &gt;&gt; XDS.INP ! default is 9</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_ALPHA/BETA=13 &gt;&gt; XDS.INP ! default is 9</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_GAMMA=13      &gt;&gt; XDS.INP ! default is 9</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_GAMMA=13      &gt;&gt; XDS.INP ! default is 9</div></td></tr> <tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l28">Line 28:</td> <td colspan="2" class="diff-lineno">Line 28:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate. Fine-slicing of profiles has been found to be advantageous at least for Pilatus detectors ([http://dx.doi.org/10.1107/S0907444911049833 Müller, Wang and Schulze-Briese (2012), Acta Cryst D68, 42]), but this should not be specific for Pilatus.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate. Fine-slicing of profiles has been found to be advantageous at least for Pilatus detectors ([http://dx.doi.org/10.1107/S0907444911049833 Müller, Wang and Schulze-Briese (2012), Acta Cryst D68, 42]), but this should not be specific for Pilatus.</div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">You may also want to change the INCLUDE_RESOLUTION_RANGE= line in XDS.INP, in particular to adapt the upper resolution parameter. A very good rule is to set this to the resolution value of the highest shell that still has a "*" appended to the CC1/2 value in [[CORRECT.LP]] .</ins></div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== using the refined values for beam divergence and mosaicity for re-integration ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== using the refined values for beam divergence and mosaicity for re-integration ===</div></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=3081&oldid=prev Kay: /* Wilson outliers (aliens) */ 2015-01-05T08:13:02Z <p><span dir="auto"><span class="autocomment">Wilson outliers (aliens)</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:13, 5 January 2015</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l40">Line 40:</td> <td colspan="2" class="diff-lineno">Line 40:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* True outliers should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers - this is the default since January 2010 (the cutoff may be modified with the REJECT_ALIEN keyword).  </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* True outliers should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers - this is the default since January 2010 (the cutoff may be modified with the REJECT_ALIEN keyword).  </div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled <del style="font-weight: bold; text-decoration: none;">non-iteratively </del>in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[FAQ#reducing_WFAC1_below_its_default_of_1_improves_my_data.2C_right.3F|WFAC1]].</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled <ins style="font-weight: bold; text-decoration: none;">automatically </ins>in [[XDS]] <ins style="font-weight: bold; text-decoration: none;">(and [[XSCALE]])</ins>; the only way to influence [[XDS]] in this respect is by modifying [[FAQ#reducing_WFAC1_below_its_default_of_1_improves_my_data.2C_right.3F|WFAC1]].</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* if CORRECT rejects many &quot;aliens&quot; in a very weak high resolution shell because they have Z&gt;20 then this is due to the fact that the reflections do not obey Wilson statistics. If this happens, the REJECT_ALIEN parameter should be set much higher (e.g. 100).</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* if CORRECT rejects many &quot;aliens&quot; in a very weak high resolution shell because they have Z&gt;20 then this is due to the fact that the reflections do not obey Wilson statistics. If this happens, the REJECT_ALIEN parameter should be set much higher (e.g. 100).</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=3080&oldid=prev Kay: /* Wilson outliers (aliens) */ 2015-01-05T08:10:56Z <p><span dir="auto"><span class="autocomment">Wilson outliers (aliens)</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:10, 5 January 2015</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l40">Line 40:</td> <td colspan="2" class="diff-lineno">Line 40:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* True outliers should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers - this is the default since January 2010 (the cutoff may be modified with the REJECT_ALIEN keyword).  </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* True outliers should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers - this is the default since January 2010 (the cutoff may be modified with the REJECT_ALIEN keyword).  </div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[WFAC1]].</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[<ins style="font-weight: bold; text-decoration: none;">FAQ#reducing_WFAC1_below_its_default_of_1_improves_my_data.2C_right.3F|</ins>WFAC1]].</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* if CORRECT rejects many &quot;aliens&quot; in a very weak high resolution shell because they have Z&gt;20 then this is due to the fact that the reflections do not obey Wilson statistics. If this happens, the REJECT_ALIEN parameter should be set much higher (e.g. 100).</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* if CORRECT rejects many &quot;aliens&quot; in a very weak high resolution shell because they have Z&gt;20 then this is due to the fact that the reflections do not obey Wilson statistics. If this happens, the REJECT_ALIEN parameter should be set much higher (e.g. 100).</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2823&oldid=prev Kay: /* General guidelines for obtaining a good result from XDS */ 2013-08-22T08:03:29Z <p><span dir="auto"><span class="autocomment">General guidelines for obtaining a good result from XDS</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 09:03, 22 August 2013</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l3">Line 3:</td> <td colspan="2" class="diff-lineno">Line 3:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* read the article [[XDS.INP]]</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* read the article [[XDS.INP]]</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* for good indexing, follow [[XDS.INP#Keywords which affect whether indexing will succeed]]  </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* for good indexing, follow [[XDS.INP#Keywords which affect whether indexing will succeed]]  </div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* mask shaded areas of the detector using the UNTRUSTED_RECTANGLE, UNTRUSTED_ELLIPSE and UNTRUSTED_QUADRILATERAL keywords. This is very easy with the [[XDSGUI]] program.</ins></div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* at least use XDS-Viewer on FRAME.cbf to check the agreement between predicted and observed spots on last frame of dataset. It would be wise to also use XDS-Viewer on MODPIX.cbf and DECAY.cbf to get an impression about systematic effects in your data.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* at least use XDS-Viewer on FRAME.cbf to check the agreement between predicted and observed spots on last frame of dataset. It would be wise to also use XDS-Viewer on MODPIX.cbf and DECAY.cbf to get an impression about systematic effects in your data.</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2816&oldid=prev Kay: /* Wilson outliers (aliens) */ 2013-07-08T20:07:21Z <p><span dir="auto"><span class="autocomment">Wilson outliers (aliens)</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 21:07, 8 July 2013</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l40">Line 40:</td> <td colspan="2" class="diff-lineno">Line 40:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[WFAC1]].</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[WFAC1]].</div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* if CORRECT rejects many "aliens" in a very weak high resolution shell because they have Z>20 then this is due to the fact that the reflections do not obey Wilson statistics. If this happens, the REJECT_ALIEN parameter should be set much higher (e.g. 100).</ins></div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Optimizing the anomalous signal ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Optimizing the anomalous signal ===</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>It may be helpful to increase WFAC1 from its default 1.0 to 1.5, to avoid rejection of the strongest Bijvoet pairs (this is not necessary when STRICT_ABSORPTION_CORRECTION=TRUE which is &#039;&#039;not&#039;&#039; the default).  </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>It may be helpful to increase WFAC1 from its default 1.0 to 1.5, to avoid rejection of the strongest Bijvoet pairs (this is not necessary when STRICT_ABSORPTION_CORRECTION=TRUE which is &#039;&#039;not&#039;&#039; the default).  </div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Read [[Tips_and_Tricks#SAD.2FMAD_data_reduction]] concerning STRICT_ABSORPTION_CORRECTION.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Read [[Tips_and_Tricks#SAD.2FMAD_data_reduction]] concerning STRICT_ABSORPTION_CORRECTION.</div></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2650&oldid=prev Kay: paragraph about beam divergence and mosaicity 2012-07-20T01:16:07Z <p>paragraph about beam divergence and mosaicity</p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 02:16, 20 July 2012</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l27">Line 27:</td> <td colspan="2" class="diff-lineno">Line 27:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate. Fine-slicing of profiles has been found to be advantageous at least for Pilatus detectors ([http://dx.doi.org/10.1107/S0907444911049833 Müller, Wang and Schulze-Briese (2012), Acta Cryst D68, 42]), but this should not be specific for Pilatus.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate. Fine-slicing of profiles has been found to be advantageous at least for Pilatus detectors ([http://dx.doi.org/10.1107/S0907444911049833 Müller, Wang and Schulze-Briese (2012), Acta Cryst D68, 42]), but this should not be specific for Pilatus.</div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">=== using the refined values for beam divergence and mosaicity for re-integration ===</ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">If the beam divergence and mosaicity is fairly constant throughout the experiment, or there are few reflections on each frame to estimate these parameters from, then it might be beneficial to use the average values for beam divergence and mosaicity for the second integration. The values from the first integration can be found in INTEGRATE.LP, and the relevant two lines e.g,</ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> BEAM_DIVERGENCE=  2.067  BEAM_DIVERGENCE_E.S.D.=  0.207</ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> REFLECTING_RANGE=  2.303  REFLECTING_RANGE_E.S.D.=  0.329</ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">should be pasted into XDS.INP, and the INTEGRATE CORRECT jobs re-run (see [[Difficult datasets]]). This can be combined with the above optimization.</ins></div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td></tr> <tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l36">Line 36:</td> <td colspan="2" class="diff-lineno">Line 42:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Optimizing the anomalous signal ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Optimizing the anomalous signal ===</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>It <del style="font-weight: bold; text-decoration: none;">is often </del>helpful to increase WFAC1 from its default 1.0 to 1.5, to avoid rejection of the strongest Bijvoet pairs (this is not necessary when STRICT_ABSORPTION_CORRECTION=TRUE which is &#039;&#039;not&#039;&#039; the default).  </div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>It <ins style="font-weight: bold; text-decoration: none;">may be </ins>helpful to increase WFAC1 from its default 1.0 to 1.5, to avoid rejection of the strongest Bijvoet pairs (this is not necessary when STRICT_ABSORPTION_CORRECTION=TRUE which is &#039;&#039;not&#039;&#039; the default).  </div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Read [[Tips_and_Tricks#SAD.2FMAD_data_reduction]] concerning STRICT_ABSORPTION_CORRECTION.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>Read [[Tips_and_Tricks#SAD.2FMAD_data_reduction]] concerning STRICT_ABSORPTION_CORRECTION.</div></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2604&oldid=prev Kay: /* Re-INTEGRATEing with the correct spacegroup and refined geometry */ fine-slicing of profiles 2012-03-29T10:38:18Z <p><span dir="auto"><span class="autocomment">Re-INTEGRATEing with the correct spacegroup and refined geometry: </span> fine-slicing of profiles</span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 11:38, 29 March 2012</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l15">Line 15:</td> <td colspan="2" class="diff-lineno">Line 15:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Final polishing ==</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>== Final polishing ==</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>=== Re-INTEGRATEing with the correct spacegroup <del style="font-weight: bold; text-decoration: none;">and </del>refined geometry ===</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>=== Re-INTEGRATEing with the correct spacegroup<ins style="font-weight: bold; text-decoration: none;">, </ins>refined geometry <ins style="font-weight: bold; text-decoration: none;">and fine-slicing of profiles </ins>===</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>After running through all steps of XDS (including space group determination), one might want to</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>After running through all steps of XDS (including space group determination), one might want to</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  cp GXPARM.XDS XPARM.XDS</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  cp GXPARM.XDS XPARM.XDS</div></td></tr> <tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l22">Line 22:</td> <td colspan="2" class="diff-lineno">Line 22:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;! JOB=XYCORR INIT COLSPOT IDXREF DEFPIX INTEGRATE CORRECT&quot; &gt; XDS.INP</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;! JOB=XYCORR INIT COLSPOT IDXREF DEFPIX INTEGRATE CORRECT&quot; &gt; XDS.INP</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;JOB=INTEGRATE CORRECT&quot; &gt;&gt; XDS.INP</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  echo &quot;JOB=INTEGRATE CORRECT&quot; &gt;&gt; XDS.INP</div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_ALPHA/BETA=13 >> XDS.INP ! default is 9</ins></div></td></tr> <tr><td colspan="2" class="diff-side-deleted"></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"> echo NUMBER_OF_PROFILE_GRID_POINTS_ALONG_GAMMA=13      >> XDS.INP ! default is 9</ins></div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  cat XDS.INP.new &gt;&gt; XDS.INP</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  cat XDS.INP.new &gt;&gt; XDS.INP</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>  xds_par</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate.</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>and thereby re-run the INTEGRATE and CORRECT steps. This has the advantage that the refined geometry parameters (from CORRECT) are recycled into INTEGRATE, which sometimes leads to better R-factors. It also results in the spacegroup&#039;s restraints on the unit cell parameters being used for the prediction of spot positions; these are therefore slightly more accurate<ins style="font-weight: bold; text-decoration: none;">. Fine-slicing of profiles has been found to be advantageous at least for Pilatus detectors ([http://dx.doi.org/10.1107/S0907444911049833 Müller, Wang and Schulze-Briese (2012), Acta Cryst D68, 42]), but this should not be specific for Pilatus</ins>.</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2593&oldid=prev Kay: /* General guidelines for obtaining a good result from XDS */ 2012-03-22T14:57:01Z <p><span dir="auto"><span class="autocomment">General guidelines for obtaining a good result from XDS</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 15:57, 22 March 2012</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l3">Line 3:</td> <td colspan="2" class="diff-lineno">Line 3:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* read the article [[XDS.INP]]</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* read the article [[XDS.INP]]</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* for good indexing, follow [[XDS.INP#Keywords which affect whether indexing will succeed]]  </div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* for good indexing, follow [[XDS.INP#Keywords which affect whether indexing will succeed]]  </div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;">* for good completeness read [[MINIMUM_ZETA]]</del></div></td><td colspan="2" class="diff-side-added"></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* at least use XDS-Viewer on FRAME.cbf to check the agreement between predicted and observed spots on last frame of dataset. It would be wise to also use XDS-Viewer on MODPIX.cbf and DECAY.cbf to get an impression about systematic effects in your data.</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* at least use XDS-Viewer on FRAME.cbf to check the agreement between predicted and observed spots on last frame of dataset. It would be wise to also use XDS-Viewer on MODPIX.cbf and DECAY.cbf to get an impression about systematic effects in your data.</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2219&oldid=prev Kay: /* Wilson outliers (aliens) */ 2010-04-06T13:46:16Z <p><span dir="auto"><span class="autocomment">Wilson outliers (aliens)</span></span></p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 14:46, 6 April 2010</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l28">Line 28:</td> <td colspan="2" class="diff-lineno">Line 28:</td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><br/></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>=== Wilson outliers (aliens) ===</div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>* Look through the list of reflections labeled as &quot;aliens&quot; at the bottom of [[CORRECT.LP]]. Decide whether they follow a slowly decaying non-Wilson distribution (resulting in many reflections with Z &gt; <del style="font-weight: bold; text-decoration: none;">8 </del>instead of almost none in the case of a Wilson distribution), or whether the top ones are true outliers. The latter arise most often from ice reflections (these may even be there when no ice rings are visible). <del style="font-weight: bold; text-decoration: none;">Outliers </del>should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers (<del style="font-weight: bold; text-decoration: none;">see [[Wishlist]]). This </del>may be <del style="font-weight: bold; text-decoration: none;">accomplished by </del></div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>* Look through the list of reflections labeled as &quot;aliens&quot; at the bottom of [[CORRECT.LP]]. Decide whether they follow a slowly decaying non-Wilson distribution (resulting in many reflections with Z &gt; <ins style="font-weight: bold; text-decoration: none;">10 </ins>instead of almost none in the case of a Wilson distribution), or whether the top ones are true outliers. The latter arise most often from ice reflections (these may even be there when no ice rings are visible).  </div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;"> awk &#039;/alien/ { if (strtonum($5) &gt; 19</del>) <del style="font-weight: bold; text-decoration: none;">print $0 }&#039; CORRECT.LP &gt;&gt; REMOVE.HKL </del></div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* Only if you have a good reason to consider a reflection as an outlier should that reflection actually be discarded. It is not good practice to mechanically discard any reflection with Z&gt;10.</ins></div></td></tr> <tr><td class="diff-marker" data-marker="−"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del style="font-weight: bold; text-decoration: none;">It is useful to inspect the list of aliens after re-running CORRECT; maybe a few more of those should be put into REMOVE.HKL. But this process of rejecting Wilson outliers usually converges very quickly</del>.</div></td><td class="diff-marker" data-marker="+"></td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">* True outliers </ins>should be put (i.e. copied) into REMOVE.HKL, and [[CORRECT]] then should be re-run.&lt;br /&gt; My personal rule of thumb is that when the integer parts of Z (&quot;int(Z)&quot;) are the numbers 8, 9, ... n, but there are no aliens (or just a single one) with int(Z) = n+1, then I consider all aliens with Z &gt; n+1 as outliers. &lt;br /&gt; A different rule of thumb would be to simply consider aliens with Z of 20 or more as outliers <ins style="font-weight: bold; text-decoration: none;">- this is the default since January 2010 </ins>(<ins style="font-weight: bold; text-decoration: none;">the cutoff </ins>may be <ins style="font-weight: bold; text-decoration: none;">modified with the REJECT_ALIEN keyword</ins>).  </div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Another way to judge Wilson outliers is to identify resolution ranges that deviate from 1. in the table &#039;&#039;&#039;HIGHER ORDER MOMENTS OF WILSON DISTRIBUTION OF ACENTRIC DATA&#039;&#039;&#039; in [[CORRECT.LP]]. &quot;Aliens&quot; that are put into REMOVE.HKL will lower the values in these resolution ranges!</div></td></tr> <tr><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[WFAC1]].</div></td><td class="diff-marker"></td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* SCALEPACK users: don&#039;t confuse this process of rejecting Wilson outliers with the iterative procedure of rejecting scaling outliers that is usually done when using SCALEPACK. Scaling outliers are handled non-iteratively in [[XDS]]; the only way to influence [[XDS]] in this respect is by modifying [[WFAC1]].</div></td></tr> </table> Kay https://wiki.uni-konstanz.de/xds/index.php?title=Optimisation&diff=2213&oldid=prev Kay: Optimization moved to Optimisation: cover both spellings 2010-03-03T10:41:13Z <p><a href="/xds/index.php/Optimization" class="mw-redirect" title="Optimization">Optimization</a> moved to <a href="/xds/index.php/Optimisation" title="Optimisation">Optimisation</a>: cover both spellings</p> <table style="background-color: #fff; color: #202122;" data-mw="interface"> <tr class="diff-title" lang="en"> <td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="1" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 11:41, 3 March 2010</td> </tr><tr><td colspan="2" class="diff-notice" lang="en"><div class="mw-diff-empty">(No difference)</div> </td></tr></table> Kay