CompareGlobal - Revision history

Nairnj: /* CompareGlobal Tool */

2023-11-26T16:51:31Z

CompareGlobal Tool

← Older revision		Revision as of 16:51, 26 November 2023
Line 20:		Line 20:

	<ul>		<ul>
	<li>Column Name - name of the global result being compared. The first result compared is always "Time". If this result does not exactly match, it means the global results in the two files were ~~record~~ and different time intervals. Even if the two codes are identical, the results certainly be different. You should always run original and new simulations using the same [[MPM Global Archiving Options#Input Commands\|global archiving time]].</li>		<li>Column Name - name of the global result being compared. The first result compared is always "Time". If this result does not exactly match, it means the global results in the two files were recorded and different time intervals. Even if the two codes are identical, the results certainly be different. You should always run original and new simulations using the same [[MPM Global Archiving Options#Input Commands\|global archiving time]].</li>
	<li>Max SM - maximum value of the symmetric mean (SM), which for one row of data is defined by:<br>		<li>Max SM - maximum value of the symmetric mean (SM), which for one row of data is defined by:<br>

Nairnj: /* Using CompareGlobal MPM */

2023-02-06T21:48:25Z

Using CompareGlobal MPM

← Older revision		Revision as of 21:48, 6 February 2023
Line 70:		Line 70:
	<dl>		<dl>

	<dt~~><b~~>-o~~</b> <u>~~originalpath</u>		<dt>-o originalpath</dt>
	<dd>Path to the original global results file. This option is required.		<dd>Path to the original global results file. This option is required.</dd>

	<dt~~><b~~>-m~~</b> <u>~~pow</u>		<dt>-m pow</dt>
	<dd>Ignore values with absolute value of symmetric mean less than 1.e(-pow) (default is to not ignore anything)</dd>		<dd>Ignore values with absolute value of symmetric mean less than 1.e(-pow) (default is to not ignore anything)</dd>

	<dt><b>-H</b> or <b>-h</b>		<dt><b>-H</b> or <b>-h</b></dt>
	<dd>Print version number and brief help on this tool and then exit.		<dd>Print version number and brief help on this tool and then exit.</dd>

	</dl>		</dl>

Nairnj: /* Using CompareGlobal MPM */

2023-02-06T21:47:24Z

Using CompareGlobal MPM

← Older revision		Revision as of 21:47, 6 February 2023
Line 64:		Line 64:
	You run the CompareGlobal command line tool on a command line with		You run the CompareGlobal command line tool on a command line with

	CompareGlobal [-H?] [-m pow] -o originalpath newpath ...		CompareGlobal [-Hh] [-m pow] -o originalpath newpath ...

	CompareGlobal compares the original global results file at <tt>originalpath</tt> to one (or more) global results files specified in command arguments <tt>newpath ...</tt>. The command options are:		CompareGlobal compares the original global results file at <tt>originalpath</tt> to one (or more) global results files specified in command arguments <tt>newpath ...</tt>. The command options are:

Nairnj: /* Using CompareGlobal MPM */

2023-02-06T21:46:32Z

Using CompareGlobal MPM

← Older revision		Revision as of 21:46, 6 February 2023
Line 64:		Line 64:
	You run the CompareGlobal command line tool on a command line with		You run the CompareGlobal command line tool on a command line with

	CompareGlobal [-H?] -o originalpath newpath ...		CompareGlobal [-H?] [-m pow] -o originalpath newpath ...

	CompareGlobal compares the original global results file at <tt>originalpath</tt> to one (or more) global results files specified in command arguments <tt>newpath ...</tt>. The command options are:		CompareGlobal compares the original global results file at <tt>originalpath</tt> to one (or more) global results files specified in command arguments <tt>newpath ...</tt>. The command options are:
Line 72:		Line 72:
	<dt><b>-o</b> <u>originalpath</u>		<dt><b>-o</b> <u>originalpath</u>
	<dd>Path to the original global results file. This option is required.		<dd>Path to the original global results file. This option is required.

			<dt><b>-m</b> <u>pow</u>
			<dd>Ignore values with absolute value of symmetric mean less than 1.e(-pow) (default is to not ignore anything)</dd>

	<dt><b>-H</b> or <b>-h</b>		<dt><b>-H</b> or <b>-h</b>
	<dd>Print version number and brief help on this tool and then exit.		<dd>Print version number and brief help on this tool and then exit.
	</dl>		</dl>

Nairnj: /* CompareGlobal Tool */

2023-01-14T15:32:36Z

CompareGlobal Tool

← Older revision		Revision as of 15:32, 14 January 2023
Line 30:		Line 30:
	where <math>N</math> is number of rows of data that were compared. This mean should be much less than maximum SM (ideally would be zero).</li>		where <math>N</math> is number of rows of data that were compared. This mean should be much less than maximum SM (ideally would be zero).</li>
	<li>Max AE - the maximum absolute error found, which is the maximum summand found when evaluating MAE.</li>		<li>Max AE - the maximum absolute error found, which is the maximum summand found when evaluating MAE.</li>
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE (%) - the symmetric mean absolute proportional error defined by:<br>

	<math> {\rm SMAPE\ (\%)} = \frac{100}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>		<math> {\rm SMAPE\ (\%)} = \frac{100}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>

Nairnj: /* CompareGlobal Tool */

2023-01-14T15:31:59Z

CompareGlobal Tool

← Older revision		Revision as of 15:31, 14 January 2023
Line 32:		Line 32:
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>

	<math> {\rm SMAPE\ (\%)} = \frac{1}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>		<math> {\rm SMAPE\ (\%)} = \frac{100}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>
	This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>		This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>
	<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>		<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>

Nairnj: /* CompareGlobal Tool */

2023-01-13T18:53:10Z

CompareGlobal Tool

← Older revision		Revision as of 18:53, 13 January 2023
Line 32:		Line 32:
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>

	<math> = \frac{1}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>		<math> {\rm SMAPE\ (\%)} = \frac{1}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>
	This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>		This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>
	<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>		<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>

Nairnj: /* CompareGlobal Tool */

2023-01-13T18:52:31Z

CompareGlobal Tool

← Older revision		Revision as of 18:52, 13 January 2023
Line 32:		Line 32:
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>

	<math> \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>		<math> = \frac{1}{N} \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>
	This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>		This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>
	<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>		<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>

Nairnj: /* CompareGlobal Tool */

2023-01-13T18:51:54Z

CompareGlobal Tool

← Older revision		Revision as of 18:51, 13 January 2023
Line 32:		Line 32:
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>

	<math>~~{\rm SMAPE\ (%)} = \frac{1}{N}~~ \sum_{i=1}^N </math><br>		<math> \sum_{i=1}^N \frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}</math><br>
	This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>		This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>
	<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>		<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>

Nairnj: /* CompareGlobal Tool */

2023-01-13T18:51:29Z

CompareGlobal Tool

← Older revision		Revision as of 18:51, 13 January 2023
Line 32:		Line 32:
	<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>		<li>SMAPE - the symmetric mean absolute proportional error defined by:<br>

	<math>{\rm SMAPE\ (%)} = \frac{1}{N} \sum_{i=1}^N ~~\frac{2\|X_i - Y_i\|}{\|X_i\| + \|Y_i\|}~~</math><br>		<math>{\rm SMAPE\ (%)} = \frac{1}{N} \sum_{i=1}^N </math><br>
	This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>		This normalized error is reported in percent difference. This mean should be very low (ideally would be zero). This metric may be unreliable for global results that are close to zero (''i.e.'', if the "Max SM" is small).</li>
	<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>		<li>Max APE (%) - maximum absolute proportional error, which is the maximum summand found when evaluating SMAPE.</li>