.
The priors in the population
The true negative rate in the population
The proportion of events in the training data
The probability cutoff for scoring
The sample means from the validation data set are applied to the training and test data sets.
The sample means from the training data set are applied to the validation and test data sets.
The sample means from the test data set are applied to the training and validation data sets.
The sample means from each partition of the data are applied to their own partition.
Score data=valid1 out=roc;
Score data=valid1 outroc=roc;
Mode1resp(event= '1') = gender region/outroc=roc;
Mode1resp(event"1") = gender region/ out=roc;
Simple random sampling without replacement
Simple random sampling with replacement
Stratified random sampling without replacement
Sequential random sampling with replacement
Proc surveryselect data=SASUSER.DATABASE samprate=0.6 out=sample; strata country; run;
Proc sort data=SASUSER.DATABASE; by county; run; proc surveyselect data=SASUSER.DATABASE samprate=0.6 out=sample outall; run;
Proc sort data=SASUSER.DATABASE; by county; run; proc surveyselect data=SASUSER.DATABASE samprate=0.6 out=sample outall; strata county; run;
Proc sort data=SASUSER.DATABASE; by county; run; proc surveyselect data=SASUSER.DATABASE samprate=0.6 out=sample; strata county; eun;
Selecting the top 10% of the population scored by the model should result in 3.14 times more events than a random draw of 10%.
Selecting the observations with a response probability of at least 10% should result in 3.14 times more events than a random draw of 10%.
Selecting the top 10% of the population scored by the model should result in 3.14 timesgreater accuracy than a random draw of 10%.
Selecting the observations with a response probability of atleast 10% should result in 3.14times greater accuracy than a random draw of 10%.
The predicted lift for the best 50% of validation data cases
The predicted lift if the entire population is scored as event cases
The predicted lift if none of the population are scored as event cases
The predicted lift if 50% of the population are randomly scored as event cases
Depth
Sensitivity
Specificity
Positive predictive value
Model A. It is more complex with a higher accuracy than model B on training data.
Model A. It performs better on the boundary for the training data.
Model B. It is more complex with a higher accuracy than model A on validation data.
Model B. It is simpler with a higher accuracy than model A on validation data.
Profit=(P_R>0.05)*Purch*200-(P_R>.05)*(1-Purch)*10;
Profit=(P_R.05)*(1-Purch)*10;
If P_R> 0.05; profit=(P_R>0.05)*Purch*200-(P_R>.05)*(1-Purch)*10;
If P_R> 0.05; profit=(P_R>0.05)*Purch*200+(P_R
Training: 50% Validation: 0% Testing: 50%
Training: 100% Validation: 0% Testing: 0%
Training: 0% Validation: 100% Testing: 0%
Training: 50% Validation: 50% Testing: 0%
Candidate 1, because the area outside the curve is greater
Candidate 2, because the area outside the curve is greater
Candidate 1, because it is closer to the diagonal reference curve
Candidate 2, because it shows less over fit than Candidate 1
Sensitivity and PV+
Specificity and PV-
PV+ and PV-
Sensitivity and Specificity
X=40, Y=10
X=.05, Y=10
X=.05, Y=.40
X=.10,Y=.05
To provide a unbiased measure of assessment for the final model.
To compare models and select and fine-tune the final model.
To reduce total sample size to make computations more efficient.
To build the predictive models.
Training data
Total data
Test data
Validation data
It violates assumptions of the model.
It requires extra computational effort and time.
It omits the training (and test) data sets from the benefits of the cleansing methods.
There is no ability to compare the effectiveness of different cleansing methods.
More high value customers are found in some regions than others.
The difference between average purchases for medium and high value customers depends on the region.
Regions with higher average purchases have more high value customers.
Regions with higher average purchases have more medium value customers.
All groups are significantly different from each other.
2XL is significantly different from all other groups.
Only XL and 2XL are not significantly different from each other.
No groups are significantly different from each other.
35%
65%
76%
Normality, because Prob > F < .0001.
Normality, because the interquartile ranges are different in different ad campaigns.
Constant variance, because Prob > F < .0001.
Constant variance, because the interquartile ranges are different in different ad campaigns.
Medium wrist size is significantly different than small wrist size.
Large wrist size is significantly different than medium wrist size.
Large wrist size is significantly different than small wrist size.
There is no significant difference due to wrist size.
Proc glm data=salary; class gender; model pay=gender; run;
Proc ttest data=salary; class gender; var pay; run;
Proc glm data=salary; class pay; model pay=gender; run;
Proc ttest data=salary; class gender; model pay=gender; run;
School*Gender should be removed because it is non-significant.
Gender should be removed because it is non-significant.
School should be removed because it is significant.
Gender should not be removed due to its involvement in the significant interaction.
A scatter plot of binary response versus a predictor variable.
A trend plot of empirical logit versus a predictor variable.
A logistic regression plot of predicted probability values versus a predictor variable.
A box plot of the odds ratio values versus a predictor variable.
Option A
Option B
Option C
Option D
There is quasi-complete separation in the data.
There is collinearity among the predictors.
There are missing values in the data.
There are too many observations in the data.
Eliminate store_id as a predictor in the model because it has too many levels to be feasible.
Cluster by using Greenacre's method to combine stores that are similar.
Use subject matter expertise to combine stores that are similar.
Randomly combine the stores into five groups to keep the stochastic variation among the observations intact.
Stabilize parameter estimates and increase the risk of overfitting.
Destabilize parameter estimates and increase the risk of overfitting.
Stabilize parameter estimates and decrease the risk of overfitting.
Destabilize parameter estimates and decrease the risk of overfitting.
Stabilize parameter estimates and increase the risk of overfitting.
Destabilize parameter estimates and increase the risk of overfitting.
Stabilize parameter estimates and decrease the risk of overfitting.
Destabilize parameter estimates and decrease the risk of overfitting.
Collinearity
Influential observations
Quasi-complete separation
Problems that arise due to missing values
The association between the continuous predictor and the binary response is quadratic.
The association between the continuous predictor and the log-odds is quadratic.
The association between the continuous predictor and the continuous response is quadratic.
The association between the binary predictor and the log-odds is quadratic.
OUTPUT=estimates
OUTP=estimates
OUTSTAT=estimates
OUTCORR=estimates
The model will likely be overfit.
There will be a high rate of collinearity among input variables.
Complete case analysis means that fewer observations will be used in the model building process.
New cases with missing values on input variables cannot be scored without extra data processing.
Concordant and discordant pairs of ranked observations
Logit link (log(p/1-p))
Rank-ordered values of the variables
Weighted sum of chi-square statistics for 2x2 tables
An increase in R-Square
A decrease in R-Square
A decrease in Mean Square Error
No change in R-Square
An increase in R-Square
A decrease in R-Square
A decrease in Mean Square Error
No change in R-Square
The errors are correlated, normally distributed with constant mean and zero variance.
The errors are correlated, normally distributed with zero mean and constant variance.
The errors are independent, normally distributed with constant mean and zero variance.
The errors are independent, normally distributed with zero mean and constant variance.
A
B
C
D
R-Square
Coeff Var
Adj R-Sq
Error DF
A
B
C
D
The predicted value of the response when all the predictors are at their current values.
The predicted value of the response when all predictors are at their means.
The predicted value of the response when all predictors = 0.
The predicted value of the response when all predictors are at their minimum values.
Age Weight RunTime RunPulse MaxPulse
Age Weight RunTime RunPulse RestPulse MaxPulse
RestPulse
RunTime
Proc glm data=sasuser.mlr; class c1 x1 x2 x3; model y=c1 x1-x3 /solution; run;
Proc glm data=sasuser.mlr; model y=c1 x1-x3 /solution; run;
Proc glm data=sasuser.mlr; class c1; model y=c1 x1-x3; run;
Proc glm data=sasuser.mlr; class c1; model y=c1 x1-x3 /solution; run;
A
B
C
D
The odds of the event are 1.142 greater for each one dollar increase in salary.
The odds of the event are 1.142 greater for each one thousand dollar increase in salary.
The probability of the event is 1.142 greater for each one dollar increase in salary.
The probability of the event is 1.142 greater for each one thousand dollar increase in salary.
Use the SCORE statement in the LOGISTIC procedure.
Augment the training data set with new observations and set their responses to missing.
Augment the training data set with new observations and rerun the LOGISTIC procedure.
Use the saved parameter estimates from the LOGISTIC procedure and score new observations in the SCORE procedure.
The SCORE statement in the LOGISTIC procedure returns only predicted probabilities, whereas the SCORE procedure returns only predicted logits.
The SCORE statement in the LOGISTIC procedure returns only predicted logits, whereas the SCORE procedure returns only predicted probabilities.
Unlike the SCORE procedure, the SCORE statement in the LOGISTIC procedure produces both predicted probabilities and predicted logits.
The SCORE procedure and the SCORE statement in the LOGISTIC procedure produce the same output.
Mode1 Purchase * Gender Age Region;
Mode1 Purchase * Gender | Age | Region;
Mode1 Purchase * Gender|Age|Region @1;
Mode1 Purchase * Gender|Age|Region @2;
OUTFILE_1 contains the final parameter estimates while OUTFILE_2 contains the newly scored probabilities.
OUTFILE_1 contains the model goodness of fit statistics while OUTFILE_2 contains the newly scored probabilities
OUTFILE_1 contains the model goodness of fit statistics while OUTFILE_2 contains the newly scored logits.
OUTFILEJ contains the final parameter estimates and Wald Chi-Square values while OUTFILE_2 contains the newly scored probabilities.
0.0819
0.5663
-3.7727
-1.0415
An observation with the event has an equal probability as another observation with the event.
An observation with the event has a lower predicted probability than the observation without the event.
An observation with the event has an equal predicted probability as the observation without the event.
An observation with the event has a higher predicted probability than the observation without the event
About 25% of the customers who did make a purchase are correctly classified as making a purchase.
About 50% of the customers who did make a purchase are correctly classified as making a purchase.
About 85% of the customers who did make a purchase are correctly classified as making a purchase.
About 95% of the customers who did make a purchase are correctly classified as making a purchase.
All parameter estimates are biased.
Only the intercept estimate is biased.
Only the non-intercept parameter estimates are biased.
Sensitivity estimates are biased.
P=1/(1+exp(-default));
Odds=exp(default); p=odds/1+odds;
P=(1+exp(default))/exp(default);
P=default/(1+default);
Adjusted R Square
Mallow's Cp
Chi Square
Average Squared Error
Adjusted R Square
Mallow's Cp
Chi Square
Average Squared Error
Scoredata data=MYDIR.NEW_DATA out=scores;
Scoredata data=MYDIR.NEW_DATA output=scores;
Score data=HYDIR.NEU_DATA output=scores;
Score data=MYDIR,NEW DATA out=scores;
A
B
C
D
An observation with the event has an equal probability as another observation with the event.
An observation with the event has a lower predicted probability than the observation without the event.
An observation with the event has an equal predicted probability as the observation without the event.
An observation with the event has a higher predicted probability than the observation without the event
Greatest: MBA Least: DOWN_AMT
Greatest: MBA Least: CASH
Greatest: DOWN_AMT Least: CASH
Greatest: DOWN_AMT Least: HOME
Missing values are imputed.
Parameters are estimated accounting for the missing values.
Parameter estimates are made on all available data.
Only cases with variables that are fully populated are used.