MODULE 6

The following covers some of the common SAS procedures with which you can run some intermediate level statistical analyses. Use the Import Wizard to import the Example Data 1 file using the  SPSS File (*.sav) source option as was done previously.

1. One-way ANOVA

Some sources will recommend use of PROC ANOVA for the one-way or single factor analysis; however, PROC ANOVA assumes balanced cells (i.e. each group has an equal number of cases). Given that we frequently do not have balanced cells, use of PROC GLM is preferred. The current example compares different stimuli conditions on ability to recall at time 1. In this example, our factor or independent variable stimuli has three levels (or conditions); spoken, written, and combined. Our dependent variable is the familiar recall at time 1 (recall1).

PROC GLM DATA=example1;
CLASS stimuli;
MODEL recall1 = stimuli;
MEANS stimuli;
RUN;

We can run post-hoc tests (here with Tukey's version) by adding additional operators to the means statement.

PROC GLM DATA=example1;
CLASS stimuli;
MODEL recall1 = stimuli;
MEANS stimuli / TUKEY;
RUN;

Here we use the Tukey and the  Ryan-Einot-Gabriel-Welsch Multiple Range Test for our post hoc comparisons.

PROC GLM DATA=example1;
CLASS stimuli;
MODEL recall1 = stimuli;
MEANS stimuli / TUKEY REGWQ;
RUN;

2. Multi-way or Factorial ANOVA

Here we are looking for mean differences among two factors with six total conditions on ability to recall at time 1 (recall1). The first factor, stimuli, has three conditions and was described above. The second factor, candy; has two conditions (Skittles & no candy).

PROC GLM DATA=example1;
CLASS candy stimuli;
MODEL recall1 = candy stimuli;
MEANS stimuli / REGWQ;
MEANS candy stimuli;
RUN;

3. One-way MANOVA

Here, we are testing for group differences among two dependent variables simultaneously using our familiar three groups of stimuli. First, we run a PROC MEANS to take a look at the descriptive statistics for each group across the two dependent variables. Then, we run the actual MANOVA.

PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS stimuli;
VAR recall1 recall2;
RUN;
PROC GLM DATA=example1;
CLASS stimuli;
MODEL recall1 recall2 = stimuli / SS3;
CONTRAST 'Printed vs Spoken&Printed and Spoken' stimuli 2 -1 -1;
CONTRAST 'Spoken vs Printed and Spoken' stimuli 0 1 -1;
MANOVA h=_all_;
RUN;
QUIT;

Given that our two dependent variables above are really the same variable measured at two points in time; it would be more appropriate to run the Repeated Measures ANOVA.

PROC GLM DATA=example1;
CLASS stimuli;
MODEL recall1 recall2 = stimuli;
REPEATED TIME 2 (0 1) / SUMMARY;
RUN;

4. Factorial MANOVA

Here, we are looking at differences between stimuli groups, as well as candy groups, on recall at time 1 and age. To begin, we will take a look at some of the descriptive statistics of our variables; then the correlation between our two dependent variables (age & recall1); then run the GLM procedure.

PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS stimuli;
VAR age;
RUN;
PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS candy;
VAR age;
RUN;
PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS stimuli;
VAR recall1;
RUN;
PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS candy;
VAR recall1;
RUN;
PROC MEANS N MEAN STD MIN MAX DATA=example1;
CLASS stimuli candy;
VAR age recall1;
RUN;

PROC CORR DATA=example2;
VAR age recall1;
RUN;

PROC GLM DATA=example1;
CLASS stimuli candy;
MODEL age recall1 = stimuli candy / SS3;
CONTRAST 'Printed vs Spoken&Printed and Spoken' stimuli 2 -1 -1;
CONTRAST 'Spoken vs Printed and Spoken' stimuli 0 1 -1;
MANOVA h=_all_ / SUMMARY PRINTE;
RUN;

5. Linear Regression.

Use the Import Wizard to import the 'regression_example_data.sav' file using the  SPSS File (*.sav) source option and the member name 'red'.

PROC PRINT DATA=red;
RUN;

First, we'll do a simple linear ordinary least squares (OLS) regression with two predictors (age & recall1) and recall2 as our outcome variable.

PROC REG DATA=red;
MODEL apt = prison age peyrs;
RUN;

SAS produces un-standardized regression coefficients by default. If you also want SAS to produce the standardized coefficients then you must include an STB (standardized beta) options statement directly following the name of the last predictor; like the following example:

PROC REG DATA=red;
MODEL apt = prison age peyrs / STB;
RUN;

Next, we'll take a second look at the same regression model, but have SAS create a graph of the residuals vs. the Cook's Distance.

PROC REG DATA=red;
MODEL apt = prison age peyrs;
OUTPUT OUT = T STUDENT = RES COOKD = COOKD;
RUN;
QUIT;
PROC GPLOT DATA = T;
PLOT res*cookd = 1 / vaxis=axis1;
RUN;
QUIT;

Now, we'll review the residual values which is a three stage process. We will first generate a new variable rabs containing the absolute value of standardized residuals. Then we sort the data on rabs in descending order. We then list the first 50 observations.

DATA T2;
SET T;
RABS = abs(res);
RUN;
PROC SORT DATA=T2;
BY DESCENDING rabs;
RUN;
PROC PRINT DATA=T2 (obs=50);
RUN;

6. Robust regression is done by Iterated Weighted Least Squares (IWLS). The procedure for running robust regression is proc robustreg. There are a couple of estimators for IWLS. We are going to use the Huber estimator in this example. We can save the final weights created by the IWLS process. This can be very useful. We  will use the data set T2 generated above. It includes the original data set and the diagnostic variables generated based on the OLS regression model. *Note in the output the presence of the AIC & BIC for model fit.

PROC ROBUSTREG DATA=T2 METHOD=m (wf=huber);
MODEL apt = prison age peyrs;
OUTPUT OUT = test1 weight=wgt;
RUN;

Next, we'll take a look at the residuals of the robust regression.

PROC SORT DATA=test1;
by wgt;
RUN;
PROC PRINT DATA=test1 (obs=50);
RUN;

Now let's compare the results of a regular OLS regression and a robust regression.  If the results are very different, you will most likely want to use the results from the robust regression.

ODS LISTING CLOSE;
PROC REG DATA=red;
MODEL apt = prison age peyrs;
ODS OUTPUT PARAMETERESTIMATES = a;
RUN;
QUIT;
PROC ROBUSTREG DATA=T2 METHOD=m (wf=huber);
MODEL apt = prison age peyrs;
ODS OUTPUT PARAMETERESTIMATES = b;
RUN;
QUIT;
ODS LISTING;
TITLE "OLS Regression";
PROC PRINT DATA=a;
TITLE "Robust Regression";
PROC PRINT DATA=b;
RUN;

Return to the SAS Short Course