Specific page references are intended for Lomax & Hahs-Vaughn, 3rd ed.
As with the random-effects model, it is possible to calculate the mixed-effects summary table from the fixed-effects model summary table. This is important to know because SPSS does not generate a correct mixed-effects ANOVA summary table in its output. The authors correctly suggest that the SPSS output cannot be interpreted directly for the mixed-effects model. However, they present a rather unclear rationale for the different F-ratios on pp. 490–491. Note, they are operating with the first factor as fixed and the second factor as random.
A more specific presentation of the formulas at the bottom of p. 491 would be:
These formulas include the scaling factor for population level sampling. is the total number of possible levels for the first factor, and is the total number of possible levels for the second factor. (Notice how the levels are “switched” with the scaling factor for depending on the number of levels for and vice versa.) Under an assumption that is fixed, then we are using all of the possible levels in our analysis. Thus, , which implies , which implies that the scaling factor for the second (random) effect is zero. The long-and-short-of-the-matter is that the 2nd term disappears from the second equation. However, as is a random factor, it is assumed that we have very few of the (nearly infinite) possible levels. In other words, we could let , which implies , which implies the scaling factor for the first (fixed) effect is one. Thus, we obtain the 2 equations in the book. To summarize, for our mixed-effects model, we should have:
This means that the F-ratios appear to be reversed: the fixed effect equation looks more like the random effects model and the random effect equation looks more like the fixed effects model. The denominator for the fixed effect should be (as with the random effects model) and the denominator for the random effect should be (as with the fixed effects model).
Here is the ANOVA summary table for a two-factor fixed-effects ANOVA where there are two levels of factor A (curriculum intervention) and six levels of factor B (teacher). Each cell includes 12 students.
Calculate the mixed-effects test statistics and significances (with the first factor fixed and the second factor random). For these problems, you are encouraged to use Excel's =FDIST() function to calculate significance values.
Report the mixed-effects results for the first (fixed) effect:
(Please report the F-ratio accurate to 3 decimal places and the P-value accurate to 4 decimal places.)
Report the mixed-effects results for the second (random) effect:
(Please report the F-ratio accurate to 3 decimal places and the P-value accurate to 4 decimal places.)
As with the random-effects model, it is possible to calculate the mixed-effects summary table from the fixed-effects model summary table. This is important to know because SPSS does not generate a correct mixed-effects ANOVA summary table in its output. The authors correctly suggest that the SPSS output cannot be interpreted directly for the mixed-effects model. However, they present a rather unclear rationale for the different F-ratios on pp. 490–491. Note, they are operating with the first factor as fixed and the second factor as random.
A more specific presentation of the formulas at the bottom of p. 491 would be:
Fixed Factor | |
Random Factor |
Here is the ANOVA summary table for a two-factor fixed-effects ANOVA where there are two levels of factor A (curriculum intervention) and six levels of factor B (teacher). Each cell includes 12 students.
Source | |||||
---|---|---|---|---|---|
350.4 | 1 | 350.4 | 5.484 | 0.0207 | |
1012.8 | 5 | 202.56 | 3.17 | 0.0098 | |
822.3 | 5 | 164.46 | 2.574 | 0.0295 | |
Error | 8434.8 | 132 | 63.9 | ||
TOTAL | 10620.3 | 143 |
Report the mixed-effects results for the first (fixed) effect:
(Please report the F-ratio accurate to 3 decimal places and the P-value accurate to 4 decimal places.)
Report the mixed-effects results for the second (random) effect:
(Please report the F-ratio accurate to 3 decimal places and the P-value accurate to 4 decimal places.)