{"id":83,"date":"2019-06-11T20:19:43","date_gmt":"2019-06-11T20:19:43","guid":{"rendered":"http:\/\/blogs.ubalt.edu\/jboettinger\/?p=83"},"modified":"2020-02-19T20:40:50","modified_gmt":"2020-02-20T01:40:50","slug":"statistics-repeated-measures-t-test","status":"publish","type":"post","link":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/2019\/06\/11\/statistics-repeated-measures-t-test\/","title":{"rendered":"Statistics: Repeated Measures t-test"},"content":{"rendered":"<h1><b>Repeated Measures T-Test<\/b><\/h1>\n<p><span style=\"font-weight: 400\"><strong>A repeated measures<\/strong> or <strong>paired samples<\/strong> design is all about minimizing confounding variables like participant characteristics by either using the same person in multiple levels of a factor or pairing participants up in each group based on similar characteristics or relationship and then having them take part in different treatments.\u00a0<strong>Matched subjects<\/strong> is another word used to describe this kind of test and it is used specifically to refer to designs in which different people are matched up by their characteristics. Participants are often matched by age, gender, race, socioeconomic status, or other demographic features, but can also be matched up on other characteristics the researchers might consider possible confounds. Twin studies are a good example of this kind of design; one twin has to be matched up with the other &#8211; they can&#8217;t be matched to someone else&#8217;s twin.<\/span><\/p>\n<p>To reiterate the differences between a repeated measures t-test and the other kinds of tests you may have learned up to this point, a<b><span style=\"font-weight: 400\">\u00a0single sample t-test revolves around drawing conclusions about a treated population based on a sample mean and an untreated population mean (no standard deviation). An i<\/span><\/b><span style=\"font-weight: 400\">ndependent sample t-tests are all about comparing the means of two samples (usually a control group\/untreated group and a treated group) to draw inferences about how there might be differences between those two groups in the broader population. Different, randomly assigned participants are used in each group.\u00a0<\/span><span style=\"font-weight: 400\">Related samples t-tests are like independent sample t-tests except they use the same person for multiple test groups or they match people based on their characteristics or relationships to cut down on extraneous variables which may interfere with the data.<\/span><!--more--><\/p>\n<h2>Mean Difference and Estimated Standard Error of the Mean Difference<\/h2>\n<p><span style=\"font-weight: 400\">The <\/span><b>mean difference<\/b><span style=\"font-weight: 400\"> is calculated by subtracting the two scores collected from each person (because there are two testing groups), adding all of those differences up, and then dividing that number by the number of scores. This is done because rather than just compare means between the two samples, like in an independent samples t-test, we have the opportunity to first calculate the difference between each individual to see how the treatment affected them.\u00a0<\/span><\/p>\n<p><b><span style=\"font-weight: 400\">The <\/span>estimated standard error of the mean difference<span style=\"font-weight: 400\"> is<\/span> <span style=\"font-weight: 400\">a measure of how much the mean difference might vary from one occasion to the next. This is different from independent measures because instead of pooling variance between two samples, you base your sum of squares on the difference between the two scores and then calculate the estimated standard error like you would a single sample t test. <\/span><\/b><\/p>\n<h2>Hypothesis Testing with Repeated Measures t-tests<\/h2>\n<p>The null and alternative hypothesis are written as follows:<\/p>\n<p><span style=\"font-weight: 400\">H<\/span><span style=\"font-weight: 400\">0<\/span><span style=\"font-weight: 400\"> : \u00b5<\/span><span style=\"font-weight: 400\">D<\/span><span style=\"font-weight: 400\"> = 0, or that there is no difference between the two conditions<\/span><\/p>\n<p><span style=\"font-weight: 400\">H<\/span><span style=\"font-weight: 400\">1<\/span><span style=\"font-weight: 400\"> : \u00b5<\/span><span style=\"font-weight: 400\">1<\/span><span style=\"font-weight: 400\"> \u2260 0, or that there is a significant difference between the two conditions<\/span><\/p>\n<p>Steps for calculating a repeated measures t-test (all formulas needed can be found in the <a href=\"http:\/\/blogs.ubalt.edu\/mathsupportcenter\/2019\/06\/30\/statistics-formula-glossary\/\">statistics formula glossary<\/a>):<\/p>\n<ol>\n<li><span style=\"font-weight: 400\">State the null and alternative hypothesis<\/span><\/li>\n<li><span style=\"font-weight: 400\">Locate the critical region (remember that the df is n-1)<\/span><\/li>\n<li><span style=\"font-weight: 400\">Calculate the t statistic using the t formula after calculating the estimated standard error of the mean difference.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Make a decision.<\/span><\/li>\n<\/ol>\n<p>Once again, there are some advantages and disadvantages to using this approach<\/p>\n<p>Advantages:<\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Fewer subjects needed<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Is well-suited for studying changes over time (developmental, learning, studying)<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Reduces or eliminates caused by individual differences within the participants by either linking participants up based on characteristics or by using the same person twice.<\/span><\/li>\n<\/ul>\n<p>Disadvantages:<\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Increases the likelihood that outside factors that change over time may be responsible for changes in the participants\u2019 scores. <\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Participation in the first treatment could affect scores in the second treatment (practice, fatigue, etc.).<\/span><\/li>\n<\/ul>\n<h2>Effect Size for Repeated Measures t-tests<\/h2>\n<p><span style=\"font-weight: 400\">Once again, Cohen\u2019s<\/span><span style=\"font-weight: 400\"> d is the effect size measurement of choice. In this case, it\u2019s the sample mean difference over the sample mean deviation (so whatever you found as the variance, square root that to get the sample mean deviation). <\/span><\/p>\n<h2>Variability as a Measure of Consistency<\/h2>\n<p><span style=\"font-weight: 400\">If a treatment consistently adds a few points to each individual\u2019s score, then the set of difference scores are clustered together on a normal distribution curve with relatively small variability. In this situation, with small variability, it is easy to see the treatment effect and it is likely to be significant. High variability means that there\u2019s no consistency with a treatment effect, meaning that it\u2019s harder to see that there\u2019s any difference between groups and it\u2019s unlikely that a significant difference will be found. <\/span><\/p>\n<h2>Degrees of Freedom<\/h2>\n<p>Before, when we were working with independent t-tests, the degrees of freedom was n-1 for each sample, so in the end, it was n-2. However, for a repeated measures t-test, we&#8217;re only needing degrees of freedom for the mean difference. Therefore, the total degrees of freedom is simply n-1.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Repeated Measures T-Test A repeated measures or paired samples design is all about minimizing confounding variables like participant characteristics by either using the same person in multiple levels of a factor or pairing participants up in each group based on similar characteristics or relationship and then having them take part in different treatments.\u00a0Matched subjects is [&hellip;]<\/p>\n","protected":false},"author":1347,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[151,153,148,152,158,155,156,150,159,160],"tags":[4,3,5,43,68,78,57,80,8,77,81,7,6,79,40],"_links":{"self":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/83"}],"collection":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/users\/1347"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/comments?post=83"}],"version-history":[{"count":6,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/83\/revisions"}],"predecessor-version":[{"id":593,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/83\/revisions\/593"}],"wp:attachment":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/media?parent=83"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/categories?post=83"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/tags?post=83"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}