{"id":81,"date":"2019-06-11T19:56:32","date_gmt":"2019-06-11T19:56:32","guid":{"rendered":"http:\/\/blogs.ubalt.edu\/jboettinger\/?p=81"},"modified":"2019-10-17T20:27:25","modified_gmt":"2019-10-17T20:27:25","slug":"statistics-independent-t-tests","status":"publish","type":"post","link":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/2019\/06\/11\/statistics-independent-t-tests\/","title":{"rendered":"Statistics: Independent t-tests"},"content":{"rendered":"<h1><b>Independent t-test<\/b><\/h1>\n<p>In our last post, we talked about single sample t-tests, which is a way of comparing the mean of a population with the mean of a sample to look for a difference. With two-sample t-tests, we are now trying to find a difference between two different sample means. More specifically,\u00a0<strong>independent t-tests<\/strong> involve comparing the means of two samples which are distinctly different from one another in regards to the individuals within each sample. For example, a group of pet owners vs. a group of folks who don&#8217;t own pets. These two groups are completely independent of one another. This distinction will be important in a later post.<\/p>\n<p>A more technical explanation of the difference between a single sample and two-sample is that a\u00a0<b><\/b><span style=\"font-weight: 400\">single sample t-test revolves around drawing conclusions about a treated population based on a sample mean and an untreated population mean (no standard deviation). An i<\/span><span style=\"font-weight: 400\">ndependent sample t-tests are all about comparing the means of two samples (usually a control group\/untreated group and a treated group) to draw inferences about how there might be differences between those two groups in the broader population<\/span><\/p>\n<p>There are some distinct advantages and disadvantages to this approach when compared to other approaches. To avoid confusion, we won&#8217;t describe the other approaches here but will just mark the advantages and disadvantages of this one here for your consideration:<!--more--><\/p>\n<p>Advantages:<\/p>\n<ul>\n<li><span style=\"font-weight: 400\">Gives the opportunity to conduct an experiment with very little contamination by extraneous factors.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Lowers the chance of participants suffering from boredom after a long series of tests as well as skewing the results by becoming more accomplished through practice experience.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Disadvantages:<\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400\">Can be complex.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Requires a large number of participants.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Needs a new group for every treatment and manipulation.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Confounding variables brought in by the individuals in the study can weaken results.<\/span><\/li>\n<\/ul>\n<h2>Hypothesis Testing with Independent t-tests<\/h2>\n<p><span style=\"font-weight: 400\">The null and alternative hypotheses for this kind of test are as follows:<\/span><\/p>\n<p><span style=\"font-weight: 400\">H<\/span><span style=\"font-weight: 400\">0<\/span><span style=\"font-weight: 400\">: \u00b5<\/span><span style=\"font-weight: 400\">1<\/span><span style=\"font-weight: 400\"> &#8211; \u00b5<\/span><span style=\"font-weight: 400\">2<\/span><span style=\"font-weight: 400\"> = 0 (no difference in the population means)<\/span><\/p>\n<p><span style=\"font-weight: 400\">H<\/span><span style=\"font-weight: 400\">1<\/span><span style=\"font-weight: 400\">: \u00b5<\/span><span style=\"font-weight: 400\">1<\/span><span style=\"font-weight: 400\"> &#8211; \u00b5<\/span><span style=\"font-weight: 400\">2<\/span><span style=\"font-weight: 400\"> \u2260 0 (there is a mean difference)<\/span><\/p>\n<p><span style=\"font-weight: 400\">Steps of calculating an independent samples t-test (from this point forward, if there is a larger formula you&#8217;re looking for, see our formula guide post or pdf)<\/span><span style=\"font-weight: 400\">:<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400\">Calculate the estimated standard error by calculating pooled variance and figuring out the degrees of freedom for each group.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Subtract the two means from one another (we assume that the difference between the population means will be 0 given the null hypothesis) and then divide by the standard error.<\/span><\/li>\n<li><span style=\"font-weight: 400\">Determine the critical region based on your alpha level and whether you\u2019re running a one or two-tailed test. Then decide whether your calculated t-test falls within the critical region or not.<\/span><\/li>\n<li>Make a decision about the null hypothesis based on this comparison.<\/li>\n<\/ol>\n<p>Assumptions of independent sample t-tests:<\/p>\n<ul>\n<li><span style=\"font-weight: 400\">The observations within each sample must be independent.<\/span><\/li>\n<li><span style=\"font-weight: 400\">The two populations from which the samples are selected must be normal.<\/span><\/li>\n<li><span style=\"font-weight: 400\">To justify using the pooled variance, the two populations from which the samples are selected must have equal variances (homogeneity of variance); essentially the standard deviation of after treatment should be very similar to the standard deviation presented before treatment. This can be confirmed using SPSS or Excel. This can also be done using Hartley&#8217;s F-max test, which is described later on in this post.\u00a0<\/span><\/li>\n<\/ul>\n<h2>Estimated Standard Error and Pooled Variance<\/h2>\n<p><span style=\"font-weight: 400\">To calculate the estimated standard error, you need to first calculate pooled variance, especially because not all treatment or non-treatment groups will have the same number of scores, and so you need to weight in both groups before coming to terms with the overall estimated standard error. Remember that the e<\/span>stimated standard error<span style=\"font-weight: 400\"> is how we calculate the standard error when there\u2019s no population mean to go off of.<\/span><\/p>\n<p>In essence, the steps for calculating a t-test by hand are:<\/p>\n<ol>\n<li>Find the sum of squares of each sample.<\/li>\n<li>Calculate the pooled variance given the sums of squares you just found and the degrees of freedom (n-1 for each sample).<\/li>\n<li>Calculate the estimated standard error using that pooled variance.<\/li>\n<li>Plug the estimated standard error into the t-test formula and solve for t.<\/li>\n<\/ol>\n<h2>Effect Size of Independent Samples t-test<\/h2>\n<p><span style=\"font-weight: 400\">We use Cohen\u2019s d to get effect size. For this particular test, it\u2019s mean 1 minus mean 2 all divided by the square root of the pool variance calculated earlier. In this case, instead of comparing the effects of a sample to the population (asking, is this practically significant rather than just statistically significant?), we&#8217;re comparing the effects of two different samples.\u00a0<\/span><\/p>\n<h2>Hartley&#8217;s F-Max Test<\/h2>\n<p><strong>Hartley&#8217;s F-max test\u00a0<\/strong><span style=\"font-weight: 400\">is a statistical test to evaluate the homogeneity assumption.\u00a0<\/span><span style=\"font-weight: 400\">To compute, you need to compute the sample variance of each sample individually. Then, you need to make a fraction with the biggest variance on top and the smallest one on the bottom. Finally, compute. The F-max value computed for the sample data is compared with the critical value found in an F-max table. If the sample value is larger than the table value, then you can conclude that the homogeneity assumption is not valid.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>If you&#8217;re looking for more help on learning the concept of the independent samples t-test or how to calculate it, check out this series on youtube: <a href=\"https:\/\/www.youtube.com\/watch?v=3azuAaOJack\">part 1<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=X3xUn40ycyM\">part 2<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=nG-MOrtNgt8\">part 3<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=PfBKBuYYb3o\">part 4<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=IQgeSeRKkVY\">part 5<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=wFp61RpDnA0\">part 6<\/a>. It may seem like a lot of videos, but each video is only 5 minutes long.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Independent t-test In our last post, we talked about single sample t-tests, which is a way of comparing the mean of a population with the mean of a sample to look for a difference. With two-sample t-tests, we are now trying to find a difference between two different sample means. More specifically,\u00a0independent t-tests involve comparing [&hellip;]<\/p>\n","protected":false},"author":1347,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[151,153,148,152,158,155,156,150,159,160],"tags":[4,3,5,68,76,57,74,8,75,7,6],"_links":{"self":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/81"}],"collection":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/users\/1347"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/comments?post=81"}],"version-history":[{"count":3,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/81\/revisions"}],"predecessor-version":[{"id":121,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/posts\/81\/revisions\/121"}],"wp:attachment":[{"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/media?parent=81"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/categories?post=81"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/mathsupportcenter\/wp-json\/wp\/v2\/tags?post=81"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}