Critical Values and Rejection Region

In statistical hypotheses testing procedure, an important step is to determine whether to reject the null hypothesis. The step is to compute/find the critical values and rejection region.

Rejection Region and Critical Values

A rejection region for a hypothesis test is the range of values for the standardized test statistic which would lead us to decide whether to reject the null hypothesis. The Critical values for a hypothesis test are the z-scores which separate the rejection region(s) from the non-rejection region (also called the acceptance region of $H_0$).  The critical values will be denoted by $Z_0$.

The rejection region for a test is determined by the type of test (left-tailed, right-tailed, or two-tailed) and the level of significance (denoted by $\alpha$) for the test. For a left-tailed test, the rejection region is a region in the left tail of the normal distribution, for a right-tailed test, it is in the right tail, and for a two-tailed test, there are two equal rejection regions in either tail.

Hypothesis-Testing-Tails-Critical Values and Rejection Region

Once we establish the critical values and rejection region, if the standardized test statistics for a sample data set fall in the region of rejection, the null hypothesis is rejected.

Examples: Critical Values and Rejection Region

Example 1: A university claims that the average SAT score for its incoming freshmen is 1080. A sample of 56 freshmen at the university is drawn and the average SAT score is found to be $\overline{x}=1044$ with a sample standard deviation of $s=94.7$ points.

    In the above SAT example, the test is two-tailed, so the rejection region will be the two tails at either end of the normal distribution. If we again want $\alpha=0.05$, then the area under the curve in both rejection regions together should be 0.05. For this purpose, we will look up $\frac{\alpha}{2}=0.025$ in the standard normal table to get critical values of $Z_0 = \pm 1.96$. The rejection region thus consists of $Z \le 1.96$ and $Z\ge 1.96$. Since the standardized test statistic $Z=-2.85$ falls in the region, the university’s claim of $\mu = 1080$ would be rejected in this case.

    Example 2: Consider a left-tailed Z test. For a 0.05 level of significance, the rejection region would be the values in the lowest 5% of the standard normal distribution (5% lowest area under the normal curve). In this case, the critical value (the corresponding) Z-score will be $-1.645$. So the critical value $Z_0$ will be $-1.645$ and the rejection region will be $Z\le -1.645$.

    Note that for the case of right-tailed the rejection region would be the values in the highest 5% of the standard normal distribution table. The Z-score will be $1.645$ and the rejection region will be $Z\ge 1.645$.

    Hypothesis Test

    Exercise: Critical Values and Rejection Region

    1. Find the critical values and rejection regions(s) for the standardized Z-test of the following:
    • A right-tailed test with $\alpha = 0.05$
    • A left-tailed test with $\alpha = 0.01$
    • A two-tailed test with $\alpha = 0.10$
    • A right-tailed test with $\alpha = 0.02$
    1. Mercury levels in fish are considered dangerous to people if they exceed 0.5mg mercury per kilogram of meat. A sample of 50 tuna is collected, and the mean level of mercury in these 50 fishes is 0.6m/kg, with a standard deviation of 0.2mg/kg. A health warning will be issued if the claim that the mean exceeds 0.5mg/kg can be supported at the $\alpha=0.10$ level of significance. Determine the null and alternative hypotheses in this case, the type of the test, the critical value(s), and the rejection region. Find the standardized test statistics for the information given in the exercise. Should the health warning be issued?

    https://rfaqs.com, https://gmstat.com

    Errors in Statistics: A Comprehensive Guide

    To learn about errors in statistics, we first need to understand the concepts related to true value, accuracy, and precision. Let us start with these basic concepts.

    True Value

    The true value is the value that would be obtained if no errors were made in any way by obtaining the information or computing the characteristics of the population under study.

    The true value of the population is possible obtained only if the exact procedures are used for collecting the correct data, every element of the population has been covered and no mistake or even the slightest negligence has happened during the data collection process and its analysis. It is usually regarded as an unknown constant.

    Accuracy

    Accuracy refers to the difference between the sample result and the true value. The smaller the difference the greater will be the accuracy. Accuracy can be increased by

    • Elimination of technical errors
    • Increasing the sample size

    Precision

    Precision refers to how closely we can reproduce, from a sample, the results that would be obtained if a complete count (census) was taken using the same method of measurement.

    Errors in Statistics

    The difference between an estimated value and the population’s true value is called an error. Since a sample estimate is used to describe a characteristic of a population, a sample being only a part of the population cannot provide a perfect representation of the population (no matter how carefully the sample is selected). Generally, it is seen that an estimate is rarely equal to the true value and we may think about how close will the sample estimate be to the population’s true value. There are two kinds of errors, sampling and non-sampling errors.

    • Sampling error (random error)
    • Non-sampling errors (nonrandom errors)

    Sampling Errors

    A sampling error is the difference between the value of a statistic obtained from an observed random sample and the value of the corresponding population parameter being estimated. Sampling errors occur due to the natural variability between samples. Let $T$ be the sample statistic and it is used to estimate the population parameter $\theta$. The sampling error may be denoted by $E$,

    $$E=T-\theta$$

    The value of the sampling error reveals the precision of the estimate. The smaller the sampling error, the greater will be the precision of the estimate. The sampling error may be reduced by some of the following listed:

    • By increasing the sample size
    • By improving the sampling design
    • By using the supplementary information

    Usually, sampling error arises when a sample is selected from a larger population to make inferences about the whole population.

    Errors in Statistics, Sampling Error

    Non-Sampling Errors

    The errors that are caused by sampling the wrong population of interest and by response bias as well as those made by an investigator in collecting, analyzing, and reporting data are all classified as non-sampling errors (or non-random errors). These errors are present in a complete census as well as in a sampling survey.

    Bias

    Bias is the difference between the expected value of a statistic and the true value of the parameter being estimated. Let $T$ be the sample statistic used to estimate the population parameter $\theta$, then the amount of bias is

    $$Bias = E(T) – \theta$$

    The bias is positive if $E(T)>\theta$, bias is negative if $E(T) <\theta$, and bias is zero if $E(T)=\theta$. The bias is a systematic component of error that refers to the long-run tendency of the sample statistic to differ from the parameter in a particular direction. Bias is cumulative and increases with the increase in size of the sample. If proper methods of selection of units in a sample are not followed, the sample result will not be free from bias.

    Note that non-sampling errors can be difficult to identify and quantify, therefore, the presence of non-sampling errors can significantly impact the accuracy of statistical results. By understanding and addressing these errors, researchers can improve the reliability and validity of their statistical findings.

    Errors in Statistics: Potential Sources of Error

    https://rfaqs.com, https://gmstat.com

    Important MCQs Multivariate Quiz 5

    The post is about the MCQs Multivariate Quiz. There are 25 multiple-choice questions about Multivariate Analysis of Variance (MANOVA), its introduction, assumptions, interpretation, and real-life application. Let us start with the MCQs Multivariate Quiz.

    Online multivariate statistics and Manova MCQs

    1. MANOVA can lose degrees of freedom:

     
     
     
     

    2. In one-way MANOVA, which variable must be continuous?

     
     
     
     

    3. If MANOVA is statistically significant:

     
     
     
     

    4. An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, which dependent variables affected the child’s gender?

     
     
     
     

    5. Which F-value is typically reported in a MANOVA?

     
     
     
     

    6. How does MANOVA handle the DVs in the analysis?

     
     
     
     

    7. What would this be interpreted as if Box’s M had an associated P-value of < 0.05?

     
     
     
     

    8. An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, for which of the following dependent variables was there an interaction effect?

     
     
     
     

    9. In MANOVA:

     
     
     
     

    10. An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, which of the following is true?

     
     
     
     

    11. What use do multivariate analyses of variance have, if any?

     
     
     
     

    12. MANOVA:

     
     
     
     

    13. In MANOVA, there are:

     
     
     
     

    14. Which of the following statements is true of MANOVA?

     
     
     
     

    15. The problem of multiple comparisons is dealt with in MANOVA by:

     
     
     
     

    16. Where would you find the option for repeated measures MANOVA in SPSS?

     
     
     
     

    17. An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, how many dependent variables are used?

     
     
     
     

    18. In which of the following conditions can MANOVA be used? Check all possible options.

     
     
     
     

    19. Which of the following is true?

     
     
     
     

    20. Which of the following has the closest relationship with MANOVA?

     
     
     
     

    21. What would you use Box’s M test for?

     
     
     
     

    22. Which statistical technique is most similar to MANOVA?

     
     
     
     

    23. The Hotelling multivariate $t^2$:

     
     
     
     

    24. What problem is associated with correlated DVs?

     
     
     
     

    25. Which of the following is true?

     
     
     
     

    Online MCQs Multivariate Quiz with Answers

    MCQs Multivariate Quiz with Answers
    • Which statistical technique is most similar to MANOVA?
    • Which of the following has the closest relationship with MANOVA?
    • In MANOVA, there are:
    • In multivariate analysis of variance (MANOVA):
    • The problem of multiple comparisons is dealt with in MANOVA by:
    • MANOVA can lose degrees of freedom:
    • Which of the following is true?
    • The Hotelling multivariate $t^2$:
    • MANOVA:
    • If MANOVA is statistically significant:
    • Which of the following is true?
    • An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, how many dependent variables are used?
    • An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, which of the following is true?
    • An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, which dependent variables affected the child’s gender?
    • An educational psychologist studies the influence of a child’s gender and their parent’s job on a number of behavioral outcomes. Based on the MANOVA output, for which of the following dependent variables was there an interaction effect?
    • How does MANOVA handle the DVs in the analysis?
    • What would this be interpreted as if Box’s M had an associated P-value of < 0.05?
    • What problem is associated with correlated DVs?
    • What use do multivariate analyses of variance have, if any?
    • What would you use Box’s M test for?
    • Where would you find the option for repeated measures MANOVA in SPSS?
    • Which F-value is typically reported in a MANOVA?
    • Which of the following statements is true of MANOVA?
    • In which of the following conditions can MANOVA be used? Check all possible options.
    • In one-way MANOVA, which variable must be continuous?
    Statistics Help

    https://rfaqs.com, https://gmstat.com

    Important MCQs Nonparametric Quiz 1

    The post is about MCQs nonparametric quiz. There are 22 multiple-choice questions covering different nonparametric tests such as Wilcoxon rank sum test, Spearman’s Rank Correlation test, Mann-Whitney U test, Sign test, Runs Test, Kruskal Wallis test, and Chi-Square goodness of fit test. Let us start with the MCQs nonparametric Quiz.

    Please go to Important MCQs Nonparametric Quiz 1 to view the test

    Online MCQs Nonparametric Quiz with Answers

    MCQs nonparametric test
    • The Wilcoxon rank-sum test can be
    • The Wilcoxon rank-sum test compares
    • The Wilcoxon signed rank is used
    • Which of the following test use rank sums?
    • Which of the following tests must be two-sided?
    • In testing for the difference between two populations, it is possible to use
    • In a Wilcoxon rank-sum test
    • The Spearman rank-correlation test requires that the
    • The sign test is
    • The nonparametric equivalent of an unpaired samples t-test is
    • The Mann-Whitney U test is preferred to a t-test when
    • When using the Sign test, if two scores are tied, then we
    • The sign test assumes that the samples are
    • When testing for randomness, we can use
    • The Runs test results in rejecting the null hypothesis of randomness when:
    • To perform a run test for randomness the data must be
    • Three brands of coffee are rated for taste on a scale of 1 to 10. Six persons are asked to rate each brand so that there is a total of 18 observations. The appropriate test to determine if three brands taste equally good is
    • If a Chi-square goodness of fit test has 6 categories and an N=30, then the correct number of degrees of freedom is
    • Comparing the times-to-failure of radar transponders made by firms A, B, and C, based on an airline’s sample experience with the three types of instruments, one may well call for:
    • Which of the following tests is most likely assessing the null hypothesis of “the number of violations per apartment in the population of all city apartments is binomially distributed with a probability of success in any one trial of $P=0.4$
    • In the Kruskal-Wallis test of $k$ samples, the appropriate number of degrees of freedom is
    • Compare to parametric methods, the nonparametric methods are
    MCQs nonparametric Statistics Quiz with answers

    Online Quiz Website gmstat.com