Testing of Hypothesis Quiz 11

The quiz is about Testing of Hypothesis Quiz with Answers. The quiz contains 20 questions about hypothesis testing and p-values. It covers the topics of formulation of the null and alternative hypotheses, level of significance, test statistics, region of rejection, decision, effect size, value, confidence interval, about acceptance and rejection of the hypothesis. Let us start with the MCQs Testing of Hypothesis Quiz now.

Testing of Hypothesis Quiz with Answers

• The main goal of a direct replication is to ————-; replications are important according to Popper because —————.  
• What is an important reason to make sure the data and analysis scripts related to your research are well-organized?
• In Frequentist statistics, a p-value lower than the alpha level can mean —————. This differs from Bayesian statistics, which focuses on ——————.
• You performed 6 studies, only 4 of them had a significant result. The likelihood ratio of this happening assuming $H_0$ versus assuming $H_1$ tells you ————-. If you assume you had around 80% power, this likelihood ratio will probably show that ————-.
• We compare model A (the effect is 0) to model B (the effect is 1) and find a Bayes Factor of 10 which means ————–; the effect size is estimated with a certain 95% credible interval, this interval ———————.
• When $H_0$ is true, the probability that at least 1 out of an $X$ completely independent findings is a Type 1 error is equal to —————-, this probability ————— when you look at your data and collect more data if a test is not significant.
• You did a pilot study that found an effect size of 0.4, and $p < 0.05$. You decide to repeat the study with a power of 80% and an alpha of 5%. In the second study, assuming $H_0$ is true, the probability of a type 1 error is ————–. Assuming $H_0$ is false, the probability of a type 2 error is —————–.
• A researcher reports two significant findings testing the same hypothesis, using an alpha of 5%. The researcher predicted one finding before doing the study, but the other finding was observed during exploratory analyses where many tests were performed. Which statement is correct?
• An example of a standardized effect size is ————–; these are useful for ————–.
• If the difference between means is 2, and the standard deviation is 3, Cohen’s d is —————- which is ————— according to the rule of thumb.
• In an ANOVA with multiple predictors, a partial eta-squared gives ————–?
• You analyze your data in two ways. With Frequentist statistics you find a mean effect size of 3, with a 95% confidence interval of 1 to 5. With Bayesian methods, you find a mean of 2.75, with a 95% credible interval of 1.5 to 4. Which conclusions can you make?
• What are the benefits of performing a study with a larger sample size, compared to doing the same study with a smaller sample size (all else being equal)?
• You performed a p-curve analysis and found a skewed distribution of p-values with much more small p-values (around 0.01) than high p-values (around 0.04). What does this mean?
• You predict that your intervention will significantly increase participants’ performance on a test, this is an example of —————-. You find a significant result and conclude your theory is true, this is an example of ——————-.
• For confirmatory analyses it is problematic to —————; for exploratory analyses, it is NOT problematic to ——————.
• The main goal of direct replication is —————; the main reason(s) why successful replication rates are low is ——————-.
• How do we know there is publication bias in favor of significant results? Why is it unreasonable to expect articles with 4 experiments that aim for 80% power to exclusively show significant results?
• The Dutch Government wants 100% of scientific articles to be Open Access in 2024. What is the main advantage of open access that led the government to aim for 100% Open Access in 2024?
• If a test of hypothesis has a Type I error probability of 0.01, what does this mean?

R Language and Data Analysis