Basic Statistics and Data Analysis

Statistics Lecture Notes, Online MCQs

Tagged: Introduction to Probability

Introduction to Probability / Probability

 by 

Introduction Probability Theory

Uncertainty is everywhere i.e nothing in this world is perfect or 100% certain except the Almighty Allah the Creator of the Universe. For example, if someone bought 10 lottery tickets out of 500 and each of 500 tickets is as likely as any other to be selected or drawn for first prize then it means that you have 10 chances out of 500 tickets or 2% chances to win the first prize.

Similarly, a decision maker seldom has complete information to make a decision.
So the probability is a measure of the likelihood that something will happen, however, probability cannot predict the number of times that something will occur in future, so it is important that all the known risks involved be scientifically evaluated. The decisions that affect our daily life are based upon the likelihood (probability or chance) but not on absolute certainty. The use of probability theory allows the decision maker with only limited information to analyze the risks and minimize the gamble inherently. For example in marketing a new product or accepting an incoming shipment possibly containing defective parts.

Probability can be considered as the quantification of uncertainty or the likelihood. Probabilities are usually expressed as fraction such as {1/6, 1/2, 8/9} or as decimals such as {0.167, 0.5, 0.889} and can also be presented as percentages such as {16.7%, 50%, 88.9%}.

Types of Probability

Suppose we want to compute the chances (Note that we are not predicting here, just measuring the chances) that something will occur in the future. For this purpose, we have three types of probability

1) Classical Approach or Prior Approach

In classical probability approach, two assumptions are used

Classical probability is defined as “The number of outcomes favorable to the occurrence of an event divided by the total number of all possible outcomes”.
OR
An experiment resulting “n” equally likely mutually exclusive and collectively exhaustive outcomes and “m” of which are favorable to the occurrence of an event A, then the probability of event A is the ratio of m/n. (D.S. Laplace (1749-1927).

Symbolically we can write $P(A) = \frac{m}{n} = \frac{number\,\, of\,\, favorable\,\, outcomes}{Total\,\, number\,\, of\,\, outcomes}$

Some shortcoming of the classical approach

  • This approach to probability is useful only when one deals with cards games, dice games or coin tosses. i.e. Events are equally likely but not suitable for serious canadian pharmacy world problems such as decisions in management.
  • This approach assumes a world that does not exist, as some assumptions are imposed described above.
  • This approach assumes symmetry about the world but there may be some disorder in a system.

2) Relative Frequency or Empirical Probability or A Posterior Approach

The proportion of times that an event occurs in the long run when conditions are stable. Relative frequency becomes stable as the number of trials becomes large under the uniform conditions.
To calculate the relative frequency an experiment is repeated a large number of times say “n” under uniform/stable conditions. So if an event A occurs m times, then the probability of the occurrence of the event A is defined by
$P(A)=\lim_{x\to\infty}\frac{m}{n}$

if we say that the probability of a number n child will be a boy is 1/2, then it means that over a large number of children born 50% of all will be boys.

Some Critics

  • It is difficult to ensure that the experiment is repeated under stable/uniform conditions.
  • The experiment can be repeated only a finite number of times in the real world, not an infinite number of times.

3) Subjective Approach

This is the probability based on the beliefs of the persons making the probability assessment.
Subjective probability assessments are often found when events occur only once or at most a very few times.
This approach is applicable in business, marketing, economics for quick decisions without performing any mathematical calculations.
The Disadvantage of subjective probability is that two or more persons facing the same evidence/problem may arrive at different probabilities i.e for the same problem there may be different decisions.

Real Life Example of Subjective Probability:

  • A firm must decide whether or not to market a new type of product. The decision will be based on prior information that the product will have high market acceptance.
  • The Sales Manager considers that there are 40% chances of obtaining the order for which the firm has just quoted. This value (40% chances) cannot be tested by repeated trials.
  • Estimating the probability that you will be married before the age of 30 years.
  • Estimating the likelihood (probability, chances) that Pakistan budget deficit will be reduced by half in the next 5 years.

Note that subjective probability is not a repeatable experiment, the relative frequency approach to probability is not applicable, nor can equally likely probabilities be assigned.

Probability

 by 

Probability Related Terms

Probability Related Terms

Sets: A set is a well defined collection of distinct objects. The objects making up a set are called its elements. A set is usually capital letters i.e. A, B, C, while its elements are denoted by small letters i.e. a, b, c etc.

Null Set: A set that contains no element is called null set or simply the empty set. It is denoted by { } or Φ.

Subset: If every element of a set A is also an element of a set B, then A is said to be a subset of B and it is denoted by A≠B.

Proper Subset: If A is a subset of B, and B contains at least one element which is not an element of A, then A is said to be a proper subset of B and is denoted by; A $\subset$ B.

Finite and Infinite Sets: A set is finite, if it contains a specific number of elements, i.e. while counting the members of the sets, the counting process comes to an end otherwise the set is an infinite set.

Universal Set: A set consisting of all the elements of the sets under consideration is called the universal set. It is denoted by U.

Disjoint Set: Two sets A and B are said to be disjoint sets, if they have no elements in common i.e. if A U B =Φ, A then A and B are said to be disjoint sets.

Overlapping Sets: Two sets A and B are said to be overlapping sets, if they have at least one element in common, i.e. if A ∩ B ≠Φ and none of them is the subset of the other set then A and B are overlapping sets.

Union of Sets: Union of two sets A and B is a set that contains the elements either belonging to A or B or to both. It is denoted by A ∩ B and read as A union B.

Intersection of Sets: Intersection of two sets A and B is a set that contains the elements belonging to both A and B. It is denoted by A U B and read as A intersection B.

Difference of Sets: The difference of a set A and a set B is the set that contains the elements of the set A which are not contained in B. The difference of sets A and B is denoted by A−B.

Complement of a Set: Complement of a set A denoted by $\bar{A}$ or $A^c$ and is defined as $\bar{A}$=U−A.

Experiment: Any activity where we observe something or measure something. Or an activity that results in or produces an event is called experiment.

Random Experiment: An experiment, if repeated under identical conditions may not give the same outcome, i.e The outcome of random experiment is uncertain, so that a given outcome is just one sample of many possible outcomes. For random experiment we knows about the all possible outcomes. A random experiment has the following properties;

  1. The experiment can be repeated any number of times.
  2. A random trial consists of at least two outcomes.

 Sample Space: The set of all possible outcomes in a random experiment is called sample space. In coin toss experiment, the sample space is S={Head, Tail}, in card-drawing experiment the sample space has 52 member. Similarly the sample space for a die={1,2,3,4,5,6}.

Event:Event is simply a subset of sample space. In a sample space there can be two or more events consisting of sample points. For coin, the list of all possible event is 4, found by event =2ni.e. i) A1={H}, ii) A2={T}, iii) A3={H,T} and iv) A4=Φ are possible event for coin toss experiment.

Simple Event: If an event consists of one sample point, then it is called simple event. For example, when two coins are tossed, the event {TT} is a simple event.

Compound Event: If an event consists of more than one sample point, it is called a compound event. For example, when two dice are rolled, an event B, the sum of two faces is 4 i.e. B={(1,3), (2,3), 3,1)} is a compound event.

Independent Events: Two events A and B are said to be independent, if the occurrence of one does not affect the occurrence of the other. For example, in tossing two coins, the occurrence of a head on one coin does not affect in any way the occurrence of a head or tail on the other coin.

Dependent Events: Two events A and B are said to be dependent, if the occurrence of one event affects the occurrence of the other event.

Mutually Exclusive Events: Two events A and B are said to be mutually exclusive, if they cannot occur at the same time i.e. AUB=Φ. For example, when a coin is tossed, we get either a head or a tail, but not both. That is why they have no common point there, so these two events (head and tail) are mutually exclusive. Similarly, when a die is thrown, the possible outcomes 1, 2, 3, 4, 5, 6 are mutually exclusive.

Equally Likely or Non-Mutually Exclusive Events: Two events A and B are said to be equally likely events when one event is as likely to occur as the other. OR If the experiment is continued a large number of times all the events have the chance of occurring equal number of times. Mathematically, AUB≠Φ. For example when a coin is tossed, head is as likely to occur as tail or vice versa.

Exhaustive Events: When a sample space S is partitioned into some mutually exclusive events, such that their union is the sample space itself, the event are called exhaustive event. OR
Events are said to be collectively exhaustive when the union of mutually exclusive events is the entire sample space S.
Let a die is rolled, the sample space is S={1,2,3,4,5,6}.
Let A={1,2}, B={3,4,5} and C={6}

A, B and C are mutually exclusive events and their union is (AUBUC=S) is the sample space, so the events A, B and C are exhaustive.