Elective Data Analysis and Modeling

Data Analysis and ModelingUnit 410 min read

Probability Models: Distributions, Rules & Real-World Applications

Unit 4 of Data Analysis and Modeling explores foundational probability models—discrete vs. continuous distributions, probability rules (addition/multiplication), Bayes’ theorem, and their applications in business decision-making. Learn through visual examples, real-world cases (e.g., Ncell’s call-drop prediction, Daraz

Key Concepts and Definitions

1. Probability Basics

Probability quantifies the likelihood of an event occurring, ranging from 0 (impossible) to 1 (certain). It is the foundation for all probability models.

Probability Rules

  • Addition Rule: For two events and , If and are mutually exclusive (cannot occur simultaneously), , so:

  • Multiplication Rule: For two events and , If and are independent, , so:

  • Complement Rule:


2. Discrete vs. Continuous Probability Distributions

Probability distributions describe how probabilities are assigned to possible outcomes.

Discrete Distributions

Used for countable outcomes (e.g., number of customers, defects).

  • Binomial Distribution: Models the number of successes () in independent trials, each with success probability . Example: Probability that exactly 3 out of 10 customers use Khalti for a transaction, given a 20% success rate.

  • Poisson Distribution: Models rare events over a fixed interval (e.g., call drops per hour). Example: Ncell records an average of 5 call drops per hour. What is the probability of 3 drops in an hour?

Continuous Distributions

Used for uncountable outcomes (e.g., height, time).

  • Normal Distribution: Bell-shaped, symmetric around the mean (), with standard deviation (). Example: NTC measures internet speeds in Kathmandu with Mbps and Mbps. What is the probability a randomly selected user gets >25 Mbps? Use the Z-score: From the standard normal table, .

  • Uniform Distribution: All outcomes equally likely (e.g., random selection of a customer from a list).


In the Real World

  1. Daraz’s Inventory Management Daraz uses the Poisson distribution to predict how many units of a product (e.g., a smartphone) will be sold in a day. If the average daily sales are 50 units (), Daraz can stock enough inventory to meet demand with 95% confidence by calculating: This reduces stockouts and overstocking.

  2. Ncell’s Call-Drop Prediction Ncell analyzes call drops using the Binomial distribution to identify high-risk areas. If a tower has a 10% call-drop rate and 100 calls are logged, the probability of >15 drops is: This helps prioritize maintenance.

  3. Khalti’s Fraud Detection Khalti uses Bayes’ Theorem to update fraud probabilities. If 5% of transactions are fraudulent and a new detection model flags a transaction with 80% accuracy, the posterior probability of fraud given a flag is: This balances false positives and negatives.


3. Bayes’ Theorem

Updates probabilities based on new evidence: Example: Pathao wants to predict rider cancellations. Historically, 10% of riders cancel. If a rider books late (after 8 PM), the cancellation rate jumps to 30%. What is the probability a rider cancels given they booked late? (Assumes 80% of cancellations occur late and 30% of late bookings cancel.)


4. Probability Trees and Decision Analysis

Visualize sequential probabilities using probability trees.

graph TD
    A["Start"] --> B["Event 1: Success (p=0.6)"]
    A --> C["Event 1: Failure (p=0.4)"]
    B --> D["Event 2: Success (p=0.7)"]
    B --> E["Event 2: Failure (p=0.3)"]
    C --> F["Event 2: Success (p=0.5)"]
    C --> G["Event 2: Failure (p=0.5)"]
    D --> H["Outcome: Both Success (0.6*0.7=0.42)"]
    E --> I["Outcome: Event 1 Success, Event 2 Failure (0.6*0.3=0.18)"]
    F --> J["Outcome: Event 1 Failure, Event 2 Success (0.4*0.5=0.20)"]
    G --> K["Outcome: Both Failure (0.4*0.5=0.20)"]

Example: NEPSE tracks stock price movements. If a stock has a 60% chance of rising tomorrow and a 40% chance of falling, and rising stocks have a 70% chance of rising further the next day, what is the probability the stock rises two days in a row? P(\text{Rise Day 1 and Day 2}) = 0.6 \times 0.7 = 0.42 \quad \text{(42%)}


5. Joint and Marginal Probabilities

  • Joint Probability: = probability both and occur.
  • Marginal Probability: = probability of regardless of .

Example: Bank Loan Approvals A bank approves 60% of loans, and 30% of approved loans default. What is the probability a randomly selected loan is approved and defaults? P(\text{Approved} \cap \text{Default}) = P(\text{Default}|\text{Approved}) \cdot P(\text{Approved}) = 0.3 \times 0.6 = 0.18 \quad \text{(18%)}


Comparison Table: Key Probability Distributions

Distribution Type Parameters Use Case Example
Binomial Discrete Fixed trials, success/failure Khalti transaction success rate
Poisson Discrete Rare events over time/space Ncell call drops per hour
Normal Continuous Symmetric, bell-shaped data NTC internet speeds in Kathmandu
Uniform Continuous Equal probability for all outcomes Random customer selection
Exponential Continuous Time between events Daraz delivery delays

Advantages and Limitations

Probability Model Advantages Limitations
Binomial Simple, intuitive for binary outcomes Assumes independence between trials
Poisson Good for rare events Requires large sample size for accuracy
Normal Flexible, works for many real-world data Assumes symmetry; may not fit skewed data
Bayes’ Theorem Updates probabilities with new data Requires prior probabilities
Probability Trees Visualizes sequential events Complex for many branches

Worked Example: Traffic Congestion Prediction (Kathmandu)

Scenario: The NTC monitors traffic on Ring Road. Historical data shows:

  • 60% chance of congestion during peak hours (7–9 AM).
  • If congested, 70% chance of delays >30 minutes.
  • If not congested, 20% chance of delays >30 minutes.
1234560.20.30.40.50.60.70.8yMean Traffic Volume (3000 vehicles)Low Traffic (1000 vehicles)High Traffic (5000 vehicles)
Modeling congestion probability as a function of vehicle count (simplified).

Question: What is the probability a commuter faces >30-minute delays during peak hours?

Solution:

  1. Define Events:

    • = Congestion occurs ()
    • = Delay >30 minutes
    • ,
  2. Use Law of Total Probability: P(D) = (0.7 \times 0.6) + (0.2 \times 0.4) = 0.42 + 0.08 = 0.50 \quad \text{(50%)}

Interpretation: There is a 50% chance of >30-minute delays during peak hours on Ring Road.


Exam Tip

  1. Memorize Key Formulas:

    • Binomial:
    • Poisson:
    • Bayes’ Theorem:
    • Normal: Use Z-scores and standard normal tables.
  2. Practice Probability Trees:

    • Draw trees for sequential events (e.g., Pathao’s rider cancellations).
    • Label branches with probabilities and outcomes.
  3. Real-World Applications:

    • Business: Use Binomial/Poisson for risk assessment (e.g., Daraz’s inventory).
    • Finance: Apply Normal distribution to stock returns (e.g., NEPSE).
    • Operations: Use Bayes’ Theorem for fraud detection (e.g., Khalti).
  4. Common Pitfalls:

    • Independence vs. Dependence: Assume independence only if stated.
    • Discrete vs. Continuous: Use the correct distribution (e.g., Poisson for counts, Normal for measurements).
    • Complement Rule: Always check if is easier to calculate.
  5. Exam Strategy:

    • Part A (Short Answers): Define terms like joint probability, marginal probability, and Bayes’ Theorem.
    • Part B (Calculations): Show all steps for binomial/Poisson/normal problems.
    • Part C (Applications): Relate to Nepali businesses (e.g., Ncell’s call drops, Daraz’s sales forecasting).

Visual Summary: Probability Distributions in Business

mindmap
  root((Probability Models in Business))
    Binomial["Binomial Distribution<br>• Success/Failure<br>• Example: Khalti transactions"]
    Poisson["Poisson Distribution<br>• Rare Events<br>• Example: Ncell call drops"]
    Normal["Normal Distribution<br>• Symmetric Data<br>• Example: NTC internet speeds"]
    Bayes["Bayes’ Theorem<br>• Updating Probabilities<br>• Example: Khalti fraud detection"]
    Trees["Probability Trees<br>• Sequential Events<br>• Example: Pathao cancellations"]

Real-World Image: Khalti Transaction Flow

Based on the PU BBA (PU) syllabus for Data Analysis and Modeling, unit 4.

Discussion

Loading…