IT273 Multimedia System Application

Multimedia System ApplicationUnit 112 min read

Multimedia Basics: Definitions, Types, Formats & Applications

Unit 1 of Multimedia System Application introduces core concepts like multimedia definition, its types (text, audio, video, animation), file formats (JPEG, MP3, MP4), and real-world applications in apps like eSewa, YouTube, and WhatsApp. Learn how multimedia integrates different media types and its role in modern syste

TAKEAWAYS:

  • Multimedia combines text, audio, video, graphics, and animation into a single interactive system.
  • It is classified into linear (sequential) and nonlinear (interactive) formats.
  • Common file formats include JPEG (images), MP3 (audio), MP4 (video), and GIF (animation).
  • Multimedia systems require hardware (CPU, GPU, storage) and software (players, encoders).
  • Applications range from e-commerce (Daraz) to social media (YouTube).
  • Compression techniques (lossy/lossless) optimize storage and streaming efficiency.

1. Definition and Scope of Multimedia

Multimedia refers to the integration of multiple media types (text, audio, video, graphics, animation) into a single system that allows interactivity, synchronization, and real-time processing. Unlike traditional media, which presents information in a single format, multimedia combines these elements to create richer, more engaging experiences.

Key Characteristics of Multimedia:

mindmap
  root((Multimedia))
    Definition["Integration of multiple media types (text, audio, video, graphics, animation)"]
    Interactivity["User engagement (e.g., clicking, dragging, input)"]
    Synchronization["Timing control (e.g., lip-sync in videos)"]
    Real-Time Processing["Live streaming, video calls"]
    Storage["Large data requirements (compression needed)"]
    Delivery["Network-dependent (streaming, downloading)"]

Why Multimedia Matters?

  • Enhances learning (e.g., educational videos on YouTube).
  • Improves communication (e.g., WhatsApp voice messages + stickers).
  • Boosts business (e.g., eSewa’s animated tutorials for digital payments).
  • Entertainment (e.g., movies, games, music streaming).

2. Types of Multimedia

Multimedia can be classified based on format, interactivity, and delivery method.

A. Classification by Format

Type Description Examples
Text Written or digital text with typography. eBooks, PDFs, social media posts.
Audio Sound recordings (music, voice, effects). MP3, WAV, podcasts.
Video Moving images with sound. MP4, AVI, YouTube videos.
Graphics Static images (raster or vector). JPEG, PNG, SVG.
Animation Moving graphics (2D/3D). GIF, Flash, 3D models.
Virtual Reality (VR) Immersive 3D environments. VR headsets (Oculus, HTC Vive).
Augmented Reality (AR) Overlays digital content on real world. Pokémon GO, IKEA Place app.

B. Classification by Interactivity

Type Description Examples
Linear Sequential playback (no user control). Traditional TV shows, podcasts.
Nonlinear User-controlled navigation. Interactive websites, video games.
Hypermedia Links between multimedia elements. Wikipedia, e-learning modules.

3. Multimedia Elements and Their Roles

Each multimedia element serves a unique purpose in creating engaging content.

1980sIntroduction ofCD-ROMs (storage revol1990sRise of digitalcameras and MP3 player2000sYouTube launch(2005) and HD video2010s4K video and VR/ARintegration2020sAI-generatedmultimedia content
Key milestones in multimedia technology evolution

A. Text

  • Role: Provides information, instructions, or storytelling.
  • Formats: .txt, .docx, .pdf, .epub.
  • Example: eSewa’s transaction receipts combine text with QR codes for verification.

B. Audio

  • Role: Adds sound effects, music, or voiceovers.
  • Formats: .mp3, .wav, .ogg, .aac.
  • Example: WhatsApp voice notes use .ogg for compression.

C. Video

  • Role: Combines moving images + audio for storytelling.
  • Formats: .mp4, .avi, .mov, .webm.
  • Example: YouTube uses .mp4 for streaming efficiency.

D. Graphics

  • Role: Visual representation (photos, illustrations, icons).
  • Formats:
    • Raster (pixel-based): .jpg, .png, .gif.
    • Vector (scalable): .svg, .ai, .eps.
  • Example: Daraz’s product images use .jpg for fast loading.

E. Animation

  • Role: Creates motion graphics or interactive elements.
  • Formats: .gif, .swf, .mp4 (for video animations).
  • Example: Loading animations on websites (e.g., Facebook’s spinner).

4. Multimedia File Formats

File formats determine compatibility, quality, and file size. Below are common formats categorized by media type.

A. Image Formats

Format Type Compression Use Case
JPEG Raster Lossy Photos, web images.
PNG Raster Lossless Logos, transparency needed.
GIF Raster Lossless Simple animations, memes.
SVG Vector None Scalable icons, logos.

B. Audio Formats

Format Compression Quality Use Case
MP3 Lossy High Music, podcasts.
WAV Lossless Very High Professional audio editing.
OGG Lossy/Lossless Medium Web audio (used in WhatsApp).

C. Video Formats

Format Compression Use Case
MP4 Lossy Web streaming (YouTube).
AVI Lossy/Lossless High-quality videos.
WebM Lossy HTML5 video (used in browsers).

5. Hardware and Software Requirements

Multimedia systems require specialized hardware and software for processing, storage, and playback.

A. Hardware Components

Processing power for renderingGPU for graphics accelerationCPU/GPUTemporary storage for multimedia dataFaster access than storage devicesMemory (RAM)Permanent storage for filesSSD faster than HDDStorage (HDD/SSD)Audio inputMicrophoneVideo inputWebcamImage inputScannerInput DevicesAudio outputSpeakerVisual outputMonitorLarge-screen displayProjectorOutput DevicesMultimedia System
Hierarchical breakdown of hardware components in a multimedia system
  • CPU/GPU: Handles rendering (e.g., gaming PCs, video editing workstations).
  • RAM: Temporary storage for smooth playback.
  • Storage: HDDs (cheap, slow) vs. SSDs (fast, expensive).
  • Input Devices: Microphones, webcams, scanners.
  • Output Devices: Speakers, monitors, projectors.

B. Software Components

Type Examples Role
Operating System Windows, macOS, Linux. Manages hardware and software.
Media Players VLC, Windows Media Player. Plays audio/video files.
Editors Adobe Premiere, Audacity. Creates/modifies multimedia content.
Encoders FFmpeg, HandBrake. Converts formats (e.g., MP4 to WebM).
Browsers Chrome, Firefox. Renders web-based multimedia.

6. Multimedia Compression

Compression reduces file size while minimizing quality loss. Two main types:

A. Lossless Compression

  • No data loss (original can be perfectly reconstructed).
  • Examples: ZIP, PNG, FLAC.
  • Use Case: Archiving, medical imaging.

B. Lossy Compression

  • Some data is discarded (irreversible).
  • Examples: JPEG, MP3, MP4.
  • Use Case: Web streaming, music storage.

Comparison Table

Feature Lossless Lossy
Quality Loss None Yes
File Size Larger Smaller
Use Case Documents, archives Music, videos, photos
Examples PNG, ZIP, FLAC JPEG, MP3, MP4

7. Applications of Multimedia

Multimedia is ubiquitous in education, business, entertainment, and communication.

Digital textbooks (e.g., Srijana App)Online classes (e.g., Swoyambhu Academy)EducationTelemedicine consultationsMedical training simulationsHealthcareVirtual tours of heritage sites360° views of Himalayan treksTourismMultimedia in Nepal
Local applications of multimedia technology in Nepal

A. In Nepal

  1. eSewa

    • Idea Used: Interactive text + graphics (transaction receipts with QR codes).
    • How? Users scan QR codes to verify payments, combining text (amount), graphics (QR), and animation (loading spinner).
  2. Nepal Stock Exchange (NEPSE)

    • Idea Used: Data visualization (charts + animations).
    • How? Stock price trends are displayed as interactive graphs with real-time updates.
  3. Pathao (Ride-Hailing App)

    • Idea Used: Video/audio + GPS tracking.
    • How? Drivers and passengers see live location updates (maps + animations) and communicate via voice calls.

B. Global Examples

  1. YouTube

    • Idea Used: Video streaming + nonlinear navigation.
    • How? Users can skip, like, comment, and share videos, making it highly interactive.
  2. WhatsApp

    • Idea Used: Audio + text + emoji (graphics).
    • How? Voice messages (.ogg), status videos (.mp4), and stickers (.png) combine multiple media types.
  3. Google Maps

    • Idea Used: 3D graphics + real-time animation.
    • How? Shows traffic updates (live animations), street view (360° images), and turn-by-turn directions (text + audio).

8. Worked Example: Calculating File Size After Compression

Scenario: A raw video file is 500 MB. After applying lossy compression (MP4), it reduces to 60 MB. What is the compression ratio?

Solution:

  1. Original Size (Uncompressed): 500 MB
  2. Compressed Size: 60 MB
  3. Compression Ratio = Original Size / Compressed Size = 500 MB / 60 MB ≈ 8.33:1

Real-World Tie-In:

  • Daraz’s product videos use MP4 compression to load quickly on slow internet.
  • NTC’s website uses compressed images (.jpg) to reduce bandwidth usage.

9. Advantages and Disadvantages of Multimedia

Advantages

Engagement (25%)Communication (20%)Education (25%)Business (15%)Entertainment (15%)
Percentage distribution of key advantages of multimedia (approximate)

Disadvantages

02468Storage8Bandwidth7Cost6Accessibility5Security4
Relative severity of multimedia disadvantages (1-10 scale, higher = worse)

10. Exam Tip: How to Score Full Marks

  1. Define Key Terms Precisely

    • Example:

      "Multimedia is the integration of multiple media types (text, audio, video, graphics) into a single interactive system that supports user control and synchronization."

  2. Compare Formats in Tables

    • Always include compression type, use case, and examples (e.g., JPEG vs. PNG).
  3. Relate to Real-World Apps

    • Example:

      "WhatsApp uses OGG for voice messages because it balances compression and quality for mobile users."

  4. Calculate Compression Ratios

    • Practice problems like:

      "A WAV file (100 MB) is compressed to MP3 (3 MB). Calculate the compression ratio."

  5. Discuss Hardware/Software Requirements

    • Mention CPU, RAM, storage, and players when explaining multimedia systems.
  6. Use Diagrams for Classification

    • Draw mindmaps for types of multimedia or flowcharts for compression methods.

Visuals for This Unit

Based on the TU BITM syllabus for Multimedia System Application (IT273), unit 1.

Discussion

Loading…