📘

Alpha Matte Compositing

MediumMatting 📚 CV: Computational Photography

Implement alpha compositing for foreground/background blending, a key technique in image matting. This process involves combining a foreground image with a background image using a matte, which is a grayscale image defining the opacity of the foreground.

The matte, represented by $\alpha$ , is used to control the blending of the foreground and background colors. The compositing equation is based on the principle of linear blending, where the resulting color is a weighted sum of the foreground and background colors.

Define the foreground, background, and matte images.
Apply the compositing equation to each pixel.

C = \alpha F + (1 - \alpha) B

This technique is widely used in digital image editing.

Example:

Input:

foreground = person image
background = beach scene
alpha = person matte (1 inside, 0 outside)

Output:

Person composited onto beach

Reasoning:

For each pixel:

Where alpha=1: use foreground
Where alpha=0: use background
Where 0<alpha<1: blend smoothly

Constraints:

foreground: Foreground image (H, W, 3)
background: Background image (H, W, 3)
alpha: Alpha matte (H, W) in [0, 1]
Return: Composited image

More from CV: Computational Photography

Trimap-Based Alpha EstimationHard Drago Adaptive Log MappingHard Gram Matrix for StyleHard Reinhard Global Tone MappingMedium Exposure FusionHard

Background Knowledge

Image matting is about separating an image into a foreground color $F$ , a background color $B$ , and a per-pixel opacity (the alpha matte) $\alpha \in [0,1]$ . The observed pixel color $C$ is assumed to be a linear mixture of foreground and background: $C = \alpha F + (1 - \alpha) B$ This is done per color channel (e.g., R, G, B independently). When you have F, B, and \alpha, you can composite the foreground onto any new background by applying this equation.

There are two common representations of images with alpha: straight alpha and premultiplied alpha. In straight alpha, F stores the true foreground colors (not multiplied by \alpha); in premultiplied alpha, the stored foreground colors are already multiplied by alpha: F_{\text{stored}} = \alpha F. In that case, the compositing equation becomes: $C = F_{\text{stored}} + (1 - \alpha) B$ Understanding which convention the problem uses is important for implementing the equation correctly and avoiding double-multiplying by $\alpha$ .

Algorithm / General Approach

At a high level, the algorithm is:

Treat each pixel independently.
For each pixel, and for each color channel:
Apply the compositing formula using the given $\alpha$ , foreground, and background.
Handle straight vs premultiplied alpha correctly:
Straight alpha: use $C = \alpha F + (1 - \alpha) B$ .
Premultiplied alpha: assume input foreground is already $\alpha F$ and use $C = F + (1 - \alpha) B$ .
Implement this in a vectorized way over the whole image (e.g., NumPy, PyTorch) instead of looping in Python, for efficiency.

Step-by-Step Strategy

Assume:

Foreground image: F with shape (H, W, 3) or (H, W, C)
Background image: B with same shape
Alpha matte: A with shape (H, W) or (H, W, 1) and values in [0, 1]

Straight alpha case:

👑

Continue the full explanation

You're reading the free preview. Unlock the complete walkthrough, the code editor, test runner and reference solution with Premium.

🔒

Editor locked

The code editor is locked for Pro problems. It is only available for free problems. Please upgrade to gain access to the code editor for all problems.

solution.py

Python 3.13

Test Results

0/0

Run code to see test results.