Skip to lesson
0/174 complete
LEARN THE CONCEPTFree forever

Sift up and sift down

Topic 2 of 5 · Heaps and priority queues

What is a heap?

A heap is a tree-shaped structure used to repeatedly get the item with the highest priority. In a min-heap, every parent is no larger than its children, so the smallest item is at the root. A priority queue uses this rule to return the most urgent item rather than the earliest item added.

Example: For values 8, 2, and 5, a min-heap places 2 at the root. Removing 2 rearranges the remaining values so that 5 becomes the smallest available item. The rest of a heap is not fully sorted.

INTERACTIVE WALKTHROUGHPredict · step · explain
SHARED CHAPTER LAB · HEAP

Keep the first two values.

01
13
1 / 4

Step 1 of 4 · k=2; threshold=1

Interview reasoningWorked exampleTry it yourself
Self-paced learning
Helpful before this chapter

If these ideas are new, begin with:

Understand the idea

Insertion appends then sifts up while smaller than its parent. Root removal moves the last element to the root and sifts down, choosing the smaller child each time.

Work through an example

Inserting 0 into [1,3,2] appends at index 3, swaps with 3, then with 1. Removing 0 later repairs only one downward path.

Time and space complexity

O(log n) push/pop/O(1) extra working state for iterative sift.

Why it works

Only the current element's ancestor or descendant path may violate heap order.

Common mistakes

  • Choosing the larger child in a min-heap can leave a violation.
  • Always handle a missing right child.

Chapter lab · Python implementation

A heap gives fast access to one extreme, without sorting all stored values. Python heapq is a min-heap API. Our lab keeps the largest k stream elements in a size-k min-heap; the root is the smallest retained candidate and therefore the kth-largest seen value.

This shared lab connects the chapter's topics. Follow the current lesson's worked example first, then trace the complete implementation. Additional algorithms described in topic exercises are variations you can implement independently.

import heapq

def top_k(values,k):
    if k<0: raise ValueError('k must be nonnegative')
    if k==0: return []
    heap=[]
    for x in values:
        if len(heap)<k: heapq.heappush(heap,x)
        elif x>heap[0]: heapq.heapreplace(heap,x)
    return sorted(heap,reverse=True)

class Median:
    def __init__(self): self.low,self.high=[],[]
    def add(self,x):
        heapq.heappush(self.low,-x)
        heapq.heappush(self.high,-heapq.heappop(self.low))
        if len(self.high)>len(self.low):
            heapq.heappush(self.low,-heapq.heappop(self.high))
    def value(self):
        if not self.low: raise ValueError('empty stream')
        if len(self.low)>len(self.high): return -self.low[0]
        return (-self.low[0]+self.high[0])/2

Run and test the lab

Copy the implementation and these assertions into a Python 3 file and run it. An assertion failure means the actual result differs from the expectation. Add the current topic's exercise and boundary tests to deepen your understanding.

assert top_k([3,1,5,2,4],2)==[5,4]
assert top_k([1],0)==[] and top_k([1],3)==[1]
m=Median()
for x in [3,1,5,2]: m.add(x)
assert m.value()==2.5
m.add(4); assert m.value()==3
CHECK YOUR UNDERSTANDING

Why can repair follow one path?

Further reading

Original documentation for the implementation details used in this chapter.

Python heapq
Course outline
Software Engineer
DSA
THE SOFTWARE ENGINEERING PATH

Data Structures
& Algorithms

Build intuition. Develop a pattern.
Make it your own.

Free course30 chapters
Your progress0%

0 of 174 published lessons complete