Design a system for real-time processing of user behavior data.

Question

Anonymous · Accepted Answer

This would a perfect use case for lambda architecture, that supports
RT-processing of events and a batch layer that contains historical data.

RT-processing should be backed by message brokers sinking into hot-storage that
supports fast-reads. Typically in-memory database something like Redis. Lets
call this L1-layer.

At the same time, another batch process keeps reading the same brokers and
writing to historical storage (typically HDFS or S3-store). Lets call this is L2
layer.

We then need to create a single API that connects to both layers (L1 and L2) to
provide a combined/unified data to the end-user.

Design a system for real-time processing of user behavior data.

Practice this question with AI

Go Premium

Community Answers

Unlock Full Access

Practice More Questions