← All projects
Real-time Sentiment Pipeline
Kafka + Spark streaming sentiment analysis, fully Dockerized.
- Role
- Solo builder
- Year
- 2024
- Type
- Data Engineering
- Stack
- Kafka · PySpark · MongoDB
Real-time sentiment analysis infrastructure: producers scraping Hespress, Twitter and YouTube feed Kafka; Spark Streaming processes the firehose into MongoDB; Streamlit dashboards visualize results live. Every component containerized with Docker Compose.