← All work
Data engineering

NovaTel Big Data Ecosystem

A telecom data-platform simulation for Egyptian-market traffic, connecting Kafka, PySpark, ClickHouse, Airflow, and Superset.

THE PROJECT / FOLLOW THE THREAD

A question. A process.
Work you can explore.

Move from the project’s purpose to its available previews and source files.

01 / WHY THIS WORK EXISTS

What this project explores.

A telecom data-platform simulation for Egyptian-market traffic, connecting Kafka, PySpark, ClickHouse, Airflow, and Superset.

ProjectNovaTel Big Data Ecosystem
Available evidence7 linked files
ExploreImplementation & documentation
02 / THE CHOICES & CONNECTIONS

Follow the implementation.

The repository documents NovaTel Big Data Ecosystem. Start with the README and follow its setup and implementation files; the source collection below gives you a way into the work.

Apache KafkaPostgreSQLPySparkClickHouseAirflowApache SupersetPythonSQLDockerApache Spark
Read the implementation notes
03 / OPEN THE WORK

Look beyond the project summary.

The source files and README are the available evidence for this project. Open them to review the implementation and its assumptions.

View the original source
04 / THE WORK BEHIND THE CLAIM

Choose where to look deeper.

Search the linked source inventory or narrow it to the kind of artifact you want to inspect. Files open at their original source.

7 linked source files

DOCREADME.mdYMLdocker-compose.ymlDOCdocs/01_business_case.mdDOCdocs/02_oltp_limitations.mdDOCdocs/03_architecture.mdDOCdocs/04_etl_mapping.mdDOCdocs/05_dwh_design.md
Open the documentation Explore the repository
LATEST FROM GITHUB

The source
keeps moving.

Source updated

This project specifically addresses the "High Write Velocity" problem in telecom, where traditional databases fail during peak events (e.g., Ramadan, football matches).

Current README excerpt

- Executive Summary - Architecture & Design - Tech Stack - Data Pipeline Workflow - Repository Structure - Getting Started - Business Insights

A source excerpt, not an independently verified outcome.

A different question.
A connected skill.

Apache Spark · PostgreSQL · Python

Stock Price Data Pipeline

An automated market-data pipeline connecting Airflow orchestration, Spark processing, object storage, PostgreSQL, and Metabase.

Follow this project
Python · SQL · PySpark

Apache Hadoop Enterprise Multi-Platform Lab

, fully configured Big Data environment for local development, education, and distributed processing.

Follow this project
Python · SQL · PySpark

Big Data Lab 2 Solution – Data Engineering Diploma

Data Engineering Diploma (Data Pill Academy) - Big Data Lab 2: Hive Internal vs. External Tables & Non-Transactional SCD Type 2 Architecture

Follow this project
A QUESTION WORTH EXPLORING?

Let’s make something useful.

Start a conversation

Project preview

Find a project

↑ ↓ to navigate · Enter to open · Esc to closeBrowse all work ↗