← All work
Learning & resources

Data & AI Career Roadmap Generator

An end-to-end data engineering pipeline that scrapes real-time job market data across multiple platforms, extracts technical skills using Gemini 2.0 Flash, and powers an interactive Serverless Next.js web application to generate sequential learning roadmaps. Includes a GitHub Actions cron job for daily market data updates across 15+ job profiles.

THE PROJECT / FOLLOW THE THREAD

A question. A process.
Work you can explore.

Move from the project’s purpose to its available previews and source files.

01 / WHY THIS WORK EXISTS

What this project explores.

An end-to-end data engineering pipeline that scrapes real-time job market data across multiple platforms, extracts technical skills using Gemini 2.0 Flash, and powers an interactive Serverless Next.js web application to generate sequential learning roadmaps. Includes a GitHub Actions cron job for daily market data updates across 15+ job profiles.

ProjectData & AI Career Roadmap Generator
Available evidence7 linked files
ExploreProject website & source
02 / THE CHOICES & CONNECTIONS

Follow the implementation.

The repository documents Data & AI Career Roadmap Generator. Start with the README and follow its setup and implementation files; the source collection below gives you a way into the work.

PythonAirflowDockerPandas
Read the implementation notes
03 / OPEN THE WORK

Try the project for yourself.

The source files and README are the available evidence for this project. Open them to review the implementation and its assumptions.

Open the project website View the original source
04 / THE WORK BEHIND THE CLAIM

Choose where to look deeper.

Search the linked source inventory or narrow it to the kind of artifact you want to inspect. Files open at their original source.

7 linked source files

DOCREADME.mdDOCCONTRIBUTING.mdYMLdocker-compose.ymlDOCdocs/architecture.mdDOCdocs/setup.mdDOCdocs/usage.mdPYscratch/check_profiles.py
Open the documentation Explore the repository
LATEST FROM GITHUB

The source
keeps moving.

Source updated

An end-to-end data engineering pipeline that scrapes real-time job market data across multiple platforms, extracts technical skills using Gemini 2.0 Flash, and powers an interactive Serverless Next.js web application to generate sequential learning roadmaps. Includes a GitHub Actions cron job for daily market data updates across 15+ job profiles.

Current README excerpt

[](https://www.python.org/) [](https://github.com/D4Vinci/Scrapling) [](https://aistudio.google.com/) [](https://fastapi.tiangolo.com/) [](https://nextjs.org/) [](https://vercel.com/) [](https://github.com/features/actions) [](https://opensource.org/licenses/MIT) [](CONTRIBUTING.md)

A source excerpt, not an independently verified outcome.

A different question.
A connected skill.

Python · Airflow · Docker

Data Engineering Learning Roadmap

A practical, self-paced roadmap for SQL, Python, analytics engineering, data pipelines, big data, and portfolio projects.

Follow this project
Python · Airflow · Docker

National Insurance Data Warehouse

An Egyptian Form 5 portfolio scenario covering synthetic data generation, cleaning, orchestration, SQL Server warehousing, and Power BI.

Follow this project
Python · Airflow · Docker

Sohila Khaled Abbas

Config files for my GitHub profile.

Follow this project
A QUESTION WORTH EXPLORING?

Let’s make something useful.

Start a conversation

Project preview

Find a project

↑ ↓ to navigate · Enter to open · Esc to closeBrowse all work ↗