Dashboards, data pipelines, automation, and learning projects. Explore the case studies or search the full GitHub collection.
Open a project to explore its preview, toolkit, and available source files.
A documented queue-mode automation stack with Docker, Redis, PostgreSQL, worker scaling, and operational runbooks.
Repository chartOfficial portfolio, applied machine learning research paper, and autonomous decision-support agent for Sohila Khaled Abbas (Applied ML Intern & Search Intelligence Engineer at FlyRank AI | BI Developer).
Data modelEnd-to-end data pipeline and Power BI model for Kickstarter campaign analysis.
Architecture diagramEnterprise Multi-Source ELT, SQL Server 2022 Kimball Data Warehouse, SCD Type 2, Automated Data Quality Quarantine & Power BI Analytics Lifecycle
Architecture diagramPwC Switzerland Virtual Case Experience: Enterprise Business Intelligence, Ralph Kimball Galaxy Semantic Model (VertiPaq Engine), DAX KPI Engineering & Executive Excel Application Architecture
Architecture diagramAnalytics Engineering Lakehouse, Multi-Format Ingestion Engine, and Power BI Semantic Model
An end-to-end automated data pipeline built with Apache Airflow, Apache Spark, MinIO, PostgreSQL, and Metabase.
docker-compose.override.ymlpyrightconfig.jsondags/random_number_checker.pyAn end-to-end automated data pipeline built with Apache Airflow, Apache Spark, MinIO, PostgreSQL, and Metabase.
An end-to-end data pipeline and warehouse solution for managing and analyzing synthetic Egyptian National Insurance data…
docker-compose.ymldags/form5_etl_dag.pylogs/query_log.sqlAn end-to-end data pipeline and warehouse solution for managing and analyzing synthetic Egyptian National Insurance data (specifically Form 5 records). This repository covers the complete lifecycle of data, from raw data generation …
Architecture diagramA multi-source ETL pipeline that consolidates banking, ATM, and credit card data into a single Customer 360 golden record, enforcing a strict three-rule exception matrix to quarantine non-conforming records before they reach the dat…
A Python data-preparation framework and Streamlit application covering missing values, outliers, validation, and feature scaling.
app.pydocs/architecture.mdnotebook/data_cleaning_tool.ipynbA Python data-preparation framework and Streamlit application covering missing values, outliers, validation, and feature scaling.
Dashboard previewReal-time insights into retailer behavior, operational performance, and customer lifecycle across the Maxab distribution network in Egypt.
Dashboard previewA comprehensive end-to-end data analytics project using Python, Excel, and Power BI to extract actionable insights from complex supply chain data. This dashboard supports operational and strategic decision-making by visualizing key …
This repository contains the source code for a personal data portfolio website built for Sohila Khaled Abbas — a recognized BI…
components.jsonfirebase.jsonindex.htmlThis repository contains the source code for a personal data portfolio website built for Sohila Khaled Abbas — a recognized BI Developer, Data Analytics Engineer, and Top 200 Arabic-Speaking Influencer in data education.
Config files for my GitHub profile.
data/visitor-analytics.jsonscripts/check_readme_links.pyscripts/check_readme_mobile.py
Architecture diagramA data-driven one-page report on the state of the global economy using World Bank and UN HDI datasets.
main.pynotebooks/api_deployment.ipynbnotebooks/data_profiling_and_validation.ipynbA data-driven one-page report on the state of the global economy using World Bank and UN HDI datasets.
Learning repository thumbnailA structured, hands-on learning companion for the 81-lecture Microsoft Power BI Data Analysis Diploma by Eng. Essam Elsayed (MCT). The repository organizes the curriculum into seven learning phases and brings together lecture notes,…
Dashboard previewAn end-to-end data engineering and analytics project analyzing historical Apple Inc. (AAPL) stock market data up to the present day, to extract actionable business insights and investment strategies.
A provenance-first public business-data discovery pipeline for Egypt's home-services market.
README.mdA provenance-first public business-data discovery pipeline for Egypt's home-services market.
Excel dashboard previewCompleted and submitted the Forage Academy Excel Skills Job Simulation on November 4, 2026. This evidence-led project documents data-quality review, conditional formatting, Excel formulas, PivotTables, KPI design, dashboard charts, …
Personal Data Portfolio Website
components.jsonindex.htmlpackage.jsonPersonal Data Portfolio Website
An end-to-end data engineering pipeline that scrapes real-time job market data across multiple platforms, extracts technical…
docker-compose.ymldocs/architecture.mddocs/setup.mdAn end-to-end data engineering pipeline that scrapes real-time job market data across multiple platforms, extracts technical skills using Gemini 2.0 Flash, and powers an interactive Serverless Next.js web application to generate seq…
This repository serves as an operational codebase and architectural proof of competency for modern Data Engineering & Database…
SECURITY.mddocker/docker-compose.ymldocs/architecture-diagram.mdThis repository serves as an operational codebase and architectural proof of competency for modern Data Engineering & Database Reliability Engineering (DBRE) on Microsoft SQL Server 2022. It is engineered directly from the curriculu…
A forensic data engineering investigation into how "Cyber Flash Drops" are silently destroying profit margins through…
databricks.ymldashboards/VoltEdge_Dark.jsondocs/data_lineage.mdA forensic data engineering investigation into how "Cyber Flash Drops" are silently destroying profit margins through deal-sniper users and coordinated bot exploitation.
Source files and documentation for Telecom Churn Analytics.
docs/dashboard_storytelling_guide.mddocs/data_dictionary.mddocs/implementation_guide.mdSource files and documentation for Telecom Churn Analytics.
Data modelBuild a structured SQL database + ERD for the Employee Directory dataset (44 columns). The goal is to normalize the flat file, reduce redundancy, and enable efficient queries for reporting, analytics, and integration with BI tools.
A personal knowledge system for mastering Excel VBA, Macros, Automation Architecture, Debugging, UserForms, and Office Suite…
SECURITY.md00 - Dashboard/Home.md00 - Dashboard/Knowledge Map.mdA personal knowledge system for mastering Excel VBA, Macros, Automation Architecture, Debugging, UserForms, and Office Suite Integration
An Omnichannel Sales & Operations Planning (S&OP) Dashboard built with Microsoft Power BI. This repository leverages the new…
docs/sop_workflow.mdS&OP_Dashboard.pbipdocs/data_dictionary.mdAn Omnichannel Sales & Operations Planning (S&OP) Dashboard built with Microsoft Power BI. This repository leverages the new Power BI Project (.pbip) format and Tabular Model Definition Language (TMDL) for standard git-based version…
Interactive Python learning roadmapA Python learning path for data and analytics engineering with 42 lessons, 53 resources, embedded videos and a browser coding lab. Thirteen guided challenges and a free playground connect EGP data, PixelFed quality, CSV, API payload…
, fully configured Big Data environment for local development, education, and distributed processing.
docker-compose.ymlSECURITY.md, fully configured Big Data environment for local development, education, and distributed processing.
Source files and documentation for Marketing Campaign Dashboard.
app.pyCrawl job listings for a search (e.g., "data analyst", Cairo) from Indeed, extract structured fields, store into SQLite, keep…
configs/example_config.ymlpython/etl.ipynbpython/job-scraper-pipeline.ipynbCrawl job listings for a search (e.g., "data analyst", Cairo) from Indeed, extract structured fields, store into SQLite, keep deduped & incremental updates.
A , secure Natural Language to SQL (NL2SQL) pipeline using Python, LangChain, and SQLAlchemy.
app.pymain.pysrc/__init__.pyA , secure Natural Language to SQL (NL2SQL) pipeline using Python, LangChain, and SQLAlchemy.
A practical, self-paced roadmap for SQL, Python, analytics engineering, data pipelines, big data, and portfolio projects.
ROADMAP.mddocs/ADD_VIDEO_RESOURCES.mddocs/CAPSTONE.mdA practical, self-paced roadmap for SQL, Python, analytics engineering, data pipelines, big data, and portfolio projects.
Interactive learning roadmapA personalized 24-week journey from Python, SQL, BI, and n8n to Forward Deployed Engineering, with an interactive skill map, weekly work plans, portfolio builds, and customer-delivery templates.
Udemy Course - Fundamentals of Networking for Effective Backend Design
Udemy Course - Fundamentals of Networking for Effective Backend Design
An engineering-first, hands-on repository covering core operating system internals, process anatomy, virtual memory, CPU cache…
docker-compose.ymldocs/os-cheat-sheet.mddocs/references.mdAn engineering-first, hands-on repository covering core operating system internals, process anatomy, virtual memory, CPU cache lines, socket buffers, page cache, and copy-on-write (COW).
A/B testing project analyzing the impact of a marketing ad campaign on user conversions using Python, PostgreSQL, and Excel.…
analysis/A_B_Testing_Marketing_Conversion_Analysis.ipynbsql/Creating Table Query.sqlsql/Prepare a Contingency Table Using SQL.sqlA/B testing project analyzing the impact of a marketing ad campaign on user conversions using Python, PostgreSQL, and Excel. Includes statistical tests (Z-test, Chi-square), data cleaning, SQL queries, and business insights.
A Obsidian Knowledge System, Interactive Learning Web Platform, Data Analytics Curriculum, and GitHub Portfolio Repository for…
implementation.mdSECURITY.md00_Home/Course Dashboard.mdA Obsidian Knowledge System, Interactive Learning Web Platform, Data Analytics Curriculum, and GitHub Portfolio Repository for mastering modern Microsoft Excel, Power Query, Power Pivot, DAX, AI-Assisted Workflows, and Executive Das…
Data modelA , enterprise data engineering & business intelligence platform for Nexora Tech Solutions (حلول نكسورا للبرمجيات), transforming 6 heterogeneous HR, L&D Academy, and Client Delivery source feeds into a high-performance Kimball Galax…
An interactive learning roadmap for AI automation, featuring n8n and adjacent automation tools as structured data-tea products.…
docs/verified-youtube-call-workflow-tool-match.jsondocs/verified-youtube-hubspot-workflows-match.jsondocs/verified-youtube-n8n-v2-subworkflows-match.jsonAn interactive learning roadmap for AI automation, featuring n8n and adjacent automation tools as structured data-tea products. · Built with Manus
event streaming pipeline with automated orchestration, idempotent production, at-most-once consumption, and high-throughput…
docs/architecture.mddocs/data_dictionary.mddocs/delivery_semantics.mdevent streaming pipeline with automated orchestration, idempotent production, at-most-once consumption, and high-throughput topic architecture.
A , 3-broker Apache Kafka cluster with ZooKeeper, designed for Big Data & Spark Structured Streaming integration.
docker-compose.ymlSECURITY.mddocs/ARCHITECTURE.mdA , 3-broker Apache Kafka cluster with ZooKeeper, designed for Big Data & Spark Structured Streaming integration.
Cloud LLM inference workflow integrating HuggingFace API with automatic 503 cold-start retries, Wait node backoff, and robust response parsing.
Real-time customer feedback sentiment classifier logging sentiment scores to Google Sheets and triggering instant priority alerts for negative reviews.
Event-driven ETL pipeline monitoring Google Drive for PDFs, extracting and chunking text, generating embeddings, and upserting vectors into Qdrant for RAG.
Content curation pipeline extracting links and media from Telegram, generating AI summaries with key takeaways, and persisting structured entries in Notion.
Automated trend monitoring pipeline scraping viral content, extracting engagement metrics, classifying topics via AI, and generating daily digest reports.
A retrieval-augmented assistant for Apple product and technical-support documentation, with Qdrant retrieval and conversational context.
Interactive Telegram delivery bot with natural language cart management, LangChain agent, OpenRouter inference, and MSSQL session state persistence.
Real estate AI lead qualification agent evaluating buyer budgets, property preferences, and down payment readiness with OpenRouter LLM, CRM logging, and agent routing.
Automated lead generation pipeline scraping Upwork jobs via Apify, evaluating client requirements with GPT-4, and generating tailored freelance proposals.
Multi-agent LangChain restaurant assistant with Qdrant/Supabase RAG, Google Sheets dynamic pricing, order management with 5-min grace cancellation, and Telegram kitchen dispatch.
Data Engineering Diploma (Data Pill Academy) - Big Data Lab 2: Hive Internal vs. External Tables & Non-Transactional SCD Type 2…
docker-compose.ymlgenerate_submission_doc.pydocs/Hive_Lab_Submission.mdData Engineering Diploma (Data Pill Academy) - Big Data Lab 2: Hive Internal vs. External Tables & Non-Transactional SCD Type 2 Architecture
The Data Tea is an interactive, community-driven career guidance portal for aspiring data professionals. It helps anyone — from…
components.jsonpackage.jsontsconfig.jsonThe Data Tea is an interactive, community-driven career guidance portal for aspiring data professionals. It helps anyone — from total beginners to mid-career switchers — discover which data career path fits their personality, then h…
An advanced, serverless Single-Page Application (SPA) built on Google Apps Script. This tool empowers HR professionals to upload…
appsscript.jsondocs/architecture.mddocs/data_flow.mdAn advanced, serverless Single-Page Application (SPA) built on Google Apps Script. This tool empowers HR professionals to upload raw CSV datasets, processes the data entirely in-memory (client-side) for maximum privacy and speed, an…
dbt course form datacamp for data analytic engineer
dbt course form datacamp for data analytic engineer
Forked from niyotham/dbt-datacamp-course-note
Dashboard previewPower BI dashboard for analyzing regional sales trends, identifying growth opportunities, and increasing profitability by 20% using actionable insights.
Architecture diagramThis repository contains the complete architecture and implementation of a data system for Global Horizon Bank. Following industry best practices, the project transitions from a highly normalized Transactional Database (OLTP) to a h…
Dashboard previewInteractive Power BI dashboard for HR analytics, providing actionable insights into employee attendance and leave patterns. Features dynamic filters, DAX measures, and visually engaging reports for data-driven decision-making.
Transform your disparate CSV and Excel files into unified, actionable intelligence.
app/__init__.pyapp/database.pyapp/main.pyTransform your disparate CSV and Excel files into unified, actionable intelligence.
A comprehensive Data Engineering and Business Intelligence solution analyzing the Brazilian E-Commerce Public Dataset by Olist.
report/O-List Dashboard.pbixA comprehensive Data Engineering and Business Intelligence solution analyzing the Brazilian E-Commerce Public Dataset by Olist.
An intentionally flawed ETL pipeline built with Apache NiFi and PostgreSQL inside Docker, designed to surface and demonstrate…
docker-compose.ymldocs/data_lineage.mdsql/init.sqlAn intentionally flawed ETL pipeline built with Apache NiFi and PostgreSQL inside Docker, designed to surface and demonstrate the architectural limitations of in-flight stateful transformation — and why the industry moved from ETL t…
An accounts-receivable analytics scenario connecting synthetic transactions, Power Query transformations, and a star schema.
docs/datalineage.mdnotebooks/data_generator.ipynbnotebooks/user_comments_generator.ipynbAn accounts-receivable analytics scenario connecting synthetic transactions, Power Query transformations, and a star schema.
A telecom data-platform simulation for Egyptian-market traffic, connecting Kafka, PySpark, ClickHouse, Airflow, and Superset.
docker-compose.ymldocs/01_business_case.mddocs/02_oltp_limitations.mdA telecom data-platform simulation for Egyptian-market traffic, connecting Kafka, PySpark, ClickHouse, Airflow, and Superset.
This project explains how data engineering and analytics enable smarter campaign investments. Optimizing marketing spend…
docs/example_interactions_guide.mddocs/marketing_analysis_mentoring_prompt.mddocs/prompt_implementation_guide.mdThis project explains how data engineering and analytics enable smarter campaign investments. Optimizing marketing spend requires reliable, well-modeled data. We build an end-to-end pipeline from raw campaign data to executive insig…
Source files and documentation for MaxAB Wallet Recharge Optimization: Databricks & Power BI.
databricks_sql/01_bronze.sqldatabricks_sql/02_silver.sqldocs/assumptions_log.mdSource files and documentation for MaxAB Wallet Recharge Optimization: Databricks & Power BI.
A production analytics project across the complete data lifecycle: ingestion, warehousing, transformation, profiling, and…
A production analytics project across the complete data lifecycle: ingestion, warehousing, transformation, profiling, and storytelling. Using Airbnb Athens data (September 2025 snapshot with 26,900+ listings).
Workshop Codespaces
pipeline/ingest_data.pypipeline/main.pypipeline/notebook.ipynbDaily scrape remote job postings, ingest into SQL, expose cleansed dataset to Power BI for trend analysis and data-driven…
config/fx_rates.jsonconfig/skills_lexicon.jsondocuments/data_export_script_guide.mdDaily scrape remote job postings, ingest into SQL, expose cleansed dataset to Power BI for trend analysis and data-driven business recommendations.
A CLI used to complete coding challenges and lessons on Boot.dev
A CLI used to complete coding challenges and lessons on Boot.dev
Forked from bootdotdev/bootdevEnd-to-end Finance Analytics solution
notebooks/finance_analysis.ipynbnotebooks/yfinance_documentation.ipynbsrc/__init__.pyA learning resource and its upstream project.
A learning resource and its upstream project.
Forked from ahmedashraffcih/Obsidian-Vault-RoadmapA curated list of data engineering tools for software developers
A curated list of data engineering tools for software developers
Forked from igorbarinov/awesome-data-engineeringA learning resource and its upstream project.
A learning resource and its upstream project.
Forked from h9-tec/AI_tools_nontechnicalall of the workflows of n8n i could find (also from the site itself)
A curated list of GitHub's awesomeness
A curated list of awesome PostgreSQL software, libraries, tools and resources, inspired by awesome-mysql
A curated list of awesome PostgreSQL software, libraries, tools and resources, inspired by awesome-mysql
Forked from dhamaniasad/awesome-postgresA curated list of awesome VBA/VB6 frameworks, libraries, software and resources
A curated list of awesome VBA/VB6 frameworks, libraries, software and resources
Forked from sancarn/awesome-vba😎 Awesome lists about all kinds of interesting topics
A learning resource and its upstream project.
A learning resource and its upstream project.
Forked from anshlambagit/AnshLambaYoutubeOfficial repo for the #tidytuesday project
A topic-centric list of HQ open datasets.
A topic-centric list of HQ open datasets.
Forked from awesomedata/awesome-public-datasetsA learning resource and its upstream project.
A learning resource and its upstream project.
Forked from data-burst/data-engineering-roadmapSource files and documentation for Amsterdam Airbnb Data Analytics.
docker/docker-compose.ymldocs/DATA_DICTIONARY.mddocs/DATA_LINEAGE.mdSource files and documentation for Amsterdam Airbnb Data Analytics.
Repo for Linux tutorial
A learning resource and its upstream project.
A learning resource and its upstream project.
Forked from a00ayad00/Machine-Learning-and-Data-Science-ResoursesThis project demonstrates a full end-to-end data analytics pipeline: from raw e-commerce customer data → ETL → clustering → star…
etl/clean_customers.pyetl/cluster.pyetl/load_to_postgres.pyThis project demonstrates a full end-to-end data analytics pipeline: from raw e-commerce customer data → ETL → clustering → star schema → advanced SQL (CTEs & window functions) → Power BI storytelling dashboard → interactive Streaml…
Dashboard previewWuzzuf Job Market Analysis is a Power BI Dashboard that analyzes job market trends in Egypt using web scraping and data analytics. This project extracts job postings from Wuzzuf.net, cleans the data, and visualizes key hiring insights.
This repository contains the code and assets for my personal portfolio website. It serves as a professional hub where visitors…
elements.htmlgeneric.htmlindex.htmlThis repository contains the code and assets for my personal portfolio website. It serves as a professional hub where visitors can explore my data analysis projects, skills, and get in touch with me. The site is built using HTML, CS…
Dashboard previewInteractive Power BI dashboard for analyzing hospital waitlists, patient demographics, and service trends.
Dashboard previewDelivered a dashboard resolving ROI data issues and highlighting a 35% click contribution from top channels.
Dashboard previewThis project integrates Python and Power BI to analyze a startup's store expansion performance. It features a 5-page interactive dashboard covering revenue, ROI, marketing efficiency, and detailed store-level insights. Includes data…
This project is an implementation of exploratory data analysis (EDA) techniques in Python, inspired by Mustafa Othman's YouTube…
notebook/Python Exploratory Data Analysis Case-study.ipynbThis project is an implementation of exploratory data analysis (EDA) techniques in Python, inspired by Mustafa Othman's YouTube tutorial. It focuses on analyzing employee salary data to uncover trends and insights.
Dashboard previewExplore cinema trends with the IMDB Top 250 Movies Dashboard, a Power BI project that visualizes movie ratings, distributions, and top-performing films. The dashboard uses interactive visualizations, advanced DAX measures, and a cle…
Dashboard previewPower BI dashboard analyzing emergency room data to improve decision-making. Features advanced DAX measures, insights into patient satisfaction, visit trends, and demographics. Includes interactive design with slicers and drill-thro…
The Global Layoffs Analysis project uses SQL to explore workforce reduction trends across industries, funding stages, and…
sql/Data Cleaning.sqlsql/Exploratory Data Analysis.sqlThe Global Layoffs Analysis project uses SQL to explore workforce reduction trends across industries, funding stages, and regions. By analyzing clean and enhanced datasets, it uncovers key drivers of layoffs, highlights global patte…
Try a shorter name, a tool, or another subject.
Public source snapshot: 2026-11-08. Checking current GitHub metadata…
New public repositories and source metadata refresh automatically. Forks retain upstream attribution. Case studies and project status are curated separately.