← All work
Data engineering

FX Rate Pipeline: Dockerized In-Flight State Management

An intentionally flawed ETL pipeline built with Apache NiFi and PostgreSQL inside Docker, designed to surface and demonstrate the architectural limitations of in-flight stateful transformation — and why the industry moved from ETL to ELT.

THE PROJECT / FOLLOW THE THREAD

A question. A process.
Work you can explore.

Move from the project’s purpose to its available previews and source files.

01 / WHY THIS WORK EXISTS

What this project explores.

An intentionally flawed ETL pipeline built with Apache NiFi and PostgreSQL inside Docker, designed to surface and demonstrate the architectural limitations of in-flight stateful transformation — and why the industry moved from ETL to ELT.

ProjectFX Rate Pipeline: Dockerized In-Flight State Management
Available evidence4 linked files
ExploreImplementation & documentation
02 / THE CHOICES & CONNECTIONS

Follow the implementation.

The repository documents FX Rate Pipeline: Dockerized In-Flight State Management. Start with the README and follow its setup and implementation files; the source collection below gives you a way into the work.

Apache NiFiPostgreSQLDockerETLSQLdbt
Read the implementation notes
03 / OPEN THE WORK

Look beyond the project summary.

The source files and README are the available evidence for this project. Open them to review the implementation and its assumptions.

View the original source
04 / THE WORK BEHIND THE CLAIM

Choose where to look deeper.

Search the linked source inventory or narrow it to the kind of artifact you want to inspect. Files open at their original source.

4 linked source files

DOCREADME.mdYMLdocker-compose.ymlDOCdocs/data_lineage.mdSQLsql/init.sql
Open the documentation Explore the repository
LATEST FROM GITHUB

The source
keeps moving.

Source updated

An intentionally flawed ETL pipeline built with Apache NiFi and PostgreSQL inside Docker, designed to surface and demonstrate the architectural limitations of in-flight stateful transformation — and why the industry moved from ETL to ELT.

Current README excerpt

[](https://www.docker.com/) [](https://nifi.apache.org/) [](https://www.postgresql.org/) [](https://www.frankfurter.app/) [](LICENSE)

A source excerpt, not an independently verified outcome.

A different question.
A connected skill.

PostgreSQL · SQL · Docker

NovaTel Big Data Ecosystem

A telecom data-platform simulation for Egyptian-market traffic, connecting Kafka, PySpark, ClickHouse, Airflow, and Superset.

Follow this project
SQL · dbt · Docker

Sohila Khaled Abbas

Config files for my GitHub profile.

Follow this project
SQL · Docker · PostgreSQL

Amsterdam Airbnb Data Analytics

Source files and documentation for Amsterdam Airbnb Data Analytics.

Follow this project
A QUESTION WORTH EXPLORING?

Let’s make something useful.

Start a conversation

Project preview

Find a project

↑ ↓ to navigate · Enter to open · Esc to closeBrowse all work ↗