Build real-time data flows with Apache NiFi, running from a pre-configured AMI in your own AWS account. Route, transform and track data between systems with full lineage, and no software licence fee.
Apache NiFi is an Apache Software Foundation platform for automating data flows between systems. It processes data as flow files with sub-second latency, and records provenance so you can trace and replay every step.
Build pipelines by connecting processors in the browser.
Event-driven flows with sub-second latency and backpressure.
Trace every record and replay from any point.
Connect databases, files, queues, APIs and legacy protocols.
Ingest sensor data, with MiNiFi at the edge.
Send data to different systems based on its content.
NiFi needs HTTPS to serve its interface. The AMI sets up the certificate at launch.
Subscribe on AWS Marketplace and launch the CloudFormation stack with your domain and admin email.
After 5-10 minutes, create a DNS record with the PublicIp from the stack outputs.
NiFi is only reachable over HTTPS at your domain. If SSL did not issue automatically, run the certificate script.
Open the DashboardUrl, complete the first login and design your first data flow.
An AMI on AWS Marketplace, launched into your own AWS account with a CloudFormation stack.
Launch on AWS | Apache NiFi | Airbyte | |
|---|---|---|
| Core model | Real-time data flow | ELT, connector-based batch sync |
| Licence | Apache 2.0 | Elastic License v2 (core) |
| Latency | Sub-second, event-driven | Scheduled, mainly batch |
| Data lineage | Full provenance and replay | Not a core feature |
| Connectors | Broad general-purpose processors | 600+ purpose-built connectors |
Loading a warehouse from SaaS tools? Airbyte is built for that job. Read Apache NiFi vs Airbyte →
Yes. It is free under Apache 2.0 and maintained by the Apache Software Foundation. On AWS you pay for the instance and any Meetrix software fee shown on the listing.
NiFi is only served over HTTPS at the DashboardUrl. Point DNS at the server and make sure SSL is issued before you try to open it.
Only if the automatic setup fails, for example when your domain is not on Route 53. Then run the certificate script over SSH.
NiFi for real-time, event-driven routing with full lineage. Airbyte for batch loading SaaS data into a warehouse.
Yes. Meetrix can help you configure a clustered NiFi setup for high availability and throughput.
t3.medium is the recommended starting point.
Back up your server data, remove the old stack and launch the new version from AWS Marketplace.
Real-time data flow against a connector-based ELT platform.
Simplify complex data flows in minutes.
Launch the stack, set up SSL and sign in.
We build and run self-hosted data pipelines every day, from flow design to clustering. Tell us what you need.
Contact us