> Source: https://meetrix.io/store/apache-nifi/
> Markdown copy of that page. Cite the URL above, not this file.

[Store](https://meetrix.io/store/)  Apache NiFi

Open-source data flow automation

# Self-hosted Apache NiFi on AWS

Build real-time data flows with Apache NiFi, running from a pre-configured AMI in your own AWS account. Route, transform and track data between systems with full lineage, and no software licence fee.

 [Launch on AWS](https://aws.amazon.com/marketplace/pp/prodview-yuu4ynzsi4gtw)

-   Ready in 5-10 minutes
-   Apache 2.0 licensed
-   Runs in your own account

![Apache NiFi deployed on AWS by Meetrix](https://meetrix.io/assets/store/apache-nifi/apache-nifi.webp)

## What is Apache NiFi?

Apache NiFi is an Apache Software Foundation platform for automating data flows between systems. It processes data as flow files with sub-second latency, and records provenance so you can trace and replay every step.

-   ### Visual flow design

    Build pipelines by connecting processors in the browser.

-   ### Real-time processing

    Event-driven flows with sub-second latency and backpressure.

-   ### Full provenance

    Trace every record and replay from any point.

-   ### Broad processor set

    Connect databases, files, queues, APIs and legacy protocols.

-   ### IoT and edge

    Ingest sensor data, with MiNiFi at the edge.

-   ### Conditional routing

    Send data to different systems based on its content.

## What's in the Meetrix Apache NiFi AMI

NiFi needs HTTPS to serve its interface. The AMI sets up the certificate at launch.

-   Apache NiFi running in Docker
-   Automatic SSL when your domain is hosted on Route 53
-   A certificate script for issuing SSL manually otherwise
-   A CloudFormation template for your own AWS account
-   Email support from Meetrix at aws@meetrix.io

## How to set up a self-hosted NiFi server

1.  ### Launch the stack

    Subscribe on AWS Marketplace and launch the CloudFormation stack with your domain and admin email.

2.  ### Point your domain at it

    After 5-10 minutes, create a DNS record with the PublicIp from the stack outputs.

3.  ### Make sure SSL is in place

    NiFi is only reachable over HTTPS at your domain. If SSL did not issue automatically, run the certificate script.

4.  ### Sign in and build a flow

    Open the DashboardUrl, complete the first login and design your first data flow.

## Deploy on AWS

### Apache NiFi on AWS

An AMI on AWS Marketplace, launched into your own AWS account with a CloudFormation stack.

Deploys with

CloudFormation

Recommended size

t3.medium

Access

HTTPS at your domain only

#### Setup guides

-   [**Developer guide** Launch, DNS, SSL, logs](https://meetrix.io/blogs/apache-nifi-developer-guide/)
-   [**Deploy Apache NiFi on AWS** Use cases and industries](https://meetrix.io/blogs/deploy-apache-nifi-aws-meetrix/)
-   [**Video walkthrough** Watch the deployment on YouTube](https://www.youtube.com/watch?v=m2uq_t8w1nU)

 [Launch on AWS](https://aws.amazon.com/marketplace/pp/prodview-yuu4ynzsi4gtw)

## Apache NiFi vs Airbyte

|  | Apache NiFi | Airbyte |
| --- | --- | --- |
| Core model | Real-time data flow | ELT, connector-based batch sync |
| Licence | Apache 2.0 | Elastic License v2 (core) |
| Latency | Sub-second, event-driven | Scheduled, mainly batch |
| Data lineage | Full provenance and replay | Not a core feature |
| Connectors | Broad general-purpose processors | 600+ purpose-built connectors |

Loading a warehouse from SaaS tools? Airbyte is built for that job. [Read Apache NiFi vs Airbyte →](https://meetrix.io/blogs/apache-nifi-vs-airbyte/)

## Video: deploy Apache NiFi on AWS

## Apache NiFi FAQ

Is Apache NiFi open source?

Yes. It is free under Apache 2.0 and maintained by the Apache Software Foundation. On AWS you pay for the instance and any Meetrix software fee shown on the listing.

Why can I not open NiFi by IP address?

NiFi is only served over HTTPS at the DashboardUrl. Point DNS at the server and make sure SSL is issued before you try to open it.

Do I need to set up SSL myself?

Only if the automatic setup fails, for example when your domain is not on Route 53. Then run the certificate script over SSH.

NiFi or Airbyte?

NiFi for real-time, event-driven routing with full lineage. Airbyte for batch loading SaaS data into a warehouse.

Can NiFi run as a cluster?

Yes. Meetrix can help you configure a clustered NiFi setup for high availability and throughput.

Which instance size should I choose?

t3.medium is the recommended starting point.

How do I upgrade?

Back up your server data, remove the old stack and launch the new version from AWS Marketplace.

## Apache NiFi guides and articles

### [Apache NiFi vs Airbyte: Data Flow vs ELT](https://meetrix.io/blogs/apache-nifi-vs-airbyte/)

Real-time data flow against a connector-based ELT platform.

### [Deploy Apache NiFi on AWS with Meetrix](https://meetrix.io/blogs/deploy-apache-nifi-aws-meetrix/)

Simplify complex data flows in minutes.

### [Apache NiFi: Developer Guide](https://meetrix.io/blogs/apache-nifi-developer-guide/)

Launch the stack, set up SSL and sign in.

## Need a hand with Apache NiFi?

We build and run self-hosted data pipelines every day, from flow design to clustering. Tell us what you need.

[Contact us](https://meetrix.io/contact-us/)