Apache NiFi Reviews and details

Social recommendations and mentions

• Ask HN: What low code platforms are worth using?

  Apache NIFI (https://nifi.apache.org/). It uses the concept of Flow-based programming. Also its so underacknolged but this tool is very flexible. I have used as an Event Bus all the 3rd-Party Integrations. - Source: Hacker News / 5 months ago

• Help with choosing techstack for a new DE team

  Presently setting up Apache Nifi + Apache MiNiFi for the ETL portion of my work. NiFi was easy enough to figure out; but the docs for MiNiFi have been a pain due to differences between the Java and C++ versions. I then entirely configured it with the Java version so that it was easier to search for answers for the MiNiFi yaml syntax. Source: 8 months ago

• Json splitting and Rerouting (new to nifi)

  NIFI, like most Apache projects does most of its discussion on its mailing lists, but also has a slack. Source: 10 months ago

• Recommend ETL tool in Linux

  You might want to give a tool like nifi a try: Https://nifi.apache.org/. Source: 10 months ago

• Anki shared decks for Clickhouse and Apache Nifi

  Recently I got a job at a new company and now I need to learn about Clickhouse, Docker, Apache Nifi and Kafka. I've found the decks about Docker and Kafka, but I can't find ones about Clickhouse and Nifi. Https://clickhouse.com/docs/en/intro Https://nifi.apache.org/. Source: 11 months ago

• Your opinion on Kong

  This suggestion isn't a standard one, but when a coworker and I were looking for API gateways with a very specific feature set, we couldn't find a single one to do what we needed. We did, however, come across Apache NiFi. It's a flow-based programming tool that allowed us to translate an http-based request to streaming text sent via netcat. Source: 11 months ago

• S3 to S3 transform

  For a simple sequential Pipeline, my goto would be Apache Camel. As soon as you want complexity its either Apache Nifi or a micro service architecture. Source: about 1 year ago

• Analysing Github Stars - Extracting and analyzing data from Github using Apache NiFi®, Apache Kafka® and Apache Druid®

  Spencer Kimball (now CEO at CockroachDB) wrote an interesting article on this topic in 2021 where they created spencerkimball/stargazers based on a Python script. So I started thinking: could I create a data pipeline using Nifi and Kafka (two OSS tools often used with Druid) to get the API data into Druid - and then use SQL to do the analytics? The answer was yes! And I have documented the outcome below. Here’s... - Source: dev.to / about 1 year ago

• Read database each 5 sec and dispatch event

  Pretty sure you can do this with a NiFi connector. Https://nifi.apache.org. Source: over 1 year ago

• Watch folder and zip new files that appear?

  It's kind of a big tool for the job, but you could do this with Nifi. Source: over 1 year ago

• Using Apache NiFi with Redpanda for your Kafka workloads

  Apache NiFi is a tool for moving and processing data between systems. It started as an internal project from the National Security Agency (NSA), where it was known by the codename NiagaraFiles. Through a technology transfer program, the NSA declassified it as an open source project under the Apache Software Foundation (ASF). NiFi models streaming data as a series of flows through a directed acyclic graph (DAG).... - Source: dev.to / almost 2 years ago

• When should Dataflow be used? Are there examples or guidelines on when we should use it?

  Tangentially, if you like Dataflow you might also want to check out Apache NiFi. Same basic idea, but with a user interface that's pretty easy to use and fairly sophisticated. Source: over 2 years ago

• NIFI Cluster on ECS

  Presuming you mean this: https://nifi.apache.org/ ? Why not go with AWS Glue or similar AWS service directly? Source: over 2 years ago

• Is Apache Airflow HIPAA Compliant & Common Healthcare Stacks?

  As part of your analysis take a look at Apache NiFi. It may not be right for you but focus on the features. It is more mature, spun out of the NSA, and has a pretty decent ecosystem. It is a Java focused stack with some Python friendly capabilities, eg can execute Jython if you want it too. Airflow is a really neat tool and I am not trying to persuade you away from exploring its use just offering a different... Source: over 2 years ago

• Best Practices for Data Pipeline Error Handling in Apache NiFi

  Fortunately, we have tools such as Apache NiFi, which allow us to design and manage our data pipelines, reducing the amount of programming and increasing overall efficiency. Yet, when it comes to creating them, a key and often neglected aspect is minimizing potential errors. - Source: dev.to / almost 3 years ago

• Ask HN: I built it, nobody came, now what?

  How does it differ from Apache NiFi? https://nifi.apache.org/. - Source: Hacker News / almost 3 years ago