NiFi backgroundNiFi
NiFi backgroundNiFi
Data Analysis Tools
NiFiApache SparkApache Hadoop HDFSApache Hadoop YarnKibana

NiFi

Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Moein monitoring system has the capability of monitoring NiFi. In this regard, it provides java virtual machine (JVM) performance indicators such as heap memory, garbage collectors, and threads metrics; as well as flow file, Content and provenance repositories, processors health metrics, and nodes status in cluster modes. The following is a list of performance indicators for Apache NiFi:

Nifi.overview.en

General information: 

  1. Is Clustered?
  2. Connected To Cluster?
  3. Total Cluster Nodes
  4. Total Connected Node To Cluster
  5. Cluster Connected Node Percentage
  6. Cluster Disconnected Node Percentage

Controller KPIs:

  1. Number Of Active Threads
  2. Number Of Terminated Threads
  3. Number Of Queued Flow Files
  4. Queued Flow Files Size
  5. Number Of Running Components
  6. Number Of Stopped Components
  7. Number Of Invalid Components
  8. Number Of Disabled Components
  9. Number Of Active Remote Ports
  10. Number Of Inactive Remote Ports
  11. Number Of Up To Date Process Groups
  12. Number Of Locally Modified Versioned Process Groups
  13. Number Of Stale Versioned Process Groups
  14. Number Of Locally Modified And Stale Versioned Process Groups
  15. Number Of Sync Failed Versioned Process Groups

Nifi.kpi.en

JVM:

  1. Daemon Threads Count
  2. Total Threads Count
  3. Available Processor
  4. Core Average Load
  5. Used Non-Heap Memory
  6. Maximum Non-Heap Memory
  7. Non-Heap Memory Used Percentage
  8. Used Heap Memory
  9. Maximum Heap Memory
  10. Heap Memory Used Percentage

Garbage Collection KPIs:

  1. Garbage Collections Count
  2. Garbage Collection Rate
  3. Garbage Collection Time
  4. Average Garbage Collection Time

Flow File Repository:

  1. Flow File Repository Free Space
  2. Flow File Repository Total Space
  3. Flow File Repository Used Space
  4. Flow File Repository Used Percentage

Content Repository:

  1. Content Repository Free Space
  2. Content Repository Total Space
  3. Content Repository Used Space
  4. Content Repository Used Percentage

Provenance Repository:

  1. Provenance Repository Free Space
  2. Provenance Repository Total Space
  3. Provenance Repository Used Space
  4. Provenance Repository Used Percentage

Processors:

  1. Processor Running Status
  2. Execution Nodes
  3. Number Of Input Flow Files
  4. Size Of Input Flow Files
  5. Read Data Size By Processor
  6. Written Data Size By Processor
  7. Size Of Transferred Flow Files
  8. Number Of Transferred Flow Files
  9. Number Of Tasks Over Last 5 Minutes
  10. Tasks Duration Over Last 5 Minutes
  11. Processor Active Threads
  12. Processor Terminated Threads
  13. Average Task Duration Over Last 5 Minutes
  14. Processor Input Data Rate
  15. Processor Output Data Rate
  16. Processor Data Read Rate
  17. Processor Date Write Rate

Input Ports KPIs:

  1. Input Port Running Status
  2. Number Of Input Flow Files
  3. Size Of Input Flow Files
  4. Size Of Transferred Flow Files
  5. Number Of Transferred Flow Files
  6. Input Port Active Threads
  7. Input Port Data In Rate
  8. Input Port Data Out Rate

Output Ports KPIs:

  1. Output Port Running Status
  2. Number Of Input Flow Files
  3. Size Of Input Flow Files
  4. Size Of Transferred Flow Files
  5. Number Of Transferred Flow Files
  6. Input Port Active Threads
  7. Output Port Data In Rate
  8. Output Port Data Out Rate

Process Groups:

  1. Number Of Process Group Input Flow Files
  2. Size Of Process Group Input Flow Files
  3. Read Data Size By Process Group
  4. Written Data Size By Process Group
  5. Size Of Transferred Flow Files
  6. Number Of Transferred Flow Files
  7. Process Group Active Threads
  8. Process Group Terminated Threads
  9. Process Group Data In Rate
  10. Process Group Data Out Rate
  11. Process Group Data Read Rate
  12. Process Group Data Write Rate

Nifi.process Group.overview.en

Cluster KPIs:

  1. Node Status
  2. Elapsed Time Since Last Heart Beat
  3. Is Primary?
  4. Is Coordinator?
  5. Node Active Threads Count
  6. Node Queued Number Of Data
  7. Node Queued Data Size
  8. Node Start Time

Nifi.nodes.en

Communication Protocols:

  • REST
Data Analysis Tools
NiFiApache SparkApache Hadoop HDFSApache Hadoop YarnKibana
Address
3rd floor, No. 8, 2nd dead-end, Sadeghi St., Azadi Ave., Tehran, Iran, Postal code 1458846155
Behpaya Co. All rights reserved