Data Analysis Tools
NiFi Monitoring
Apache NiFi is an easy to use, powerful, and reliable system to process and distribute data. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic. Moein monitoring system has the capability of monitoring NiFi. In this regard, it provides java virtual machine (JVM) performance indicators such as heap memory, garbage collectors, and threads metrics; as well as flow file, Content and provenance repositories, processors health metrics, and nodes status in cluster modes. The following is a list of performance indicators for Apache NiFi:
General information:
- Is Clustered?
- Connected To Cluster?
- Total Cluster Nodes
- Total Connected Node To Cluster
- Cluster Connected Node Percentage
- Cluster Disconnected Node Percentage
Controller KPIs:
- Number Of Active Threads
- Number Of Terminated Threads
- Number Of Queued Flow Files
- Queued Flow Files Size
- Number Of Running Components
- Number Of Stopped Components
- Number Of Invalid Components
- Number Of Disabled Components
- Number Of Active Remote Ports
- Number Of Inactive Remote Ports
- Number Of Up To Date Process Groups
- Number Of Locally Modified Versioned Process Groups
- Number Of Stale Versioned Process Groups
- Number Of Locally Modified And Stale Versioned Process Groups
- Number Of Sync Failed Versioned Process Groups
JVM:
- Daemon Threads Count
- Total Threads Count
- Available Processor
- Core Average Load
- Used Non-Heap Memory
- Maximum Non-Heap Memory
- Non-Heap Memory Used Percentage
- Used Heap Memory
- Maximum Heap Memory
- Heap Memory Used Percentage
Garbage Collection KPIs:
- Garbage Collections Count
- Garbage Collection Rate
- Garbage Collection Time
- Average Garbage Collection Time
Flow File Repository:
- Flow File Repository Free Space
- Flow File Repository Total Space
- Flow File Repository Used Space
- Flow File Repository Used Percentage
Content Repository:
- Content Repository Free Space
- Content Repository Total Space
- Content Repository Used Space
- Content Repository Used Percentage
Provenance Repository:
- Provenance Repository Free Space
- Provenance Repository Total Space
- Provenance Repository Used Space
- Provenance Repository Used Percentage
Processors:
- Processor Running Status
- Execution Nodes
- Number Of Input Flow Files
- Size Of Input Flow Files
- Read Data Size By Processor
- Written Data Size By Processor
- Size Of Transferred Flow Files
- Number Of Transferred Flow Files
- Number Of Tasks Over Last 5 Minutes
- Tasks Duration Over Last 5 Minutes
- Processor Active Threads
- Processor Terminated Threads
- Average Task Duration Over Last 5 Minutes
- Processor Input Data Rate
- Processor Output Data Rate
- Processor Data Read Rate
- Processor Date Write Rate
Input Ports KPIs:
- Input Port Running Status
- Number Of Input Flow Files
- Size Of Input Flow Files
- Size Of Transferred Flow Files
- Number Of Transferred Flow Files
- Input Port Active Threads
- Input Port Data In Rate
- Input Port Data Out Rate
Output Ports KPIs:
- Output Port Running Status
- Number Of Input Flow Files
- Size Of Input Flow Files
- Size Of Transferred Flow Files
- Number Of Transferred Flow Files
- Input Port Active Threads
- Output Port Data In Rate
- Output Port Data Out Rate
Process Groups:
- Number Of Process Group Input Flow Files
- Size Of Process Group Input Flow Files
- Read Data Size By Process Group
- Written Data Size By Process Group
- Size Of Transferred Flow Files
- Number Of Transferred Flow Files
- Process Group Active Threads
- Process Group Terminated Threads
- Process Group Data In Rate
- Process Group Data Out Rate
- Process Group Data Read Rate
- Process Group Data Write Rate
Cluster KPIs:
- Node Status
- Elapsed Time Since Last Heart Beat
- Is Primary?
- Is Coordinator?
- Node Active Threads Count
- Node Queued Number Of Data
- Node Queued Data Size
- Node Start Time
Communication Protocols:
- REST
Data Analysis Tools
Behpaya Co. All rights reserved