Data Flow Manager

    1. Introduction

    Data Flow Manager v2.1.4 introduced the support for monitoring Apache NiFi clusters effectively by adding a monitoring (Grafana) dashboard link.

    Data Flow Manager is a UI-based tool to automate the deployment and upgrade of data flows across Apache NiFi clusters. It simplifies the transfer of data flows from one NiFi cluster to another. It eliminates the time-consuming, error-prone manual process of data flow deployments, which involves writing complex Ansible scripts.

    Designed for NiFi admins and developers, Data Flow Manager is aimed at improving operational efficiency, reducing human errors, and ensuring secure data handling across NiFi clusters. With the point-and-click interface, it ensures significant time savings in data flow management.

    Data Flow Manager provides the flexibility to schedule NiFi flow deployments during off-business hours, ensuring minimal disruptions to ongoing operations. Additionally, scheduled deployments come with built-in admin approval. Admins can approve or reject scheduled data flow deployments to maintain control over data flows.

    With granular activity and process group-level tracking, Data Flow Manager tracks and records all user actions associated with data flows. Robust user access and permission controls ensure that only authorized users have appropriate access (view, edit, deactivate, or delete) to NiFi clusters.

    With seamless LDAP integration for authentication, Data Flow Manager ensures secure and efficient access control. Moreover, admins can manage NiFi clusters from a unified dashboard, reducing administrative overhead and the complexity of multi-cluster environments.

    With Data Flow Manager, you can focus on driving innovation and strategic growth to your business, leaving behind the complexities of data flow deployments.

    Release Notes Data Flow Manager v2.1.4

    2. Verified Builds

    Build Version: 2.1.4

    In Data Flow Manager v2.1.4, we have conducted extensive testing and validation to ensure the stability, reliability, and performance of the application across multiple environments.

    With this verified build, Data Flow Manager v2.1.4 continues to offer a robust, reliable, and high-performing solution for automating NiFi flow deployment.

    3. New Features

    With the release of Data Flow Manager v2.1.4, we’ve introduced powerful new features to enhance monitoring, usability, and error handling.

    • Add a Monitoring (Grafana) Dashboard Link to monitor NiFi clusters/servers and track their performance in real time.
    • Improved user experience by displaying a "Something went wrong" message when clicking the refresh icon if an issue occurs.
    • The save button is now disabled when no changes have been made to parameters, variables, or controller services, preventing unnecessary actions.
    • Introduced a search functionality on the Process Group page. Users can now search for specific process groups with ease, making navigation faster and more efficient.
    • Introduced resizable columns in Controller Services. Added flexibility by allowing column resizing within the Controller Services section for better visibility of data.
    • If an error occurs during an upgrade or downgrade process, a clear and actionable toast message is displayed.
    • When deploying a process group using an unsecured registry, a proper error message now alerts the user.
    • Activity history status colors for improved visual clarity:
      • Success status – Green
      • Failed status – Red (previously grey/black)

    4. Defect Fixes

    In Data Flow Manager v2.1.4, we've addressed several critical defects to improve system reliability, error handling, and user experience.

    • Intermittent "No Authorization Token Found" Issue: Fixed a bug where users occasionally received a toast message indicating a missing authorization token, ensuring consistent authentication handling.
    • "No Value" Property Setting Issue: Resolved an issue where setting a property value as "No Value" wasn’t working properly in NiFi.
    • Empty String Display in Parameter Context: Fixed a display issue where an empty string was incorrectly shown as "No Value Set", ensuring accurate parameter representation.
    • Mismatched Tooltip Content: Fixed inconsistent tooltip messages, ensuring accurate and clear descriptions.
    • Error/Warning Display: Users will now see a proper error or warning message when enabling or disabling a service, improving feedback clarity.
    • Cluster Name Update Issue: Fixed a bug where edited cluster names were not reflected when switching between clusters, ensuring real-time updates.
    • Intermittent Status Code 400 Error: Resolved an issue where a 400 status code error appeared randomly in toast messages, ensuring smoother operations.
    • Controller Service Properties Visibility: Fixed an issue where controller service properties were not visible in the process group detail page.

    5. Additional Defect Fixes

    We've implemented further refinements in Data Flow Manager v2.1.4 to enhance validation and system consistency.

    • When searching for a process group, the tooltip now displays its parent group, providing better context and clarity.
    • Made the table grid adjustments. Improved table layouts for better readability and alignment.
    • Validate reference parameters before saving controller service properties that require another service as the property.
    • Referencing parameters are properly assigned when a controller service property requires another service as its value.
    • Detailed investigation into SSO implementation to align with the business model and security requirements.