Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-1527

Resource Claim counts not incremented on restart for FlowFiles that are swapped out

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 0.6.0, 0.5.1
    • Core Framework
    • None

    Description

      When NiFi starts, it tallies the count of how many FlowFiles reference each Resource Claim and then removes or archives any file in the Content Repository for which there is no claim.

      However, the claim counts are not incremented for data that is swapped out. As a result, the content repository could delete or archive data on restart that it should not. This could potentially result in data loss, if NiFi is restarted while both of the following conditions are met:

      • All FlowFiles that reference a Resource Claim are swapped out
      • Content Repository's archive is disabled, or the archival threshold is already exceeded from data outside of the Content Repository

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            markap14 Mark Payne
            markap14 Mark Payne
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment