We are seeing an intermittent issue on multiple masters where builds are becoming hung. We have not identified a specific trend among these builds that are becoming hung and have had a hard time trying to reproduce the issue ourselves sense it's intermittent.
One of our masters is on LTS 2.1383 and the rest are on LTS 2.89.2. We updated the durable task plugin on one of the masters. That resolved a looping issue we had but this hung build issue persists. We are seeing this on pipeline job types and freestyle jobs. Any help to identify root cause is appreciated.