GitHub action stuck during package resolution Swift

So I have created a set of reusable scripts and workflows to use across multiple Swift repos here. In my Swift repos I have main GitHub action that runs tests for swift packages, lints podspecs for CocoaPods, validates Xcode projects for Carthage and then creates release according to semantic-release specifications.

The issue I am having is my deployment/release job always gets stuck in the package resolution process until the job time limit exceeds and the job is cancelled:

I tried to reproduce this with minimal action running only the reusable scripts but couldn't reproduce this. From the logs what I can check is the issue happens during the download of binary product which is used by SwiftSyntax library.

I am facing this issue for a long time and haven't found anything related to this. I would really appreciate any help.