Make the fields in Salesforce Package modifiable by drag instead remove and add again.
Go to Installed Packages
Click Configure for JIRA Cloud for Salesforce
Make changes on the package Fields
The fields should be able to be dragged up and down rather than deleting it and add again.