Troubleshooting LexoRank System Issues
プラットフォームについて: Server および Data Center のみ。この記事は、Server および Data Center プラットフォームのアトラシアン製品にのみ適用されます。
Support for Server* products ended on February 15th 2024. If you are running a Server product, you can visit the Atlassian Server end of support announcement to review your migration options.
*Fisheye および Crucible は除く
目的
In Agile 6.4 and above, the ranking system has been changed to support cluster-safe rank operations on JIRA Data Center. The new rank system (often called 'LexoRank') is stored in a lexicographical order of strings to determine the ranking of issues.
See also related KB Understand the LexoRank managment page in Jira server
In the course of this article, some specific terms will be used:
Re-balance job
This is a plugin job to maintain the integrity of the ranking table. The JIRA Agile plugin should run this job automatically. This is a background job, which means it should not interfere with the user operation.
Rank bucket
The new ranking system utilizes 3 'buckets' (0, 1, 2) to move issues around during the re-balance job. The bucket is indicated by the number prefix before the pipeline character ('|') in the Rank field value:
"0|...." indicates ranking is stored in bucket 0, "1|..." indicates bucket 1, and so on.
ソリューション
- Check the database collation and encoding setting, as per Configuring Database Character Encoding.
- Ensure you are running on the latest Agile version.
Run Rank Integrity Checker by accessing
https://<jira-base-url>/rest/greenhopper/1.0/lexorank/integrity
(perform a GET, this is done if you access the URL in the browser).Depending on which test is failing, check with the KB article section down below.
If you are in doubt, please follow sending information to support.
サポートに情報を提供する
Please raise a case at https://support.atlassian.com/ja and provide the following information:
- Generate JIRA support zip.
- The result of rank integrity checks.
- An XML backup of your database (Administration > System > Backup System). You can anonymise if you wish by going as per our Anonymising JIRA Data page.
If attaching a backup is not possible, please provide us with the result of the following SQL (preferably in a CSV file format).
SELECT * FROM "AO_60DB71_LEXORANK" ORDER BY "RANK";
Depending upon the DBMS used, the tablename may be different. For example
AO_60DB71_LEXORANK
instead of"AO_60DB71_LEXORANK"
.
Enable Additional Logging for LexoRank
By default, the logging of ranking system is disabled. To get detailed logging of what the system is doing add a new logger to JIRA's Logging and Profiling page
Logging for balancing
level: DEBUG
package:com.atlassian.greenhopper.service.lexorank.balance
Logging for ranking
level: DEBUG
package:com.atlassian.greenhopper.service.lexorank
- Logging for ranking DB operations
level: DEBUG
package: com.atlassian.greenhopper.manager.lexorank - Logging for statistics: every minute logs the activity and performance of the ranking system
level: DEBUG
package:com.atlassian.greenhopper.service.lexorank.LexoRankStatisticsAgent
List of Lexorank errors
See related KB List of all known Agile Lexorank error
FAQ
How to check if a re-balance is scheduled?
When a re-balance is scheduled, the AO_60DB71_LEXORANKBALANCER
table in the database should contain an entry for each Rank field.
The REBALANCE_TIME column will contain the time when the operation is scheduled to start in Epoch time (aka Unix time).
How to check if a re-balance is running?
Accessing https://<jira-base-url>/rest/greenhopper/1.0/lexorank/balance
through the browser will return information on the status of the balancer. This will show you whether or not it's running, and also a % status and the distribution of the buckets.
A re-balance will be running when the following conditions are met:
- There is an entry in the
AO_60DB71_LEXORANKBALANCER
table in the database, scheduled for a time which has already passed. The query below should return two rows. They must be on different buckets during a rebalance, on one the following bucket combinations: 0 and 1; 1 and 2; 2 and 0
Once a rebalance operation is completed, this query will return two ranks on the same bucket (e.g. "1|000000:" and "1|zzzzzz:").
SELECT "RANK" FROM "AO_60DB71_LEXORANK" WHERE "TYPE" <> 1 ORDER BY "RANK";
When is a re-balance job is triggered or required?
- When the ranking value splits in 2 different buckets.
The number of characters on the lengthiest rank field on the table is what defines the need for a rebalance operation, and here are the thresholds:
128 characters: a rebalance operation is scheduled to occur in 12 hours;
160 characters: a rebalance operation is immediately started;
- Issues with > 254 characters RANK can't be ranked.
How to check lengthiest rank field:
SELECT "FIELD_ID", max(length("RANK")) AS max_rank_string_length FROM "AO_60DB71_LEXORANK" GROUP BY "FIELD_ID";
Check issues with long lexorank
SELECT l."FIELD_ID",l."ISSUE_ID",j.project,j.issuenum, length(l."RANK") AS rank_length FROM "AO_60DB71_LEXORANK" l join jiraissue j on l."ISSUE_ID"=j.ID where length(l."RANK") > 250;
What happens if we stop JIRA while a re-balance is happening?
Whenever the JIRA Agile plugin is stopped, JIRA is stopped or a foreground re-index is triggered, the LexoRank scheduler job will stop any balance job that is running. Then the actual plugin scheduler job is stopped by the plugin system. Once the plugin is re-enabled, the balance job will start again and pick up from where it left. It will check the AO_60DB71_LEXORANKBALANCER
table again and see that there are still entries for balance job to be run and start going through them 1 by 1. Once a balance job is completed, the entry in the table will be removed.
Can issue be ranked while re-balancing is running?
Before: 7.2.8
If max RANK length exceed 200 characters: a rebalance operation is immediately started and all ranking operations are disabled for given field.
From JIRA 7.2.8 to 8.8.x:
If max RANK length doesn't exceed 254 characters: all issues can be ranked during re-balancing. For issues which target RANK length exceeds 254 characters, ranking operation will not be possible until re-balancing normalises the RANK length.
See related:
- JIRA Software Data Center Lexorank Indexing Lag
- JSWSERVER-15712 - Getting issue details... STATUS
From JIRA 8.9.0 and upwards:
- If rank length is between 128 and 159 characters: a rebalance is scheduled for the next 12 hours.
- If rank length is between 160 and 253 characters: a rebalance starts immediately.
- If rank length equal to, or above 254 characters: a rebalance starts immediately, it is still possible to rank issues, but any ranking operations yielding values with more than 254 characters will still fail.
What happens when issue rank exceed 254 characters
JIRA 7.2.8+ only
For issues which future allocated RANK length exceeds 254 characters during ranking operation, that operation will not be possible until RANK length gets back to normal.
Eg: IssueA has RANK 254 and IssueB - 30, if you try to position IssueB after IssueA that will fail. Positioning IssueA before IssueB will work.
In case of operation failed, you will get the following error in the logs:
[c.a.g.customfield.lexorank.LexoRankCFType] gh.api.rank.error.lexorank.fieldlength.exceeded.norebalance
or
2018-02-12 14:36:21,726 NodeReindexServiceThread:thread-1 WARN [c.a.g.customfield.lexorank.LexoRankCFType] Unable to retrieve rank for field [10600] and issue [2341873]
2018-02-12 14:36:21,726 NodeReindexServiceThread:thread-1 WARN [c.a.g.customfield.lexorank.LexoRankCFType] gh.api.rank.error.lexorank.fieldlength.exceeded.norebalance
Can JIRA Agile be updated while a re-balance is happening?
Yes. However, we highly recommend taking a backup from the JIRA instance prior to updating the plugin. Additionally, updating JIRA Agile might not necessarily fix existing inconsistencies in the LexoRank system in case it is already corrupted. In such cases, please report a support ticket providing the information requested on the Sending Information to Support section.