Uploaded image for project: 'SonarQube'
  1. SonarQube
  2. SONAR-9567

Divide by 2 the size of the Elasticsearch index for issues

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.6-M1, 6.6
    • Component/s: ElasticSearch
    • Labels:

      Description

      Size of the index issues/issue can be quite huge when storing dozens of millions issues. Reducing its size allows to speed-up indexing time, especially the first time on fresh index, and to decrease IO consumption.

      That is achieved by:

      • dropping the unused fields attributes, gap and updatedAt
      • loading issues from database instead of index in the web service batch/issues. That allows to:
        • drop the fields message and manual_severity
        • stop storing _source documents in the index.

      At the time of writing, with Elasticsearch 2.4, these changes decrease size of index by 55%. The web service api/issues/search is also improved by stopping loading the whole documents just to get the issue keys.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              simon.brandhof Simon Brandhof (Inactive)
              Reporter:
              simon.brandhof Simon Brandhof (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Due:
                Created:
                Updated:
                Resolved: