今回はGitLab Self-managed版のバージョンアップ手順を簡単に紹介します。
背景
GitLabはインストール方法に応じてバージョンアップの方法も異なりますが、今回はLinux packageでインストールした場合の方法になります。
GitLabはバージョンアップを行う場合、以下のようなステップで実施します。
- バージョンアップ情報の確認: 更新先のターゲットとなるバージョンの情報を確認します。
- Upgrade path: GitLabは一回のバージョンアップでターゲットのバージョンに更新できないこともあるので、どのような順番で更新を完了するか調査します。
- Pre-upgrade check: 更新前にGitLabの状態や設定を確認します。
- General configuration: GitLabの各コンポーネントのセットアップ状態を確認します
- Encrypted database values: 暗号化されたDBの値をSecretファイルで復号化できるか確認します
- UI: GitLab UIからGitlabの動作を確認します（例：サインインできるか、Projectは表示されるか、など）
- CI/CD: GitLab CI/CDが正常に動作するか (RunnerはJobを取得・実行するか、RegistryにコンテナイメージをPush / Pullできるか) を確認します
- バックアップ: バージョンアップ後に問題が見つかった場合に備え、バックアップを取得します。
- データバックアップ: DBやリポジトリ、コンテナイメージといったデータを取得します
- 設定ファイルバックアップ: GitLabの設定ファイルやSecret情報などをバックアップします
- アップデート: GitLabのバージョンを更新します
- Upgrade pathの確認: アップデートするバージョンの順番を確認します
- パイプラインジョブへの対応: GitLab RunnerがJobを処理中にGitLabをアップデートすると、Jobの失敗・再実行を繰り返します。Jobの種類によってはJobの実行結果に影響するため、Jobの抑制を行います。
- Background migration: GitLabの特定のバージョンでは、バージョンを更新する前に、DBテーブルなどの移行を完了している必要があります。
- Upgrade: GitLabのバージョンを更新します。
- Post-upgrade check: 更新後にGitLabの状態や設定を確認します。
なおGitLabを複数のインスタンスで構成する場合、ダウンタイムなしでバージョンアップする手順も案内されています。
検証
更新の流れ
今回の作業対象と更新先のバージョンは以下の通りです。
- 作業対象のGitLabサーバー:
- OS:
Amazon Linux 2 - GitLab:
16.7.0
- OS:
- 更新先のバージョン:
16.9.1
GitLabサーバーにはあらかじめユーザーとProject、テスト用のコードなどを配置しておきます。
更新前の確認
作業を始める前に、GitLabをどの順番で更新するか確認します。更新方法ですが、GitLabはUpgrade PathというWebサイトを提供しており、現在のバージョンと更新先のバージョンを入力すると、更新するバージョンの順番を案内してくれます。
今回は 16.7.0 -> 16.7.6 -> 16.9.1 という順番で更新するよう案内されました。
各バージョンに更新する際の注意点も案内されます。
次にPre-upgrade checkとして以下のコマンドを実行します。
gitlab-rake gitlab:env:infogitlab-rake gitlab:checkgitlab-rake gitlab:doctor:secrets
Pre-upgrade checkコマンドの実行結果
[ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:env:info System information System: Proxy: no Current User: git Using RVM: no Ruby Version: 3.1.4p223 Gem Version: 3.4.22 Bundler Version:2.4.22 Rake Version: 13.0.6 Redis Version: 7.0.14 Sidekiq Version:6.5.12 Go Version: unknown GitLab information Version: 16.7.0-ee Revision: 9e7d34f7ff1 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: PostgreSQL DB Version: 14.9 URL: http://43.206.209.216 HTTP Clone URL: http://43.206.209.216/some-group/some-project.git SSH Clone URL: git@43.206.209.216:some-group/some-project.git Elasticsearch: no Geo: no Using LDAP: no Using Omniauth: yes Omniauth Providers: GitLab Shell Version: 14.32.0 Repository storages: - default: unix:/var/opt/gitlab/gitaly/gitaly.socket GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Gitaly - default Address: unix:/var/opt/gitlab/gitaly/gitaly.socket - default Version: 16.7.0 - default Git Version: 2.42.0 [ec2-user@ip-10-0-0-5 ~]$ [ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:check Checking GitLab subtasks ... Checking GitLab Shell ... GitLab Shell: ... GitLab Shell version >= 14.32.0 ? ... OK (14.32.0) Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Internal API available: OK Redis available via internal API: OK gitlab-shell self-check successful Checking GitLab Shell ... Finished Checking Gitaly ... Gitaly: ... default ... OK Checking Gitaly ... Finished Checking Sidekiq ... Sidekiq: ... Running? ... yes Number of Sidekiq processes (cluster/worker) ... 1/1 Checking Sidekiq ... Finished Checking Incoming Email ... Incoming Email: ... Reply by email is disabled in config/gitlab.yml Checking Incoming Email ... Finished Checking LDAP ... LDAP: ... LDAP is disabled in config/gitlab.yml Checking LDAP ... Finished Checking GitLab App ... Database config exists? ... yes Tables are truncated? ... skipped All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Cable config exists? ... yes Resque config exists? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... skipped (no tmp uploads folder yet) Systemd unit files or init script exist? ... skipped (omnibus-gitlab has neither init script nor systemd units) Systemd unit files or init script up-to-date? ... skipped (omnibus-gitlab has neither init script nor systemd units) Projects have namespace: ... Administrator / test-project ... yes Redis version >= 6.0.0? ... yes Ruby version >= 3.0.6 ? ... yes (3.1.4) Git user has default SSH configuration? ... yes Active users: ... 2 Is authorized keys file accessible? ... yes GitLab configured to store new projects in hashed storage? ... yes All projects are in hashed storage? ... yes Elasticsearch version 7.x-8.x or OpenSearch version 1.x ... skipped (Advanced Search is disabled) All migrations must be finished before doing a major upgrade ... skipped (Advanced Search is disabled) Checking GitLab App ... Finished Checking GitLab subtasks ... Finished [ec2-user@ip-10-0-0-5 ~]$ [ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:doctor:secrets I, [2024-02-23T01:05:47.785134 #11927] INFO -- : Checking encrypted values in the database I, [2024-02-23T01:05:57.329809 #11927] INFO -- : - DependencyProxy::Packages::Setting failures: 0 I, [2024-02-23T01:05:57.336179 #11927] INFO -- : - SystemAccess::MicrosoftGraphAccessToken failures: 0 I, [2024-02-23T01:05:57.341945 #11927] INFO -- : - SystemAccess::MicrosoftApplication failures: 0 I, [2024-02-23T01:05:57.347518 #11927] INFO -- : - StatusPage::ProjectSetting failures: 0 I, [2024-02-23T01:05:57.353049 #11927] INFO -- : - RemoteDevelopment::WorkspaceVariable failures: 0 I, [2024-02-23T01:05:57.378743 #11927] INFO -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration failures: 0 I, [2024-02-23T01:05:57.398187 #11927] INFO -- : - WebHook failures: 0 I, [2024-02-23T01:05:57.403728 #11927] INFO -- : - Packages::Debian::ProjectDistributionKey failures: 0 I, [2024-02-23T01:05:57.408889 #11927] INFO -- : - Packages::Debian::GroupDistributionKey failures: 0 I, [2024-02-23T01:05:57.414131 #11927] INFO -- : - Clusters::Providers::Gcp failures: 0 I, [2024-02-23T01:05:57.419537 #11927] INFO -- : - Clusters::Providers::Aws failures: 0 I, [2024-02-23T01:05:57.421021 #11927] INFO -- : - Clusters::Integrations::Prometheus failures: 0 I, [2024-02-23T01:05:57.426177 #11927] INFO -- : - ServiceDesk::CustomEmailVerification failures: 0 I, [2024-02-23T01:05:57.431271 #11927] INFO -- : - ServiceDesk::CustomEmailCredential failures: 0 I, [2024-02-23T01:05:57.436335 #11927] INFO -- : - Integrations::ZentaoTrackerData failures: 0 I, [2024-02-23T01:05:57.441767 #11927] INFO -- : - Integrations::JiraTrackerData failures: 0 I, [2024-02-23T01:05:57.446655 #11927] INFO -- : - Integrations::IssueTrackerData failures: 0 I, [2024-02-23T01:05:57.451467 #11927] INFO -- : - IncidentManagement::ProjectIncidentManagementSetting failures: 0 I, [2024-02-23T01:05:57.456449 #11927] INFO -- : - ErrorTracking::ProjectErrorTrackingSetting failures: 0 I, [2024-02-23T01:05:57.475575 #11927] INFO -- : - Clusters::KubernetesNamespace failures: 0 I, [2024-02-23T01:05:57.480523 #11927] INFO -- : - BulkImports::Configuration failures: 0 I, [2024-02-23T01:05:57.485479 #11927] INFO -- : - Atlassian::Identity failures: 0 I, [2024-02-23T01:05:57.490002 #11927] INFO -- : - Alerting::ProjectAlertingSetting failures: 0 I, [2024-02-23T01:05:57.494700 #11927] INFO -- : - Ai::ServiceAccessToken failures: 0 I, [2024-02-23T01:05:57.499439 #11927] INFO -- : - SlackIntegration failures: 0 I, [2024-02-23T01:05:57.503838 #11927] INFO -- : - RemoteMirror failures: 0 I, [2024-02-23T01:05:57.526044 #11927] INFO -- : - ProjectSetting failures: 0 I, [2024-02-23T01:05:57.531548 #11927] INFO -- : - PagesDomainAcmeOrder failures: 0 I, [2024-02-23T01:05:57.550421 #11927] INFO -- : - PagesDomain failures: 0 I, [2024-02-23T01:05:57.556878 #11927] INFO -- : - JiraConnectInstallation failures: 0 I, [2024-02-23T01:05:57.563833 #11927] INFO -- : - GrafanaIntegration failures: 0 I, [2024-02-23T01:05:57.569687 #11927] INFO -- : - AuditEvents::Instance::GoogleCloudLoggingConfiguration failures: 0 I, [2024-02-23T01:05:57.575993 #11927] INFO -- : - AuditEvents::Instance::AmazonS3Configuration failures: 0 I, [2024-02-23T01:05:57.582071 #11927] INFO -- : - AuditEvents::AmazonS3Configuration failures: 0 I, [2024-02-23T01:05:57.588704 #11927] INFO -- : - AuditEvents::GoogleCloudLoggingConfiguration failures: 0 I, [2024-02-23T01:05:57.594615 #11927] INFO -- : - AuditEvents::InstanceExternalAuditEventDestination failures: 0 I, [2024-02-23T01:05:57.600707 #11927] INFO -- : - Dast::SiteProfileSecretVariable failures: 0 I, [2024-02-23T01:05:57.607117 #11927] INFO -- : - AlertManagement::HttpIntegration failures: 0 I, [2024-02-23T01:05:57.611009 #11927] INFO -- : - Integration failures: 0 I, [2024-02-23T01:05:57.617002 #11927] INFO -- : - ProjectImportData failures: 0 I, [2024-02-23T01:05:57.637622 #11927] INFO -- : - Snippet failures: 0 I, [2024-02-23T01:05:57.644147 #11927] INFO -- : - Clusters::Platforms::Kubernetes failures: 0 I, [2024-02-23T01:05:57.651187 #11927] INFO -- : - GeoNode failures: 0 I, [2024-02-23T01:05:57.653459 #11927] INFO -- : - GroupHook failures: 0 I, [2024-02-23T01:05:57.655291 #11927] INFO -- : - SystemHook failures: 0 I, [2024-02-23T01:05:57.657142 #11927] INFO -- : - ServiceHook failures: 0 I, [2024-02-23T01:05:57.659196 #11927] INFO -- : - ProjectHook failures: 0 I, [2024-02-23T01:05:57.661292 #11927] INFO -- : - Integrations::SquashTm failures: 0 I, [2024-02-23T01:05:57.663268 #11927] INFO -- : - Integrations::Pushover failures: 0 I, [2024-02-23T01:05:57.665375 #11927] INFO -- : - Integrations::BaseMonitoring failures: 0 I, [2024-02-23T01:05:57.667466 #11927] INFO -- : - Integrations::Pivotaltracker failures: 0 I, [2024-02-23T01:05:57.669416 #11927] INFO -- : - Integrations::PipelinesEmail failures: 0 I, [2024-02-23T01:05:57.671306 #11927] INFO -- : - Integrations::Packagist failures: 0 I, [2024-02-23T01:05:57.673318 #11927] INFO -- : - Integrations::BaseSlashCommands failures: 0 I, [2024-02-23T01:05:57.675295 #11927] INFO -- : - Integrations::Irker failures: 0 I, [2024-02-23T01:05:57.677208 #11927] INFO -- : - Integrations::Harbor failures: 0 I, [2024-02-23T01:05:57.679319 #11927] INFO -- : - Integrations::GooglePlay failures: 0 I, [2024-02-23T01:05:57.681201 #11927] INFO -- : - Integrations::ExternalWiki failures: 0 I, [2024-02-23T01:05:57.683207 #11927] INFO -- : - Integrations::EmailsOnPush failures: 0 I, [2024-02-23T01:05:57.685632 #11927] INFO -- : - Integrations::BaseChatNotification failures: 0 I, [2024-02-23T01:05:57.687531 #11927] INFO -- : - Integrations::Datadog failures: 0 I, [2024-02-23T01:05:57.689673 #11927] INFO -- : - Integrations::BaseThirdPartyWiki failures: 0 I, [2024-02-23T01:05:57.692195 #11927] INFO -- : - Integrations::Campfire failures: 0 I, [2024-02-23T01:05:57.695024 #11927] INFO -- : - Integrations::BaseIssueTracker failures: 0 I, [2024-02-23T01:05:57.697234 #11927] INFO -- : - Integrations::BaseCi failures: 0 I, [2024-02-23T01:05:57.699201 #11927] INFO -- : - Integrations::Github failures: 0 I, [2024-02-23T01:05:57.700995 #11927] INFO -- : - Integrations::Assembla failures: 0 I, [2024-02-23T01:05:57.702910 #11927] INFO -- : - Integrations::Asana failures: 0 I, [2024-02-23T01:05:57.704830 #11927] INFO -- : - Integrations::AppleAppStore failures: 0 I, [2024-02-23T01:05:57.706662 #11927] INFO -- : - Integrations::MockMonitoring failures: 0 I, [2024-02-23T01:05:57.708643 #11927] INFO -- : - Integrations::Prometheus failures: 0 I, [2024-02-23T01:05:57.710636 #11927] INFO -- : - Integrations::SlackSlashCommands failures: 0 I, [2024-02-23T01:05:57.712499 #11927] INFO -- : - Integrations::MattermostSlashCommands failures: 0 I, [2024-02-23T01:05:57.714412 #11927] INFO -- : - Integrations::WebexTeams failures: 0 I, [2024-02-23T01:05:57.716305 #11927] INFO -- : - Integrations::UnifyCircuit failures: 0 I, [2024-02-23T01:05:57.718248 #11927] INFO -- : - Integrations::Telegram failures: 0 I, [2024-02-23T01:05:57.720306 #11927] INFO -- : - Integrations::BaseSlackNotification failures: 0 I, [2024-02-23T01:05:57.722136 #11927] INFO -- : - Integrations::Pumble failures: 0 I, [2024-02-23T01:05:57.724130 #11927] INFO -- : - Integrations::MicrosoftTeams failures: 0 I, [2024-02-23T01:05:57.726078 #11927] INFO -- : - Integrations::Mattermost failures: 0 I, [2024-02-23T01:05:57.727903 #11927] INFO -- : - Integrations::HangoutsChat failures: 0 I, [2024-02-23T01:05:57.729805 #11927] INFO -- : - Integrations::Discord failures: 0 I, [2024-02-23T01:05:57.731618 #11927] INFO -- : - Integrations::GitlabSlackApplication failures: 0 I, [2024-02-23T01:05:57.733522 #11927] INFO -- : - Integrations::Slack failures: 0 I, [2024-02-23T01:05:57.735516 #11927] INFO -- : - Integrations::Confluence failures: 0 I, [2024-02-23T01:05:57.737346 #11927] INFO -- : - Integrations::Zentao failures: 0 I, [2024-02-23T01:05:57.739286 #11927] INFO -- : - Integrations::Youtrack failures: 0 I, [2024-02-23T01:05:57.741094 #11927] INFO -- : - Integrations::Redmine failures: 0 I, [2024-02-23T01:05:57.743151 #11927] INFO -- : - Integrations::Jira failures: 0 I, [2024-02-23T01:05:57.745046 #11927] INFO -- : - Integrations::Ewm failures: 0 I, [2024-02-23T01:05:57.746972 #11927] INFO -- : - Integrations::CustomIssueTracker failures: 0 I, [2024-02-23T01:05:57.748866 #11927] INFO -- : - Integrations::Clickup failures: 0 I, [2024-02-23T01:05:57.750661 #11927] INFO -- : - Integrations::Bugzilla failures: 0 I, [2024-02-23T01:05:57.752569 #11927] INFO -- : - Integrations::MockCi failures: 0 I, [2024-02-23T01:05:57.754473 #11927] INFO -- : - Integrations::Teamcity failures: 0 I, [2024-02-23T01:05:57.756258 #11927] INFO -- : - Integrations::Jenkins failures: 0 I, [2024-02-23T01:05:57.758179 #11927] INFO -- : - Integrations::DroneCi failures: 0 I, [2024-02-23T01:05:57.759982 #11927] INFO -- : - Integrations::Buildkite failures: 0 I, [2024-02-23T01:05:57.761857 #11927] INFO -- : - Integrations::Bamboo failures: 0 I, [2024-02-23T01:05:57.763459 #11927] INFO -- : - ProjectSnippet failures: 0 I, [2024-02-23T01:05:57.764887 #11927] INFO -- : - PersonalSnippet failures: 0 I, [2024-02-23T01:05:58.321804 #11927] INFO -- : - User failures: 0 I, [2024-02-23T01:05:58.336511 #11927] INFO -- : - ApplicationSetting failures: 0 I, [2024-02-23T01:05:58.352671 #11927] INFO -- : - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger failures: 0 I, [2024-02-23T01:05:58.361171 #11927] INFO -- : - Ci::JobVariable failures: 0 I, [2024-02-23T01:05:58.362977 #11927] INFO -- : - Ci::Trigger failures: 0 I, [2024-02-23T01:05:58.369911 #11927] INFO -- : - Ci::GroupVariable failures: 0 I, [2024-02-23T01:05:58.377405 #11927] INFO -- : - Ci::Variable failures: 0 I, [2024-02-23T01:05:58.384108 #11927] INFO -- : - Ci::PipelineScheduleVariable failures: 0 I, [2024-02-23T01:05:58.387586 #11927] INFO -- : - Ci::PipelineVariable failures: 0 I, [2024-02-23T01:05:58.393832 #11927] INFO -- : - Ci::InstanceVariable failures: 0 I, [2024-02-23T01:05:58.399956 #11927] INFO -- : - ScimOauthAccessToken failures: 0 I, [2024-02-23T01:05:58.405970 #11927] INFO -- : - Operations::FeatureFlagsClient failures: 0 I, [2024-02-23T01:05:58.412285 #11927] INFO -- : - Clusters::AgentToken failures: 0 I, [2024-02-23T01:05:58.477209 #11927] INFO -- : - Project failures: 0 I, [2024-02-23T01:05:58.484801 #11927] INFO -- : - DeployToken failures: 0 I, [2024-02-23T01:05:58.487852 #11927] INFO -- : - Group failures: 0 I, [2024-02-23T01:05:58.513263 #11927] INFO -- : - Ci::Runner failures: 0 I, [2024-02-23T01:05:58.525685 #11927] INFO -- : - Ci::Build failures: 0 I, [2024-02-23T01:05:58.525759 #11927] INFO -- : Total: 0 row(s) affected I, [2024-02-23T01:05:58.525789 #11927] INFO -- : Done! [ec2-user@ip-10-0-0-5 ~]$
バックアップの取得
データバックアップの取得は gitlab-backup create というコマンドで実行します。またGitLabの設定ファイルのバックアップは、該当のファイルを cp コマンドで複製して完了としました。
バックアップ取得時のコマンド実行結果
[ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-backup create 2024-02-23 01:12:15 UTC -- Dumping database ... Dumping PostgreSQL database gitlabhq_production ... [DONE] 2024-02-23 01:12:19 UTC -- Dumping database ... done 2024-02-23 01:12:19 UTC -- Dumping repositories ... {"command":"create","gl_project_path":"root/test-project","level":"info","msg":"started create","pid":12174,"relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git","storage_name":"default","time":"2024-02-23T01:12:19.364Z"} {"command":"create","gl_project_path":"root/test-project","level":"info","msg":"completed create","pid":12174,"relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git","storage_name":"default","time":"2024-02-23T01:12:19.398Z"} {"command":"create","gl_project_path":"root/test-project.wiki","level":"info","msg":"started create","pid":12174,"relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git","storage_name":"default","time":"2024-02-23T01:12:19.456Z"} {"command":"create","gl_project_path":"root/test-project.wiki","level":"info","msg":"completed create","pid":12174,"relative_path":"@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git","storage_name":"default","time":"2024-02-23T01:12:19.477Z"} 2024-02-23 01:12:19 UTC -- Dumping repositories ... done 2024-02-23 01:12:19 UTC -- Dumping uploads ... 2024-02-23 01:12:19 UTC -- Dumping uploads ... done 2024-02-23 01:12:19 UTC -- Dumping builds ... 2024-02-23 01:12:19 UTC -- Dumping builds ... done 2024-02-23 01:12:19 UTC -- Dumping artifacts ... 2024-02-23 01:12:19 UTC -- Dumping artifacts ... done 2024-02-23 01:12:19 UTC -- Dumping pages ... 2024-02-23 01:12:19 UTC -- Dumping pages ... done 2024-02-23 01:12:19 UTC -- Dumping lfs objects ... 2024-02-23 01:12:19 UTC -- Dumping lfs objects ... done 2024-02-23 01:12:19 UTC -- Dumping terraform states ... 2024-02-23 01:12:19 UTC -- Dumping terraform states ... done 2024-02-23 01:12:19 UTC -- Dumping container registry images ... [DISABLED] 2024-02-23 01:12:19 UTC -- Dumping packages ... 2024-02-23 01:12:19 UTC -- Dumping packages ... done 2024-02-23 01:12:19 UTC -- Dumping ci secure files ... 2024-02-23 01:12:19 UTC -- Dumping ci secure files ... done 2024-02-23 01:12:19 UTC -- Creating backup archive: 1708650735_2024_02_23_16.7.0-ee_gitlab_backup.tar ... 2024-02-23 01:12:19 UTC -- Creating backup archive: 1708650735_2024_02_23_16.7.0-ee_gitlab_backup.tar ... done 2024-02-23 01:12:19 UTC -- Uploading backup archive to remote storage ... [SKIPPED] 2024-02-23 01:12:19 UTC -- Deleting old backups ... [SKIPPED] 2024-02-23 01:12:19 UTC -- Deleting tar staging files ... 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/backup_information.yml 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/db 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/repositories 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/uploads.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/builds.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/artifacts.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/pages.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/lfs.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/terraform_state.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/packages.tar.gz 2024-02-23 01:12:19 UTC -- Cleaning up /var/opt/gitlab/backups/ci_secure_files.tar.gz 2024-02-23 01:12:19 UTC -- Deleting tar staging files ... done 2024-02-23 01:12:19 UTC -- Deleting backups/tmp ... 2024-02-23 01:12:19 UTC -- Deleting backups/tmp ... done 2024-02-23 01:12:19 UTC -- Warning: Your gitlab.rb and gitlab-secrets.json files contain sensitive data and are not included in this backup. You will need these files to restore a backup. Please back them up manually. 2024-02-23 01:12:19 UTC -- Backup 1708650735_2024_02_23_16.7.0-ee is done. 2024-02-23 01:12:19 UTC -- Deleting backup and restore PID file ... done [ec2-user@ip-10-0-0-5 ~]$ sudo ls -l /var/opt/gitlab/backups/ total 492 -rw------- 1 git git 501760 Feb 23 01:12 1708650735_2024_02_23_16.7.0-ee_gitlab_backup.tar [ec2-user@ip-10-0-0-5 ~]$ [ec2-user@ip-10-0-0-5 ~]$ sudo ls -l /etc/gitlab/ total 176 -rw------- 1 root root 151881 Feb 23 00:46 gitlab.rb -rw------- 1 root root 19103 Feb 23 00:46 gitlab-secrets.json -rw------- 1 root root 749 Feb 23 00:46 initial_root_password drwxr-xr-x 2 root root 6 Feb 23 00:46 trusted-certs [ec2-user@ip-10-0-0-5 ~]$ sudo cp -p /etc/gitlab/gitlab.rb /etc/gitlab/gitlab.rb.bkup [ec2-user@ip-10-0-0-5 ~]$ sudo cp -p /etc/gitlab/gitlab-secrets.json /etc/gitlab/gitlab-secrets.json.bkup [ec2-user@ip-10-0-0-5 ~]$
バージョンアップ
Upgrade pathの表示に従い、まずは 16.7.6に更新します。
[ec2-user@ip-10-0-0-5 ~]$ sudo yum --showduplicates list gitlab-ee | grep 16.7.6 gitlab-ee.x86_64 16.7.6-ee.0.amazon2 gitlab_gitlab-ee [ec2-user@ip-10-0-0-5 ~]$ sudo yum install gitlab-ee-16.7.6-ee.0.amazon2 (割愛) Updated: gitlab-ee.x86_64 0:16.7.6-ee.0.amazon2 Complete!
更新できたことを確認します。
[ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:env:info System information System: Proxy: no Current User: git Using RVM: no Ruby Version: 3.1.4p223 Gem Version: 3.4.22 Bundler Version:2.4.22 Rake Version: 13.0.6 Redis Version: 7.0.15 Sidekiq Version:6.5.12 Go Version: unknown GitLab information Version: 16.7.6-ee # 16.7.6を確認 Revision: c8f3448a2f0 Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: PostgreSQL DB Version: 14.10 URL: http://43.206.209.216 HTTP Clone URL: http://43.206.209.216/some-group/some-project.git SSH Clone URL: git@43.206.209.216:some-group/some-project.git Elasticsearch: no Geo: no Using LDAP: no Using Omniauth: yes Omniauth Providers: GitLab Shell Version: 14.32.0 Repository storages: - default: unix:/var/opt/gitlab/gitaly/gitaly.socket GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Gitaly - default Address: unix:/var/opt/gitlab/gitaly/gitaly.socket - default Version: 16.7.6 - default Git Version: 2.42.0 [ec2-user@ip-10-0-0-5 ~]$
次に 16.9.1へ更新しますが、更新前にGitLabの画面からBackground migrationがないかを確認し、ある場合は完了まで待機します。
完了後、16.9.1に更新します。
[ec2-user@ip-10-0-0-5 ~]$ sudo yum --showduplicates list gitlab-ee | grep 16.9.1 gitlab-ee.x86_64 16.9.1-ee.0.amazon2 gitlab_gitlab-ee [ec2-user@ip-10-0-0-5 ~]$ sudo yum install gitlab-ee-16.9.1-ee.0.amazon2 (割愛) Updated: gitlab-ee.x86_64 0:16.9.1-ee.0.amazon2 Complete!
更新後の確認
更新後、Post-upgrade checkとして以下のコマンドを実行します。
gitlab-rake gitlab:env:infogitlab-rake gitlab:checkgitlab-rake gitlab:doctor:secrets
Post-upgrade checkコマンドの実行結果
[ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:env:info System information System: Proxy: no Current User: git Using RVM: no Ruby Version: 3.1.4p223 Gem Version: 3.5.5 Bundler Version:2.5.5 Rake Version: 13.0.6 Redis Version: 7.0.15 Sidekiq Version:7.1.6 Go Version: unknown GitLab information Version: 16.9.1-ee Revision: cc62007c12d Directory: /opt/gitlab/embedded/service/gitlab-rails DB Adapter: PostgreSQL DB Version: 14.10 URL: http://43.206.209.216 HTTP Clone URL: http://43.206.209.216/some-group/some-project.git SSH Clone URL: git@43.206.209.216:some-group/some-project.git Elasticsearch: no Geo: no Using LDAP: no Using Omniauth: yes Omniauth Providers: GitLab Shell Version: 14.33.0 Repository storages: - default: unix:/var/opt/gitlab/gitaly/gitaly.socket GitLab Shell path: /opt/gitlab/embedded/service/gitlab-shell Gitaly - default Address: unix:/var/opt/gitlab/gitaly/gitaly.socket - default Version: 16.9.1 - default Git Version: 2.43.0 [ec2-user@ip-10-0-0-5 ~]$ [ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:check Checking GitLab subtasks ... Checking GitLab Shell ... GitLab Shell: ... GitLab Shell version >= 14.33.0 ? ... OK (14.33.0) Running /opt/gitlab/embedded/service/gitlab-shell/bin/check Internal API available: OK Redis available via internal API: OK gitlab-shell self-check successful Checking GitLab Shell ... Finished Checking Gitaly ... Gitaly: ... default ... OK Checking Gitaly ... Finished Checking Sidekiq ... Sidekiq: ... Running? ... yes Number of Sidekiq processes (cluster/worker) ... 1/1 Checking Sidekiq ... Finished Checking Incoming Email ... Incoming Email: ... Reply by email is disabled in config/gitlab.yml Checking Incoming Email ... Finished Checking LDAP ... LDAP: ... LDAP is disabled in config/gitlab.yml Checking LDAP ... Finished Checking GitLab App ... Database config exists? ... yes Tables are truncated? ... skipped All migrations up? ... yes Database contains orphaned GroupMembers? ... no GitLab config exists? ... yes GitLab config up to date? ... yes Cable config exists? ... yes Resque config exists? ... yes Log directory writable? ... yes Tmp directory writable? ... yes Uploads directory exists? ... yes Uploads directory has correct permissions? ... yes Uploads directory tmp has correct permissions? ... skipped (no tmp uploads folder yet) Systemd unit files or init script exist? ... skipped (omnibus-gitlab has neither init script nor systemd units) Systemd unit files or init script up-to-date? ... skipped (omnibus-gitlab has neither init script nor systemd units) Projects have namespace: ... Administrator / test-project ... yes Redis version >= 6.2.14? ... yes Ruby version >= 3.0.6 ? ... yes (3.1.4) Git user has default SSH configuration? ... yes Active users: ... 2 Is authorized keys file accessible? ... yes GitLab configured to store new projects in hashed storage? ... yes All projects are in hashed storage? ... yes Elasticsearch version 7.x-8.x or OpenSearch version 1.x ... skipped (Advanced Search is disabled) All migrations must be finished before doing a major upgrade ... skipped (Advanced Search is disabled) Checking GitLab App ... Finished Checking GitLab subtasks ... Finished [ec2-user@ip-10-0-0-5 ~]$ [ec2-user@ip-10-0-0-5 ~]$ sudo gitlab-rake gitlab:doctor:secrets I, [2024-02-23T02:02:48.604626 #10214] INFO -- : Checking encrypted values in the database I, [2024-02-23T02:02:59.757200 #10214] INFO -- : - DependencyProxy::Packages::Setting failures: 0 I, [2024-02-23T02:02:59.764666 #10214] INFO -- : - AuditEvents::Instance::ExternalStreamingDestination failures: 0 I, [2024-02-23T02:02:59.771235 #10214] INFO -- : - AuditEvents::Group::ExternalStreamingDestination failures: 0 I, [2024-02-23T02:02:59.776402 #10214] INFO -- : - SystemAccess::MicrosoftGraphAccessToken failures: 0 I, [2024-02-23T02:02:59.782016 #10214] INFO -- : - SystemAccess::MicrosoftApplication failures: 0 I, [2024-02-23T02:02:59.787328 #10214] INFO -- : - StatusPage::ProjectSetting failures: 0 I, [2024-02-23T02:02:59.792351 #10214] INFO -- : - RemoteDevelopment::WorkspaceVariable failures: 0 I, [2024-02-23T02:02:59.814853 #10214] INFO -- : - Gitlab::BackgroundMigration::BackfillIntegrationsEnableSslVerification::Integration failures: 0 I, [2024-02-23T02:02:59.846078 #10214] INFO -- : - WebHook failures: 0 I, [2024-02-23T02:02:59.852006 #10214] INFO -- : - Packages::Debian::ProjectDistributionKey failures: 0 I, [2024-02-23T02:02:59.857111 #10214] INFO -- : - Packages::Debian::GroupDistributionKey failures: 0 I, [2024-02-23T02:02:59.862205 #10214] INFO -- : - Clusters::Providers::Gcp failures: 0 I, [2024-02-23T02:02:59.867826 #10214] INFO -- : - Clusters::Providers::Aws failures: 0 I, [2024-02-23T02:02:59.869343 #10214] INFO -- : - Clusters::Integrations::Prometheus failures: 0 I, [2024-02-23T02:02:59.874607 #10214] INFO -- : - ServiceDesk::CustomEmailVerification failures: 0 I, [2024-02-23T02:02:59.879931 #10214] INFO -- : - ServiceDesk::CustomEmailCredential failures: 0 I, [2024-02-23T02:02:59.884990 #10214] INFO -- : - Integrations::ZentaoTrackerData failures: 0 I, [2024-02-23T02:02:59.890533 #10214] INFO -- : - Integrations::JiraTrackerData failures: 0 I, [2024-02-23T02:02:59.895528 #10214] INFO -- : - Integrations::IssueTrackerData failures: 0 I, [2024-02-23T02:02:59.900730 #10214] INFO -- : - IncidentManagement::ProjectIncidentManagementSetting failures: 0 I, [2024-02-23T02:02:59.905918 #10214] INFO -- : - ErrorTracking::ProjectErrorTrackingSetting failures: 0 I, [2024-02-23T02:02:59.926432 #10214] INFO -- : - Clusters::KubernetesNamespace failures: 0 I, [2024-02-23T02:02:59.932394 #10214] INFO -- : - CloudConnector::ServiceAccessToken failures: 0 I, [2024-02-23T02:02:59.947281 #10214] INFO -- : - BulkImports::Configuration failures: 0 I, [2024-02-23T02:02:59.954105 #10214] INFO -- : - Atlassian::Identity failures: 0 I, [2024-02-23T02:02:59.959476 #10214] INFO -- : - Alerting::ProjectAlertingSetting failures: 0 I, [2024-02-23T02:02:59.980166 #10214] INFO -- : - SlackIntegration failures: 0 I, [2024-02-23T02:02:59.986150 #10214] INFO -- : - RemoteMirror failures: 0 I, [2024-02-23T02:03:00.008495 #10214] INFO -- : - ProjectSetting failures: 0 I, [2024-02-23T02:03:00.027053 #10214] INFO -- : - PagesDomainAcmeOrder failures: 0 I, [2024-02-23T02:03:00.070388 #10214] INFO -- : - PagesDomain failures: 0 I, [2024-02-23T02:03:00.089987 #10214] INFO -- : - JiraConnectInstallation failures: 0 I, [2024-02-23T02:03:00.097434 #10214] INFO -- : - GrafanaIntegration failures: 0 I, [2024-02-23T02:03:00.104206 #10214] INFO -- : - ChatName failures: 0 I, [2024-02-23T02:03:00.113226 #10214] INFO -- : - AuditEvents::Instance::GoogleCloudLoggingConfiguration failures: 0 I, [2024-02-23T02:03:00.118898 #10214] INFO -- : - AuditEvents::Instance::AmazonS3Configuration failures: 0 I, [2024-02-23T02:03:00.124372 #10214] INFO -- : - AuditEvents::AmazonS3Configuration failures: 0 I, [2024-02-23T02:03:00.131382 #10214] INFO -- : - AuditEvents::GoogleCloudLoggingConfiguration failures: 0 I, [2024-02-23T02:03:00.137185 #10214] INFO -- : - AuditEvents::InstanceExternalAuditEventDestination failures: 0 I, [2024-02-23T02:03:00.143890 #10214] INFO -- : - Dast::SiteProfileSecretVariable failures: 0 I, [2024-02-23T02:03:00.151523 #10214] INFO -- : - AlertManagement::HttpIntegration failures: 0 I, [2024-02-23T02:03:00.156147 #10214] INFO -- : - Integration failures: 0 I, [2024-02-23T02:03:00.163210 #10214] INFO -- : - ProjectImportData failures: 0 I, [2024-02-23T02:03:00.196711 #10214] INFO -- : - Snippet failures: 0 I, [2024-02-23T02:03:00.204572 #10214] INFO -- : - Clusters::Platforms::Kubernetes failures: 0 I, [2024-02-23T02:03:00.225820 #10214] INFO -- : - GeoNode failures: 0 I, [2024-02-23T02:03:00.228926 #10214] INFO -- : - GroupHook failures: 0 I, [2024-02-23T02:03:00.235296 #10214] INFO -- : - SystemHook failures: 0 I, [2024-02-23T02:03:00.238169 #10214] INFO -- : - ServiceHook failures: 0 I, [2024-02-23T02:03:00.240438 #10214] INFO -- : - ProjectHook failures: 0 I, [2024-02-23T02:03:00.243076 #10214] INFO -- : - Integrations::BeyondIdentity failures: 0 I, [2024-02-23T02:03:00.245363 #10214] INFO -- : - Integrations::Pushover failures: 0 I, [2024-02-23T02:03:00.248352 #10214] INFO -- : - Integrations::BaseMonitoring failures: 0 I, [2024-02-23T02:03:00.250571 #10214] INFO -- : - Integrations::Pivotaltracker failures: 0 I, [2024-02-23T02:03:00.252609 #10214] INFO -- : - Integrations::PipelinesEmail failures: 0 I, [2024-02-23T02:03:00.254826 #10214] INFO -- : - Integrations::Packagist failures: 0 I, [2024-02-23T02:03:00.257298 #10214] INFO -- : - Integrations::Irker failures: 0 I, [2024-02-23T02:03:00.259367 #10214] INFO -- : - Integrations::EmailsOnPush failures: 0 I, [2024-02-23T02:03:00.261467 #10214] INFO -- : - Integrations::Datadog failures: 0 I, [2024-02-23T02:03:00.267024 #10214] INFO -- : - Integrations::GoogleCloudPlatform::ArtifactRegistry failures: 0 I, [2024-02-23T02:03:00.269222 #10214] INFO -- : - Integrations::GitGuardian failures: 0 I, [2024-02-23T02:03:00.271415 #10214] INFO -- : - Integrations::Github failures: 0 I, [2024-02-23T02:03:00.273816 #10214] INFO -- : - Integrations::SquashTm failures: 0 I, [2024-02-23T02:03:00.276035 #10214] INFO -- : - Integrations::BaseSlashCommands failures: 0 I, [2024-02-23T02:03:00.283842 #10214] INFO -- : - Integrations::Harbor failures: 0 I, [2024-02-23T02:03:00.287038 #10214] INFO -- : - Integrations::GooglePlay failures: 0 I, [2024-02-23T02:03:00.292312 #10214] INFO -- : - Integrations::ExternalWiki failures: 0 I, [2024-02-23T02:03:00.295282 #10214] INFO -- : - Integrations::BaseChatNotification failures: 0 I, [2024-02-23T02:03:00.297600 #10214] INFO -- : - Integrations::DiffblueCover failures: 0 I, [2024-02-23T02:03:00.299947 #10214] INFO -- : - Integrations::BaseThirdPartyWiki failures: 0 I, [2024-02-23T02:03:00.302166 #10214] INFO -- : - Integrations::Campfire failures: 0 I, [2024-02-23T02:03:00.304778 #10214] INFO -- : - Integrations::BaseIssueTracker failures: 0 I, [2024-02-23T02:03:00.307425 #10214] INFO -- : - Integrations::BaseCi failures: 0 I, [2024-02-23T02:03:00.309611 #10214] INFO -- : - Integrations::Assembla failures: 0 I, [2024-02-23T02:03:00.311924 #10214] INFO -- : - Integrations::Asana failures: 0 I, [2024-02-23T02:03:00.314239 #10214] INFO -- : - Integrations::AppleAppStore failures: 0 I, [2024-02-23T02:03:00.316432 #10214] INFO -- : - Integrations::MockMonitoring failures: 0 I, [2024-02-23T02:03:00.318737 #10214] INFO -- : - Integrations::Prometheus failures: 0 I, [2024-02-23T02:03:00.320891 #10214] INFO -- : - Integrations::SlackSlashCommands failures: 0 I, [2024-02-23T02:03:00.323146 #10214] INFO -- : - Integrations::MattermostSlashCommands failures: 0 I, [2024-02-23T02:03:00.325459 #10214] INFO -- : - Integrations::WebexTeams failures: 0 I, [2024-02-23T02:03:00.327549 #10214] INFO -- : - Integrations::UnifyCircuit failures: 0 I, [2024-02-23T02:03:00.329732 #10214] INFO -- : - Integrations::Telegram failures: 0 I, [2024-02-23T02:03:00.331890 #10214] INFO -- : - Integrations::Pumble failures: 0 I, [2024-02-23T02:03:00.334048 #10214] INFO -- : - Integrations::MicrosoftTeams failures: 0 I, [2024-02-23T02:03:00.336332 #10214] INFO -- : - Integrations::HangoutsChat failures: 0 I, [2024-02-23T02:03:00.338386 #10214] INFO -- : - Integrations::Mattermost failures: 0 I, [2024-02-23T02:03:00.340610 #10214] INFO -- : - Integrations::BaseSlackNotification failures: 0 I, [2024-02-23T02:03:00.342802 #10214] INFO -- : - Integrations::Discord failures: 0 I, [2024-02-23T02:03:00.344827 #10214] INFO -- : - Integrations::Slack failures: 0 I, [2024-02-23T02:03:00.347042 #10214] INFO -- : - Integrations::GitlabSlackApplication failures: 0 I, [2024-02-23T02:03:00.349094 #10214] INFO -- : - Integrations::Confluence failures: 0 I, [2024-02-23T02:03:00.351299 #10214] INFO -- : - Integrations::Zentao failures: 0 I, [2024-02-23T02:03:00.353463 #10214] INFO -- : - Integrations::Jira failures: 0 I, [2024-02-23T02:03:00.355466 #10214] INFO -- : - Integrations::Clickup failures: 0 I, [2024-02-23T02:03:00.357586 #10214] INFO -- : - Integrations::Youtrack failures: 0 I, [2024-02-23T02:03:00.359625 #10214] INFO -- : - Integrations::Ewm failures: 0 I, [2024-02-23T02:03:00.361831 #10214] INFO -- : - Integrations::Redmine failures: 0 I, [2024-02-23T02:03:00.364124 #10214] INFO -- : - Integrations::CustomIssueTracker failures: 0 I, [2024-02-23T02:03:00.366205 #10214] INFO -- : - Integrations::Bugzilla failures: 0 I, [2024-02-23T02:03:00.368430 #10214] INFO -- : - Integrations::MockCi failures: 0 I, [2024-02-23T02:03:00.370728 #10214] INFO -- : - Integrations::Teamcity failures: 0 I, [2024-02-23T02:03:00.372880 #10214] INFO -- : - Integrations::Jenkins failures: 0 I, [2024-02-23T02:03:00.375276 #10214] INFO -- : - Integrations::DroneCi failures: 0 I, [2024-02-23T02:03:00.377335 #10214] INFO -- : - Integrations::Buildkite failures: 0 I, [2024-02-23T02:03:00.379520 #10214] INFO -- : - Integrations::Bamboo failures: 0 I, [2024-02-23T02:03:00.381282 #10214] INFO -- : - ProjectSnippet failures: 0 I, [2024-02-23T02:03:00.383118 #10214] INFO -- : - PersonalSnippet failures: 0 I, [2024-02-23T02:03:00.461952 #10214] INFO -- : - User failures: 0 I, [2024-02-23T02:03:00.479208 #10214] INFO -- : - ApplicationSetting failures: 0 I, [2024-02-23T02:03:00.513227 #10214] INFO -- : - Gitlab::BackgroundMigration::EncryptCiTriggerToken::CiTrigger failures: 0 I, [2024-02-23T02:03:00.536651 #10214] INFO -- : - Ci::JobVariable failures: 0 I, [2024-02-23T02:03:00.538930 #10214] INFO -- : - Ci::Trigger failures: 0 I, [2024-02-23T02:03:00.546723 #10214] INFO -- : - Ci::GroupVariable failures: 0 I, [2024-02-23T02:03:00.554038 #10214] INFO -- : - Ci::Variable failures: 0 I, [2024-02-23T02:03:00.561180 #10214] INFO -- : - Ci::PipelineScheduleVariable failures: 0 I, [2024-02-23T02:03:00.567462 #10214] INFO -- : - Ci::PipelineVariable failures: 0 I, [2024-02-23T02:03:00.574721 #10214] INFO -- : - Ci::InstanceVariable failures: 0 I, [2024-02-23T02:03:00.577819 #10214] INFO -- : - Ci::PipelineVariable::Partitioned failures: 0 I, [2024-02-23T02:03:00.584307 #10214] INFO -- : - ScimOauthAccessToken failures: 0 I, [2024-02-23T02:03:00.590575 #10214] INFO -- : - Operations::FeatureFlagsClient failures: 0 I, [2024-02-23T02:03:00.611103 #10214] INFO -- : - Clusters::AgentToken failures: 0 I, [2024-02-23T02:03:00.776924 #10214] INFO -- : - Project failures: 0 I, [2024-02-23T02:03:00.789473 #10214] INFO -- : - DeployToken failures: 0 I, [2024-02-23T02:03:00.816660 #10214] INFO -- : - Group failures: 0 I, [2024-02-23T02:03:00.841691 #10214] INFO -- : - Ci::Runner failures: 0 I, [2024-02-23T02:03:00.852769 #10214] INFO -- : - Ci::Build failures: 0 I, [2024-02-23T02:03:00.852844 #10214] INFO -- : Total: 0 row(s) affected I, [2024-02-23T02:03:00.852869 #10214] INFO -- : Done! [ec2-user@ip-10-0-0-5 ~]$
GitLabにログインして問題ないことを確認し、更新は完了です。
