View profile

Verify Engineering Update - April 2021

April 1 · Issue #10 · View online
Verify Engineering Update
Thanks again for reading the Verify Engineering Update! Please share any feedback you have in this issue, or send it to me directly either on Slack, or to

Breaking: Commodore International Partnership 🕹
Some exciting news from the Runner team - today we’re announcing a new partnership with Commodore International! This partnership will unlock a huge market by making the GitLab Runner available to the Commodore 64 platform - more details in the press release. Next up we will be focused on other up and coming platforms like the ColecoVision.
Runner Frontend
Miguel will be moving across from Verify:CI to Verify:Runner to help build out new Runner Enterprise Management capabilities. We’re very excited to watch this develop.
Rapid Actions
The past several weeks has been quite busy with multiple rapid action efforts (1, 2). All of the teams have done a great job responding to these challenges and we are already seeing a positive impact! Much of the planned work has been delivered, so we will likely be wrapping up these efforts in a couple weeks. A few notable improvements to call out:
Ci::Runner#can_pick? query for optimisation and review execution frequency had a significant impact on decreasing primary db pressure
Rollout of all changes for Short-term solution for improving builds queuing included a number of improvements to build queuing resulting decreased primary db pressure and eliminating N+1 queries
Resolving API: jobs/request: ensure that BIG QUERY always runs on replicas this chart shows the impact on the total statement time on primary db for /api/v4/jobs/request
CI Scaling
I’ve created an issue to discuss scaling targets for CI on Please take a look and contribute any feedback or suggestions you might have.
Frontend Technical Debt Cleanup
The Frontend team has been continuing to make great progress cleaning up technical debt and closing over 50 issues already this quarter!
Improve Runner Resiliency
Our Runner infrastructure is now more resilient thanks to using multiple GCP projects to avoid hitting quotas during high-traffic or abuse situations. This change is already providing some much needed headroom during high traffic periods.
CI Minutes Reset Improvements
CI engineers have collaborated with Infrastructure to mitigate the risk involved in the CI Minutes DB resets. Thank you to Matija and Fabio on this latest effort. SRE is reporting much improved results this month.
Verify Think Big
We recently kicked of a quarterly Think Big series focused on Next Generation CI. You can catch up on the discussion in the agenda doc and the recording is on Unfiltered. If you’d like to participate in the next session, please let Jackie or myself know.
Security Fixes & Feature Flags
Security has a draft MR to update the current process around how to handle “disruptive” (e.g. potentially breaking) changes in a minor release. Please provide any feedback you might have in the issue.
While we’re not quite sure how April Fool’s Day started, it’s become a tradition celebrated across the globe. This list of the 100 best April Fool’s Day hoaxes is pretty great 🤣
I wanted to take a moment to say thank you to everyone on the team for their support during the recent rapid action efforts. It’s been a hectic time, but we all came together as a team and supported each other in numerous ways. We wouldn’t see the results we’re seeing today without the support and collaboration of the whole team. Great work everyone!
Did you enjoy this issue?
In order to unsubscribe, click here.
If you were forwarded this newsletter and you like it, you can subscribe here.
Powered by Revue