Skip to content
GitLab
  1. 29 Mar, 2022 1 commit
  3. 25 Mar, 2022 5 commits
  5. 21 Feb, 2022 5 commits
  7. 13 Sep, 2021 3 commits
  9. 09 Sep, 2021 1 commit
  11. 08 Sep, 2021 1 commit
    • Majavah's avatar
      deployment: Drop wm-* images · dcba446c
      Majavah authored 
      Those images don't really have any beneficts over Toolforge images. The
versions on the Toolforge registry are usually outdated.

Change-Id: I37a424a1445cb1b1cebe06cf5ab1dd831210d8ef
      dcba446c
  13. 06 Sep, 2021 8 commits
  15. 15 Aug, 2021 1 commit
    • Majavah's avatar
      kubernetes: Add Bullseye images · 9c234577
      Majavah authored 
      Add Bullseye created in I2e7f6b661f454a03061246bb61ec5e500297114b.

Bug: T284590
Change-Id: I97af2280669c1799d7a42d6351e635800d22d6d9
      9c234577
  17. 14 Aug, 2021 1 commit
    • Majavah's avatar
      ops: Validate per-container limits · d7c9c12f
      Majavah authored 
      This ensures that the user sees an error message if their container
can't start due to per-container limits set by Toolforge admins.
Otherwise the job will be created successfully but it will fail creating
any pods as they go over the limits.

Bug: T287275
Change-Id: I5944a038e483efeaa0bf1565695cecc471ef247f
      d7c9c12f
  19. 22 Jul, 2021 1 commit
    • Arturo Borrero Gonzalez's avatar
      containers: store information in a ConfigMap · 4d8235b8
      Arturo Borrero Gonzalez authored 
      

So we can mark some of the containers as deprecated.

The workflow would be mostly the same: reload the API app to reload the containers available
in the API.

The end user output would be something like this:

+------------------------+------------------------------------------------------------------------+
|       Short name       |                         Docker container image                         |
+------------------------+------------------------------------------------------------------------+
|     tf-buster-std      |  docker-registry.tools.wmflabs.org/toolforge-buster-standalone:latest  |
|       tf-golang        |  docker-registry.tools.wmflabs.org/toolforge-golang-sssd-base:latest   |
|      tf-golang111      | docker-registry.tools.wmflabs.org/toolforge-golang111-sssd-base:latest |
|        tf-jdk11        |   docker-registry.tools.wmflabs.org/toolforge-jdk11-sssd-base:latest   |
|   tf-jdk8-DEPRECATED   |   docker-registry.tools.wmflabs.org/toolforge-jdk8-sssd-base:latest    |
|       tf-node10        |  docker-registry.tools.wmflabs.org/toolforge-node10-sssd-base:latest   |
|  tf-node6-DEPRECATED   |   docker-registry.tools.wmflabs.org/toolforge-node6-sssd-base:latest   |
|   tf-php5-DEPRECATED   |   docker-registry.tools.wmflabs.org/toolforge-php5-sssd-base:latest    |
|  tf-php72-DEPRECATED   |   docker-registry.tools.wmflabs.org/toolforge-php72-sssd-base:latest   |
|        tf-php73        |   docker-registry.tools.wmflabs.org/toolforge-php73-sssd-base:latest   |
| tf-python2-DEPRECATED  |  docker-registry.tools.wmflabs.org/toolforge-python2-sssd-base:latest  |
| tf-python34-DEPRECATED | docker-registry.tools.wmflabs.org/toolforge-python34-sssd-base:latest  |
| tf-python35-DEPRECATED | docker-registry.tools.wmflabs.org/toolforge-python35-sssd-base:latest  |
|      tf-python37       | docker-registry.tools.wmflabs.org/toolforge-python37-sssd-base:latest  |
|  tf-ruby21-DEPRECATED  |  docker-registry.tools.wmflabs.org/toolforge-ruby21-sssd-base:latest   |
|       tf-ruby25        |  docker-registry.tools.wmflabs.org/toolforge-ruby25-sssd-base:latest   |
|        tf-tcl86        |   docker-registry.tools.wmflabs.org/toolforge-tcl86-sssd-base:latest   |
|       wm-buster        |       docker-registry.tools.wmflabs.org/wikimedia-buster:latest        |
| wm-stretch-DEPRECATED  |       docker-registry.tools.wmflabs.org/wikimedia-stretch:latest       |
+------------------------+------------------------------------------------------------------------+

Bug: T287077
Signed-off-by: Arturo Borrero Gonzalez's avatarArturo Borrero Gonzalez <aborrero@wikimedia.org>
Change-Id: If9248eb805e14d0138a648957b0b407dc0be330a
      4d8235b8
  21. 21 Jul, 2021 5 commits
  23. 16 Jul, 2021 3 commits
  25. 15 Jul, 2021 1 commit
  27. 14 Jul, 2021 2 commits
    • Arturo Borrero Gonzalez's avatar
      jobs: include option to log job stdout/stderr to the each user home directory · 858a20bf
      Arturo Borrero Gonzalez authored 
      

Users home directories are on NFS and are our current way to share storage between the k8s cluster
and bastions.

This patch introduces a new API argument: filelog (boolean). If set to true, we will force redirect
stdout/stderr to a file in the home dir with the name of the job. If set to false (the default)
stdout/stderr will be redirected to /dev/null.

For this to happen, we wrap the whole job command in a /bin/sh execution.
To simplify a bit the whole parsing game when listing back jobs, we store the log preference in a
custom k8s label.

Incidentally, this enables commands to be arbitrary strings, meaning we can have arguments for the
job command, for example:

   ./arg.sh one --2 'three four'

Bug: T286485
Bug: T286107
Signed-off-by: Arturo Borrero Gonzalez's avatarArturo Borrero Gonzalez <aborrero@wikimedia.org>
Change-Id: I2321d5c7061135bdf47265373a4c8e8e5b945c6a
      858a20bf
    • Arturo Borrero Gonzalez's avatar
      jobs: enforce job name to be friendly · c5b8f6db
      Arturo Borrero Gonzalez authored 
      

Only allow job names to be letters, numbers and dash (-), max 100 characters. In a later
patch, we will use the job name to generate log files, and we want the string to be as friendlier
as possible.

Bug: T286485
Signed-off-by: Arturo Borrero Gonzalez's avatarArturo Borrero Gonzalez <aborrero@wikimedia.org>
Change-Id: Ic152b39311628b1d7bba72adaf2cafee85fd30e2
      c5b8f6db
  29. 13 Jul, 2021 1 commit
  31. 12 Jul, 2021 1 commit