Commits · a714987ed90f0ee3a36778f2c529ae20715d90c0 · freedesktop.org / helm-gitlab-config

17 Apr, 2020 1 commit
- Set in stone our new external IP · a714987e
  Benjamin Tissoires authored Apr 17, 2020
  
  a714987e
16 Apr, 2020 2 commits

Setup grafana · a70bd312
Benjamin Tissoires authored Apr 16, 2020

a70bd312

Fix constantly reloading nginx · d5126fcc

Benjamin Tissoires authored Apr 16, 2020

The controller all the time removes and adds the following:

```
ssl_trusted_certificate  /etc/ingress-controller/ssl/default-gitlab-pages-tls-full-chain.pem;
ssl_stapling             on;
ssl_stapling_verify      on;
```

d5126fcc

15 Apr, 2020 2 commits

Add grafana from k8s native chart · f9df4a25
Benjamin Tissoires authored Apr 15, 2020

f9df4a25

Add missing nginx config · 9901aa48

Benjamin Tissoires authored Apr 15, 2020



It seems the CN doesn't need this as there is a job creating
the secrets on upgrade. But for us, we need it or the ssh
port will not be forwarded.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>

9901aa48

14 Apr, 2020 1 commit

upgrade the config with the new charts · c6c7bf85

Benjamin Tissoires authored Apr 14, 2020



For the new charts to work, we need to namespace all of the config
files because we are using the root of the directory, not just
`./charts/gitlab-omnibus`.

This allows to be more compatible with the gitlab native kubernetes
chart and should allow us to move forward.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>

c6c7bf85

10 Apr, 2020 1 commit
- runner-cloud-init: add our current docker-gc-exclude files · ceacc58d
  Benjamin Tissoires authored Apr 10, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
  ceacc58d
08 Apr, 2020 19 commits

d-f-s: introduce docker_fromisoformat · 70534ecd

Benjamin Tissoires authored Apr 08, 2020



To simplify the calls to get_correct_iso_format()

Then:
`%s/datetime.datetime.fromisoformat(get_correct_iso_format(\(.*\)))/docker_fromisoformat(\1)/g`

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

70534ecd

d-f-s: temporary exclude the tagged images with a null refcount · 5214cd72

Benjamin Tissoires authored Apr 07, 2020



Some images are not part of the db, either the db is not up to date,
either they were pulled manually. Ignore them.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

5214cd72

d-f-s: include the last used timestamp in the images too · 2c1dbee7

Benjamin Tissoires authored Apr 07, 2020



so that we do not remove objects that have been created/used less than
a day ago.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

2c1dbee7

d-f-s: immediately clean the disk upon startup · f324b3b1

Benjamin Tissoires authored Apr 07, 2020



Now that the history is offloaded to the gitlab server, we can start
we accurate data.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

f324b3b1

d-f-s: use the exported containers usage instead of docker events · eced563e

Benjamin Tissoires authored Apr 07, 2020



This should remove the complex need to listen to events, not have
history and whatnot.

Right now it is very simple, it counts since the beginning of the
available files in fdo-containers-usage.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

eced563e

d-f-s: actually clean up containers and their volumes · 25c609c3
Benjamin Tissoires authored Apr 08, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
25c609c3
d-f-s: listen to docker events! · 32dfe9b2
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
32dfe9b2

d-f-s: parse previous events to get an initial idea of the refcount · 96bd50b5

Benjamin Tissoires authored Apr 03, 2020

problem is that the stored docker events are not that many, and
we mostly only get events from gitlab/gitlab-runner-helper

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

96bd50b5

d-f-s: do not reset the FDOServer object all the time · df95a5c0

Benjamin Tissoires authored Apr 03, 2020



We want to listen to events, so clearing up our state at every run
will make this moot.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

df95a5c0

d-f-s: make expired and is_protected_image properties · 9076c5ec
Benjamin Tissoires authored Apr 08, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
9076c5ec
d-f-s: add a refcount to the images · 1d01c935
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
1d01c935
d-f-s: make the target of free disk space an argument · 6ba83256
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
6ba83256

d-f-s: add a default timestamp to all images · d5cbee3a

Benjamin Tissoires authored Apr 03, 2020



this makes easier to sort the list of last used images

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

d5cbee3a

d-f-s: remove the oldest terminated container first · 195d2573
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
195d2573

d-f-s: prevent errors if a container disappears while the script is loading · 4b9aeab8

Benjamin Tissoires authored Apr 03, 2020

otherwise:

File "/usr/lib/python3/dist-packages/docker/errors.py", line 31, in create_api_error_from_http_exception
raise cls(e, response=response, explanation=explanation)
docker.errors.NotFound: 404 Client Error: Not Found ("No such container: 03c5217472db4bc979a167371262ce56e93dc2a9fd7e19791fa59ecf4cb0ef24")

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

4b9aeab8

d-f-s: use the new docker api and start removing images · e6fbf78b

Benjamin Tissoires authored Apr 03, 2020



We need to enforce working with UTC, otherwise we won't get accurate
expired time stamps.

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>

e6fbf78b

d-f-s: at every iteration, remove the expired images first · 98d1e90c
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
98d1e90c
d-f-s: use the exclusion file instead of hardcoding it · 1354d34e
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
1354d34e
d-f-s: compute the total size for each container · a1d7aa94
Benjamin Tissoires authored Apr 03, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@redhat.com>
```
a1d7aa94

07 Apr, 2020 1 commit

Update marge to drop --tested-by. · 845aa78c

Emma Anholt authored Apr 07, 2020

As a reminder to myself in the future, this was generated with:

kubectl get pods --namespace marge-bot -o yaml > marge-mesa-config.yaml

845aa78c

28 Mar, 2020 12 commits

docker-free-space: add a sleep option · 1fc3da4a
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
allows to run the script just once or in a loop

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
1fc3da4a
docker-free-space: use f-string where possible · ecd2b924
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
ecd2b924
docker-free-space: decide to be aggressive based on the free disk space · 3c36884e
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
3c36884e
docker-free-space: add a verbose option · eb30188f
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
eb30188f
docker-free-space: use mib() instead of manually dividing · 7d0a56f8
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
7d0a56f8
docker-free-space: fix is_enough_free · 0b081150
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
0b081150

docker-free-space: process the labels · e6d6cd84

Benjamin Tissoires authored Mar 27, 2020 and

Benjamin Tissoires committed Mar 28, 2020



- and guess if the image can be safely removed,
- and if the image is part of an upstream project, and should likely
  not be cleaned

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>

e6d6cd84

docker-free-space: fix is_protected_image · 95fc809f
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
95fc809f
docker-free-space: use click to provide arguments to the script · a60f8de3
Benjamin Tissoires authored Mar 27, 2020 and Benjamin Tissoires committed Mar 28, 2020
```
click is so much better than argparse

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
```
a60f8de3

docker-free-space: fix flake8 complains · 03927f43

Benjamin Tissoires authored Mar 27, 2020 and

Benjamin Tissoires committed Mar 28, 2020

no functional changes, merely whitespaces and unused imports.

docker-free-space.py:31:1: F401 'functools' imported but unused
docker-free-space.py:34:1: F401 'sys' imported but unused
docker-free-space.py:39:1: E302 expected 2 blank lines, found 1
docker-free-space.py:42:1: E302 expected 2 blank lines, found 1
docker-free-space.py:45:1: E305 expected 2 blank lines after class or function definition, found 1
docker-free-space.py:47:1: E302 expected 2 blank lines, found 1
docker-free-space.py:54:1: E302 expected 2 blank lines, found 1
docker-free-space.py:60:1: E302 expected 2 blank lines, found 1
docker-free-space.py:70:31: E201 whitespace after '{'
docker-free-space.py:70:124: E202 whitespace before '}'
docker-free-space.py:82:9: E265 block comment should start with '# '
docker-free-space.py:83:13: E265 block comment should start with '# '
docker-free-space.py:97:31: E201 whitespace after '{'
docker-free-space.py:97:124: E202 whitespace before '}'
docker-free-space.py:115:24: E201 whitespace after '{'
docker-free-space.py:115:81: E202 whitespace before '}'
docker-free-space.py:116:28: E201 whitespace after '{'
docker-free-space.py:116:101: E202 whitespace before '}'
docker-free-space.py:128:77: E226 missing whitespace around arithmetic operator
docker-free-space.py:128:82: E226 missing whitespace around arithmetic operator
docker-free-space.py:128:104: E226 missing whitespace around arithmetic operator
docker-free-space.py:128:109: E226 missing whitespace around arithmetic operator
docker-free-space.py:139:44: E261 at least two spaces before inline comment
docker-free-space.py:139:44: E262 inline comment should start with '# '
docker-free-space.py:142:20: E261 at least two spaces before inline comment
docker-free-space.py:142:21: E262 inline comment should start with '# '
docker-free-space.py:145:13: E265 block comment should start with '# '
docker-free-space.py:146:13: E265 block comment should start with '# '

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>

03927f43

docker-free-space: replace 8 spaces by 4 · 9b4ba2f3

Benjamin Tissoires authored Mar 27, 2020 and

Benjamin Tissoires committed Mar 28, 2020



flake8 complains that lines are over indented.

`%s/        /    /g`

Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>

9b4ba2f3

Upgrade to 12.9.1 · 7470b5cd
Daniel Stone authored Mar 28, 2020

7470b5cd

26 Mar, 2020 1 commit
- cloud-init: set up raid 5 for the 4 spare disks · 149fcaf7
  Benjamin Tissoires authored Mar 13, 2020 and Benjamin Tissoires committed Mar 26, 2020
```
not my best script ever, but it'll do the job
```
  149fcaf7