enhance ostree mirroring for better UX

[dustymabe]

Since we have decided on using ostree repos to deliver content to end users for now, let's work with Fedora Infra and upstream in ostree to get ostree mirroring set up and working well.

related:

• ostree delivery model #23 (comment)
• https://pagure.io/fedora-infrastructure/issue/5970

[dustymabe]

mariking as high priority as the UX is something we want to get right for FCOS

[sinnykumari]

Mirrormanager issue - fedora-infra/mirrormanager2#258

[sinnykumari]

We are also exploring using cloudfront to CDN entire ostree repo/ for content delivery and making use of contenturl to fetch repo/deltas/ and repo/objects/ content on client machine. This approach has some interesting results at ostreedev/ostree#1541 (comment)

[ramcq]

(CDN works really well for Flathub, fwiw! :D)

[sinnykumari]

We have new cloudfront set-up done from Fedora side caching content of ostree repo https://kojipkgs.fedoraproject.org/atomic/repo/ .
With new config, user's config looks something like:

[remote "fedora"]
url=https://ostree.fedoraproject.org
gpg-verify=true
gpgkeypath=/etc/pki/rpm-gpg/RPM-GPG-KEY-fedora-29-primary
contenturl=mirrorlist=https://ostree.fedoraproject.org/mirrorlist

With new config, we have seen nice results with speed improvement upto 20 times faster. See ostreedev/ostree#1541 (comment)

[jlebon]

Let's discuss this in today's community meeting? And if we're agreed, then we can move forward with planning on updating user configs. (This is more for other Fedora OSTree-based systems available right now of course, given that FCOS is not yet out :)).

One note: was talking about this with @sinnykumari and @puiterwijk at DevConf.cz about shipping the config as part of a package. Now that we have ostreedev/ostree#1773, we should definitely do this from day 0 for FCOS.

[dustymabe]

This work is in progress and should be complete today.

[sinnykumari]

In FCOS community meeting , we agreed that using ostree config with contenturl set makes ostree update much faster on user's system.

Updated ostree ostree config looks like:

[remote "fedora"]
url=https://ostree.fedoraproject.org
gpg-verify=true
gpgkeypath=/etc/pki/rpm-gpg/
contenturl=mirrorlist=https://ostree.fedoraproject.org/mirrorlist

Latest ostree supports passing directory containing list of gpgpkeys in gpgkeypath .

Next step is to ship this config to user through an rpm package. This allow us to update the remote config whenever required without effecting user's existing ostree remote config. This will be tracked in #143 .

[dustymabe]

Nice work sinny!