Looks like it works.

Edit still see some performance issues. Needs more troubleshooting

Update: Registrations re-opened We encountered a bug where people could not log in, see https://github.com/LemmyNet/lemmy/issues/3422#issuecomment-1616112264 . As a workaround we opened registrations.

Thanks

First of all, I would like to thank the Lemmy.world team and the 2 admins of other servers @stanford@discuss.as200950.com and @sunaurus@lemm.ee for their help! We did some thorough troubleshooting to get this working!

The upgrade

The upgrade itself isn’t too hard. Create a backup, and then change the image names in the docker-compose.yml and restart.

But, like the first 2 tries, after a few minutes the site started getting slow until it stopped responding. Then the troubleshooting started.

The solutions

What I had noticed previously, is that the lemmy container could reach around 1500% CPU usage, above that the site got slow. Which is weird, because the server has 64 threads, so 6400% should be the max. So we tried what @sunaurus@lemm.ee had suggested before: we created extra lemmy containers to spread the load. (And extra lemmy-ui containers). And used nginx to load balance between them.

Et voilà. That seems to work.

Also, as suggested by him, we start the lemmy containers with the scheduler disabled, and have 1 extra lemmy running with the scheduler enabled, unused for other stuff.

There will be room for improvement, and probably new bugs, but we’re very happy lemmy.world is now at 0.18.1-rc. This fixes a lot of bugs.

  • tmpod@lemmy.ptEnglish
    1·
    1 year ago

    Awesome work!

    I’d like to know more about the exact container topology you have, since I may try something similar on my instance as well.
    Is it something like this?

    ┌───┐       ┌───┐
│WEB│       │WEB│
└─┬─┘       └─┬─┘
┌─┴─┐ ┌───┐ ┌─┴─┐
│BE ├─┤IMG├─┤BE │
└─┬─┘ ├───┤ └─┬─┘
  └───┤DB ├───┘  
      └───┘

    Thank you! :3

  • oulayaettayebi@lemmy.world
    1·
    11 days ago

    GET YOUR FREE TRIAL NOW FRO OUR WEBSITE https://enjoychannels.com/

    are you looking for best ireland IPTV ? we have what you are looking for get Your free trial now from https://enjoychannels.com/ we have more than 90K Channels

    Ireland /UK / US focused IPTV service + Plenty More. Positive Feedback come and speak to our current members. Contact me for a Free trial and a invite to our discord server.

    ⦁ All PPV with multiple Links, Full Sport including all 3pm’s and ifollow ,European Football, Motorsport , Rugby, NBA,NFL,MLB ,UFC , NHL AND CHL , Irish and Scottish and lots of international

    Full VOD system which is kept up to date , we also take requests to add to this

    catch up

    EPG

    No VPN required but your welcome to use one

    Great support

    Please PM me for a Free trial

    We support a range of Device’s so whatever you have we can get you setup on

    Android Devices

    Firesticks

    IOS devices/Apple devices

    PC

    Mag box

    Smart TV

    Chromecast

    ZGemma

    We Support a range of our own hardcoded apps(XCIPTV,LTQ,Smarters,Flix) a few UI’s displayed below but we also support generic apps like tivimate , GSE , IptvX etc… once subscribed.