I’m going to set up a cronjob to restart the Lemmy docker container every 6 hours. That seems to be around when stuff stops working usually.
Sounds like something a cardassian would say.
It took me a second to realize what cardassians you were talking about. I constantly forget the other ones are spelled with a K
Sheesh.
I’d say the big seems to be slightly different from my observations, in that things are meant rather than broken. Could be wrong though.
oof
I would comment on this but since federation is broken…this won’t be seen until the instance admin restarts Lemmy and federation works once again.
Federation seems to be working fine from where I stand?
Edit:
Edit 2:
Even the edit federated out to your instance fine…
I think it works for a while after restart of the server, and then stops working. Yesterday I was making comments that didn’t federate until 12 hours later when I assume the instance admin restarted the server.
My instance has been uo for over 3 days since 0.19.1 update with no issues - very little load though
Yeah it seems to work for some instances with 0.19.1 but Lemmy.today has issues and feddit.de as well, just from what I’ve heard. Probably plenty more.
I have mh suspicions that this is some kind of deadlock issue. After fucking up my config during am upgrade (too many database connections, too many workers) the new multithreaded federation thingy seemed to become quite unstable. From what I could tell, the threads that are supposed to deal with federation all broke/shut down, but didn’t get automatically restarted again, leaving some messages and instances in limbo until the entire server got restarted.
After fixing my database connection issue and reducing the amount of workers, I don’t think I’ve encountered many issues since. I occasionally click the little icon above a post to check if my response had reached the community server, and usually it does, pretty quickly.
This issue sounds awful to have to debug, best of luck to the Lemmy devs in finding a fix!
Lemmy has been feeling pretty empty the past couple of days. That just really goes to show how important federation really is.
Yes and no, if you have enough users you do not need federation for a server to not feel empty. But overall many servers do not have that many users, so federation with larger ones is essential.
I noticed that as well, thought maybe things were just slowing down, but it’s good to know it was the software and not a sudden drop in community involvement. Since admins became aware of the bug and began restarting their servers as an ad-hoc fix, I’ve been seeing way more engagement on my instance.
I’m glad I’m not the only one then. 19.1 here
A while ago, programming.dev had a problem where nothing from the instance federated for a week. Lemmy felt so empty
Does my comment reach anyone?
Yup, absolutely nothing I posted from lemm.ee yesterday made it out into the wider world. In fact I’ll probably have to manually federate this comment too.
Hopefully they can get to the bottom of it. Maybe next year we need a rule about releasing anything in December when everyone’s too busy to bugfix 😅
A restart of Lemmy seems to fix it temporarily according to admin of Lemmy.today.
But it’s inconsistent and stops working after a while it seems.
Curious: what do you mean by “manually federating” a comment?
My other account is on .world so I can use search to forcibly pull things onto at least that server (search for the original URL of the unfederated post or comment and then wait a few seconds). Sometimes doing that will also encourage whatever it was to federate more widely to more servers, but that doesn’t seem to be happening as reliably either since the upgrade 🤷♀️