ruud 1 week ago • 100%
Yes there is an issue with the Mlym container (old.lemmy.world), we have now stopped it because it also slowed the other alternative UI's. We'll troubleshoot this.
ruud 1 week ago • 100%
It would have been better if they communicated to us first. I don't disagree that user signups should be spread over instances. We now have a link to https://lemmyverse.net on our signup page so people can check if another instance would fit them better.
ruud 2 weeks ago • 100%
I have setup bskysocial.world to test that (there's no web interface, just select this domain when logging in or signing up via the app or https://bsky.app)
Note: This is for testing only, I can't promise it will remain running.
(I am @ruud.bskysocial.world)
ruud 2 weeks ago • 100%
I think the owner of this (and other decades music) is no longer active. I'll find some other mods for it if he doesn't respond to my message, and I'm sure we can update the title ;-)
ruud 2 weeks ago • 100%
It's a feature of the app, where it doesn't load all messages at once. Whenever you've read all it has loaded, you'll see this message, and when clicking it it will load more posts.
ruud 2 weeks ago • 100%
I think the links and usernames are now OK.
ruud 2 weeks ago • 100%
Yeah that went wrong when copy/pasting the text, I'll fix it.
Finally a new blog post about all our instances and the finances..
ruud 4 weeks ago • 100%
The community already existed but was deleted by the creator. I have purged that and you can now create it again.
cross-posted from: https://toast.ooo/post/3740832 > *turns out I did my math wrong, so it’s a little less than 30 days* > > # July 12th, 2024 @ midnight EDT > > https://canvas.fediverse.events > > ✨ this year’s event also supports **the entire fediverse** *not just Lemmy!* > > (you have to be able to make/receive text posts, like mastodon, lemmy, pixelfed, etc) > (peertube accounts will not work) > > you can get update announcements on other fedi platforms with `@canvas@fediverse.events` [link](https://social.fediverse.events/@canvas) > > chat about Canvas on [Matrix](https://matrix.to/#/#canvas:aftermath.gg) or [Discord](https://discord.gg/mEUqXZw8kR) (they’re bridged)
Woo-hoo today's my cake-day on Lemmy.world.. actually I'm the first here but many will follow the next days. Happy cake day to you all!
ruud 4 months ago • 100%
I do host some stuff myself 😉 but there's one thing to keep in mind.
Don't self host stuff that your family still needs after you're gone. Unless they are self host nerds like you. I stopped self hosting our mail and docs for example.
Would you agree?
ruud 4 months ago • 100%
I did register writefreely.world planning to host that one day, but I need some more selfhosting nerds to help out running all these instances :-) The foundation is now already running a few dozen Fedi instances :-D
ruud 4 months ago • 100%
I found this community via their website :-) The link is here: https://proton.me/community under forums.
ruud 4 months ago • 100%
Hi, I'll assist. Let me look into this.
ruud 5 months ago • 100%
Well thanks! ;-)
ruud 6 months ago • 92%
I don't know yet. I think that's something we need to discuss with the team and get input from the users. (Yes, I did register sublinks.world :-) )
ruud 6 months ago • 95%
I really hope there will be an option in Lemmy and Sublinks (and bin,mbin etc) to move communities between instances. But I think that's not very easy. I agree that having a few large instances isn't how the fediverse is meant to be. Ideally there would be a separate instance for each community.
ruud 6 months ago • 84%
.world has many instances in the fediverse and existed long before Lemmy.world. Ruud has never, to my knowledge, posed anything like this post about another potential fedi service. The other fediverse services have coexisted without need to position them against each other. This difference in approach implies intentions, if not outright actions with the illusion of user input.
I see my name mentioned here, but I don't understand the remark. Positioning fediverse services against each other? The team has posted this to get input to assist the Sublinks development team in getting moderation tools in their software. I think it's good there's many options in software to choose from. Lemmy, Kbin, Main, Piefed, Sublinks. I also run mastodon, but also similar platforms like firefish, sharkey, akkoma etc. Users can choose. Nothing is positioned against each other. They all work together as 1 large Fediverse. And, the more instances, the better. The fediverse ideally should exist of many instances instead of a few large ones. (Yes, I agree that having 1 big Lemmy server isn't ideal. But that's another discussion.)
ruud 6 months ago • 60%
It's also an option to just ask if it can be unpinned. You're welcome. Have a nice day.
ruud 6 months ago • 60%
I like Vivaldi, which is Chromium based. I also like Safari for the speed. Difficult to choose between the two. The feature that Vivaldi has and Safari hasn't, which I'm missing in Safari, is tab auto-refresh.
ruud 6 months ago • 100%
That won't work. I have 340k users on my servers and it just covers the running cost. So with a 100 user instance you would get peanuts.
ruud 6 months ago • 100%
I added a Liberapay link: https://liberapay.com/fhf/
ruud 6 months ago • 100%
Subscribed!
ruud 6 months ago • 100%
Ohh I didn't know there was a minimum setting in Ko-Fi. I changed the minimum there to 1. Thanks!
ruud 6 months ago • 100%
Ko-Fi or PayPal directly, or crypto
ruud 6 months ago • 100%
We keep that at https://blog.mastodon.world (I know, I'm behind with that...)
ruud 6 months ago • 100%
I see it OK when logged in, in the default UI.
ruud 6 months ago • 100%
Thanks!!
ruud 6 months ago • 100%
This is f**kin annoying me. Because we don't pay for premium support, it takes them hours to respond to an e-mail. So they ask me to specify a time when they can enable the account, so I can immediately remove the content. So I specify 12:00 UTC, but they don't respond so I need to propose a new time hoping they will respond before that...
Grrr
ruud 6 months ago • 100%
🫡 Thanks for the donation!
ruud 6 months ago • 100%
No, this time it's in the Mastodon bucket
Currently we have an images issue. Our Wasabi (S3) account was disabled because of some illegal content that was found, we're working with them to get the account re-enabled and the content removed. [Update 20240308 14:47 UTC] The issue has been fixed.
ruud 6 months ago • 100%
Yeah almost all links were broken, not sure how. I edited them, saved and they were broken again... For now it seems it's fixed.
ruud 6 months ago • 100%
Hmm. Why does Lemmy mess up the links...
ruud 7 months ago • 100%
I run a pixelfed and misskey on the same server, and used to run a mastodon besides that. No issues. (I use docker)
ruud 7 months ago • 100%
Thanks. This made us find out that we misconfigured it. I have now changed the configuration, hope it works.
ruud 7 months ago • 100%
Someone should build a Lemmy client so we don't see that ugly colour anymore! And give it a StarTrekkie name!
;-)
ruud 7 months ago • 100%
I was able to enable my 2FA now :-)
ruud 7 months ago • 100%
Commenting
ruud 7 months ago • 100%
Our Monero address is 83tnuFN4f28jRxTBW9qGDad2U23qNE5nfeW4Pfyd85oWMW7J9gqpXi3S8FDbX5uEeCAKcGnSpS2XT5dGwYiELthg8XuDrxH
There's some unrest because the Open Collective Foundation is stopping. Don't worry, we use Open Collective Europe as a donations platform, they're going nowhere. We've added some donation platforms, so if you would like to support us running our .world servers, you can do so here: - [Ko-Fi](https://ko-fi.com/fhfworld) (Preferred because of low fees) - [Liberapay](https://liberapay.com/fhf/) - [PayPal](https://paypal.me/fedihosting) - [Patreon](https://patreon.com/mastodonworld) - [OpenCollective](https://opencollective.com/mastodonworld) - [Bunq](https://bunq.me/fhf) And for those wanting to donate crypto: - Monero address: `83tnuFN4f28jRxTBW9qGDad2U23qNE5nfeW4Pfyd85oWMW7J9gqpXi3S8FDbX5uEeCAKcGnSpS2XT5dGwYiELthg8XuDrxH` - Cardano address: `addr1v9qv6xvfwcx9ny56uag4umu6238sw2e7ff2kcxl3qe7p9esayjxgu` Thank you! [Edit] Some of the links were broken, they should now all work! [Edit 20240314: Added Liberapay]
ruud 7 months ago • 100%
Yeah it's Sunday. Someone hasn't had their coffee yet it seems. :-)
ruud 7 months ago • 100%
When exactly did it stop? Maybe we can check an action on our side did that?
Next to Mastodon.world and Lemmy.world I am also running Calckey.world. This was running Calckey, a Misskey fork. That was re-branded to FireFish (that's the danger of running sites with the software name in the URL... :-) ). Unfortunately due to circumstances the FireFish software will no longer be maintained. Therefore I was looking for another Misskey fork that could replace it, and I found [Sharkey](https://git.joinsharkey.org/Sharkey/Sharkey). This looks really nice. So being who I am, I registered https://sharkey.world and installed it. It still needs some configuring and branding, but it works and you can use it! (As you will see it currently uses the Calckey.world branding) I will write a brief how-to on migrating from Calckey to Sharkey and hope the calckey.world users will migrate.
I run a server https://calckey.world , which used to be CalcKey, but the software was re-branded to Firefish. Unfortunately, firefish.world is taken. What domain should I use for my new Firefish instance? Preferably a .world domain. I have remembered these options suggested to me so far: - dartfish.world (a sort of fish similar to the firefish) - fedifish.world - fire-fish.world - f-fish.world Any other suggestions? Or do you like one of the above?
I've written a short blog about what happened in August, and the finances.
I did it again.... started another Fediverse service, this time a Bookwyrm instance. I used Goodreads, but if there's a Federated alternative, why not use that.. So I setup a server and opened registrations. Enjoy, and please let me know if you find anything that can be improved or changed.
There was another attack going on (as you might have noticed). We're working on a fix. In the meantime, we've blocked the listing of comments, so we at least aren't down, but it did break comments. Hope to have a fix in the next hour. Stay tuned! **Update** OK we've implemented a fix, again many thanks to [@sunaurus@lemm.ee](https://lemm.ee/u/sunaurus) for his assistance. This will prevent the outages we've seen last couple of days. Let's see what they will come up with next...
A few days ago I saw some cool [JoinLemmy stickers](https://www.etsy.com/listing/1532398821/place-2023sticker-packsmotivational?click_key=202669597a80d6f60b5afb9b21260113b41e3b90%3A1532398821&click_sum=dc8e01d4&ref=shop_home_active_33) created by [@cheeseblintzes@lemmy.world](https://lemmy.world/u/cheeseblintzes) . I asked her if she could also create lemmy.world stickers, and she did! You can see and order them [here](https://www.etsy.com/listing/1535729033/lemmyworld-stickers-motivational), also check the [other cool stickers in her shop](https://www.etsy.com/shop/thespookyfarmer). Thanks for creating them!
Lemmy.world has been down between 02:00 UTC and 05:45 UTC. This was caused by the database spiking to 100% cpu (all 32 cores/64 threads!) due to inefficient queries been fired to the db very often. I’ve collected the logs and we’ll be checking how to prevent this. (And what caused this)
**Update** The upgrade was done, DB migrations took around 5 minutes. We'll keep an eye out for (new) issues but for now it seems to be OK. **Original message** We will upgrade lemmy.world to 0.18.3 today at 20:00 UTC+2 ([Check what this isn in your timezone](https://www.timeanddate.com/worldclock/fixedtime.html?msg=Lemmy.world+upgrade+to+lemmy+18.3&iso=20230730T20&p1=16)). Expect the site to be down for a few minutes. ""Edit"" I was warned it could be more than a few minutes. The database update might even take 30 minutes or longer. Release notes for 0.18.3 can be found here: https://github.com/LemmyNet/lemmy/blob/main/RELEASES.md (This is unrelated to the downtimes we experienced lately, those are caused by attacks that we're still looking into mitigating. Sorry for those)
Now playing: Silver eye by Goldfrapp.
I saw this post by @miketorr@mastodon.art And I don't know what it is, but I like it very much! So now I'm curious! Already asked a DJ friend of mine, he thought in the direction of Massive Attack / Boards of Canada but we didn't find it.
Today, like the past few days, we have had some downtime. Apparently some script kids are enjoying themselves by targeting our server (and others). Sorry for the inconvenience. Most of these 'attacks' are targeted at the database, but some are more ddos-like and can be mitigated by using a CDN. Some other Lemmy servers are using Cloudflare, so we know that works. Therefore we have chosen Cloudflare as CDN / DDOS protection platform for now. We will look into other options, but we needed something to be implemented asap. For the other attacks, we are using them to investigate and implement measures like rate limiting etc.
As requested by some users: 'old' style now accessible via https://old.lemmy.world Code can be found here: https://github.com/rystaf/mlmym , created by [Ryan](https://github.com/rystaf) (Is he here?) (Yes he appears to be! [@nnrx@sh.itjust.works](https://sh.itjust.works/u/nnrx) ! Thanks for this awesome front-end!)
Thanks to [@aeharding@lemmy.world](https://lemmy.world/u/aeharding) for another release with awesome enhancements, see release notes here: https://lemmy.world/post/1558795
I blogged about what happened in June, and the financial overview.
It's always the small things you overlook... The `docker-compose.yml` I copied from somewhere when setting up lemmy.world apparently was missing the external network for the pictrs container.. So pictrs was working, as long as it got the images via Lemmy. Getting the images via URL didn't work... Looks like it's working now. Looks a whole lot better with all the images :-) **Edit** For existing posts: Edit the post, then Save. (No need to change anything). This also fetches the image.
(Duplicate post :-) see https://lemmy.world/post/1375042)
Let me contribute an oldie favorite.
cross-posted from: https://lemmy.world/post/1303201 > We've installed Voyager and it's reachable at https://m.lemmy.world, you can browse Lemmy, and login there (also if your account isn't on lemmy.world)
We've installed Voyager and it's reachable at https://m.lemmy.world, you can browse Lemmy, and login there (also if your account isn't on lemmy.world) **PS** Thanks go out to @stux[@stux@geddit.social](https://geddit.social/u/stux) , he came up with the idea (see https://m.geddit.social).
While I was asleep, apparently the site was hacked. Luckily, (big) part of the lemmy.world team is in US, and some early birds in EU also helped mitigate this. As I am told, this was the issue: - There is an vulnerability which was exploited - Several people had their JWT cookies leaked, including at least one admin - Attackers started changing site settings and posting fake announcements etc Our mitigations: - We removed the vulnerability - Deleted all comments and private messages that contained the exploit - Rotated JWT secret which invalidated all existing cookies The vulnerability will be fixed by the Lemmy devs. [Details of the vulnerability are here](https://lemmy.world/post/1293336) Many thanks for all that helped, and sorry for any inconvenience caused! **Update** While we believe the admins accounts were what they were after, it could be that other users accounts were compromised. Your cookie could have been 'stolen' and the hacker could have had access to your account, creating posts and comments under your name, and accessing/changing your settings (which shows your e-mail). For this, you would have had to be using lemmy.world at that time, and load a page that had the vulnerability in it.
We've updated Lemmy.world to Lemmy 0.18.1. For the release notes, see https://lemmy.world/post/1139237
Anyone running Forgejo? It's I think a fork of Gitea. They are also [implementing federation](https://codeberg.org/forgejo/forgejo/issues/59)
For those who find it interesting, enjoy!
I've been to the M72 concerts (both nights) in Amsterdam, in April. Bought the album too. (I'll check why the image got rotated...)
Another day, another update. More troubleshooting was done today. What did we do: - Yesterday evening @phiresky[@phiresky@lemmy.world](https://lemmy.world/u/phiresky) did some SQL troubleshooting with some of the lemmy.world admins. After that, phiresky submitted some PRs to github. - [@cetra3@lemmy.ml](https://lemmy.ml/u/cetra3) created a docker image containing 3PR's: [Disable retry queue](https://github.com/LemmyNet/lemmy/pull/3468), [Get follower Inbox Fix](https://github.com/LemmyNet/lemmy/pull/3482), [Admin Index Fix](https://github.com/LemmyNet/lemmy/pull/3483) - We started using this image, and saw a big drop in CPU usage and disk load. - We saw thousands of errors per minute in the nginx log for old clients trying to access the websockets (which were removed in 0.18), so we added a `return 404` in nginx conf for `/api/v3/ws`. - We updated lemmy-ui from RC7 to RC10 which fixed a lot, among which the issue with replying to DMs - We found that the many 502-errors were caused by an issue in Lemmy/markdown-it.actix or whatever, causing nginx to temporarily mark an upstream to be dead. As a workaround we can either 1.) Only use 1 container or 2.) set ~~`proxy_next_upstream timeout;`~~ `max_fails=5` in nginx. Currently we're running with 1 lemmy container, so the 502-errors are completely gone so far, and because of the fixes in the Lemmy code everything seems to be running smooth. If needed we could spin up a second lemmy container using the ~~`proxy_next_upstream timeout;`~~ `max_fails=5` workaround but for now it seems to hold with 1. Thanks to [@phiresky@lemmy.world](https://lemmy.world/u/phiresky) , [@cetra3@lemmy.ml](https://lemmy.ml/u/cetra3) , [@stanford@discuss.as200950.com](https://discuss.as200950.com/u/stanford), [@db0@lemmy.dbzer0.com](https://lemmy.dbzer0.com/u/db0) , [@jelloeater85@lemmy.world](https://lemmy.world/u/jelloeater85) , [@TragicNotCute@lemmy.world](https://lemmy.world/u/TragicNotCute) for their help! And not to forget, thanks to [@nutomic@lemmy.ml](https://lemmy.ml/u/nutomic) and [@dessalines@lemmy.ml](https://lemmy.ml/u/dessalines) for their continuing hard work on Lemmy! And thank you all for your patience, we'll keep working on it! Oh, and as bonus, an image (thanks Phiresky!) of the change in bandwidth after implementing the new Lemmy docker image with the PRs. ![](https://lemmy.world/pictrs/image/166fc6d9-972d-4ff2-aa3a-b2ecbbb90cd5.png) **Edit** So as soon as the US folks wake up (hi!) we seem to need the second Lemmy container for performance. So that's now started, and I noticed the `proxy_next_upstream timeout` setting didn't work (or I didn't set it properly) so I used `max_fails=5` for each upstream, that does actually work.
# Status update July 4th Just wanted to let you know where we are with Lemmy.world. ## Issues As you might have noticed, things still won't work as desired.. we see several issues: ### Performance - Loading is mostly OK, but sometimes things take forever - We (and you) see many 502 errors, resulting in empty pages etc. - System load: The server is roughly at 60% cpu usage and around 25GB RAM usage. (That is, if we restart Lemmy every 30 minutes. Else memory will go to 100%) ### Bugs - Replying to a DM doesn't seem to work. When hitting reply, you get a box with the original message which you can edit and save (which does nothing) - 2FA seems to be a problem for many people. It doesn't always work as expected. ## Troubleshooting We have many people helping us, with (site) moderation, sysadmin, troubleshooting, advise etc. There currently are 25 people in our Discord, including admins of other servers. In the Sysadmin channel we are with 8 people. We do troubleshooting sessions with these, and sometimes others. One of the Lemmy devs, [@nutomic@lemmy.ml](https://lemmy.ml/u/nutomic) is also helping with current issues. So, all is not yet running smoothly as we hoped, but with all this help we'll surely get there! Also thank you all for the donations, this helps giving the possibility to use the hardware and tools needed to keep Lemmy.world running!