Thanks!
Cost is not the bottleneck in this case… The problem is that I am rather ignorant about the options and their benefits/limitations. Moving the images the first time was painfully slow because of those same rate limits, and I expect the next migration to be the same, so I want to make a better choice next time and would rather find a solution with the current provider 😅
Thanks for the heads up. I am still trying to resolve this without a migration… I will try again to get a response from them as they have not replied in a week.
This is the current status:
The instance is serving the images via object storage. Specifically, I am making use of Contabo to save and serve the images.
I now know that the default limits are 250 requests / second and 80 Mbit/s: https://help.contabo.com/en/support/solutions/articles/103000275478-what-limits-are-there-on-object-storage-
It appears to me like when the requests are exceeded, the “Too many requests” error is triggered and it takes a few seconds before the requests are accepted again. This can happen if few users access the front page at once as this will fetch all of the thumbnails and icons on the page.
I have been in touch with Contabo’s customer support via e-mail. But they mis-understood my original e-mails and thought I was speaking about increasing the maximum number of images that can be stored (3 million by default). I have clarified that I want to increase the rate limit and have been waiting for their response for a few days now.
The other solution would be to move the images to a different object storage provider. The migration is also limited to the 250 requests/s and 80 Mbit/s, so it will require turning off the images for 4 - 7 days while all the images are moved… Since I am not familiar with the policies of other object storage providers I would also need to do research to avoid falling into the same trap.
So, I am hoping that Contabo’s support will get back to me soon and allow me to increase the rate limits, as this would be the most straight forward approach.
And you are doing a great job at that! 😄
Very interesting article, thanks for sharing. I agree that it is a good one to pin!!
I have been reaching out to the object storage provider to see if I can increase the rate limits… Unfortunately I might need to change to a different provider to overcome this. Since the migration takes several days, especially so because of those same rate limits, I would rather avoid this…
That’s an error I had not seen before, but I also just encountered with this specific post. I will investigate, thanks.
This error is a rate limit from the object storage provider. I did not know of this limit when I chose them, and I still have not found a way to change the limit. I will send them an e-mail. If the limit can’t be increased, one option is to pick another object storage provider, but the migration takes days.
Thank you for being alert! I have banned them instance-wide now.
Publishing in a more prestigious journal usually means that your work will be read by a greater number of people. The journal that a paper is published on carries weight on the CV, and it is a relevant parameter for committees reviewing a grant applicant or when evaluating an academic job applicant.
Someone who is able to fund their own research can get away with publishing to a forum, or to some of the Arxivs without submitting to a journal. But an academic that relies on grants and benefits from collaborations is much more likely to succeed in academia if they publish in academic journals. It is not necessarily that academics want to rely on publishers, but it is often a case of either you accept and adapt to the system or you don’t thrive in it.
It would be great to find an alternative that cuts the middle man altogether. It is not a simple matter to get researchers to contribute their high-quality work to a zero-prestige experimental system, nor is it be easy to establish a robust community-driven peer-review system that provides a filtering capacity similar to that of prestigious journals. I do hope some alternative system manages to get traction in the coming years.
That’s really cool, I will use it
Some time last year I learned of an example of such a project (peerreview on GitHub):
The goal of this project was to create an open access “Peer Review” platform:
Peer Review is an open access, reputation based scientific publishing system that has the potential to replace the journal system with a single, community run website. It is free to publish, free to access, and the plan is to support it with donations and (eventually, hopefully) institutional support.
It allows academic authors to submit a draft of a paper for review by peers in their field, and then to publish it for public consumption once they are ready. It allows their peers to exercise post-publish quality control of papers by voting them up or down and posting public responses.
I just looked it up now to see how it is going… And I am a bit saddened to find out that the developer decided to stop. The author has a blog in which he wrote about the project and about why he is not so optimistic about the prospects of crowd sourced peer review anymore: https://www.theroadgoeson.com/crowdsourcing-peer-review-probably-wont-work , and related posts referenced therein.
It is only one opinion, but at least it is the opinion of someone who has thought about this some time and made a real effort towards the goal, so maybe you find some value from his perspective.
Personally, I am still optimistic about this being possible. But that’s easy for me to say as I have not invested the effort!
I find it satisfying to see the graph come down :)
Yes, sorry, there was some serious lagg in fetching posts from Lemmy World that persisted for several days and accumulated a 1-week delay.
But after upgrading Mander it is now fetching data from LW quite rapidly and it should be back in-sync in about a day and a half from now.
If you are curious about the ranking algorithm, there is some info here: https://join-lemmy.org/docs/contributors/07-ranking-algo.html
I think that they are referring to Paxillus involotus
It is quite an interesting mushroom. It was considered “safe to eat” for a long time, but it contains an antigen that a human’s immune system can learn to attack.
The antigen is still of unknown structure but it stimulates the formation of IgG antibodies in the blood serum.
I once looked into whether this immune response builds up over many exposures, or if it is a random event that has a probability of happening for each exposure. I don’t remember finding a convincing answer… If it is a random event, then mushroom could be considered a “Russian roulette” mushroom that will usually provide a nice meal, but, if unlucky, you may experience the following:
Poisoning symptoms are rapid in onset, consisting initially of vomiting, diarrhea, abdominal pain, and associated decreased blood volume. Shortly after these initial symptoms appear, hemolysis develops, resulting in reduced urine output, hemoglobin in the urine or outright absence of urine formation, and anemia. Hemolysis may lead to numerous complications including acute kidney injury, shock, acute respiratory failure, and disseminated intravascular coagulation. These complications can cause significant morbidity with fatalities having been reported.
I agree with you that this is probably unrelated to the “generally similar to humans” comment. I feel like this fantasy is a combination of the above fact mixed in with the fact that the Fungi belong to the Opisthokonts, which places them closer to animals than plants, and so they share some interesting cellular characteristics with us. This places them closer to animals than plants, but “generally similar to humans” is perhaps a bit of a stretch _
But, it is just a meme about a guy being hyped about mushrooms. Hopefully people don’t expect memes to be super accurate 😁
As someone who grew up in the tropics and now lives somewhere colder, I went through the first three table entries thinking that this was Celsius and felt understood.
Thanks! I can imagine preserving a feather for 65 millions of years is no easy feat.
I am going to be that guy and point out that pterosaurs were not dinosaurs, unless you consider primates to be squirrels cause we are distantly related.
Ah, thank you for being that guy! Now I know 😄
Also fun fact pterosaurs may have had a type of feathering which either means that the ancestors of both dinosaurs and pterosaurs had feathers or it evolved at least twice. And on a similar thing of body coverings, stem mamals/proto-mammals had fur before the dinosaurs ever evolved.
Can the feathers and fur (or their impression) be preserved for millions of years in some types of fossilization? Or is the presence of these concluded from the bone structures, fossilized skin, or other not so direct pieces of evidence? And, is any direct evidence of color preserved? No pressure to answer, I am just wondering out loud.
Good news! Just got a reply from them and they have increased the connection limit. They did not specify what the new number is, but hopefully it is high enough to not be an issue for the foreseeable future.
So, if you do run into other similar reports after this comment I would appreciate it if you tag me again.