Suggestion of fediverse server that doesn't consume so many resources (unlike both Mastodon and Filefish)

cc @selfhost@lemmy.ml @selfhosted@lemmy.world

As an example: some people might be using the offerings from Microsoft or Amazon, whilst other people might be running a VM with a VPS somewhere and hosting their apps like Homeassistant, OpenHAB, Node-Red etc there.

I wanted to know if you do something like this, and what might be the downsides to doing something like this.

Thanks!

From the article:

Since Tailscale was founded in 2019, customers have been forced to choose between either Tailscale or Mullvad without the ability for them to co-exist.
Today we announce a partnership with Tailscale that allows you to use both in conjunction through the Tailscale app. This functionality is not available through the Mullvad VPN app. This partnership allows customers of Tailscale to make use of our WireGuard VPN servers as “exit nodes”. This means that whilst connected to Tailscale, you can access your devices across Tailscale’s mesh network, whilst still connecting outbound through Mullvad VPN WireGuard servers in any location.

Announcement also on Tailscale blog.

cross-posted from: https://programming.dev/post/2678496

Introduction

Hello everybody, About 5 months ago I started building an alternative to the Searx metasearch engine called Websurfx which brings many improvements and features which lacks in Searx like speed, security, high levels of customization and lots more. Although as of now it lacks many features which will be added soon in futures release cycles but right now we have got everything stabilized and are nearing to our first release v1.0.0. So I would like to have some feedbacks on my project because they are really valuable part for this project.

In the next part I share the reason this project exists and what we have done so far, share the goal of the project and what we are planning to do in the future.

Why does it exist?

The primary purpose of the Websurfx project is to create a fast, secure, and privacy-focused metasearch engine. While there are numerous metasearch engines available, not all of them guarantee the security of their search engine, which is critical for maintaining privacy. Memory flaws, for example, can expose private or sensitive information, which is never a good thing. Also, there is the added problem of Spam, ads, and unorganic results which most engines don't have the full-proof answer to it till now. Moreover, Rust is used to write Websurfx, which ensures memory safety and removes such issues. Many metasearch engines also lack important features like advanced picture search, which is required by many graphic designers, content providers, and others. Websurfx attempts to improve the user experience by providing these and other features, such as providing custom filtering ability and Micro-apps or Quick results (like providing a calculator, currency exchanges, etc. in the search results).

Preview

Home Page

Search Page

404 Page

What Do We Provide Right Now?

• Ad-Free Results.
• 12 colorschemes and a simple theme by default.
• Ability to filter content using filter lists (coming soon).
• Speed, Privacy, and Security.

In Future Releases

We are planning to move to leptos framework, which will help us provide more privacy by providing feature based compilation which allows the user to choose between different privacy levels. Which will look something like this:

• Default: It will use wasm and js with csr and ssr.
• Harderned: It will use ssr only with some js
• Harderned-with-no-scripts: It will use ssr only with no js at all.

Goals

• Organic and Relevant Results
• Ad-Free and Spam-Free Results
• Advanced Image Search (providing searches based on color, size, etc.)
• Dorking Support (in other words advanced search query syntax like using And, not and or in search queries)
• Privacy, Security, and Speed.
• Support for low memory devices (like you will be able to host websurfx on low memory devices like phones, tablets, etc.).
• Quick Results and Micro-Apps (providing quick apps like calculator, and exchange in the search results).
• AI Integration for Answering Search Queries.
• High Level of Customizability (providing more colorschemes and themes).

Benchmarks

Well, I will not compare my benchmark to other metasearch engines and Searx, but here is the benchmark for speed.

Number of workers/users: 16
Number of searches per worker/user: 1
Total time: 75.37s
Average time per search: 4.71s
Minimum time: 2.95s
Maximum time: 9.28s

Note: This benchmark was performed on a 1 Mbps internet connection speed.

Installation

To get started, clone the repository, edit the config file, which is located in the websurfx directory, and install the Redis server by following the instructions located here. Then run the websurfx server and Redis server using the following commands.

git clone https://github.com/neon-mmd/websurfx.git
cd websurfx
cargo build -r
redis-server --port 8082 &
./target/debug/websurfx

Once you have started the server, open your preferred web browser and navigate to http://127.0.0.1:8080 to start using Websurfx.

Check out the docs for docker deployment and more installation instructions.

Call to Action: If you like the project then I would suggest leaving a star on the project as this helps us reach more people in the process.

"Show your love by starring the project"

Project Link:

https://github.com/neon-mmd/websurfx

cross-posted from: https://lemmy.ml/post/4448974

I've recently started using a self hosted SearXNG instance but I'm still using the search engines enabled by default (google, duckduckgo and qwant). What search engines do you have enabled or which ones do you feel you've gotten the best results with?

I'm trying to stand up an instance of Cryptpad on a VPS. I have followed 3 different articles to try to get my way through it. They all end in the same result, browser errors and I see the Cryptpad logo with "loading" and that's it.

Browser error is always some variation of this:

NOTE: Actual error I receive right now, blurring out my domain name

And I don't know enough of HTML and JS to figure this out beyond it's missing something it's looking for. I did get it to load once, where the icons for the various apps loaded, but clicking on any of them yielded similar errors.

The tutorials I tried (formatting and reloading the OS between attempts):

1. Official documentation
2. How To Forge
3. Make Tech Easy

Option 3 was the clearest tutorial by far, but I still ran into issues. I followed each step exactly and still can't seem to figure this out. Does anyone have a second set of eyes and point out what I'm clearly doing wrong? I don't think I missed any steps in my multitude of attempts, but clearly I am.

I know I can pay someone to host it or use a public instance, but I'd really like to know what I missed so I can learn from it.

Please advise me, where i can place a mini computer such as Raspberry Pi, in data center, I mean. No matter where, send them my computer and let them install it in the rack?!

since the weather is going to start getting colder, i’ve been looking ahead and trying to plan out some projects that i want to work on over the winter. mostly, network service projects, ai server build, home assistant stuff, various 3d printer projects, etc. and i’m looking for a way to keep all the notes and files in a main “notebook” type of system. i’ve got gitea setup and nextcloud, ( and most common network services). i was looking at openproject, but that seems WAY to much for what i need, focalboard looks kind of interesting though.

basically, i’d like to be use git for all file storage, but with a more complete frontend. or integrations with nextcloud, i was thinking of trying to piece something together using gitea actions or node-red (i’m VERY new to both, so this would be an adventure), but before i head down that rabbit hole, i’d like to know if there is a better, easier, more complete option?

Multiple people have been asking about it, so the support for self-hosting using docker is added.

The quickest way to get it up and running is using docker-compose: https://github.com/RikudouSage/LemmySchedule/#docker-compose

In the coming days I'll be adding support for locking the app to a single instance only, meaning if you self host it alongside your Lemmy instance, only people from your own instance will be able to use it.

Edit: The hosted version is at https://schedule.lemmings.world and the support forum is at !schedule@lemmings.world

Figure I'd ask here, but I'm looking to set something up for email in the future, I'm looking into custom domains so that if something happens with one email account, then I have more security in mind to pick up from there as opposed to being screwed.

I know that fully self hosting email full stop is usually not recommended, so I'm up for any advice anyone has on that end.

It is always a struggle configuring a cronjob to run certain scripts; there is always a mis configuration, a PATH, an environment variable that is different from when you use it in interactive mode, etc.. Do you have any tricks to avoid or minimize those issues?

cc @selfhost@lemmy.ml

There have been users spamming CSAM content in !lemmyshitpost@lemmy.world causing it to federate to other instances. If your instance is subscribed to this community, you should take action to rectify it immediately. I recommend performing a hard delete via command line on the server.

I deleted every image from the past 24 hours personally, using the following command: sudo find /srv/lemmy/example.com/volumes/pictrs/files -type f -ctime -1 -exec shred {} \;

Note: Your local jurisdiction may impose a duty to report or other obligations. Check with these, but always prioritize ensuring that the content does not continue to be served.

Update

Apparently the Lemmy Shitpost community is shut down as of now.

So I got a warning that nginx proxy manager hadn't been renewing my certificates for a while tonight.

Tried to renew them manually.

It broke, everywhere, badly. Ended up reinstalling from scratch, even on a different machine, but it Would Not Work. Kept throwing internal NPM errors.

Is it currently broken? I've resorted to a manual nginx config for now. but it's not ideal. Anyone else seeing flakiness from nginx proxy manager?

I'd like to be somewhat vague because my job is somewhat niche. For my job I made custom products that are made up of subcomponents that cost me either by the foot, by the pair, or individually. So a particular product may include 5 feet of X, Y and Z, a pair of V and 1 of T and U. Then I add a bit for profit.

Right now I have a somewhat simple spreadsheet that has all my components and their costs listed which are then referenced on other sheets. The problem is adding or removing components is a real pain in the ass because I'd have to edit each and every sheet.

I'd like a better system where I can create a new product then from a drop down or something pick all the relevant components and enter how many of that component I need. Then create a quote that I can email to a client that lists the final cost of a bunch of products.

I'd prefer this to be a, open source web app but it can be a desktop application.

For example, I prefer to use a VPN instead of port forwarding. And I use SSH for anything I used to use an FTP for.

About a year and a half ago I posted a script I made for deleting movie content in your library not being watched. Folks really seemed to like it, and I still get comments on that thread every so often. So I've updated it!

Far and away, the two biggest requests I got were:

• Make it do TV, too
• Make a dry-run mode
• Edit: Added just now: a protected mode when you volume mount a protected file!

The code is now available on github here:

https://github.com/ASK-ME-ABOUT-LOOM/purgeomatic

Even better, no installation is required. You can run it as a docker container like so:

docker run --rm -it --env-file .env --network=host ghcr.io/ask-me-about-loom/purgeomatic:latest python delete.movies.unwatched.py

It now supports TV series as well. Thanks to a suggestion from /u/JimLahey-, I was able to get my head around the idea - I had always thought of managing TV shows as "collections of seasons" of media, but the reality is, if nobody has watched anything related to a TV show in a while, the whole thing can go! And that's what this does:

docker run --rm -it --env-file .env --network=host ghcr.io/ask-me-about-loom/purgeomatic:latest python delete.tv.unwatched.py

No more editing python, either. Create yourself a .env file, set up all of your config, and even enable dry run mode, so you can test to your heart's content:

$ docker run --rm -it --env-file .env --network=host ghcr.io/ask-me-about-loom/purgeomatic:latest python delete.movies.unwatched.py
DRY_RUN enabled!
--------------------------------------
2023-08-25T12:40:57.288608
DRY RUN: Chaos Walking | Radarr ID: 1445 | TMDB ID: 412656
DRY RUN: Captain Marvel | Radarr ID: 885 | TMDB ID: 299537
DRY RUN: Captain America: Civil War | Radarr ID: 1768 | TMDB ID: 271110
DRY RUN: Black Widow | Radarr ID: 1517 | TMDB ID: 497698
DRY RUN: Birds of Prey (and the Fantabulous Emancipation of One Harley Quinn) | Radarr ID: 1092 | TMDB ID: 495764
DRY RUN: Bill & Ted's Excellent Adventure | Radarr ID: 1777 | TMDB ID: 1648
DRY RUN: Bill & Ted's Bogus Journey | Radarr ID: 1778 | TMDB ID: 1649
DRY RUN: Big Hero 6 | Radarr ID: 71 | TMDB ID: 177572
DRY RUN: Big | Radarr ID: 71 | TMDB ID: 177572
DRY RUN: Batman Begins | Radarr ID: 1745 | TMDB ID: 272
DRY RUN: Assault on Precinct 13 | Radarr ID: 1212 | TMDB ID: 17814
DRY RUN: 21 Jump Street | Radarr ID: 1096 | TMDB ID: 64688
Total space reclaimed: 164.88GB

To use protected mode, just create a text file with one TMDB/TVDB ID per line and volume mount it as /app/protected like so:

docker run --rm -it --env-file .env --network=host -v /home/user/protected:/app/protected ghcr.io/ask-me-about-loom/purgeomatic:latest python delete.movies.unwatched.py

Good luck! Please let me know if you have questions or problems and I'll do my best to help out!

I"m relatively new to self-hosting and I have an instance on Oracle cloud with a few apps that I run. More recently this instance is becoming unresponsive every 30 minutes or so. It becomes impossible to SSH to it and any connection to it is dropped. Oracle Cloud says that it is unresponsive, forcibly rebooting it fixes the issue until it becomes unresponsive again in 30 minutes. I believe the most major thing I did since this started was installing Java and doing an "apt update" followed by "apt upgrade" after many months of not doing it. I have tried to turn off every service that I have running using pm2 and systemctl. No luck. Are there any tools that I can use to better understand why it is freezing like that?

Edit: I ran the following command systemctl --type=service --state=running And noticed there was a Gnome Display Manager that was running and I wasn't using it. After disabling this service with systemctl disable [servicename] The server stopped crashing. Thanks for all the replies!

hey all, i'm looking to replace my isp's router (i know that i can, it's basically just DHCP on a specific VLAN) with my own one and i'm looking for recommendations.

here's what i would need out of it:

• best price-to-performance ratio. the larger the NAT table it can keep in RAM the better (i run some things akin to ipv4 scanning)
• OpenWRT support
• at least one sfp port for internet access, supporting 5Gb/s.
• at least one 1 Gb/s ethernet port
• ideally 2-3 100Mb/s ethernet ports
• wifi support: yes (don't need anything fancy, even 5GHz is optionnal but preffered)
• LTE modem: dont care but nice to have

i had a look around the OpenWRT supported devices table but since it doesn't really list ports and i need sfp, it takes a long time to go through and read german router pages.

can anyone recommend a router that meets these at least partially?

My main server is named Postulate (an idea that you assume for the sake of argument), my desktop is named Axiom (a proved postulate), and my backup server is named Corollary (an idea that follows from an axiom).

What are your computers named, and why?

Soon, I'll need to increase the storage capacity of my Lemmy server. I use a Digital Ocean VPS running Debian 11. I don't really need to increase the RAM, CPU, or other core system resources so I planning on adding some block storage to my VPS. My question is: How can I tell Lemmy/Pict-rs to store/retrieve new data here without losing my existing data?

Assume the volume will be positioned on /mnt/vol-1.

Thanks in advance!

I recently stood up a new file server using ZFS on linux. I'd like to automate the disk checking in such a way that I can essentially ignore and have a service notify me when SMART or other indications are hitting failure or pre-fail levels.

I'm not looking for a fancy GUI or web UI - a plain old config file would suit me just fine. In my ideal world, it would be a container I could simply spin up with minimal configuration, but I'm willing to give anything a try.

I'm pretty new in this space, and have been tinkering around with some self-hosting for the last month or so, via Docker on an Ubuntu host. I'm pretty comfortable with Linux, but trying to learn reverse-proxy stuff. So, I thought my next project would be Vaultwarden, but I want to be able to access it from outside the network, and I need SSL working. I have gotten other dockers to be accessible from outside (http://bookstack.oaf.monster) using nginx manager, but the two I've tried with SSL (vik.oaf.monster and vault.oaf.monster) give me 502 Bad Gateway errors. So I know I'm configuring something incorrectly. Been trying to fix this as I've had time for the last week, and finally deciding I need to reach out for help! Any notes/tips/ideas are appreciated.

First and foremost, here's what I see in the error log for nginx:

2023/08/21 16:54:29 [error] 3049756#3049756: *95695 SSL_do_handshake() failed (SSL: error:1408F10B:SSL routines:ssl3_get_record:wrong version number) while SSL handshaking to upstream, client: 10.23.0.32, server: vault.oaf.monster, request: "GET / HTTP/2.0", upstream: "https://10.23.0.220:8006/", host: "vault.oaf.monster"
2023/08/21 16:54:29 [error] 3049756#3049756: *95695 SSL_do_handshake() failed (SSL: error:1408F10B:SSL routines:ssl3_get_record:wrong version number) while SSL handshaking to upstream, client: 10.23.0.32, server: vault.oaf.monster, request: "GET /favicon.ico HTTP/2.0", upstream: "https://10.23.0.220:8006/favicon.ico", host: "vault.oaf.monster", referrer: "https://vault.oaf.monster/"

I see it says wrong version number, but admittedly I have no idea what to do with that. Not experienced enough in SSL.

My NGINX config file for vaultwarden (I know how to use cat, but I don't know how to manually edit this file if I need to... no vi on the docker!):

[root@docker-bf5d51784409:/data/nginx/proxy_host]# cat 7.conf
# ------------------------------------------------------------
# vault.oaf.monster
# ------------------------------------------------------------

server {
  set $forward_scheme https;
  set $server         "10.23.0.220";
  set $port           8006;

  listen 80;
listen [::]:80;

listen 443 ssl http2;
listen [::]:443 ssl http2;

  server_name vault.oaf.monster;

  # Let's Encrypt SSL
  include conf.d/include/letsencrypt-acme-challenge.conf;
  include conf.d/include/ssl-ciphers.conf;
  ssl_certificate /etc/letsencrypt/live/npm-4/fullchain.pem;
  ssl_certificate_key /etc/letsencrypt/live/npm-4/privkey.pem;

    # Force SSL
    include conf.d/include/force-ssl.conf;

  access_log /data/logs/proxy-host-7_access.log proxy;
  error_log /data/logs/proxy-host-7_error.log warn;

  location / {
    # Proxy!
    include conf.d/include/proxy.conf;
  }

  # Custom
  include /data/nginx/custom/server_proxy[.]conf;
}

This is my docker-compose for vaultwarden, in case it's relevant:

version: '3'

services:
  vaultwarden:
    image: vaultwarden/server:latest
    container_name: vaultwarden
    restart: unless-stopped
    environment:
      DOMAIN: "https://vault.oaf.monster"  # Your domain; vaultwarden needs to know it's https to work properly with attachments
    volumes:
      - ./vw-data:/data
    ports:
      - 8006:80

And lastly, I took a few screenshots and put them here... might be useful. https://imgur.com/a/JRH9jXi

What am I doing wrong? I'm open to the idea that it might be multiple things. Thanks in advance!

Tl;dr: Automatic updates on my home server caused 8 hours of downtime of all of renn.es' docker services including email and public websites