[-] zutto@lemmy.fedi.zutto.fi 3 points 3 weeks ago

I've been toying with Perplexica over the last few weeks occasionally, it feels really restrictive.

I've had to modify the internal prompts to make it generate better search terms with my SearxNG (And depending on what LLM model you use, you need to fine tune this.....) and having to rebuild the container image to do this has just been annoying. Overall, I've had experience with self-hosted LLM web searches on Open-webui, but perplexica is a fun project to try out nevertheless.

[-] zutto@lemmy.fedi.zutto.fi 3 points 4 weeks ago

On varmaa kyllä, tuolla wordpress-asennus näyttää olevan jossa on materiaalia ainakin vuodesta 2020 alkaen, mahdollisesti vielä aiempaakin sisältöä.

Kyseinen domaini on myös Hurstin Avun yhdistyksen omistuksessa, sekä Suomen yritysrekistereissä tätä käytetään Hurstin Avun sähköpostilaatikkona. (YTJ lähde)

Whois tiedotwhois hurstinapu.fi

domain.............: hurstinapu.fi status.............: Registered created............: 17.10.2013 01:52:35 expires............: 17.10.2025 01:52:34 available..........: 17.11.2025 01:52:34 modified...........: 17.9.2020 09:07:17 RegistryLock.......: no

Nameservers

nserver............: ns1.euronic.fi [185.55.84.18] [OK] nserver............: ns2.euronic.fi [185.55.84.19] [OK] nserver............: ns3.euronic.fi [92.243.21.222] [OK]

DNSSEC

dnssec.............: no

Holder

name...............: Veikko ja Lahja Hurstin Laupeudentyö ry register number....: 1980574-9 address............: Ounasvaarankuja 1 postal.............: 00970 city...............: Helsinki country............: Finland phone..............: holder email.......:

Registrar

registrar..........: Domainkeskus Oy www................: www.domainkeskus.com

Last update of WHOIS database: 20.8.2024 13:16:07 (EET) <<<

[-] zutto@lemmy.fedi.zutto.fi 2 points 1 month ago

This is a bit off-topic, but did you try to increase the JVM limits inside Yacy's administration panel?

Spoilering to hide wall of text related to this topic.This setting located in /Performance_p.html-page for example gives the java runtime more memory. Same page also has other settings related to ram, such as setting how much memory Yacy must leave unused for the system. (These settings exist so people who run Yacy on their personal machines can have guaranteed resources for more important stuff)

Other things that would reduce memory usage is to limit the concurrency of the crawler for example. There's quite a lot of tunable settings that can affect memory usage. Would recommend trying to hit up one of the Yacy forums is also good place to ask questions. The Matrix channel (and IRC) are a bit dead, but there are couple of people including myself there!

Also, theres new docs written by the community, they might help as well! https://yacy.net/docs/ https://yacy.net/operation/performance/

[-] zutto@lemmy.fedi.zutto.fi 5 points 1 month ago

Yes, I mentioned Kagi because of the Teclis search index is hosted by them.

However, most of the search results in Kagi are aggregated from dedicated search engines. (such as, but not limited to: Yandex, Brave, Google, Bing, etc.)

[-] zutto@lemmy.fedi.zutto.fi 2 points 1 month ago

Hey! I noticed this anime was being made in recent Paolo from Tokyo's video of daily life of anime director!

https://youtu.be/UCPZzEbhNJw

[-] zutto@lemmy.fedi.zutto.fi 5 points 1 month ago

OMEGATRON is that you?

[-] zutto@lemmy.fedi.zutto.fi 4 points 1 month ago

Kagi is a metasearch-engine (apart from their homebrew small-web index, known as Teclis), so the reddit lenses will continue to function long as one of the search engines it's querying is paying reddit.

[-] zutto@lemmy.fedi.zutto.fi 3 points 2 months ago

Ihmettelin myös kun Pöllölaakso purettiin, missään ei ole edes uutisoitu tästä. Rakennuskompleksi on kuitenkin sen verran tunnettu että kaikki on nähnyt videoita/sarjoja/elokuvia/uutislähetyksiä yms tästä rakennuksesta tai sen lähiympäristöstä..

Tuleepahan varmasti kauniita kerrostaloja tilalle ":)".

[-] zutto@lemmy.fedi.zutto.fi 3 points 2 months ago

Tulin ilmoittamaan että omalla osalla meni tällä copy-pastella läpi!

Kiitos!

[-] zutto@lemmy.fedi.zutto.fi 2 points 3 months ago

WeeChat! I've been using WeeChat for like 13 years now and I love it. I used to use irssi back in the days and mIRC before irssi existed.. Some bitchX experiments may have happened at some point during the shell boom too.

This remote interface is the biggest selling point to me even today, it's amazing: WeeChat-Android.

[-] zutto@lemmy.fedi.zutto.fi 3 points 3 months ago

Hi!

Great question! I don't crawl reddit, but this applies to other large sites as well. reddit themselves they have at this very moment banned the ip range where I host my Yacy at (Hetzner). I just looked up from my index that I do have 257k pages indexed from reddit through teddit I used to run, this is from before reddit api-enshittification, going to delete those right now.

And the way how the crawling is done is you define crawling depth, which limits how much content is crawled from the site.

  • 0 crawling depth = only the page you send Yacy to, nothing more.
  • 1 crawling depth = all the links on the page you send Yacy to
  • 2 crawling depth = all links on the page you send Yacy to, and all links on the pages crawled..
  • 3 ...
  • n ...

... etc.

I have my tampermonkey scripts set to only crawling depth of 1 at the moment (Just set them to 2 actually, kinda curious how much more I will be crawling), I've manually crawled some local news sites as a curiosity at the beginning. And my database is currently relatively small, only around ~86.38 gigabytes according to Yacy. This stores aproximately 2.6 million documents in Yacy's Solr.

Yacy memory & disk usage. Yacy solr index size

--

Yacy has tons of options for crawling, so you can customize how much it crawls and even filter out overly large sites with maximum number of documents set when you send Yacy there.

Large picture of Yacy's interface for starting a crawl.

--

The tampermonkey script I've been talking about in these posts, it's very simple script: https://github.com/JeremyRand/YaCyIndexerGreasemonkey

Hit me up if you guys have more questions! I'm by no means an expert on Yacy, but I will do my best to answer.

[-] zutto@lemmy.fedi.zutto.fi 4 points 3 months ago

I've been using dwm for well over 10 years now.. It just works, does what I want. Super easy to extend as well, and I can only blame myself for any bugs.

view more: ‹ prev next ›

zutto

joined 3 months ago