• 0 Posts
  • 20 Comments
Joined 3 years ago
cake
Cake day: July 4th, 2023

help-circle
  • It’s interesting to me that nowhere in the article and really nowhere in the comments does anyone raise the question of why do the Faroe Islanders do these hunts in the first place?

    Obviously people living close to the sea have always gotten large portions of their diet from seafood, so are they actually preserving and eating all of the whale/dolphin meat they are harvesting?

    If so then it doesn’t seem to me like a question of should the hunt be banned, unless we also want to discuss banning all other forms of hunting and animal husbandry.
    It seems instead that we should be asking if they are doing it less humanely than other forms of hunting or animal husbandry, and if so what can be done to reduce the whales’ suffering?



  • It can vary a lot based on what qwen model you want to run, but generally the 27b dense or 35b MoE are currently the best balance between size and capability afaik.

    If you can run two 16GB cards you can pretty much max out the context on the 27b model, but a single card like the 3060 12gb could still work well on the 35b MoE model with the excess spilling into system memory.

    I saw in another comment you have cards from the 2010’s but if they don’t have at least 8gb I wouldn’t even bother


  • It’s hard to say what exactly your requirements are in terms of VRAM/RAM from what you described here, but as a general recommendation whether AMD or Intel, I’d stick with DDR4 generation hardware. DDR5 is extremely expensive, but any non-MoE model that spills into system memory will still be frustratingly slow.

    For GPU’s the best bang for your buck if you want Nvidia is probably the 3060 12GB, it has 360GB/s memory bandwidth and one or more of those is a very reasonable starting point for local AI.
    If you’re okay with AMD there are some really unique cards floating around, I recently picked up a V620 off ebay for $350, it’s an ex-datacenter card with 32GB GDDR6 @ 512GB/s bandwidth. It’s a bit of a power hog but in my early testing it was running Qwen coder 3 30B at like 100 tokens/sec.

    I run it on an ASUS X570 PRO board which is the cheapest AM4 board I could find with an optimal PCI-E setup: three x16 slots running 4.0x8, 4.0x8, 3.0x4. I have successfully tested it with the V620, a 9060XT, and a 3060 for 60 GB total VRAM, though the third x16 is only single slot so I had to borrow a pci extender cable to try it. I’ve found 48gb VRAM is plenty for me so I doubt I’ll actually run a third card unless I find a good deal on a single slot one.

    Kinda turned into a ramble but let me know if you got questions






  • First of all like the other commenter said make sure you have all the right Immich containers running, should be 4 to 5 depending on if you have a backup container.

    In the webpage, not the app, go to server settings first, in the machine learning section check that you have facial recognition turned on and a model selected, read through in case you want to change anything else about it.
    Then secondly go to job queue and try refreshing face detection and grouping.








  • I haven’t tried Docker Desktop as the other poster mentioned but I use a similar GUI interface called Cosmos Cloud to manage Docker. It integrates a “market” of easily installable docker apps, graphic interface for managing/updating the containers, internal port management and optional reverse proxy/url management for external access, plus a few more advanced features like VPN and OIDC SSO.
    It’s probably overkill for just Jellyfin but if you’ve been considering trying out other self-hosted services I highly recommend it.

    Standalone installation is the way to go: https://cosmos-cloud.io/docs/index/