A HN user asked me0 how I run LLMs locally with some specific questions, I’m documenting it here for everyone. Before I begin I would like to credit the thousands or millions of unknown artists, coders and writers upon whose work the Large Language Models(LLMs) are trained, often without due credit or compensation. Get Started r/LocalLLaMA subreddit1 & Ollama blog2 are great places to get started with running LLMs locally.

Hi I'm Abishek Muthian, an indie, I write code to solve problems in health and build tools for indies to create sustainable income. Bone Health Tracker Track your bone health, Monitor the progress of your treatments. Memory Hammer What if you can remember everything you see, forever? Open Payment Host Sell what you want without paying double commissions. Gait Analyzer Analyze your gait for health disorders at the comfort of your home in your own personal computer.

If I have to restart my modem often like a caveman, I'll at least automate it. Years ago I would have pitied the soul which had to restart their Internet modem often, Now I'm in the situation where the ISP seems to have not heard about network reliability and so my modem hangs at least once per day. My modem is completely managed by the ISP and so there are no useful options for me to fix the issue.

When a new device is connects to my OpenWRT router, I get a notification on Gotify. This serves as a good low-key intrusion detection along with my earlier OpenWRT login alerts. Heavy lifting was already done by Brandon McFarlin, I had to just modify the code to send messages to Gotify instead of MQTT. #!/bin/sh cat << "EOF" > /etc/hotplug.d/dhcp/90-newdev [ "$ACTION" == "add" ] || exit 0 # [ "$ACTION" == "add" -o "$ACTION" == "update" ] || exit 0 known_macs="/etc/known_macs" if !