A HN user asked me0 how I run LLMs locally with some specific questions, I’m documenting it here for everyone. Before I begin I would like to credit the thousands or millions of unknown artists, coders and writers upon whose work the Large Language Models(LLMs) are trained, often without due credit or compensation. Get Started r/LocalLLaMA subreddit1 & Ollama blog2 are great places to get started with running LLMs locally.

Hi I'm Abishek Muthian, an indie, I write code to solve problems in health and build tools for indies to create sustainable income. Bone Health Tracker Track your bone health, Monitor the progress of your treatments. Memory Hammer What if you can remember everything you see, forever? Open Payment Host Sell what you want without paying double commissions. Gait Analyzer Analyze your gait for health disorders at the comfort of your home in your own personal computer.

A friend passed away recently during sleep due to unknown natural causes when they were all alone in a hotel in a foreign country. I couldn't dismiss the thought that may be if they had worn a smart watch they could have had better chances of reaching out for help and perhaps even got alerted of some discrepancies in their vitals. There's no dearth of smart watches in the market offering health monitoring solutions but Apple Watch has been leading the pack in terms of accuracy of heart-rate, sleep and exercise tracking for years; In fact a 4 year old Apple Watch is more accurate than most recent commercial competitors.

If I have to restart my modem often like a caveman, I'll at least automate it. Years ago I would have pitied the soul which had to restart their Internet modem often, Now I'm in the situation where the ISP seems to have not heard about network reliability and so my modem hangs at least once per day. My modem is completely managed by the ISP and so there are no useful options for me to fix the issue.

When a new device is connects to my OpenWRT router, I get a notification on Gotify. This serves as a good low-key intrusion detection along with my earlier OpenWRT login alerts. Heavy lifting was already done by Brandon McFarlin, I had to just modify the code to send messages to Gotify instead of MQTT. #!/bin/sh cat << "EOF" > /etc/hotplug.d/dhcp/90-newdev [ "$ACTION" == "add" ] || exit 0 # [ "$ACTION" == "add" -o "$ACTION" == "update" ] || exit 0 known_macs="/etc/known_macs" if !