Full Width [alt+shift+f] Shortcuts [alt+shift+k]
Sign Up [alt+shift+s] Log In [alt+shift+l]
2
A HN user asked me0 how I run LLMs locally with some specific questions, I’m documenting it here for everyone. Before I begin I would like to credit the thousands or millions of unknown artists, coders and writers upon whose work the Large Language Models(LLMs) are trained, often without due credit or compensation. Get Started r/LocalLLaMA subreddit1 & Ollama blog2 are great places to get started with running LLMs locally.
a month ago

Improve your reading experience

Logged in users get linked directly to articles resulting in a better reading experience. Please login for free, it takes less than 1 minute.

More from Abishek Muthian

Projects

Hi I'm Abishek Muthian, an indie, I write code to solve problems in health and build tools for indies to create sustainable income. Bone Health Tracker Track your bone health, Monitor the progress of your treatments. Memory Hammer What if you can remember everything you see, forever? Open Payment Host Sell what you want without paying double commissions. Gait Analyzer Analyze your gait for health disorders at the comfort of your home in your own personal computer.

2 months ago 2 votes
Apple Watch with Android

A friend passed away recently during sleep due to unknown natural causes when they were all alone in a hotel in a foreign country. I couldn't dismiss the thought that may be if they had worn a smart watch they could have had better chances of reaching out for help and perhaps even got alerted of some discrepancies in their vitals. There's no dearth of smart watches in the market offering health monitoring solutions but Apple Watch has been leading the pack in terms of accuracy of heart-rate, sleep and exercise tracking for years; In fact a 4 year old Apple Watch is more accurate than most recent commercial competitors.

2 months ago 2 votes
Restart modem automatically when Internet is down

If I have to restart my modem often like a caveman, I'll at least automate it. Years ago I would have pitied the soul which had to restart their Internet modem often, Now I'm in the situation where the ISP seems to have not heard about network reliability and so my modem hangs at least once per day. My modem is completely managed by the ISP and so there are no useful options for me to fix the issue.

2 months ago 1 votes
Get notification when a new device connects to OpenWRT

When a new device is connects to my OpenWRT router, I get a notification on Gotify. This serves as a good low-key intrusion detection along with my earlier OpenWRT login alerts. Heavy lifting was already done by Brandon McFarlin, I had to just modify the code to send messages to Gotify instead of MQTT. #!/bin/sh cat << "EOF" > /etc/hotplug.d/dhcp/90-newdev [ "$ACTION" == "add" ] || exit 0 # [ "$ACTION" == "add" -o "$ACTION" == "update" ] || exit 0 known_macs="/etc/known_macs" if !

2 months ago 2 votes

More in technology

Reading list 02/22/25

Waymo’s factory, a map of US land values, ships in the Arctic Circle, battery industry trends, and more.

13 hours ago 6 votes
How Core Git Developers Configure Git

What `git config` settings should be defaults by now? Here are some settings that even the core developers change.

17 hours ago 5 votes
WordCamp Asia and Maha Kumbh Mela

It’s been fantastic being in the Philippines for this year’s WordCamp Asia. We have attendees from 71 countries, over 1,800 tickets sold, and contributor day had over 700 people! It’s an interesting contrast to US and EU WordCamps as well in that the audience is definitely a lot younger, and there’s very little interest in … Continue reading WordCamp Asia and Maha Kumbh Mela →

20 hours ago 3 votes
Odds and Ends #59: The end of "woke capitalism"

Plus the government did the stupid thing after all.

18 hours ago 2 votes
“Trust me”

I’m not trying to send any hate at a random MacRumors forum commentor who I don’t know, so please take this more as me explaining why there’s more skepticism about the Vision Pro than other gen-1 Apple products. From the post: BTW, I also

2 days ago 3 votes