they don’t have ai…

64GB unified memory. I run it (and a lot more) on a dgx spark, but a Mac mini would suffice also.

You could prob run 4-bit version on a RTX card with 32g. Maybe even 24g. Like a 5090 or 4090 or such.

So much info out there.

I run Qwen 3.6 27B at home. For “free”. It is extremely useful.

My point being that I’m not going to be priced out of using it

Docker does by default - it only works if you use sudo. But the docs tell you to add yourself to the docker group (which requires sudo to do). Then running docker doesn’t require sudo anymore.

That seems similar to my path. Covid put me on the remote worker world, so we packed up and hit the road. Moved to a remote small town near vast nature. Bought a nice house on the river.

I’m also self employed and doing normal near retirement things. Currently on a 3-6 month contract for an ex employer in the financial space doing AI security stuff.

Then I’ll take the winter off and snowboard every day.

I’m 50 and in the process of retiring. It’s such a fitting exit. I’ll ride the slop wagon into the sunset.

Qwen 3.6 27B dense is really good. Very usable coding output

Yeah I’m familiar with some places protecting that word.

I find all the workforce productivity related academic papers in the space right now to be sensationalist and subjective. We just haven’t had enough time to let the dust fall.

Totally understand what you’re struggling with. Ppl still need to care about and understand what they’re writing and make sure things are done properly. You don’t oneshot everything.

Also, it depends on what types of systems you’re working on. Integration and glue code in backend systems is where I live most of the time. Using ai removes a lot of tedious boilerplate.

Removed by mod

Yes, that must be wonderful to live in academic world and to throw around papers and shit but down here on the ground a lot of us actually get shit done and we aren’t the delusional ones that are pretending like somethings making us faster because we don’t have the money to waste if it’s not actually making us faster.

Are you an engineer? I’m trying to get a feel for what type of people don’t think that LLMs are useful for software engine

Removed by mod

Yeah absolutely agree. In another thread I pointed out the difference between a pro using it and a novice using it.

Currently the loudest people seem to be the novices using it, even journalists? Maybe it’s just hatred and determination of people to make it sound bad to fulfill their fantasy of it sucking. Theres definitely an echo chamber effect going around also, a hivemind of “ai sucks”.

Anyhow, I like to add my experience with AI to discussions to counter all the negativity.

I’m a self employed old-timer engineer. I love the magic pattern machine box. Wish I had this back in the y2k bug fixing days.

I pay for it myself, as a business owner.

I pay for it because it solves real problems I have, and improves my quality of life.

Pretty simple for most EVs to set a schedule I’d think. My Tesla allows that so I avoid peak

No, I don’t study or review research on this subject at the moment. My personal experience is far more reliable.

Look, I’m 50 years old. Been doing this shit forever. It’s an amazing productivity enhancer for ME. I can’t say any more really. I linked unique repos that were built by me in minutes as examples.

I understand your position and your doubt since it’s pretty common opinion in the echo chambers around here. Are you a software engineer?

We can call it that if you want.

My tool to pull up syntax for very specific use cases does an amazing job smashing out code for me.

Are you asking me to reject my professional daily reality?!

You can provide sources all day, but it won’t change my reality of this being the most productivity enhancing tool since MS introduced intellisense in 1996.

If I wanted to shit on AI I could absolutely provide data to make it look like it sucks and laugh at it. It can do some really stupid shit.

In the hands of an expert, this technology is a productivity multiplier. In the hands of a beginner, this technology is a security and code quality problem. If you’re having problems controlling it, look inward.

Removed by mod

Nah I typically have it doing something else. And every 15m or so I toggle back and do next step.

Quite often Sysadmin stuff too. I have it do ansible for my pi cluster, and general cluster maintenance like check backups, troubleshoot services, create a firewall rule, etc.

I’ll also ask it research style stuff, like “check out ram usage of ai-1 box and lmk if cache is big enough for 5 concurrent full contexts. If not, change the recipe and restart it. “

Removed by mod