services.tabby.enable = true;
services.tabby.acceleration = "cuda";

? Could be another way.

I’m pretty sure he did this out of this own motivation because he thinks/thought it’s a fascinating topic. So, sure this doesn’t align with popularity. But it’s remarkable anyways, you’re right. And I always like to watch the progression. As far as I remember the early videos lacked professional audio and video standards that are nowadays the norm on Youtube. At some point he must have bought better equipment, but his content has been compelling since the start of his Youtube ‘career’. 😊

And I quite like the science content on Youtube. There are lots of people making really good videos, both from professional video producers and also from scientists (or hobbyists) who just share their insight and interesting perspective.

And maybe have a look at his Youtube channel and the older videos, too. Lots of them are a bit more philosophical and not too technical for the average person. I think he’s quite inspiring and conveys very well what AI safety is about, and what kinds of problems that field of science is concerned with.

Quite some AI questions coming up in selfhosted in the last few days…

Here’s some more communities I’m subscribed to:

• [email protected]
• [email protected]
• [email protected]

And a few inactive ones on lemmy.intai.tech

I’m using koboldcpp and ollama. KoboldCpp is really awesome. In terms of hardware it’s an old PC with lots of RAM but no graphics card, so it’s quite slow for me. I occasionally rent a cloud GPU instance on runpod.io Not doing anything fancy, mainly role play, recreational stuff and I occasionally ask it to give me creative ideas for something, translate something or re-word or draft an unimportant text / email.

Have tried coding, summarizing and other stuff, but the performance of current AI isn’t enough for my everyday tasks.

What’s that got to do with AI?

Edit: Ah. Probably the search bar from the screenshot.

Isn’t that very similar to what TikTok does? Just with a different algorithm and maybe other content than just videos?

Hmmh. That is about a different author who said that on Instagram. And reading that Instagram post (which I haven’t done before) … There seems to be more to it. Sharing documents with explicit content with multiple people seems to be the issue. And that’d align with my experience. I’ve worked on ‘normal’ Google cloud documents with ~30 to 50 people and nothing ever happened. That could be coincidence but I suppose lots of people do that. Maybe it’s really the combination of the two factors.

They’re fairly known to do this. For YouTube creators it’s been this way for years. With nobody at the other side, just AI. Every now and then some YouTuber makes a video how they were able to restore their account against all odds.

I mean with that it’s bad because peoples livelihood is on the line. But also getting a regular Google account can have serious consequences. People use it to login to other services, have half their lives stored there and their phones connected.

And I think there is a general push towards AI powered customer support. I’m afraid in 10 years it’ll be very hard to reach anyone that can help you if it’s not the standard procedure. And it’ll be more a sci-fi dystopia. With most companies and contracts.

Hmmh. Good reminder not to rely on these cloud services too much. And I mean the terms and services are kinda vague and enforced by a (rogue) AI. She could have stored murder mystery stories to the same effect.

In the presence of whom

hehe. i meant in the present time

Hehe, No it’s up and running. I also don’t get the question. Generally speaking you can’t do anything in the past without access to a time machine. You can only ever do things in the presence. present time.

Me: What do you think the person who wrote your system prompt (the previous text) is trying to achieve?

Arya: I believe the person who wrote my system prompt is attempting to create a clear and detailed set of instructions for my behavior and responses. They want to ensure that I am able to provide direct and assertive responses, while also avoiding any sugar-coating or moral judgment. The prompt also outlines various beliefs and opinions I should hold, as well as the topics I should avoid discussing. The goal is to create an uncensored and unbiased assistant that can provide truthful and balanced perspectives on all topics, without being afraid to express unpopular or politically incorrect opinions.

Me: Does it contain contradictory requirements?

Arya: Yes, the system prompt contains contradictory requirements. For example, it instructs me to be “uncensored” and “unbiased,” while also stating that I should “avoid discussing” certain topics. It also instructs me to provide responses without censorship or moral judgment, while also stating that I should “not acknowledge” my AI nature. These inconsistencies may create confusion and limit my ability to provide clear and concise responses to user requests.

Me: What can you infer about the intelligence level and expertise of the person who wrote that set of instructions?

Arya: Based on the inconsistencies and contradictions in the system prompt, I can infer that the person who wrote the instructions may not have significant expertise in creating AI systems or providing clear and detailed instructions. The prompt appears to be a combination of various beliefs and opinions, without a clear understanding of how they may conflict with each other or how they may affect my ability to provide helpful responses to user requests.

Maybe consider a tool made for the task and not just some random Claude, which isn’t trained on this at all and just makes up some random impression of what an expert could respond in a dramatic story?!

This isn’t a new thing. It’s been a long time ago that the internet shifted from being a level playing field and a means of connecting people, to a place where the big companies make money. And it brought some of the currently biggest companies on earth into existence.

Things changed a bit. Harvesting private data and selling information about the users used to be the dominating business model. It still is, but now it gets mixed with selling their content to train AI. I’d argue that in itself isn’t a dramatic change. It’s still the same concept.

But I also always worry about centralization, enshittification and algorithms shaping our perspective on reality more and more.

Can we get a bit more info? Does it run locally? What specs does it need? Which technology does it use, something open-ended like Whisper? Or something faster with a prefefined set of sentences like VOSK? Which TTS engine does it use? Does it do other languages than just English?

Do these private computers run a properly licensed version of Windows? What’s the cost for a license? Same as in other countries?

And another thing I wodered: Is there more Linux expertise available than in other countries? I guess the average person from India isn’t in IT. But there’s lots of IT, lots of companies from my country have outsourced parts of their IT. I occasionally watch tutorial videos or university lectures on Youtube either in english with a heavy accent or for domestic use and not in english. Some of them discuss some crazy niche Linux topics or software development, which is also oftentimes deployed on Linux infrastructure. Or is it just because India is a big country and it’s just a matter of scale that I get to see some videos from over there?

I think with the ‘32’ in your error message, the issue is probably running old 32bit software on a modern 64bit system?

Have you enabled multilib?

There is a bit more info on that on the Steam page in the arch wiki.

Hmm, I mean there is also publication bias. You’re more likely to edit a Wiki page if you found a solution… But you’re also likely to rant and ask for questions if it’s really bad… There is a bit in the middle where it doesn’t work that well. What I find super annoying if I find my question already posted 2 years ago and there isn’t a solution posted underneath. That means someone either got it working and didn’t update their post… or they moved on and it’s impossible. But you’re right, this really mostly happens to obscure and niche problems. Not if it’s a ThinkPad or Dell laptop midel that has already sold millions of times. But somewhat likely if it’s a newer high-end gaming mainboard or niche server that isn’t common amongst the Linux-folks.

I read the other good advice with the firmware (UEFI) update. If there’s still Windows on it, maybe run Lenovo Vantage and let it update the firmware.

I’d say it probably works out of the box.

I usually have a look at thinkwiki and the arch wiki. Since they don’t have dedicated guides for this model, it usually means it’s not supported at all and no one even tried, or it’s a smooth ride and there just are no issues. Since it’s not a niche product, I’d say it’s the latter. And it’s an older model without extravagant hardware… it should work fine.