[rangatang]

Wouldn't it just be a better option to run an Offline AI with Ollama with either an uncensored Llama or Mistral model on their repository, or code your own with custom markdown files?

Perhaps. Fast moving space. Time and tech will tell.

[Korvidius]

Wouldn't it just be a better option to run an Offline AI with Ollama with either an uncensored Llama or Mistral model on their repository, or code your own with custom markdown files?

Perhaps. Fast moving space. Time and tech will tell.

The only constant is that with more parameters, the more memory and GPU processing capability required. The more processing power required, the more electricity. So either you're going to be running a mid PC with an 7B model, or a high end gaming pc with a 21B model or faster. The more parameters, the more accurate.

[Oni]

Moved to the Artificial Intelligence section.

[Snickerdoodle]

Wouldn't it just be a better option to run an Offline AI with Ollama with either an uncensored Llama or Mistral model on their repository, or code your own with custom markdown files?

Perhaps. Fast moving space. Time and tech will tell.

The only constant is that with more parameters, the more memory and GPU processing capability required. The more processing power required, the more electricity. So either you're going to be running a mid PC with an 7B model, or a high end gaming pc with a 21B model or faster. The more parameters, the more accurate.

People are already having issues with AI's need for water consumption. If there were any major upgrades in terms of processing power, it would have to change its format and structure to be able to compensate for its limitations today. For home devices, it would power creep to an extent to where users would need higher spec pc's to operate it or pay higher costs on subscriptions to access newer AI models.

[max24x]

This is only AI, when Quantum takes place in a larger scale, AI will be an old tech, it would require nuclear fusion to generate the necessary energy to power Quantum tech.

[Snickerdoodle]

This is only AI, when Quantum takes place in a larger scale, AI will be an old tech, it would require nuclear fusion to generate the necessary energy to power Quantum tech.

What would the estimated cost be between companies and users?

[max24x]

This is only AI, when Quantum takes place in a larger scale, AI will be an old tech, it would require nuclear fusion to generate the necessary energy to power Quantum tech.

What would the estimated cost be between companies and users?

before getting into costs, i imagine the cooling issue will be a huge one as well, they have to come up with a better way than watercooling because it won't be enough.

[Korvidius]

Perhaps. Fast moving space. Time and tech will tell.

The only constant is that with more parameters, the more memory and GPU processing capability required. The more processing power required, the more electricity. So either you're going to be running a mid PC with an 7B model, or a high end gaming pc with a 21B model or faster. The more parameters, the more accurate.

People are already having issues with AI's need for water consumption. If there were any major upgrades in terms of processing power, it would have to change its format and structure to be able to compensate for its limitations today. For home devices, it would power creep to an extent to where users would need higher spec pc's to operate it or pay higher costs on subscriptions to access newer AI models.

That's the problem, it's entirely dependent on what hardware you have which AI model you can run, how many parameters, and how much storage space it's gonna need. A low-end laptop like the one I'm using will run a 3B model fine, albeit a bit sluggish, but anything above 7B is going to need a pretty good PC to run properly.

[Snickerdoodle]

This is only AI, when Quantum takes place in a larger scale, AI will be an old tech, it would require nuclear fusion to generate the necessary energy to power Quantum tech.

What would the estimated cost be between companies and users?

before getting into costs, i imagine the cooling issue will be a huge one as well, they have to come up with a better way than watercooling because it won't be enough.

What would be possible alternatives?

[Jjsh0]

I heard there's an AI on the dark web that's completely unrestricted. Anyone know about that, and if it's even worth using?