It’s time to start testing various Private AI models, and fortunately, the timing is just right. Meta has just released six new AI language models. These models run on-premises and do not interact with the cloud or OpenAI’s ChatGPT. Llama 3.1 405B competes with leading models like GPT-4, GPT-4o, and Claude 3.5 Sonnet, while smaller…
Category: AI/ML & vGPU
Solving Real Business Problems with Private AI: Unlocking Efficiency and Productivity
I’m on a mission to find a company facing a real problem that can be solved using Private AI—AI that operates entirely within your own data center, without relying on cloud services. I need your help to identify the most challenging, time-consuming, or tedious issues within your company that could greatly benefit from an AI…
Struggling with Crucial T705 NVMe and VMware ESXi 8. U3 Compatibility
I was so confident that the Crucial T705 4TB PCIe Gen5 NVMe M.2 SSD would work with VMware ESXi without any issues that I didn’t even bother to Google or check. I wanted to get and test what it feels like and how much of a performance boost it gives when using the fastest (R:…
AI, ML, and vGPU Server Build – Part 3: The Server Case as a Double-Decker Bus
Those two mining frames in the photo illustrate my idea well, but I plan to use a PC case and build a frame on top of it where I can easily attach different GPUs, essentially connecting 2 PC cases together. The server motherboard is secured inside the PC case, and the GPUs are openly mounted…
AI, ML, and vGPU Server Build – Part 2: Server Noise, Temperature, and Power
Noise: Server not operating: I used the Tadeto SL720 Sound Level Meter for measurement. When only the ESX-Core Server, router, and switch are turned on in my room, I measured the sound and obtained the following results. My computer desk, where I sit: 34.7 dBCabinet on the other side of the wall: 34.7 dB Right…
Supercharging the Future: My Ultimate AI, ML, and vGPU Server Build- Part 1
I am so happy that I was able to surpass my goals and got this server before the beginning of 2024. It’s hard to describe this joy. Initially, the plan was to buy and assemble this server during 2024, but fortunately, I achieved it earlier. Buying from abroad becomes many times more expensive in 2024,…
Apples-to-Apples Comparison: VMware Horizon Gaming vs. Bare-Metal Gaming
I have now played various games that are graphically demanding and the most graphically realistic games. Using VMware Horizon Direct Connect and converting the server into a PC, here is my as honest answer as I can give. First of all, I would say that I don’t consider myself a professional gamer.What attracted me to…
Cloud Gaming Experience Using the Sony HT-A7000 Dolby Atmos Soundbar, SA-RS5 Rear Speakers, and VMware Horizon
Before, I wrote about testing the Logitech Z906 5.1 speakers and Creative Labs Sound Blaster X4 sound card for True Surround sound and what that experience was like. I managed to get the surround sound working in the end, but I returned both devices because the Creative Labs Sound Blaster X4 was total junk and…
Cloud Gaming: Cooling Nvidia Tesla K80
They finally arrived. I tested them in every way possible. But honestly, they don’t work well with quiet fans and are mostly a waste of money. The best cooling method was removing the cover from the Nvidia K80 and attaching fans directly to it. Cloud Gaming: What’s it like playing the most graphically demanding games…
Tinkering with Nvidia Tesla K80 + VMware Horizon
I always wanted to give a try on Data Center GPU and now is the time to get the experience. Luckily, I found a very low price and I negotiated even little bit more down the price. I was very skeptical maybe the GPU could be broken or something wrong, because comparing with other seller…