#nvidia

waynerad@diasp.org

"CUDA is still a giant moat for Nvidia"

"It's really difficult to explain to non-programmers -- or even programmers who don't deal with massive compute problems -- just how night-and-day the difference is between CUDA and its alternatives."

"Because NVIDIA controls CUDA and their GPUs, they control the entire stack. Software, firmware, and hardware. This is the same thing that gives Apple a killer advantage on their platforms. NVIDIA has the same thing, and even aside from programmer productivity/ease (which, as we've learned over the years, is itself huge), stuff in CUDA just magically works much better. Behind the scenes, CUDA performs significant optimizations."

AMD has its own "drop-in" replacement for CUDA called ROCm, but "Even if you were an ambitious PhD in computer science who is also an outstanding programmer who somehow wants to write a new AI-related library in OpenCL or Vulcan or whatever, you still wouldn't get the performance you could with CUDA (at least not without a massive amount of extra low-level programming effort)."

CUDA is still a giant moat for Nvidia - by James Wang

#solidstatelife #ai #nvidia #cuda

waynerad@diasp.org

"Tiny Corp decides to make both AMD and Nvidia versions of its TinyBox AI server" but "GeForce version is 67% more expensive".

"The TinyBox went public with much fanfare this February. Tiny Corp described it as an innovation that could help democratize PetaFLOPS-class performance for artificial intelligence. It was convinced of the AMD advantage at the time, explaining that the Radeon consumer-grade GPUs worked with superior 'full fabric' PCIe 4.0 x16 links and peer-to-peer interconnections necessary for large language models (unlike GeForce). Top performers like the AMD Radeon RX 7900 XTX were also much cheaper to buy and easier to find."

I'm always interested in the question of whether Nvidia can get some serious competition. The article goes on to recount how Tiny Corp ran into problems with their AMD GPUs.

"Fast forward to today, and Tiny Corp says that it has found a useful userspace debugging and diagnostic tool for AMD GPUs that offers some hope."

Tiny Corp decides to make both AMD and Nvidia versions of its TinyBox AI server - GeForce version is 67% more expensive | Tom's Hardware

#solidstatelife #ai #nvidia #gpus #amd #aihardware

waynerad@diasp.org

So 3 days ago (while I was watching "Boeing" videos), Nvidia had a developers conference where Nvidia CEO Jensen Huang gave a 2-hour keynote address. The video, as I write this, has over 16 million views -- maybe you are one of them? Maybe there is no reason for me to talk about any of the items in the keynote address.

If you somehow haven't seen it and are wondering what's in it, here are some of the items that got my attention.

First, he starts off saying, "I hope you realize this is not a concert. You have arrived at a developers conference." It might not be a concert, but you have to admit, Jensen Huang is one heck of a showman. His salesmanship probably accounts for a lot of the success of the company.

Moving on to some of the substance of the presentation, Nvidia is working with Ansys, Synopsys, and Cadence Design Systems to use AI to design chips. Ansys develops physics simulation software and is going to be working with Nvidia to improve its simulation systems. Synopsys and Cadence are both electronic design automation (EDA) companies -- which is to say, they sell software that is used to automate the chip design process. These do such things as logic synthesis, where you give the software high-level logic and it figures out what logic gates you need, and physical layout, where the software figures out where to locate transistors on a chip and where the wiring should go. (I don't think he mentioned, Synopsys is in the process of acquiring Ansys, so Ansys might soon disappear as a separate company.) Cadence and Nvidia are building Cadence's next supercomputer together, and Synopsis is integrating AI into its computational lithography system.

He says large language models (LLMs) are able to double in size every six months due to Nvidia chips.

He shows Nvidia's new GPU, called "Blackwell", with, he says, 208 billion transistors. Named for a mathematician named David Blackwell. He says it is made of two "dies" that are somehow stuck together to form a single "chip". He says 10 terabytes of data goes back and fourth between the two dies per second.

I remember in the mid-2000s when I first heard chips had crossed the 1-billion transistor mark. I thought that was mindblowing. 208 billion is like, I feel like I need a word more mindblowing than "mindblowing".

He says it works with the same infrastructure as their previous chip "Hopper". Can that be true? Surely it must make a lot more heat.

He talks a lot about robotics and Nvidia Omniverse and Isaac Sim.

Isaac Sim is a simulation world for training robots in simulation before they are unleashed in the real world.

Omniverse is all about "digital twins", but "digital twins" are not twins of people -- they're "twins" of factories. Basically the idea is to simulate your whole factory in a 3D simulator. The next step is to fill your real-life factory with cameras and link the factory and the simulation together, so the simulation always knows what's happening in the real factory. And link that to language models so you can ask questions in English about what's going on in your factory. Siemens, a giant industrial equipment company in Germany, is working with Nvidia for automating factories.

It's part of Nvidia's mission to "digitize" everything. Not just factories but proteins and genes, etc. A digital twin of the Earth for predicting weather.

Nvidia is launching a new service called "NIM", which stands for "Nvidia Inference Microservices". The plan is to build AlphaFold 2 for you, and lots of other models for proteins and genes and other medical and scientific application. These models are called "NIMs".

Nemo Retriever is platform for building a "digital human" chatbot for retrieving information about a topic, either serving the public, or as "co-pilots" helping employees on their jobs with information inside the company.

He shows videos of robots learning in simulation in Isaac Sim, then has humanoid robots walk out on stage. Finally he has some Disney robots called BDX robots walk out on stage, which are super cute.

"They're powered by Jetson. Little Jetson robotics computers inside. They learn to walk in Isaac Sim."

Throughout the whole presentation, he's making grandiose predictions for the future about how everything everywhere is going to "be robotic". Nvidia's decades of past success, not just Jensen Huang's showmanship, make such predictions credible.

GTC March 2024 Keynote with NVIDIA CEO Jensen Huang - NVIDIA

#solidstatelife #ai #gpus #nvidia #eda #omniverse #isaacsim #ansys #synopsys #cadence #siemens

anonymiss@despora.de

#NVIDIA sued for stealing #trade secrets after screensharing blunder showed rival #company's #code

source: https://www.engadget.com/nvidia-sued-for-stealing-trade-secrets-after-screensharing-blunder-showed-rival-companys-code-063009605.html

NVIDIA is facing a lawsuit filed by French automotive company #Valeo after a screensharing blunder by one of its employees. According to Valeo's complaint, Mohammad Moniruzzaman, an engineer for NVIDIA who used to work for its company, had mistakenly showed its #source code files on his computer as he was sharing his screen during a meeting with both firms in 2022. Valeo's employees quickly recognized the code and took #screenshots before #Moniruzzaman was notified of his mistake.

enter image description here


#crime #fail #economy #justice #software

prplcdclnw@diasp.eu

Why Big Tech, Cops, and Spies Were Made for One Another

by Cory Doctorow

The American surveillance state is a public-private partnership.

https://theintercept.com/2023/10/16/surveillance-state-big-tech/

The techlash has finally reached the courts. Amazon’s in court. Google’s in court. Apple’s under EU investigation. The French authorities just kicked down Nvidia’s doors and went through their files looking for evidence of crimes against competition. People are pissed at tech: about moderation, about monopolization, about price gouging, about labor abuses, and — everywhere and always — about privacy.

#privacy #surveillance #security #doctorow #cory-doctorow #monopoly #spying #surveillance-capitalism #surveillance-economy #nsa #snowden #prism #amazon #google #facebook #nvidia #apple #spies#big-tech #cops

faab64@diasp.org

A shocking new discovery about China's successful ability to manufacture 7nm System on Chip in a local factory, based on domestic CPU and GPU architecture.

The technology blogs and "experts" are all in shock, because they had no idea what China was able to produce such advanced SoC like "Huawei's HiSilicon Kirin 9000S" that is powering the company's flagship mobile phone P60 Pro.

Ever since the US started the campaign to sanction and boycott Huawei a few years ago, the company has turned away from using American based products and any technology that could be controlled by the American/Western sanctions.

The impressive (yet not so fast with today's levels) SoC is nothing but a wake up call for the western companies dominating the #CPU, #GPU and #SoC market, from #Intel, to #AMD, #NVidia and of course #Qualcum.

The technology war that the US started, is not going to end well when China manages to create even more efficient and powerful CPUs to power not only expensive mobile phones, but also mid range and low cost ones as well as tablets and ultra portable tablets.

The treatment of #Russia after the War in #Ukraine and how the whole western world tried to isolate and corner Russia was a wake up call for China in so many fronts, and they seems to be making giant leaps rather than baby steps.

Huawei's HiSilicon Kirin 9000S looks to be a quite complex SoC packing four high-performance cores (one at up to 2.62 GHz and two at up to 2,150 MHz) and four energy-efficient cores (up to 1,530 MHz) based on the company's own TaiShan microarchitecture (which still looks to be found on the Armv8a ISA ) as well as the Maleoon 910 graphics processing unit operating at up to 750 MHz, based on screenshots by Huawei Central. CPU and GPU cores run at relatively low clocks compared to frequencies of Arm's cores featured in previous generations of HiSilicon's SoCs.

But low frequencies can be explained by the fact that SMIC makes the new SoC on its unannounced 2nd generation 7nm fabrication process, which could be a breakthrough for #SMIC, Huawei, and China's high-tech industry. Although TechInsights calls this fabrication technology SMIC's 2nd generation production node, state-controlled Global Times claims that China's foundry champion uses its 5nm-class manufacturing technology to make the SoC. But these two names seem to describe the same thing, which was once known as SMIC's N+2.

#Technology #SoC #Huawei #7nmTechnlogy #ChipManufacturing #China #US #Politics #Economy

https://www.tomshardware.com/news/huaweis-new-mystery-7nm-chip-from-chinese-fab-defies-us-sanctions

bliter@diaspora-fr.org

#373 - La fulgurante ascension de #nVidia - #GunhedTV

top
https://www.youtube.com/watch?v=7oCfOD8WIwA

La fulgurante ascension de nVidia

La #société fête en 2023 ses trente années d'existence et c'est l'occasion de revenir sur son #histoire trépidante !

Sommaire :

00:00:00 Jean-Jacques et Nadine
00:02:23 Propos introductifs
00:22:13 Un peu de #France et d' #Italie dans le #chipset
00:27:55 Le lancement du NV One
00:42:11 Riva la seconde chance de nVidia
00:55:41 La trahison de la mort !
01:04:39 The War is Coming #TNT vs #3Dfx
01:36:13 Le Dieu #GeForce
02:06:36 Le retour des démonstrations techniques
02:24:56 Générique de Fin

Si vous aimez mes inepties, sachez que vous pouvez aussi les lire !

Les Chroniques de Gunhed TV
Tome 1 : https://amzn.to/3PaALsR
Tome 2 : https://amzn.to/3PabkrJ
Tome 3 : https://amzn.to/3Hf0pLn
Tome 4 : https://amzn.to/3FAwz2o

Si la guerre #Amiga vs #Atari ST m'était contée
https://amzn.to/3W0hT2g

#Babes in #Video #Games
Tome 1 : https://amzn.to/40WyXsl
Tome 2 : https://amzn.to/3UMOLvI


#retrocomputer #hardware #computer #CGX #GraphicCard #Doom

danie10@squeet.me

Complete guide to Nvidia Control Panel and GeForce Experience for Windows users

Green and black background with an Nvidia RTX4090 graphics card in the middle
Whether you use AMD, Intel, or Nvidia GPUs, your graphics card comes with an application that offers additional settings to tweak your GPU. Owners of Nvidia cards have access to the Nvidia Control Panel and GeForce Experience, two programs that enable users to customize their gaming experience even more than with settings that are in individual games. While it looks like there’s lots to do in these apps, in reality most options don’t really do anything apart from a few key settings.

The story of Nvidia Control Panel and GeForce Experience is that while there are many settings to change, only a few of them will likely matter to most users. That’s actually not unique to Nvidia, as AMD’s and Intel’s driver suites are similarly filled with settings you don’t really need to worry about.

But within all those irrelevant settings, there are a few really important ones that are crucial in making your GPU as good for gaming as it can be (short of getting a brand-new one), such as enabling G-SYNC and customizing Shadowplay.

On Linux, we have a slightly simpler app called nvidia-settings for the main settings. I also have NVidia System Monitor Qt, GEForce Now and GreenWithEnvy. But I saw again this week when I bought a Stream Deck, that although the hardware is supported, the software side by manufacturers really only concentrates on the Windows platform (although this is lowly changing). I really hope this will change one day as there are plenty of Linux gamers (forced to use Windows emulators) and there is little actually wrong with Linux apart from the lack of OEM software.

Still, it is an interesting article to just understand more what most of the settings actually do.

See https://www.xda-developers.com/nvidia-control-panel-geforce-experience/
#Blog, #gaming, #nvidia, #technology