This company designs chips ideal for AI inference tasks, which explains the outstanding growth in its revenue and earnings.

Google said this week that its research on a new compression method could reduce the amount of memory required to run large language models by six times. SK Hynix, Samsung and Micron shares fell as ...

Stanford adjunct professor and successfully exited founder Zain Asgar just raised an $80 million Series A for a startup that solve the AI inference bottleneck problem in an astute way. The round was ...

The message from Nvidia chief Jensen Huang at GTC this week is that AI is no longer about models or chips alone, but about monetizing inference at scale – where tokens become the core unit of value, ...

SAN JOSE, Calif.—Nvidia NVDA-2.17%decrease; red down pointing triangle Chief Executive Jensen Huang ushered in the Age of Inference at the company’s annual GTC event Monday, outlining a huge array of ...

Nvidia is set to continue to benefit from the surge in AI infrastructure spending. Alphabet has a huge cost advantage over rivals due its custom chips. Meta is enjoying a powerful AI-fueled flywheel ...

Foundries cannot produce the world's most advanced semiconductors without ASML's EUV technology. ASML operates in a safer business environment than TSMC. Artificial intelligence (AI) stock investors ...

Amazon Web Services plans to deploy processors designed by Cerebras inside its data centers, the latest vote of confidence in the startup, which specializes in chips that power artificial-intelligence ...

TEL AVIV, Israel--(BUSINESS WIRE)--NeuReality, a pioneer in AI infrastructure, today introduced NR-NEXUS, an inference operating system designed to power large-scale inference services. Already ...

Every GPU cluster has dead time. Training jobs finish, workloads shift and hardware sits dark while power and cooling costs keep running. For neocloud operators, those empty cycles are lost margin.

Equinix launched its Distributed AI Hub platform, which is designed to simplify and secure complex, distributed AI ecosystems for enterprises. The Hub aims to provide a single, unified framework for ...

Lightbits Labs Ltd. today is introducing a new architecture aimed at addressing one of the most stubborn bottlenecks in large-scale artificial intelligence inference: the growing mismatch between the ...