Advanced Micro Devices (AMD) has released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts (MoE) large language model trained from scratch on its Instinct MI300X and MI325X Graphics Processing Units (GPUs). This model boasts a total of 16 billion parameters, but crucially, it…
Earlier in Computing & Chips
NVIDIA's Transformer Engine is designed to accelerate the training of transformer-based artificial intelligence models by leveraging a combination of fused GPU kernels, BF16 (Brain Floating Point 16) computation, and hardware-aware FP8 (8-bit floating-point) execution.
A comprehensive tutorial has been released detailing the implementation of an end-to-end streaming 3D reconstruction pipeline using LingBot-Map. This tutorial guides users through the entire process, starting with the initial configuration of input sources, reconstruction settings, selection of pre-trained checkpoints…
JetBrains Research has open-sourced KotlinLLM, an IntelliJ IDEA plugin designed for Kotlin/JVM projects that introduces a new language feature termed "Smart macros." These Smart macros are essentially standard Kotlin function calls whose implementation is dynamically generated Kotlin code.
Nous Research has released support for its Hermes Agent to integrate with Buzz, an open-source, self-hostable workspace developed by Block. Buzz is designed to enable humans and AI agents to share the same communication channels, operating on the Nostr protocol.