SAMURAIQ DAILY: The Humane Wearable AI Pin // Nvidia's Hot New HGX H200 AI Chip

Reading time: 8.5 mins

🎊 Welcome, SAMURAIQ Readers! 🎊

🌟 As a SAMURAIQ DAILY reader, you are not just a spectator but an integral part of our digital family, walking a path with us toward a future where AI is not just a tool but a trusted ally in our daily endeavors.

Today we are looking into two hardware stories - Humane’s new wearable AI Pin and Nvidias new HGX H200 AI Chip!

MOUNT UP!

🤖⚔️ SAMURAIQ Team ⚔️🤖

Unveiling the Humane AI Pin - A Revolutionary OpenAI-Powered Wearable

Summary:

• Humane launches the AI Pin, a groundbreaking wearable for interacting with large language models.

• Priced at $699 USD with a $24 monthly subscription, preorders start on November 16th, with shipping in early 2024.

• Weighing 34 grams, the AI Pin utilizes a Snapdragon processor, voice control, gestures, and a built-in camera for diverse functionality.

• The Pin connects to AI models through the AI Mic software, featuring Microsoft and OpenAI technologies.

• Humane's goal is to simplify technology interfaces, allowing users to seamlessly interact with the Pin without traditional settings and apps.

• Key features include voice-based messaging, email summarization, nutritional information retrieval, and real-time translation, with plans for navigation and shopping capabilities.

In-Depth: Humane has officially unveiled its highly anticipated device, the AI Pin, signaling a transformative leap in the realm of wearables designed for seamless interaction with large language models. Pioneered by a team led by co-founder Imran Chaudhri, this $699 gadget, comprising a square device and a magnetic battery pack, stands out as a departure from traditional smartphones.

The AI Pin, slated for early 2024 shipment with preorders beginning on November 16th, boasts a unique combination of features. Powered by a Snapdragon processor, its functionality spans voice control, gestures, and a built-in camera capable of capturing 13-megapixel photos and videos. Weighing a mere 34 grams, the device is further enhanced by a 20-gram "battery booster" for extended usage.

Central to the AI Pin's capabilities is the proprietary AI Mic software, establishing connections with AI models. Notably, Humane mentions collaboration with industry giants Microsoft and OpenAI, emphasizing ChatGPT access as a core feature. The operating system, Cosmos, intelligently directs user queries to the appropriate tools, eliminating the need for cumbersome app management.

In line with Humane's vision to streamline technology interfaces, the AI Pin deviates from the conventional approach. Eschewing a traditional homescreen and complex settings, the device encourages users to engage through voice commands or touch interactions, creating a seamless and intuitive experience.

The unveiled features include voice-based messaging and calling, an email summarization tool ("catch me up"), nutritional information retrieval by scanning food items, and real-time translation. Although the device initially positions itself as an LLM-powered search engine, Humane plans to expand its capabilities to include navigation and shopping, with developers encouraged to contribute to this evolving ecosystem.

Humane envisions the AI Pin as the inaugural step in a broader project, anticipating improvements aligned with advancements in underlying models. While acknowledging the ongoing industry-wide quest for novel AI applications, Humane positions its device as a catalyst for a revolution comparable to the evolution of smartphones. The journey ahead involves refining hardware for an enhanced user experience, with the ultimate revolution stemming from the possibilities unlocked by the device.

Key Takeaway: The Humane AI Pin represents a pivotal stride towards a more intuitive and simplified interaction with AI models, offering a glimpse into a future where technology seamlessly integrates into daily life. As the device evolves, it has the potential to redefine user experiences, much like the transformative impact of smartphones on the tech landscape.

Jim: Intrusive? To some yes. To others, I can see this being an important part of their life. Would you prefer to wear a pin or perhaps Meta’s new Ray Ban glasses?

Nvidia Unveils Cutting-Edge HGX H200 AI Chip: Enhancing Generative AI and LLMs

Summary:

• Nvidia launches the HGX H200, a top-of-the-line AI chip, surpassing the in-demand H100.

• H200 boasts 1.4x more memory bandwidth and 1.8x more memory capacity, optimizing generative AI tasks.

• Concerns arise about chip availability, following the supply constraints of the H100.

• Release scheduled for the second quarter of 2024, with collaboration with global system manufacturers and cloud service providers.

Article:

Nvidia, a front-runner in AI technology, is set to revolutionize the industry with its latest offering, the HGX H200. This cutting-edge GPU promises enhanced capabilities for intensive generative AI work, outperforming its predecessor, the H100, with 1.4 times more memory bandwidth and 1.8 times more memory capacity.

The H200, scheduled for release in the second quarter of 2024, raises questions about its availability and potential supply constraints. Nvidia is working closely with global system manufacturers and cloud service providers to ensure accessibility, but specific production numbers remain undisclosed.

Key Features of the HGX H200:

• Memory Upgrade: The H200 introduces a faster memory specification known as HBM3e, elevating its memory bandwidth to an impressive 4.8 terabytes per second, a significant increase from the H100's 3.35 terabytes per second. Additionally, its total memory capacity sees a substantial boost, reaching 141GB compared to the 80GB of its predecessor.

• Compatibility: The H200 is designed to seamlessly integrate with systems supporting H100s, minimizing the need for alterations by cloud providers. Leading providers like Amazon, Google, Microsoft, and Oracle are expected to incorporate the H200 into their offerings next year.

• Cost Considerations: While Nvidia has not disclosed the pricing of the H200, the prior-generation H100s are estimated to range between $25,000 to $40,000 each. Pricing is determined by Nvidia's partners, indicating a potentially high cost for these state-of-the-art chips.

Amidst the excitement for the H200, concerns linger about its impact on the availability of the H100. Nvidia's spokesperson, Kristin Uchiyama, reassures that the H200's debut will not affect H100 production, emphasizing ongoing efforts to bolster overall supply.

Looking ahead, 2024 is anticipated to be a pivotal year for GPU buyers. Nvidia aims to triple H100 production, potentially reaching up to 2 million units, responding to the soaring demand driven by the explosive growth of generative AI. As the industry eagerly awaits the H200 release, Nvidia remains at the forefront of innovation, shaping the future of AI processing.

Key Takeaway: Nvidia's unveiling of the HGX H200 signifies a significant leap in AI chip technology, catering to the escalating demands of generative AI tasks. While anticipation surrounds its release, Nvidia assures customers of sustained H100 production, hinting at a more promising year for GPU buyers in 2024.

Jim: The heart of AI, Nvidia keeps on keeping on. With competition on the horizon (AMD, Intel, etc), this release looks like a homerun especially being designed to elegantly upgrade from the H100.