blog

  • Image placeholder

    The Rise of Neural Processing Units: Speeding Up and Greening On-Device AI

    Ever wondered how your phone can recognize faces, understand voices, or enhance photos in a blink? Spoiler alert: It’s all thanks to super-smart tiny processors called Neural Processing Units, or NPUs. In this blog post, we’re diving into how these little wonders are making on-device AI faster and greener. Challenges of On-device Generative AI Infrastructure…

  • Image placeholder

    Deploying Large Language Models on Kubernetes: A Comprehensive Guide

    Lugging around a massive dataset and scratching your head over how to deploy your shiny new Large Language Model (LLM)? Let’s demystify that confusing jargon and get your model up and running on Kubernetes! By the end of this guide, you’ll see why Kubernetes is the go-to choice for scaling, managing, and keeping your LLM…

  • Image placeholder

    Revolutionizing Innovation: Carl Rost Unveils AI’s Role at Patsnap

    Imagine having a highly knowledgeable assistant who can answer all your intricate patent-related questions swiftly and accurately. Meet Hiro, the AI assistant developed by Patsnap, designed to revolutionize the way R&D and IP professionals navigate the world of patents and innovation data. Today, we dive into an insightful conversation with Carl Rost, Principal Consultant at…

Take your business to the next level