What's Hot

    What Can You Trust?

    May 7, 2025

    Build a Safer Jobsite with AI and Cameras

    May 7, 2025

    Women in Construction: PPE

    May 6, 2025
    Get your Copy Today
    Facebook Twitter Instagram
    Facebook Twitter Instagram
    Connected WorldConnected World
    • SPM
    • Sustainability
    • Projects
    • Technology
    • Constructech
    • Awards
      • Top Products
      • Profiles
    • Living Lab
    Connected WorldConnected World
    Home»Artificial Intelligence»LLMs and AI at the Enterprise
    Artificial Intelligence

    LLMs and AI at the Enterprise

    Updated:October 29, 2024No Comments4 Mins Read
    Facebook Twitter Pinterest LinkedIn Tumblr WhatsApp Email
    Share
    Facebook Twitter LinkedIn WhatsApp Pinterest Email

    The opportunities gen AI (artificial intelligence) brings to most industries are significant—dare we say remarkable? But let’s be clear, there are still some challenges. For example, most LLMs (large language models) are trained on publicly available data and the vast majority of enterprise data remains untapped, and much work needs to be done to address this. And again, dare we say address this sooner, rather than later? Enter Granite 3.0, IBM’s third-generation Granite flagship language models, which was announced earlier this week at IBM’s second annual TechXchange event.

    By combining a small Granite model with enterprise data, especially using the alignment technique InstructLab—introduced by IBM and RedHat in May—IBM believes businesses have the opportunity to achieve task-specific performance that rivals larger models at a fraction of the cost. But here’s the rub. They can’t do it alone.

    At a recent analyst event IBM hosted last week, attendees (including myself) got a sneak peek under the sheet where executives shared their thoughts about what lies ahead for IBM in innovation with quantum computing, AI assistants and their consulting business.

    “I think there is so much opportunity we can go get,” Arvind Krishna, CEO, IBM says. “We need to be ready for the future. That is kind of what excites me. I am excited about our portfolio today.”

    “When we talk about a hybrid cloud from a portfolio perspective, you are going to hear us talk about three words: (trusted, comprehensiveness, and consistency),” says Brian Gracely, senior director, portfolio strategy, Red Hat.

    “IBM Consulting Advantage is our AI-powered delivery platform for IBM Consulting,” adds Eileen Lowry, IBM vice president, product management. “It is where all our assets, namely our agents, our assistants, our applications, and our methods reside.”

    “We have seen tremendous progress,” says Nick Otto, head of global strategic partnerships, IBM. “We still have a lot more to do, but when we look at some of the stats around that progress. First, almost 2,000 new transacting partners since we launched with Partner Plus stepped forward, and that was one of our main objectives. Two, almost 300,000 new badges for our ecosystems.”

    An Enterprise Workhorse

    The new Granite 3.0 8B and 2B language models are designed as ‘workhorse’ models for enterprise AI, delivering performance for tasks such as RAG (retrieval augmented generation), classification, summarization, entity extraction, and tool use. These compact, versatile models are designed to be fine-tuned with enterprise data and seamlessly integrated across diverse business environments or workflows.

    Consistent with the company’s commitment to open-source AI, the Granite models are released under the permissive Apache 2.0 license.

    The Granite 3.0 models were trained on more than 12 trillion tokens on data taken from 12 different natural languages and 116 different programming languages, using a novel two-stage training method, leveraging results from several thousand experiments designed to optimize data quality, data selection, and training parameters. By the end of the year, the 3.0 8B and 2B language models are expected to include support for an extended 128K context window and multi-modal document understanding capabilities.

    An Era of Responsible AI

    As we enter into a new era of innovation and AI, industries must also consider how they approach the use of gen AI in a way that is both responsible and ethical. A new family of Granite Guardian models permit application developers to implement safety guardrails by checking user prompts and LLM responses for a variety of risks. The Granite Guardian 3.0 8B and 2B models provide risk and harm detection capabilities.

    While the Granite Guardian models are derived from the corresponding Granite language models, they can be used to implement guardrails alongside any open or proprietary AI models.

    Certainly, this is one example of how LLMs and AI are advancing, but it is exciting to see the opportunities it opens up for the enterprise today.

    Want to tweet about this article? Use hashtags #IoT #sustainability #AI #5G #cloud #edge #futureofwork #digitaltransformation #GenAI #IBM #watsonx #IBMPartner

    5G AI Cloud Digital Transformation Edge Future of Work Gen AI Granite 3.0 IBM IBM Consulting IoT Peggy’s Tech Blog Sustainability Tech News watsonx
    Share. Facebook Twitter Pinterest LinkedIn Tumblr WhatsApp Email

    Related Posts

    What Can You Trust?

    May 7, 2025

    Build a Safer Jobsite with AI and Cameras

    May 7, 2025

    Women in Construction: PPE

    May 6, 2025

    Success Stories: Customized Sensors for Wildfire Prevention

    May 5, 2025

    The Rise of Prefab

    May 1, 2025

    Manufacturing in an Era of Digital Product Passports

    April 30, 2025
    Add A Comment

    Comments are closed.

    Get Your Copy Today
    2025 ASCE REPORT CARD FOR AMERICA’S INFRASTRUCTURE
    https://youtu.be/HyDCmQg6zPk
    ABOUT US

    Connected World works to expand quality of life and influence a sustainable future through digital transformation, innovation, and create opportunities all around.

    We’re accepting new partnerships and radio guests right now.

    Email Us: info@specialtypub.com

    4611 Hard Scrabble Road
    Suite 109-276
    Columbia, SC  29229

     

    Our Picks
    • What Can You Trust?
    • Build a Safer Jobsite with AI and Cameras
    • Women in Construction: PPE
    Specialty Publishing Media

    Questions? Please contact us at info@connectedworld.com

    Press Room

    Privacy Policy

    Media Kit – Connected World/Peggy Smedley Show

    Media Kit – Constructech

    Facebook Twitter Instagram YouTube LinkedIn
    © 2025 Connected World.

    Type above and press Enter to search. Press Esc to cancel.