Developing AI? RHEL AI’s Developer Preview is Here

Red Hat introduces Red Hat Enterprise Linux AI, featuring open-source Granite models and InstructLab for easy AI deployment.

In recent years, AI has become a central focus within the tech community, attracting significant investments and yielding highly promising outcomes.

Big tech companies are diligently crafting their own AI models, which are widely regarded as the next major technological breakthrough that will shape and propel the future of technology.

In light of this, Red Hat is once again a step ahead of its competitors in the Enterprise Linux segment by providing a dedicated platform to develop AI models. Here’s what it’s all about.

In an unexpected move towards democratizing AI development, Red Hat today announced the developer preview of its new offering, Red Hat Enterprise Linux AI (RHEL AI), promising to change how enterprises deploy AI by leveraging the power of open source.

Built on the InstructLab open-source project, RHEL AI integrates IBM Research’s Granite large language models and InstructLab model alignment tools, making it easier for domain experts without extensive data science skills to develop AI-driven applications.

Key Features of RHEL AI include:

  • Community-Driven Innovation: RHEL AI fully utilizes open-source models and knowledge, allowing users to contribute to and benefit from shared advancements.
  • User-Friendly Tools: The platform offers tools that simplify AI training and fine-tuning processes, making these technologies accessible to non-specialists.
  • Optimized for AI Hardware: Packaged in a bootable RHEL image, it supports optimized AI hardware, ensuring efficient server deployment.
  • Enterprise Support: Red Hat guarantees support and intellectual property indemnification, enhancing reliability for enterprise use.

The developer preview provides access to the Granite 7b English language base model and its LAB-aligned counterpart. Looking forward, Red Hat plans to expand the Granite model family to include specialized code models.

Moreover, the company outlined a three-step process to integrate RHEL AI into enterprise environments:

  • Step 1: Run the InstructLab CLI on a personal computer to familiarize yourself with the tools and develop initial models.
  • Step 2: To refine and enhance your models, move to more powerful hardware, such as bare metal servers or cloud VMs.
  • Step 3: For large-scale deployments, spread training across multiple nodes using OpenShift AI to enhance throughput and integration with cloud-native applications.

At the moment, Red Hat Enterprise Linux AI is available in developer preview, leveraging IBM Cloud’s GPU infrastructure for training Granite models and InstructLab.

You can start by training open-source Granite models with the InstructLab CLI on your personal laptop or desktop, or if you feel confident enough, dive directly into the RHEL AI developer preview.

For more information, visit the official Red Hat announcement or look here.

Bobby Borisov

Bobby Borisov

Bobby, an editor-in-chief at Linuxiac, is a Linux professional with over 20 years of experience. With a strong focus on Linux and open-source software, he has worked as a Senior Linux System Administrator, Software Developer, and DevOps Engineer for small and large multinational companies.

Think You're an Ubuntu Expert? Let's Find Out!

Put your knowledge to the test in our lightning-fast Ubuntu quiz!
Ten questions to challenge yourself to see if you're a Linux legend or just a penguin in the making.

1 / 10

Ubuntu is an ancient African word that means:

2 / 10

Who is the Ubuntu's founder?

3 / 10

What year was the first official Ubuntu release?

4 / 10

What does the Ubuntu logo symbolize?

5 / 10

What package format does Ubuntu use for installing software?

6 / 10

When are Ubuntu's LTS versions released?

7 / 10

What is Unity?

8 / 10

What are Ubuntu versions named after?

9 / 10

What's Ubuntu Core?

10 / 10

Which Ubuntu version is Snap introduced?

The average score is 68%