Nvidia has released its NeMo microservices, a set of tools designed to help developers embed AI agents into enterprise workflows. The move comes as research reveals that nearly half of businesses are seeing only minor gains from their AI investments.
NeMo microservices are part of Nvidia’s AI Enterprise suite and enable developers to build AI agents that can integrate with existing applications and services to automate tasks. The components include NeMo Curator for data gathering, NeMo Customizer for model training, NeMo Evaluator to check model improvement, and NeMo Guardrails to prevent safety and security issues.
According to Joey Conway, Nvidia’s senior director of generative AI software for enterprise, NeMo microservices work in a circular pipeline, using new data and user feedback to improve the AI model, which is then redeployed. Conway described NeMo microservices as “essentially like a Docker container,” with orchestration relying on Kubernetes.
Nvidia claims its AI toolkit has broad software support, including enterprise platforms like SAP, ServiceNow, and Amdocs, as well as AI software stacks like DataRobot and Dataiku. Examples of NeMo microservices in use include Amdocs, which is developing three types of agents for telecoms operators: a billing agent, a sales agent, and a network agent.
Developers can download NeMo microservices from the Nvidia NGC catalog or deploy it as part of the Nvidia AI Enterprise suite. The release of NeMo microservices coincides with research published in the UK, which found that businesses are spending an average of £321,000 ($427,000) on AI to improve customer experience.
Nvidia starts manufacturing AI chips for the US in Texas
The research, commissioned by Storyblok, found that 44% of business leaders reported that AI has delivered only a slight improvement, although 93% claimed their AI investment has delivered a good return on investment. The most popular use cases for AI among UK business leaders include website content creation, customer service, marketing analysis, translation services, and marketing content creation.