LLM Infrastructure Companies

Mosaic ML

San Francisco, United States

, based on the provided information: MosaicML develops a comprehensive platform for efficiently training and deploying large language models (LLMs), offering tools like Mosaic AI for custom model pre-training (starting at $20) and infrastructure optimized for LLM workflows. Their key innovation lies in sparse mixture-of-expert architectures, demonstrated by DBRX – an open-source 36B parameter LLM released in March 2024 and recognized as a leading-quality model in its class. Notably, MosaicML also powers ImageAI, a text-to-image diffusion model trained on Shutterstock data, showcasing their capabilities in generative AI and trusted data applications.

CacheAI Technologies provides next-generation infrastructure for AI efficiency with patented semantic caching that speeds up LLM responses by 10x.