Groq vs Together AI

By valuation, Groq is the larger company at $20B versus $3.3B — a 6.1x difference. Size can also be measured by team: Groq employs 300 people while Together AI has 100 employees.

Groq has raised more in total funding at $1.4B, compared to Together AI's $533.5M — a gap of $856.5M. Combined, the two companies have completed 7 known funding rounds.

Groq leads with an Awaira Score of 80/100, while Together AI sits at 77/100. That 3-point gap reflects real differences in funding, scale, and traction — it's not a vanity metric.

Groq was founded by Jonathan Ross in 2016. Together AI was founded by Ce Zhang in 2022. Visit each company's profile on Awaira for a full founder biography.

Groq: Groq is an AI infrastructure company founded in 2016 that designs and manufactures specialized processors for artificial intelligence workloads. The company's core product is the Language Processing Unit (LPU), a custom-built chip architecture optimized for inference tasks in large language models and other AI applications. Unlike traditional GPUs designed for general-purpose computing, Groq's LPUs prioritize deterministic latency and throughput for sequential AI processing, enabling faster token generation in inference scenarios. Groq has positioned itself as an alternative to NVIDIA's GPU-dominated infrastructure market, targeting enterprises requiring high-performance AI inference at scale. The company offers cloud-based access to its hardware through GroqCloud, allowing developers to run inference workloads with reduced latency compared to conventional GPU implementations. Groq operates in the competitive AI infrastructure sector, competing with established players like NVIDIA, as well as emerging alternatives including custom chip manufacturers and cloud providers developing proprietary AI accelerators. In December 2025, Nvidia and Groq announced an agreement reportedly valued at approximately $20 billion to license Groq's AI inference technology. Groq's growth trajectory reflects increasing enterprise demand for efficient inference infrastructure. Groq's LPU architecture specifically optimizes for inference latency rather than training, addressing a distinct performance bottleneck in deployed AI systems. Groq operates in the AI Infrastructure sector and is headquartered in United States. Founded in 2016 by Jonathan Ross, Groq has raised $1.4B in total funding, achieving a valuation of $20B as of its latest round. The company's funding journey includes a Series A of $30M in 2019, a Series B of $40M in 2021, a Series C of $300M in 2021, a Series D of $450M in 2023. The most recent round was led by SoftBank Vision Fund 2. With approximately 300 employees, Groq has established itself as a Acquired-stage player in the AI Infrastructure market. The company holds an Awaira Score of 80/100, reflecting its strong position across valuation, funding trajectory, team scale, and market influence. Groq competes in a rapidly evolving segment alongside other AI Infrastructure companies. Based in United States, Groq is part of a growing international AI ecosystem attracting talent and investment. The AI Infrastructure space has attracted significant investment in recent years, with companies racing to capture enterprise and consumer demand for AI-powered solutions. Together AI: Together AI is an AI infrastructure company founded in 2022 that provides cloud-based platforms for training, fine-tuning, and deploying large language models. The company operates a managed inference service and model hosting platform that enables developers and enterprises to run open-source and proprietary models at scale. Together AI's core offering allows customers to access GPU compute resources specifically optimized for LLM workloads without building infrastructure in-house. The company positions itself in the competitive inference and model deployment segment, competing with services like Replicate, Modal, and cloud providers' native ML offerings. Together AI emphasizes open-source model support and cost-efficient inference through optimized serving techniques. The platform supports popular models including Llama, Mistral, and other community-developed architectures. With $228 million in total funding and a $1.3 billion valuation as of its Series B stage, Together AI has secured substantial capital to expand its infrastructure and product capabilities. The company serves use cases spanning application development, research, and enterprise deployment scenarios. Its growth trajectory reflects increased demand for accessible LLM infrastructure alternatives to proprietary API providers, though the market remains highly competitive with low switching costs and commoditizing pricing dynamics. Together AI addresses the infrastructure gap for organizations seeking open-source LLM deployment alternatives to closed commercial APIs.

Groq got there first, launching in 2016 — that's 6 years of extra runway. Together AI didn't arrive until 2022. In AI, that kind of head start means more training data, deeper customer relationships, and a bigger talent moat.

Groq has about 300 employees; Together AI has about 100. A bigger team usually means more revenue or heavier VC backing, but in AI, small teams can build at massive scale.

Yes — they're direct rivals. Both Groq and Together AI compete in AI Infrastructure, targeting many of the same buyers. If you're evaluating one, you should be looking at the other.