Groq

Groq are a super fast and efficient AI provider. The LPU™ Inference Engine by Groq is a hardware and software platform that delivers exceptional compute speed, quality, and energy efficiency. Orate supports Groq's transcription services.

Setup

The Groq provider is available by default in Orate. To import it, you can use the following code:

import { Groq } from 'orate/groq';

Configuration

You can use Groq by creating a new instance of the Groq class:

const groq = new Groq();

This will use the GROQ_API_KEY environment variable. If you don't have this variable set, you can pass your API key as an argument to the constructor.

const groq = new Groq('your_api_key');

Usage

The Groq provider provides a single interface for all of Groq's transcription services.

Speech to Text

The Groq provider provides a stt function that allows you to create a speech-to-text transcription function using Groq Whisper. By default, the stt function uses the whisper-large-v3 model.

import { transcribe } from 'orate';
import { Groq } from 'orate/groq';
 
const text = await transcribe({
  model: new Groq().stt(),
  audio: new File(...),
});

You can specify the model to use by passing it as an argument to the stt function.

const text = await transcribe({
  model: new Groq().stt('whisper-large-v3'),
  audio: new File(...),
});

You can also specify specific Groq properties by passing them as an argument to the stt function.

const text = await transcribe({
  model: new Groq().stt('whisper-large-v3', {
    temperature: 0.5,
  }),
  audio: new File(...),
});