Groq Integrations with Bit Flow – Run Fast AI Inference Automatically

Groq Integrations: Groq is a high-performance AI inference platform known for its lightning-fast processing speeds, powered by proprietary LPU (Language Processing Unit) hardware. It enables developers and businesses to run large language models (LLMs) like Llama, Mixtral, and Gemma with ultra-low latency, making it ideal for real-time applications such as chatbots, live content generation, and interactive AI tools.

In this guide, we’ll walk you through the Groq integrations using Bit Flows. While we’ll use Bit Form as the trigger in this example, you can choose any trigger that suits your needs. Once the setup is complete, data from each form submission will be automatically sent to Groq for processing or generating a response.

This beginner-friendly tutorial takes you through each step, making it simple to build your first AI-powered automation using Bit Flows and Groq.

Authorization of Groq Integrations

To set Groq as an action in Bit Flows, first open your Bit Flows Dashboard, then either create a new flow or open an existing one. In the Flow Builder, click the plus (+) icon to add an action. From the list of available apps, search for and select Groq.

After selecting your preferred action, the next step is to choose an event. For example, in this case, we’ve selected the “Create Chat Completion” event.

After selecting the action event, a new popup will appear. Here, you need to connect your Groq account. If you’ve already connected Groq before and want to use the same account, simply select it from the “Select Connection” dropdown. If not, click on “Add Connection” to create a new one.

When you click the Add Connection button, you’ll be asked to enter a name for your connection and provide your token in to Value field.

To get your Groq API Token you can click here or follow these steps:

• Go to Groq AI Studio
• Click on “API Key” in the top-right corner
• Click “Create API Key”
• Choose your existing project name and expire date
• Click “Create API Key”
• Once the key is generated, copy it
• Paste the copied key into the Value field in Bit Flows

After entering your token, click on Connect. Once connected successfully, a popup will appear where you can configure the integration settings and map the fields.

Model: Select the Groq model you want to use for this integration.

After selecting you can put Max Tokens Returned and if you want to Get Unique Response click on it and put Memory Key and Context Length

Click on add message

Add user roll from the dropdown menu

Message: Enter the message you want to send to Groq. You can also map available form fields to include dynamic content in the message. Additionally, you can use Flow, Math, String, and System functions to enhance your message logic.
Learn more about Field Mapping.

Advance Feature

If you want to use advanced features, first enable the “Show Advanced Features” option.

Temperature: Controls randomness in the response. Higher values (e.g., 0.8) make output more random and creative. Lower values (e.g., 0.2) make it more focused and deterministic. Range: 0-2, Default: 1.

Response Format: Specifies the format of the response. Messages’ must contain the word ‘json’ in some form, to use ‘response_format’ of type ‘json_object’.

Top-p Sampling Value: An alternative to temperature for controlling randomness. Top-p sampling considers only the top tokens whose cumulative probability mass is p. For example, 0.1 means only tokens in the top 10% probability are considered. Range: 0-1, Default: 1.

Frequency Penalty: Positive values penalize tokens based on their frequency in the text so far, decreasing the likelihood of repeated phrases. Range: -2.0 to 2.0, Default: 0.

Seed: If specified, the system will attempt to sample deterministically such that repeated requests with the same seed and parameters return the same result. Useful for reproducibility.

Once you’ve finished these settings, you can either click the “Test Run” button to check if the integration is working correctly or simply close the popup to complete the setup.

You also have the option to test the full flow. You can either click “Listen Response” and then run the trigger event (e.g., submit the form), or use existing data to test the integration and make sure everything works correctly.

After completing all the steps, click the “Logs” icon at the top-right corner of the Flow Builder to view your integration logs. Logs help you verify if the trigger and action worked correctly and make it easier to spot and fix any issues.

That’s it! You’ve successfully set up an automation in Bit Flows to connect your trigger with Groq. Now, whenever the trigger event occurs, a message will be sent to Groq, and you’ll receive a dynamic AI-generated response based on your configuration. This completes your Groq integrations with Bit Flows, enabling smart, automated workflows powered by AI.

If you need more help or want to explore more integrations, feel free to check out our User Guide.

Check out our easy-to-follow tutorials!

• How to Integrate Groq AI with Bit Flows