You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Enables the rapid orchestration and reuses of the latest large model capabilities, achieves low-latency, real-time multi-modal interactions with AI Agents.
27
+
🎉 Creation of real-time multi-modal AI Agents 🎉
18
28
19
29
</div>
20
30
21
-
</br>
22
-
23
31
## Quick Start
24
32
25
33
### Playground
@@ -30,9 +38,9 @@ Enables the rapid orchestration and reuses of the latest large model capabilitie
30
38
31
39
We provide a [live playground](https://astra-agents.agora.io/) where you can experiment and interact with the Astra powered voice agent.
32
40
33
-
### Local Agent
41
+
### Run Local Agent
34
42
35
-
And of course, you are more than welcome to run our voice agent locally. We have a Docker image ready for you to build and run the agent on both macOS and Windows.
43
+
Of course, you are more than welcome to run our voice agent locally. We have a Docker image ready for you to build and run the agent on both macOS and Windows.
This should start an agent server running on port 8080.
60
68
61
-
### Use Astra.ai playground to connect to your agent
69
+
### Use the playground to connect to your agent
62
70
63
71
You can use the playground project to test with the server you just started.
64
72
65
-
The playground project is built on NextJS 14, hence it needs Node 18+.
73
+
The Playground project is built on NextJS 14, hence it needs Node 18+.
66
74
67
75
```shell
68
76
# set up an .env file
@@ -79,9 +87,7 @@ npm i && npm run dev
79
87
80
88
# Agent Customization
81
89
82
-
### Example
83
-
84
-
Our voice agent is a great place for you to get started with, it uses following Extensions:
90
+
Our voice agent is a great place for you to start with, it uses following Extensions:
85
91
86
92
-_agora_rtc_ / [Agora](https://docs.agora.io/en) for RTC transport + VAD + Azure speech-to-text (STT)
87
93
-_azure_tts_ / [Azure](https://azure.microsoft.com/en-us/products/ai-services/text-to-speech) for text-to-speech (TTS)
🎉 Congratulations! You have created your first personalized voice agent. We appreciate your effort and look forward to seeing it in the extension store. We’d love it if you could share it within the community.
143
+
🎉 Congratulations! You have created your first personalized voice agent. We appreciate your effort and look forward to seeing it in the Astra Cloud Store. We’d love it if you could share it within the community.
138
144
139
145
<br />
140
146
141
147
# Astra Service
142
148
143
-
Now let's discuss what's under the hood. The Astra Service is composed of various Astra extensions, developed in different programming languages. These extensions are interconnected using the concept of a graph, which describes their relationships and illustrates the flow of data. Furthermore, sharing and downloading extensions are simplified through the Astra cloud store and the Astra package manager.
149
+
Now let's discuss what's under the hood. The Astra Service is composed of various Astra extensions, developed in different programming languages. These extensions are interconnected using Graph, which describes their relationships and illustrates the flow of data. Furthermore, sharing and downloading extensions are simplified through the Astra Cloud Store and the Astra Package Manager.
144
150
145
151
<divalign="center">
146
152
@@ -164,7 +170,7 @@ As of June 2024, we support extensions written in the following languages:
164
170
165
171
### Graph
166
172
167
-
A graph in Astra describes the data flow between extensions, orchestrating their interactions. For example, the text output from a speech-to-text (STT) extension might be directed to a large language model (LLM) extension. Essentially, a graph defines which extensions are involved and the direction of data flow between them. Developers can customize this flow, directing outputs from one extension, such as an STT, into another, like an LLM.
173
+
A Graph in Astra describes the data flow between extensions, orchestrating their interactions. For example, the text output from a speech-to-text (STT) extension might be directed to a large language model (LLM) extension. Essentially, a Graph defines which extensions are involved and the direction of data flow between them. Developers can customize this flow, directing outputs from one extension, such as an STT, into another, like an LLM.
168
174
169
175
In Astra, there are four main types of data flow between extensions:
170
176
@@ -173,19 +179,19 @@ In Astra, there are four main types of data flow between extensions:
173
179
- Image frame
174
180
- PCM frame
175
181
176
-
By specifying the direction of these data types in the graph, developers can enable mutual invocation and unidirectional data flow between plugins. This is especially useful for PCM and image data types, simplifying audio and video processing.
182
+
By specifying the direction of these data types in the Graph, developers can enable mutual invocation and unidirectional data flow between plugins. This is especially useful for PCM and image data types, simplifying audio and video processing.
177
183
178
184
### Astra Agent App
179
185
180
186
An Astra Agent App is a runnable server-side application that combines multiple Extensions following Graph rules to accomplish more sophisticated operations.
181
187
182
-
### Astra Store
188
+
### Astra Cloud Store
183
189
184
190
The Astra Store is a centralized platform where developers can share their extensions and access those created by others.
185
191
186
192
### Astra Package Manager
187
193
188
-
The Astra Package Manager simplifies the process of uploading, sharing, downloading, and installing Astra extensions. Extensions can specify dependencies on other extensions and the environment, and the package manager automatically manages these dependencies, making the installation and release of extensions extremely convenient.
194
+
The Astra Package Manager simplifies the process of uploading, sharing, downloading, and installing Astra extensions. Extensions can specify dependencies on other extensions and the environment, and the Astra Package Manager automatically manages these dependencies, making the installation and release of extensions extremely convenient and intuitive.
0 commit comments