From d170cb00b083809654ceda29d73251217c5b8cba Mon Sep 17 00:00:00 2001 From: Bryant Date: Sat, 9 Nov 2024 15:05:10 +1100 Subject: [PATCH 1/5] update custom voices section with tavus --- fern/customization/custom-voices/tavus.mdx | 17 +++++++++++++++++ fern/docs.yml | 2 ++ 2 files changed, 19 insertions(+) create mode 100644 fern/customization/custom-voices/tavus.mdx diff --git a/fern/customization/custom-voices/tavus.mdx b/fern/customization/custom-voices/tavus.mdx new file mode 100644 index 000000000..858676e3e --- /dev/null +++ b/fern/customization/custom-voices/tavus.mdx @@ -0,0 +1,17 @@ +--- +title: Tavus +subtitle: 'Quickstart: Setup Tavus Custom Replica' +slug: customization/custom-voices/tavus +--- + + +This guide outlines the procedure for integrating your custom replica with Tavus through the VAPI platform. + +An API subscription is required for this process to work. + +To integrate your custom replica with [Tavus](https://platform.tavus.io/) using the VAPI platform, follow these steps. + +1. **Obtain a Tavus API Subscription:** Visit the [Tavus pricing page](https://platform.tavus.io/billing) and subscribe to an API plan. +2. **Retrieve Your API Key:** Go to the [API Keys section](https://platform.tavus.io/api-keys) on Tavus to get your API key. +3. **Enter Your API Key in VAPI:** Navigate to the [VAPI Provider Key section](https://dashboard.vapi.ai/keys) and input your Tavus API key under the Tavus section. +4. **Enter Your Custom Replica ID:** After adding your API key, you can select Tavus as your assistant's voice provider and add your Custom Replica ID manually through the dashboard. Alternatively, you may use the API and specify the replica ID within the `voiceId` field. diff --git a/fern/docs.yml b/fern/docs.yml index c5eb56f7c..09423b209 100644 --- a/fern/docs.yml +++ b/fern/docs.yml @@ -170,6 +170,8 @@ navigation: path: customization/custom-voices/elevenlabs.mdx - page: PlayHT path: customization/custom-voices/playht.mdx + - page: Tavus + path: customization/custom-voices/tavus.mdx - page: Custom Keywords path: customization/custom-keywords.mdx - page: Knowledge Base From e254db2a1289b1cffb462152de9c9216effacc09 Mon Sep 17 00:00:00 2001 From: Bryant Date: Sat, 9 Nov 2024 16:00:35 +1100 Subject: [PATCH 2/5] add tavus to voice providers --- fern/docs.yml | 2 ++ fern/providers/voice/tavus.mdx | 62 ++++++++++++++++++++++++++++++++++ 2 files changed, 64 insertions(+) create mode 100644 fern/providers/voice/tavus.mdx diff --git a/fern/docs.yml b/fern/docs.yml index 09423b209..3c3be0fc0 100644 --- a/fern/docs.yml +++ b/fern/docs.yml @@ -310,6 +310,8 @@ navigation: path: providers/voice/rimeai.mdx - page: Deepgram path: providers/voice/deepgram.mdx + - page: Tavus + path: providers/voice/tavus.mdx - section: Models contents: - page: OpenAI diff --git a/fern/providers/voice/tavus.mdx b/fern/providers/voice/tavus.mdx new file mode 100644 index 000000000..b66a31d06 --- /dev/null +++ b/fern/providers/voice/tavus.mdx @@ -0,0 +1,62 @@ +--- +title: Tavus +subtitle: What is Tavus? +slug: providers/voice/tavus +--- + + +**What is Tavus?** + +Tavus is a leading generative AI video research company on a mission to humanize AI. They build frontier AI models and APIs to enable developers to build digital twin experiences with video generation and real-time conversational video. + +**The Evolution of AI in Video Personalization:** + +AI-driven video personalization has transformed how businesses interact with their audiences. Early methods of personalization were limited to text or static images, but advancements in machine learning and deep learning have enabled dynamic, video-based personalization. Tavus harnesses these technological advancements to produce videos that not only replicate human likeness and voice but also deliver tailored content to each recipient, enhancing engagement and conversion rates. + +**Overview of Tavus' Offerings:** + +Tavus provides a suite of tools designed to simplify and enhance personalized video creation: + +**Automated Video Generation** + +- Tavus’ platform automates the creation of personalized videos by using a single recording. Users record a base video, and the AI technology modifies it to address each recipient individually. This eliminates the need for recording multiple videos, saving time and resources while maintaining a personal touch. + +**Deepfake Technology with Ethical Safeguards:** + +- Utilizing advanced deepfake technology, Tavus can mimic a user's facial expressions and voice to create realistic video messages. The platform is designed with ethical considerations in mind, implementing safeguards to prevent misuse and ensure that content is used appropriately and consensually. + +**Integration Capabilities:** + +- Tavus offers seamless integration with various customer relationship management (CRM) systems and marketing tools. This allows businesses to incorporate personalized videos into their existing workflows, enhancing campaigns without disrupting established processes. + +**Use Cases for Tavus:** + +Tavus’s technology is versatile and applicable across multiple sectors: + +**Marketing and Sales Outreach:** + +Personalized videos can significantly improve open rates and engagement in email marketing campaigns. By addressing recipients by name and tailoring content to their interests, businesses can create more meaningful connections with potential customers. + +**Customer Engagement:** + +In customer support and account management, personalized videos can enhance communication by providing tailored updates, tutorials, or thank-you messages. This personal touch can improve customer satisfaction and loyalty. + +**Recruitment and Onboarding:** + +Companies can use Tavus to create personalized recruitment messages or onboarding materials for new employees, making the hiring process more engaging and welcoming. + +**Impact on Business Communication:** + +Tavus is redefining business communication by making personalized video content scalable and accessible. By automating the personalization process, businesses can reach a larger audience with tailored messages without the prohibitive time and cost traditionally associated with personalized video production. This advancement enables companies to stand out in crowded markets and foster stronger relationships with their audiences. + +**Innovation and Research:** + +Tavus is committed to ongoing innovation in AI and video technology. The platform continually evolves to improve the realism of generated videos and expand the range of customization options. Research efforts focus on enhancing the AI's capabilities while ensuring ethical standards are upheld. + +**AI Safety and Ethics:** + +Ethical use of AI is a core principle for Tavus. The company implements strict guidelines and technical measures to prevent misuse of its technology, such as unauthorized impersonation. User consent and data protection are paramount, and Tavus complies with relevant regulations to safeguard personal information. + +**Integrations and Compatibility:** + +Tavus’ API and platform integrations enable easy incorporation of personalized video capabilities into existing systems. Whether it's integrating with email marketing platforms, CRM systems, or custom applications, Tavus provides the flexibility needed to enhance communication strategies effectively. From 53065b9df2feae3915bc07a5c1f5009b2c4c1753 Mon Sep 17 00:00:00 2001 From: Bryant Date: Mon, 11 Nov 2024 16:04:13 +1100 Subject: [PATCH 3/5] add video tutorial iframe link --- fern/customization/custom-voices/tavus.mdx | 12 ++++++++++++ 1 file changed, 12 insertions(+) diff --git a/fern/customization/custom-voices/tavus.mdx b/fern/customization/custom-voices/tavus.mdx index 858676e3e..6bb6c0f65 100644 --- a/fern/customization/custom-voices/tavus.mdx +++ b/fern/customization/custom-voices/tavus.mdx @@ -15,3 +15,15 @@ To integrate your custom replica with [Tavus](https://platform.tavus.io/) using 2. **Retrieve Your API Key:** Go to the [API Keys section](https://platform.tavus.io/api-keys) on Tavus to get your API key. 3. **Enter Your API Key in VAPI:** Navigate to the [VAPI Provider Key section](https://dashboard.vapi.ai/keys) and input your Tavus API key under the Tavus section. 4. **Enter Your Custom Replica ID:** After adding your API key, you can select Tavus as your assistant's voice provider and add your Custom Replica ID manually through the dashboard. Alternatively, you may use the API and specify the replica ID within the `voiceId` field. + +**Video Tutorial:** +