Suno AI: How To Create Generative AI Music

All Your Tech AI
21 Dec 202307:51

TLDRMicrosoft's co-pilot has been updated with a music creation feature in partnership with sunno, a company aiming to democratize music creation. The feature allows users to generate songs using AI, with a plugin on co-pilot's platform. Users can access a preview of the song, but full access requires a premium subscription on sunno's website. Co-pilot, built on Microsoft's foundational framework and GPT-4, offers this unique feature not available on regular chat GPT. There's a daily limit to song creations, and users can also customize songs with their lyrics or choose from trending ones.

Takeaways

  • 🎵 Microsoft co-pilot has integrated a music creation feature through a partnership with a company called Sunno.
  • 🌟 Sunno's vision is to enable anyone to create great music, regardless of their musical background, using just their imagination.
  • 🤖 The team behind Sunno consists of musicians and AI experts based in Cambridge, Massachusetts, with backgrounds in pioneering tech companies like Meta and TikTok.
  • 📖 Sunno has an open-source project called Bark, a Transformer-based text-to-audio model that generates realistic multilingual speech and other audio types, including music.
  • 🔗 The original Bark model is available on GitHub, but it is not the model used in the co-pilot integration; instead, it is presumably a new model called Chirp.
  • 🚀 Co-pilot is built on Microsoft's foundational framework and uses GPT-4, the same model as the premium version of ChatGPT, but fine-tuned with Microsoft's training data.
  • 🎮 To access the music creation feature, users go to co-pilot.microsoft.com, enable the Sunno plugin from the plugins section, and can then request song creations.
  • 💡 Co-pilot generates a 34-second song preview using the Sunno plugin, with the option to subscribe to Sunno's premium service for full songs.
  • 🚫 There is a daily limit to the number of song creations per user, which resets daily.
  • 🎤 Users can customize their music by adding their own lyrics, choosing a music genre, and creating a title, in addition to generating random lyrics and exploring trending songs created by others.

Q & A

  • What is the new feature added to Microsoft co-pilot?

    -Microsoft co-pilot has been updated with a Music Creation feature integrated through a partnership with a company called sunno.

  • What does sunno specialize in?

    -Sunno specializes in building a future where anyone can make great music, regardless of their musical background, by breaking barriers between individuals and the songs they dream of making, requiring no instruments, just imagination.

  • Where is sunno's team based?

    -Sunno's team of musicians and artificial intelligence experts is based in Cambridge, Massachusetts.

  • What is bark, and how does it relate to sunno's projects?

    -Bark is an open-source Transformer-based text-to-audio model created by sunno. It can generate highly realistic multilingual speech and other audio, including music, background noise, and simple sound effects. However, it is not the model powering sunno's integration with Microsoft co-pilot.

  • How can you access the music creation feature on Microsoft co-pilot?

    -To access the music creation feature, you need to go to copilot.microsoft.com, enable the sunno plugin under the 'plugins' section, and then you can request the AI to make songs using the plugin.

  • What is the cost associated with generating full songs using sunno's feature?

    -To generate full songs, you need to subscribe to one of sunno's premium accounts through their Discord channel, as the free version only provides a 34-second song preview.

  • Are there any limitations to using the music creation feature?

    -Yes, there is a daily limit to the number of times you can ask the AI to create a song. Once the limit is reached, you would have to wait until the next day to use the feature again.

  • What other features does the music creation interface offer besides generating songs?

    -The interface allows users to explore trending songs created by others, create their own songs, provide feedback by thumbing up or down, remix songs, share them, and download them as audio or video files.

  • How does the custom mode in the music creation feature work?

    -In custom mode, users can either input their own lyrics or have the AI generate random lyrics, choose the style or genre of music, and create a title for the song.

  • What are the initial credits and the cost for additional credits or subscriptions?

    -Users start with 50 credits, and each song generation takes 10 credits. For more credits, users can subscribe to one of sunno's plans, starting at $8 a month for 2500 credits, which allows for the creation of about 500 songs.

  • What is the potential future impact of generative AI in music and entertainment?

    -Generative AI could revolutionize the music industry by potentially reaching the top of the Billboard charts and leading to AI-generated radio stations creating non-stop music. In the更远的未来, it could lead to text-to-movie or text-to-TV series models that create personalized content based on individual preferences.

Outlines

00:00

🎵 Microsoft Co-Pilot's Music Creation Update with Sunno

This paragraph introduces the recent update to Microsoft Co-Pilot, which now includes a music creation feature integrated with a company called Sunno. The update allows users to create music through Co-Pilot by leveraging Sunno's technology. The paragraph discusses the background of Sunno, a company aiming to democratize music creation for everyone, and its team of musicians and AI experts based in Cambridge, Massachusetts. It also touches on Sunno's open-source projects, particularly the 'bark' model, which is not the model used in Co-Pilot but is worth mentioning. The focus then shifts to how Co-Pilot, which is essentially a version of Chat GPT built on Microsoft's foundational framework and uses GPT 4, has been fine-tuned with Microsoft's training data to include this new music integration feature. The activation process for the Sunno plugin within Co-Pilot is explained, along with an example of how to generate a rap song about artificial intelligence. The limitations, such as the daily limit on song creations and the need for a premium account for full songs, are also highlighted.

05:00

🎶 Exploring Sunno's Music Creation Features and Customization Options

This paragraph delves deeper into the music creation capabilities of Sunno when integrated with Microsoft Co-Pilot. It explains how users can create a pop song about artificial intelligence and the process of generating two different variations of the song. The paragraph discusses the training data collection method through user feedback on the generated songs. It also introduces the custom mode, which allows users to input their own lyrics or generate random ones, choose the music genre, and create a title. The options for sharing, downloading the song as a video or audio, and the credit system for song generation are detailed. The paragraph concludes with a forward-looking perspective on the potential of generative AI in music, predicting its impact on the music industry and the possibility of personalized music content in the future.

Mindmap

Keywords

💡Microsoft co-pilot

Microsoft co-pilot is an AI-based service that has been updated with a music creation feature. It is essentially a version of chat GPT built on Microsoft's foundational framework and uses GPT-4, the same model utilized in the premium version of chat GPT. The integration allows users to generate music by providing text prompts, showcasing the capabilities of AI in creative tasks.

💡Sunno

Sunno is a company that focuses on AI and music, aiming to make music creation accessible to everyone regardless of musical expertise. They have integrated their music creation AI with Microsoft co-pilot, allowing users to generate songs through text prompts. Sunno's team consists of musicians and AI experts, and they also contribute to the research community with open-source projects.

💡Music Creation

Music creation in the context of the video refers to the process of generating music through AI, specifically using the integrated feature in Microsoft co-pilot. Users can input text prompts to create songs in various styles, showcasing the versatility of AI in producing creative content.

💡Bark

Bark is an open-source Transformer-based text-to-audio model created by Sunno. It is capable of generating realistic multilingual speech and other audio types, including music, background noise, and simple sound effects. Bark represents Sunno's initial contribution to the AI research community and is different from the model used in the co-pilot music creation feature.

💡Chirp

Chirp is presumably the model developed by Sunno that powers the music creation feature in Microsoft co-pilot. Although the video script mentions a 404 error when trying to access more information about Chirp, it is implied that this model is responsible for turning text prompts into music, a significant advancement in AI's application in the creative arts.

💡Artificial Intelligence (AI)

In the context of the video, AI refers to the technology that enables the creation of music through Microsoft co-pilot and Sunno's integration. AI is used to interpret text prompts and generate corresponding music, demonstrating its capability to assist in creative processes and its potential to revolutionize the music industry.

💡GPT-4

GPT-4 is the AI model used by Microsoft co-pilot for various features, including the newly integrated music creation. It is an advanced version of the open AI model that has been fine-tuned with Microsoft's training data, providing unique capabilities beyond the standard chat GPT model.

💡Plugins

In the context of the video, plugins refer to the additional features or functionalities that can be enabled within Microsoft co-pilot. One such plugin is Sunno, which allows users to create music through AI-generated content based on text inputs.

💡Discord Channel

The Discord Channel mentioned in the video is a communication platform used by Sunno for user interaction and support. It is where users can subscribe to premium accounts to access the full capabilities of the music creation feature, beyond the limited previews provided in co-pilot.

💡Daily Limit

The daily limit refers to the restriction on the number of times a user can request music creation through the co-pilot platform. This limit is in place to manage server resources and prevent overuse of the AI music generation service.

💡Custom Mode

Custom mode is an option within the music creation feature of co-pilot that allows users to further personalize their music by adding their own lyrics, selecting a music genre, and creating a song title. This mode provides a higher level of control over the creative output.

💡Credits

Credits in the context of the video are a form of virtual currency used within the co-pilot platform to generate music. Users start with a certain number of credits, and each song generation consumes a specific amount of these credits. Additional credits can be purchased through subscriptions.

Highlights

Microsoft co-pilot has been updated with a Music Creation feature.

The music creation feature is a result of integration with a company called sunno.

Sunno aims to make music creation accessible to everyone, regardless of musical expertise.

Sunno's team consists of musicians and AI experts based in Cambridge, Massachusetts.

Sunno has open-source projects, including one called 'bark', a text-to-audio model.

Bark can generate realistic multilingual speech and various audio types, including music.

Sunno's new text-to-music model is called 'chirp', but its examples page currently leads to a 404 error.

Co-pilot is essentially Chat GPT built on Microsoft's foundational framework and uses GPT 4.

Co-pilot has unique features not available in Chat GPT, including the new music integration.

Activating the music creation feature is done through the Co-pilot website under plugins.

Once the sunno plugin is enabled, users can request Co-pilot to make songs.

Co-pilot generates a 34-second song preview using the sunno plugin.

Full songs require a subscription to sunno's premium accounts via their Discord channel.

There is a daily limit to the number of song creations with Co-pilot's music feature.

Co-pilot can also create songs through its 'make a song' feature with trending songs and custom creations.

Users can provide feedback on generated songs, which helps improve the AI model.

Custom mode allows users to input their own lyrics or generate random ones, choose music genres, and create titles.

New users are given 50 credits, with each song generation costing 10 credits.

Sunno offers subscription plans starting at $8 a month for 2500 credits to create about 500 songs.

The future may see generative AI music reaching the top of the Billboard charts and continuous AI-generated radio stations.

The technology could eventually lead to text-to-movie or text-to-TV series models, personalized content creation.