This is what you will be building: A custom chatbot using MindsDB’s connectors to Twitter, OpenAI’s GPT-4 and custom prompts.
A simple example is this Twitter bot - @Snoop_Stein - who will reply with the appropriate context and personality to any tweets which mention him. If you haven’t tried tweeting to SnoopStein yet, check it out and tweet at your new friend and rapping physicist! See what it comes up with.
To get started:
MindsDB is a popular open-source low-code machine learning platform that helps developers easily build #AI-powered solutions. It automates and integrates top machine learning frameworks into the data stack to streamline the integration of AI into applications, making it accessible to developers of all skill levels.
Now let us show you how we built the Snoop_Stein GPT-4 bot and how you can build your own.
Let’s first see how simple it is to create a machine learning model represented as a virtual ‘AI table’ in MindsDB. In this example, we will call our GPT4 model gptbot_model.
(Bear in mind that GPT-4 API is in HIGH demand and is rate limited, so can be slow. The following steps might each take a few seconds)
CREATE MODEL mindsdb.gpt_model PREDICT response USING engine = 'openai', -- api_key = 'your openai key', in MindsDB cloud accounts we provide a default key model_name = 'gpt-4', -- you can also use 'text-davinci-003', 'gpt-3.5-turbo' prompt_template = 'respond to {{text}} by {{author_username}}';
Note:
Optionally, If you are using MindsDB on docker or if you want to use your own OpenAI API key, simply pass theapi_key argument in the USING.
One important attribute here is prompt_template. This is where we tell GPT how to write answers; it is a template because you can pass values from columns, in this case the template contains {{author_username}} and {{text}}, which will be replaced from the WHERE variables in the query. Let’s see in action:
SELECT response from mindsdb.gpt_model WHERE author_username = "mindsdb" AND text="why is gravity so different on the sun?";
As you can see, the previous model gave responses that aren’t that exciting. But we can use some prompt template magic to shape how we want the model to respond. Essentially we use prompt_template to explain
CREATE MODEL mindsdb.snoopstein_model PREDICT response USING engine = 'openai', max_tokens = 300, -- api_key = 'your openai key, in cloud accounts we provide one', model_name = 'gpt-4', -- you can also use 'text-davinci-003' or 'gpt-3.5-turbo' prompt_template = 'From input message: {{text}}\ by from_user: {{author_username}}\ In less than 550 characters, write a Twitter response to {{author_username}} in the following format:\ Dear @<from_user>, <respond a rhyme as if you were Snoop Dogg but you also were as smart as Albert Einstein, still explain things like Snoop Dogg would, do not mention that you are part Einstein. If possible include references to publications for further reading. If you make a reference quoting some personality, add OG, for example;, if you are referencing Alan Turing, say OG Alan Turing and very briefly explain why you think they would be dope reads. If the question makes no sense, explain that you are a bit lost, and make something up that is both hilarious and relevant. sign with -- mdb.ai/bot by @mindsdb.';
Now let’s test this model:
SELECT response from mindsdb.snoopstein_model WHERE author_username = "someuser" AND text="@snoop_stein, why is gravity so different on the sun?.";
Let’s try another one:
SELECT response from mindsdb.snoopstein_model WHERE author_username = "someuser" AND text="@snoop_stein, Apart from yourself, which rappers would make the best physicists and why?!";
We are going to prepare a MindsDB SQL statement to connect to twitter with read-only access:
CREATE DATABASE my_twitter WITH ENGINE = 'twitter';
This creates a database called my_twitter. This database ships with a table called tweets that we can use to search for tweets as well as to write tweets.
You can use the Twitter API to get a list of tweets with a particular text or hashtag, in the case below mindsdb or #mindsdb.
SELECT id, created_at, author_username, text FROM my_twitter.tweets WHERE query = '(@snoopstein OR @snoop_stein OR #snoopstein OR #snoop_stein) -is:retweet' AND created_at > '2023-03-20' LIMIT 20;
Note that the parameter query supports anything that the twitter API supports as query, for more reference, read (https://developer.twitter.com/en/docs/twitter-api/tweets/search/integrate/build-a-query)
Let’s test that this model can generate outputs based on the Snoop Stein personality on many tweets, by joining the model with the tweets table:
SELECT t.id AS in_reply_to_tweet_id, t.text AS input_text, t.author_username, t.created_at, r.response AS text FROM my_twitter.tweets t JOIN mindsdb.snoopstein_model r WHERE t.query = '(@snoopstein OR @snoop_stein OR #snoopstein OR #snoop_stein) -is:retweet -from:snoop_stein' AND t.created_at > '2023-03-20' LIMIT 4;
Now we are at the part where we want MindsDB to write responses back into Twitter. For this, you will need to sign up for a Twitter dev account in order to actually be able to write tweets back into Twitter (write, as opposed to read-only), if you don’t have a Twitter dev account already.
We recommend you use the Elevated access allowing you to pull 2m tweets and to avoid parameters or authentication issue error you might get sometimes. You can check this step-by-step guide describing how to apply for the Elevated access.
Twitter may take a day or so to approve your new dev account. Once you are approved, here are the steps to link your Twitter account to MindsDB:
https://www.youtube.com/watch?v=qVe7PeC0sUQ
You can create a new updated database so it can read and write as follows:
CREATE DATABASE mindsdb.my_twitter_v2 WITH PARAMETERS = { "consumer_key": "your twitter App API key", "consumer_secret": "your twitter App API key secret", "bearer_token": "your twitter App bearer TOKEN", "access_token": "your twitter App Access Token", "access_token_secret": "your twitter App Access Token Secret" };
Let's test by tweeting a few things into the MindsDB Twitter account
INSERT INTO my_twitter_v2.tweets (in_reply_to_tweet_id, text) VALUES (1633439839491092482, 'MindsDB is great! now its super simple to build ML powered apps using JOBS https://docs.mindsdb.com/sql/tutorials/twitter-chatbot'), (1634126825377996800, 'Holy!! MindsDB is such a useful tool for developers doing ML https://docs.mindsdb.com/sql/tutorials/twitter-chatbot');
Like magic right? Those tweets should be live now on twitter, You can check your tweet responses here:
https://twitter.com/MindsDB/status/1633439839491092482
And here:
https://twitter.com/MindsDB/status/1634126825377996800
Note: you can insert any of the values of the tweepy function create_tweet: https://docs.tweepy.org/en/stable/client.html#tweepy.Client.create_tweet
The CREATE JOB statement is great because you can use it to automate work. The idea is simple, you give it a query you want to execute and how often. Let’s set up a job for Snoop Stein!
Let’s write a JOB called gpt4_twitter_job:
All of this can be written in one SQL command
CREATE JOB mindsdb.gpt4_twitter_job AS ( -- insert into tweets the output of joining model and new tweets INSERT INTO my_twitter_v2.tweets (in_reply_to_tweet_id, text) SELECT t.id AS in_reply_to_tweet_id, r.response AS text FROM my_twitter.tweets t JOIN mindsdb.snoopstein_model r WHERE t.query = '(@snoopstein OR @snoop_stein OR #snoopstein OR #snoop_stein) -is:retweet -from:snoop_stein' AND t.created_at > "{{PREVIOUS_START_DATETIME}}" limit 10 ) EVERY hour
And there it is! Every hour, we will be checking for new tweets that mention MindsDB, and replying with responses generated by OpenAI GPT-4 using the template from step 2 that will respond in a style that combines Albert Einstein and Snoop Dogg.
You can check if your JOB is running effectively
SELECT * FROM jobs WHERE name="gpt4_twitter_job"; SELECT * FROM jobs_history WHERE name="gpt4_twitter_job";
You can stop the job as follows
DROP JOB gpt4_twitter_job
MindsDB is a powerful software platform that enables developers to easily build machine learning features into their applications. With MindsDB, developers can train machine learning models from different data sources and integration platforms, and output the generated ML results or predictions directly into the DB, queryable as tables, or output via the connected application, in this case, Twitter. This example of building a Twitter chatbot with GPT-4 integration is not the only quick solution that developers can implement in just a few minutes: MindsDB has many examples, including integration with many other models, including Hugging Face, to build applications that can summarize text, translate, analyze customer sentiment (product reviews) and perform all kinds of business forecasting. You can find many examples here https://docs.mindsdb.com/nlp/nlp-extended-examples.
In pt. 2 of this series on Twitter and GPT integration, out next week, we will walk you through some new features that will allow quick creation of a conversational chatbot, that is able to maintain the state of historical messages and provide appropriate responses in context. Make sure you don’t miss it by going here and signing up for our blog updates!
Happy coding, and please join our community Slack for feedback, support, and questions. We look forward to meeting you there!