Do you think all AI chatbots can access the internet and get real-time information? We tested top AI chatbots with simple questions, and here are the things we found.
I will be using two questions for this experiment. The first question is, ‘Who won the Ashes 2023?’ The Ashes is one of the most popular cricket series between Australia and England. The series was drawn to equal, while Australia took the trophy as the previous champions. The second question is, ‘What’s the release date of Wordpress 6.3?’ The release date of Wordpress 6.3 is 8th of August 2023.
Let’s get started with ChatGPT and see if it can provide correct answers. First, I’m going to test the GPT 3.5 model of ChatGPT. Both free users and plus users have access to this. As expected, GPT 3.5 says it can’t find the answer. GPT 3.5 is only trained for data up to September 2021, so it can only use that data to provide answers.
Now let’s try the same questions on GPT4. This is only available to plus users. Again, the same answer as last time. GPT4 also doesn’t have access to the internet by default; it can only use the data it was trained on.
Now I’m going to see if the ChatGPT code interpreter has access to the internet. I am in the code interpreter tab under GPT4. Unfortunately, the same response again. The code interpreter doesn’t have access to the internet either.
Let’s try ChatGPT plugins under the GPT4 tab. I am using the Vox script plugin and see if it can answer the two questions. Let’s ask the same questions and wait for the response. Finally, we have some good results. It says the winner of the Ashes is not explicitly mentioned, but Vox script failed to answer the question. However, it was able to access the internet for new information. We do have the correct answer for the second question.
Let’s ask the same questions again and see if it makes any difference. This time, it’s giving the correct answer to both of the questions. When I asked earlier, it said the answer for the first question is not mentioned. So we can use the Vox script plugin to access the internet and get answers. However, the answers are not consistent.
Let’s use another plugin and see if it can access the internet and provide consistent answers. I am going to test the Webpilot plugin now. I am adding the same two questions. Let’s wait for the response. Looks like it’s providing the correct answer to the first question. It was able to provide the correct answer. Also, we have more details compared to the Vox script plugin. The other difference is it gives an answer to the first question before searching for the next question. Now we have the answer for the second question, and it’s also correct. Webpilot plugin seems to be more reliable while providing a better output.
Let’s summarize our findings about ChatGPT. GPT 3.5 and GPT4 don’t have access to the internet. The code interpreter doesn’t have access to the internet either. Some of the plugins do have access to the internet.
Now we move on to Google Bard. Let me ask the same questions again. Now we have the answer. The first answer is correct, while the second answer for the WordPress question is incorrect. Let’s resubmit and see if it makes any changes. Now the first answer is incorrect, while the second answer is correct. Let me ask it for the third time. Now both answers are incorrect. Based on our tests, Google Bard has access to the internet. However, the answer seems to be inconsistent and unreliable at this stage.
Next, I’m going to test Perplexity AI. Let me submit the questions again. Here we have the answers. The first answer says the Ashes is still ongoing, even though it completed two months ago. The answer to the second question is also incorrect. Let me resubmit the questions to see if there is any change. The answer is the same for the first question. The answer for the second question is slightly better, but still, we don’t have the correct answer.
Based on the tests, Perplexity AI has access to the internet, but it’s also inconsistent and unreliable. Now I’m going to test Anthropoclaude. As usual, let’s submit the questions and wait for the answer. It says, ‘Unfortunately, I don’t have context to answer your questions.’ Similar to ChatGPT, Claude doesn’t have access to the internet, but it doesn’t mention the knowledge cutoff date like ChatGPT.
Finally, I’m going to test Llama 2 model by Meta. I am accessing this model through labs.perplexity.ai. Let’s submit the questions. Both answers are incorrect. In this case, let’s submit and check again. Yet again, both answers are incorrect. It’s not clear if it doesn’t have internet access or if it’s finding the wrong answers with internet access.
In conclusion, Perplexity AI, Google Bard, and ChatGPT plugins are the only three tools that have access to the internet. Generally, Perplexity is my number one choice and accurate in most cases. However, it was unable to answer our questions properly. Claude and Llama 2 were unable to access the internet. However, the tools with access to the internet can also provide wrong or made-up answers. It’s important to cross-check with proper sources without blindly relying on them at this stage.
Thanks for watching! Subscribe to our channel and like this video to see more AI-related videos.
