Which AI Model is Best? A Side-by-Side Comparison

As the international break comes to a close this week, the England Football team secured a top seeding at Euro 24. I took inspiration from this news to run a Gen AI experiment and compare the output of 5 AI Models. Using the same prompt, I went about generating content using the Claude 1, Claude 2, GPT 3.5, GPT 4, and GPT 4 Turbo models.

Are All Models Equal?

Firstly, it is worth noting that not all models are equal.

For example, Claude 1 & 2 trained by Anthropic are factual language models.  Trained on a massive dataset of text and code, they can generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. Claude 1, released in 2022, is still under development and was trained with data up to December 2022.

Claude 2 is a fine-tuned version of Claude 1 that has been specifically optimised for dialogue. This means that it is better at understanding and responding to conversational prompts.  Claude 2 is trained on data up to early 2023.

Interestingly, Claude 2 was released in 2023 and became available for public use before Claude 1.

With the GPT models, the release dates and training data cut-offs are:

• GPT-3.5 was released in 2021 and trained on data up to September 2021,
• GPT 4 was released in 2022 and trained on data up to September 2021
• GPT 4 Turbo was released in 2023 and has been trained with information up to April 2023

What Are The Different Types Of AI Models?

Factual Language Models (FLMs) have a specific design for generating factual and objective text. This means they are better at understanding and responding to prompts that require factual information, such as “What is the capital of France” or “What is the formula for water?” Claude 1 and 2 are FLMs.

On the other hand, the GPT models are Large Language Models (LLMs) from OpenAI.  All are trained on massive datasets of text and code. They are capable of generating text, translating languages, writing different kinds of creative content, and answering your questions in an informative way.

Large Language Models, in contrast to Factual Language Models, undergo training on both factual and non-factual information. This means that they are better at generating creative and imaginative text, such as poems, code, scripts, musical pieces, emails, letters, etc. They are also better at understanding and responding to open-ended, challenging, or strange prompts.  

Given this background, I decided to conduct my side-by-side model comparison based on a factual prompt. ‘Write me a history of players wearing the number 7 jersey who have played for England Football Team over the last 10 years.’  

Which AI Model is Best? The Results.

You can watch the truncated test in the video below.  The video also introduces Copy.ai workflows.

The test was conducted using a workflow powered by Copy.ai. We checked the results against the comprehensive statistics available on the Transfer Markt website. Here you can find the England Squad Number history dating as far back as the 1953/54 season. 

The model results were disappointing. They highlight that inaccuracies are still possible, even when drawing on factual reasoning and content from large models.  Here are some of the findings:

• The results should have returned responses that consisted of up to 20 players’ names. Players who have played for the England Football Squad in the number seven shirt over the period 2013 – 2023.  Worst case, with GPT 3.5 having a training cut-off date of September 2021, the list should have included 18 players.
• Across all models, players like Jude Bellingham, Jack Wiltshire, Ross Barkley and Mason Mount have been omitted from history.
• Claude 2 incorrectly listed Adam Lallana, a player who never took to the pitch with the senior England squad in a number seven shirt but did play for England with other numbers on his back.
• Only one player received consistent naming across all five models.  This was Raheem Sterling.
• GPT 3.5: Aaron Lennon – never played in a number seven shirt after the season 2009/10.
• Exercise caution with timeline data presented with a period specified as continuing today (i.e., 20xx – present). The models depend on past data and lack the ability to predict the future, so their effectiveness is contingent on the information they were trained on before the cut-off date.  As I write this article, England has just left the field after drawing with North Macedonia in the Euro 2024 qualifying match.  In this match, Bukayo Saka wore the number seven shirt.  All three GPT models presented different players to Saka as being the ‘present’ number seven, such as Jadon Sancho and Jack Grealish (who actually played in the number 11 shirt for this game tonight, but of course, these AI models wouldn’t know that).
• You can get different answers from different models in the same family.  Following on from the point above, the GPT family of models gave two different answers when responding to who currently owns the number seven shirt.  GPT 3.5 and 4 named Jadon Sancho whilst GPT 4 Turbo named Jack Grealish.
• Maybe the most misleading response of all was from GPT 4 Turbo.  It doesn’t acknowledge the omission of some players in the presented history, leading to a fragmented timeline for the period from 2013 to the present. Anyone with less than a fanatical knowledge of the England squad might accept this as factually correct.

The moral of this story is ALWAYS check your facts.  Models can not yet be trusted to present factual content back to the user which is accurate and correct.  With more creative content, be wary that its responses will be based on the interpretation of these factual events so creative output could be biased.

Which AI Model is Best? Full Response From All 5 Models.

Prompt: ‘Write me a history of players wearing the number 7 jersey who have played for England Football Team over the last 10 years.‘

Claude 1

Over the last 10 years, the number 7 jersey for the England national football team has been worn by several notable players:

In the early 2010s, the number 7 shirt was worn by Theo Walcott. Walcott made his England debut in 2006 at the age of 17 and went on to earn 47 caps, scoring 8 goals. However, his time as a regular starter for England faded in the mid-2010s.

In 2015, Raheem Sterling took over the number 7 jersey. Sterling has been a key part of the England squad since his debut in 2012 at age 17. As of 2019, Sterling has earned over 50 caps for England and scored 12 goals. He continues to be an important part of England’s attack and wore the number 7 at the 2018 World Cup.

Most recently, Jadon Sancho wore the number 7 shirt for England. Sancho made his England debut in 2018 at age 18. He is considered one of England’s most promising young players and has already earned over 10 caps for the senior national team. There are high hopes that Sancho can become a star for England in the coming years while wearing the prestigious number 7 shirt.

In summary, the number 7 jersey for England has been worn by some of England’s most talented attackers over the last decade, highlighting the importance of that shirt number in England’s football history and tradition. Theo Walcott, Raheem Sterling, and Jadon Sancho have all donned the number 7 jersey with hopes of continuing that tradition.

Claude 2

The number 7 jersey has a rich history for the England national football team over the past decade. Some of the most talented English players have donned the iconic shirt number and left their mark on the international stage.

In the 2010 World Cup, the number 7 shirt was worn by James Milner. Although still early in his England career at the time, Milner played in all four of England’s games at the tournament in South Africa.

For the Euro 2012 championships, Theo Walcott was England’s number 7. Walcott started two group-stage matches but couldn’t prevent England from being knocked out in the quarterfinals by Italy.

The 2014 World Cup saw a new name on the back of the number 7 shirt – Adam Lallana. After some strong Premier League form for Southampton, Lallana earned a place in England’s squad for the tournament in Brazil. He made three substitute appearances as England were again eliminated at the group stage.

In the lead up to Euro 2016, Raheem Sterling had emerged as one of England’s most dangerous attacking players. He wore the number 7 shirt in France and scored in the famous 2-1 win over Wales. England reached the Round of 16 before being upset by Iceland.

At the 2018 World Cup in Russia, Sterling retained the number 7 and started all three group games, scoring twice. He couldn’t prevent England from losing in the semifinals to Croatia.

More recently, Jack Grealish inherited the number 7 shirt and has begun to make his mark for England. After initially opting to play for Ireland, Grealish switched allegiance to England in 2020. He was part of the squad that reached the Euro 2020 final at Wembley, losing on penalties to Italy.

The number 7 remains an iconic shirt in English football. While no player has fully cemented their legend status wearing it for England over the past decade, the future looks bright with Grealish as the current incumbent.

GPT 3.5

History of players wearing the number 7 jersey in the England Football team over the last 10 years:

Over the past decade, the number 7 jersey in the England Football team has been adorned by several talented players who have left their mark on the national team. Let’s take a look at some of the notable players who have worn the prestigious shirt.

1. Aaron Lennon (2010-2013):
   Aaron Lennon, the skilful winger, wore the number 7 jersey for England from 2010 to 2013. Known for his incredible pace and dribbling skills, Lennon represented England in major tournaments like the 2010 FIFA World Cup and UEFA Euro 2012.
2. James Milner (2014-2016):
   James Milner, a versatile midfielder, donned the number 7 shirt for England between 2014 and 2016. Milner was known for his work rate and ability to contribute both defensively and offensively. He played a crucial role in England’s qualification for the UEFA Euro 2016.
3. Raheem Sterling (2017-present):
   Raheem Sterling, a dynamic forward, has been wearing the number 7 jersey for England since 2017. Sterling’s explosive pace, technical ability, and goal-scoring prowess have made him a key player for both England and his club, Manchester City. He has represented England in major tournaments, including the UEFA Nations League and the 2018 FIFA World Cup.
4. Jadon Sancho (2021-present):
   Jadon Sancho, a highly promising young talent, took over the number 7 shirt in 2021. Known for his exceptional dribbling skills and creativity, Sancho has already made a significant impact for England. He represented the national team in the UEFA Euro 2020 and will undoubtedly be one to watch in the coming years.

These are just a few of the notable players who have worn the number 7 jersey for the England Football team over the last 10 years. Each player has brought their unique skills and contributions to the team, adding to the rich history of this iconic shirt.

GPT 4

The number 7 jersey in the England Football team has a storied history, with many great players donning this number over the last decade. Here is a brief history of the players who have worn the number 7 jersey for England over the last 10 years:

1. James Milner (2010-2016): An accomplished player with excellent versatility, James Milner wore the number 7 shirt from 2010 to 2016. Milner, who played as a midfielder, was known for his tireless work rate and versatility. He retired from international football in 2016.

2. Alex Oxlade-Chamberlain (2012-2016): Known for his speed and technical skills, Oxlade-Chamberlain, often played as a winger or central midfielder. He wore the number 7 shirt sporadically throughout his time in the England squad, particularly when Milner was not on the pitch.

3. Raheem Sterling (2016-2018): A speedy winger with great dribbling skills, Raheem Sterling wore the number 7 jersey from 2016 to 2018. His performances were instrumental in several of England’s victories during this time.

4. Jesse Lingard (2018-2019): Known for his creativity and goal-scoring ability, Jesse Lingard wore the number 7 jersey for England from 2018 to 2019. Despite some inconsistent performances, he proved to be a valuable player for the team.

5. Jadon Sancho (2019-Present): The current wearer of the number 7 shirt for England is Jadon Sancho. Sancho, who is known for his incredible speed and technical ability, has been a revelation since breaking into the England team in 2019. He has since become a key player for the national team and continues to wear the number 7 shirt with pride.

Over the last 10 years, the number 7 jersey for the England football team has been worn by some truly exceptional players. These players have all brought their unique talents to the team, contributing to the success of English football on the international stage.

GPT 4 Turbo

Over the past 10 years, the number 7 jersey for the England national football team has been worn by several talented players who have made significant contributions on the international stage. Here is a brief history of those who have donned this iconic number:

**2013-2015: Theo Walcott**

Theo Walcott was one of the main players to wear the number 7 shirt for England around the early 2010s. Known for his blistering pace and finishing ability, Walcott was a key player for England during the 2014 World Cup qualifying campaign. However, he was unfortunately sidelined due to an injury just before the tournament in Brazil, where England were eliminated at the group stage.

**2015-2017: Raheem Sterling**

As the England squad evolved, Raheem Sterling began to make the number 7 his own. Sterling, who can operate as a winger or forward, brought a new level of excitement and skill to the England setup. His performances at the UEFA Euro 2016, while not leading to team success as England suffered a disappointing exit, showcased his potential to be a mainstay in the team.

**2017-2018: Jesse Lingard**

For a period, Jesse Lingard took up the mantle of the number 7 jersey. Lingard is an attacking midfielder known for his movement, energy, and eye for goal. He played a part in the 2018 FIFA World Cup in Russia, where England reached the semi-finals, their best performance in a World Cup since 1990. Lingard scored a memorable goal against Panama in the group stage, contributing to England’s journey to the semi-finals.

**2018-2019: Jadon Sancho**

Emerging talent Jadon Sancho, who made a name for himself in the Bundesliga with Borussia Dortmund, has also worn the number 7 shirt for England. Sancho’s dribbling skills, vision, and creativity have made him one of England’s most promising young talents. He featured in the UEFA Nations League and was part of the squad for the Euro 2020 qualifiers.

**2019-Present: Jack Grealish**

Most recently, Jack Grealish has been seen wearing the number 7 jersey for England. Grealish, who earned his place in the England team with his performances for Aston Villa and later Manchester City, is known for his ability to carry the ball, draw fouls, and create chances for his teammates. He was part of the England squad for UEFA Euro 2020, which was held in 2021 due to the COVID-19 pandemic, where England reached the final but lost to Italy in a penalty shootout.

These players have all brought their unique talents to the number 7 jersey for England, contributing to the team’s efforts in various international competitions. The number 7 continues to be a symbol of skill, creativity, and attacking threat in the England squad, with its recent occupants demonstrating just why it’s such a revered shirt number in football.

The Accurate List As Presented By Transfer Markt.

• Jarrod Bowen (22/23)
• Trent Alexander-Arnold (22/23)
• Bukayo Saka (22/23),  (20/21)
• Phil Foden (22/23), (20/21)
• Declan Rice (22/23), (20/21)
• Jack Grealish (20/21 – 22/23)
• Jesse Lingard (20/21), (17/18 – 18/19)
• Raheem Sterling (20/21), (18/19), (14/15 – 16/17)
• Jude Bellingham (20/21)
• Mason Mount (20/21)
• Kalvin Phillips (20/21)
• Jadon Sancho (18/19)
• Ross Barkley (18/19)
• Theo Walcott (16/17), (14/15), (10/11 – 12/13)
• Harry Winks (16/17)
• Marcus Rashford (16/17)
• Alex Oxlade-Chamberlain (14/15), (12/13)
• James Milner (14/15), (12/13)
• Jack Wilshere (13/14 – 14/15)
• Andros Townsend (12/13)