ReSpo.Vision: AI and AR/VR that revolutionises data tracking

ReSpo.Vision is an AI & Computer Vision-based optical tracking system which automatically collects player skeletal tracking data from any single camera recording of a sporting event.

Using immersive 3D visuals, the system allows the audience to unlock performance data and insights that weren’t before available like tactical or scouting insights with AR/VR.

Respo.Vision – a Polish-based start-up founded in early 2020 started by four founders – Pawel Osterreicher, Mateusz Szala, Wojciech Rosiński, and Łukasz Grad.

These four individuals have had combined experiences in data science, consulting and machine learning engineering, and believe AI can unlock a wealth of possibilities by capturing previously uncapturable player tracking data.

The company’s mission is to bring a new depth of analytics to sports using Computer Vision.

The product merges the immersive AR/VR world with the deep analytical environment that sports is, and the company specifically specialises in football.

They leverage bleeding-edge deep learning algorithms to automatically generate 3D skeletal tracking data from sporting events and analyse it with an unprecedented level of insight.

The technology system detects 3D positions of the ball and 50+ body parts of every player, in every video frame, using a single-camera video input (which can be any recording, present or past, a TV broadcast, or a training session recording). Fully automatically, for any game, with accuracy measured in centimetres, and without any wearable sensors or expensive pre-installed cameras.

The company are scaling up their clientele (among them clubs, leagues, federations, media, or sports data companies) and are doing so by offering an unmatched depth of knowledge in a scalable, and cost-effective way.

ReSpo.Vision Head of Product Mateusz Dłużniewski presenting at the GSIC powered by Microsoft Summit APAC in Singapore.

The technology is split into two different products: Data & Stats as well as Visuals which allow the audience a chance to choose how they want to experience the game.

This is how each work:

Data and Stats

– 2D & 3D Tracking data: Uses coordinates of players’ body parts & the ball generated from any match recording, even TV broadcasts with the option to view the game in either 2D or 3D.

– Physical data: Tracks accurate physical measurements, including speed, acceleration, body orientation, or motion types

– Game reports: 3D tracking-derived analytical summary of any game. Revealing unique metrics, including player zones of control, Team Compactness, Open Passing Lanes, Pressing performance, and more – all to power better tactical decisions

Visuals

3D Digital twin of football: Recreate any real-life game in a realistic, VR-ready 3D environment with unlimited camera perspectives and full immersion.

Matchday in the metaverse: Open the gates to the virtual stadium and use VR technology to teleport fans directly into the heart of the action for an incredible immersive experience.

Data visualisations & AR Add-Ons: Enhance the fan experience or aid the player coaching process with visualized stats & insights (e.g. tactical view, pitch control overlay).

ReSpo.Vision Body Keypoints Detection.

How this technology can be used in Australia

Specifically in Australia, technology like this is severely underutilised at the top level and will be part of football in the near future, where Australia can get ahead of other Asian countries in this field.

An example to look upon is Melbourne Knights and their recent partnership with advanced data tracking system ProTrainUp who aren’t currently connected to any other club in the country.

More clubs in the country should follow in these footsteps and invest in immersive and analytical systems that give them a deeper understanding of the game, where the top European clubs first flagged as a big importance on improving on the pitch.

The founders in a recent interview with SportsPro also suggested that the system can be used by broadcast media companies to give their audience an enhanced viewing experience by allowing them to view advanced metrics, a feature that Australian football also lacks on its A-League broadcasts.

The company is truly revolutionising the AI sports realm with fans, clubs and the media being the target audience for this technology to shape the way we view and analyse football.

Previous ArticleNext Article

Keisuke Honda’s venture capital secures $158M to back AI startups

Former Japanese soccer star Keisuke Honda has scored another win off the pitch, his venture capital firm, X&KSK Fund, has secured $158 million to invest in tech start-ups specialising in AI and cutting-edge business solutions.

Over 20 investors are supporting Honda’s fund, including prominent Japanese financial institutions like Sumitomo Mitsui Banking Corp, Nomura Holdings, and SBI Holdings. Notably, SBI Holdings and SBI Shinsei Bank have contributed a combined $20.46 million (¥2 billion), making them the fund’s largest stakeholders.

Shohei Yamada, a partner at SBI Investment, highlighted that the goal of this investment is to expand its network of international investors and promote Japanese start-ups. In Japan, where the number of so-called “unicorn” companies—those valued at over $1.61 billion—remains limited, this initiative represents a significant step forward for the local start-up ecosystem.

Keisuke Honda, known for his stellar performances at CSKA Moscow, AC Milan, and three consecutive World Cups, has been expanding his business ventures. Together with American actor Will Smith, he co-founded Dreamers VC. His goal is to create a “decacorn”—a private company valued at over $16.17 billion in Japan.

Honda is aware establishing a decacorn is rare in Japan, however, he is assertive it can be achieved.

“I’m aware that creating a decacorn in Japan is a very difficult challenge, but considering what the Japanese have already achieved, I believe it is possible,” he said via email interview.

The former AC Milan midfielder recognized that his soccer fame opens doors to profitable investment opportunities. He also pointed out that, unlike in the U.S., celebrities in Japan are typically reluctant to openly talk about their investments.

Although the number of start-ups in Japan is on the rise, the country still falls short in producing unicorns. A report from Japan’s Ministry of Economy, Trade, and Industry highlights that fostering start-up growth requires improved access to significant funding.

In 2022, Japanese start-ups raised a record ¥978.2 billion (10.01 billion AUD), but this figure dropped to ¥803.9 billion (8.22 billion AUD) in the following year. Despite the decline, it still represents a fivefold increase compared to 2014.

The X&KSK Fund seeks to back innovative projects and promote cutting-edge technologies. This initiative marks a significant milestone for Keisuke Honda and Japan’s emerging start-up ecosystem, bringing fresh momentum to its expansion.

Keisuke Honda’s involvement in the X&KSK Fund represents a significant shift in how athletes, especially football players, are positioning themselves within the broader business and tech world.

Historically, athletes, particularly in football, have often focused on careers post-retirement that include media ventures, sponsorships, or brand endorsements. However, Honda’s active role in venture capital, particularly in sectors like AI and tech innovation, signals a new wave of athlete entrepreneurs taking a more hands-on approach in shaping the future industries.

This shift is particularly important because football players, given their fame and influence, have the potential to leverage their personal brands to foster meaningful change within industries beyond sports.

Players such as Honda, who have gained global recognition, can access exclusive investment opportunities that might otherwise be difficult to reach for traditional investors.

By actively participating in initiatives like Dreamers VC, Honda is not just a figurehead—he’s an active contributor to the creation of business ecosystems that can have a lasting impact on both the tech industry and Japan’s start-up scene.

Moreover, for footballers, particularly those who achieve global success, such investments can be a smart way to secure long-term financial stability post-retirement, as they can often face a shorter career span.

The increased involvement of athletes in high-level investments allows them to diversify their portfolios and contribute to industries that influence the future of society. This trend is beginning to reshape how sports figures are perceived, from being athletes to being influential business leaders and investors.

Signality: Revolutionising Sports Data with AI Technology

Signality was founded in 2016 with a clear vision to transform sports data. The company was driven by the ambition to make sports data as efficient and autonomous as a self-driving car.

With a rise in AI technology, the Swedish-based company are changing the way sports data is captured, analysed and utilised.

Signality have focused heavily on using their technology to create an extensive and complex soccer data system thanks to their automated cloud-based platform.

This platform processes thousands of live soccer games every year, delivering unparalleled data insights. It can ingest feeds from a single panoramic camera to multiple cameras, with more inputs resulting in richer data.

As the company continues to grow, it is expanding in the sports media landscape, after recently being acquired by automated camera and video production company Spiideo, another Swedish sportstech brand.

Signality’s Soccer API

The company’s prized product is their Soccer API which comprehensively tracks data sets from all different angles of the sport to help clubs, leagues and athletes perform at their best.

This is how it works:

Revolutionising Soccer Analytics with Automated Tracking and Event Data

A cutting-edge Soccer API is transforming the way soccer data is collected and delivered. Through fully automated tracking and event data collection, the platform leverages static video camera streams to derive accurate positional and event data without the need for manual intervention.

Automated Data Collection and Low-Latency Delivery

By connecting video streams to the platform’s system, users can initiate an automated process that generates real-time data feeds. These feeds, accessible via an open and user-friendly API, ensure low-latency data delivery, providing crucial insights for analysts, coaches, and broadcasters.

Comprehensive Tracking Data

The platform provides detailed positional data for all players, including the ball and referee. This data forms the basis for numerous Key Performance Indicators (KPIs) that can be easily derived, such as:

  • Total Running Distances
  • Speed Zones
  • Number of Sprints
  • Player Separation Metrics
  • And Many More

This positional data is presented with high accuracy and precision, allowing teams to analyse movement patterns and player performance comprehensively.

Rich Event Data

In addition to tracking data, the API delivers extensive event data, covering a broad range of on-field events. Each event is timestamped and linked to the respective team and player. The list of supported event types is continuously expanding and currently includes:

  • Kick-Off
  • Goals
  • Passes
  • Substitutions
  • Red Cards
  • Yellow Cards
  • Corner Kicks
  • Dangerous Free Kicks
  • Penalties
  • End of Phase

This comprehensive event data enables deeper tactical analysis and enhances the storytelling for media coverage.

Proven and Validated Technology

The quality of the platform’s services has been validated by Gothenburg University, ensuring reliability and accuracy. In addition, continuous in-house validation and collaboration with partners help maintain and improve the high standard of service. Interested users can request further details about the validation process.

How It Works

  1. Connect Video Streams: Users can connect their respective video streams to the API and optionally provide additional match information, such as team lineups, home and away teams, and kick-off time.
  2. Automated Processing: The platform’s AI models process the video streams, automatically extracting positional and event data.
  3. Access Data via API: The processed data is made available through an easy-to-use open API, enabling seamless integration into existing systems.
  4. Quality Assurance: Built-in QA services ensure data accuracy by continuously training and refining AI models based on feedback and new data.

Conclusion

Signality’s Soccer API offers a revolutionary solution for automated soccer analytics. By providing fast, accurate, and comprehensive data through a robust open API, it empowers teams, analysts, and broadcasters to gain unparalleled insights into the game. With proven technology and continuous improvement, this platform is set to become a key player in the future of soccer analytics.

Most Popular Topics

Editor Picks

Send this to a friend