Latest News

Something’s fishy—new funding to tackle illegal activities at sea using machine learning and data analytics

By Xerra News Cat

A partnership between Aotearoa’s Xerra and Australia’s FrontierSI kicks off this week, with $100K AUD awarded to Xerra to help the Australian Geospatial-Intelligence Organisation’s Analytics Lab Program (AGO Labs) build new industry capability in the areas of machine learning and analytics.

Xerra is one of New Zealand’s commercially focused regional research institutes, and one of 3 successful applicants for funding in round 1 of the 2021 AGO Labs program. Xerra’s work focuses on remote sensing and data analytics, which in the past year has culminated in their flagship product—Starboard Maritime Intelligence, a platform that uses satellite data and machine learning technologies to monitor maritime activity.

Xerra and AGO analysts will work together to develop a model to detect anomalies in maritime vessel behaviour at sea, in particular identifying vessels whose behaviour (e.g. speed, location, track shape) deviates from the normal activity for vessels of its type. This work will enable AGO analysts to focus their attention on vessels that are anomalous, or behaving in out of the ordinary ways.

This work will be a continuation of Xerra’s research and algorithm development for the Starboard platform—using vessel transponder data (AIS) and satellite data to analyse vessel behaviour at sea, searching for evidence of illegal, unreported and unregulated (IUU) fishing, human rights abuses, and other related activities.

“We’re excited to be working in collaboration with AGO, FrontierSI and their analysts to better understand the questions they ask when looking at maritime vessel behaviour—what is ‘normal’ behaviour, and what signifies a deviation from that,” said Joseph Corbett, Data Scientist at Xerra and project lead for this work.

“AIS offers a significant potential for gaining maritime domain awareness, but large data volumes and data quality issues prohibit effective manual analysis at scale. Our objective is to develop an automated anomaly detection model based on recurrent neural networks—a machine learning technique commonly used to model sequences of data—to learn the behaviours of different vessel types, and ultimately enable us to detect when a behaviour deviates from ‘normal’.” Corbett continued.

The successful round 1 partners were announced earlier this month by AGO Labs program funding coordinators, FrontierSI. Chief Executive Officer Graeme Kernich remarked, ‘We would like to congratulate Xerra on their outstanding submission and are delighted to partner with them as part of AGO on the AGO Labs program.”

“The Program outcomes will improve the way in which AGO and the Department of Defence work with companies like Xerra, to test new innovations and applications and develop solutions, all with the objective of strengthening partnerships to build geospatial intelligence capability.’’ Kernich said.

Strengthening Aotearoa’s COVID-19 maritime border protection

By Xerra News Cat

The COVID-19 pandemic has changed many facets of our lives in Aotearoa New Zealand. Although we have enjoyed relative freedom in recent months, maintaining vigilance at our maritime borders whilst minimising disruptions to trade is a challenging endeavour.  

Xerra has been awarded $850,000 through the Ministry of Business, Innovation and Employment’s (MBIE’s) COVID-19 Innovation Acceleration Fund (CIAF) to support the pandemic response in Aotearoa New Zealand and the Pacific Islands. The funding is being used to accelerate the delivery of two maritime border protection tools in our Starboard Maritime Intelligence platform. 

The first of these tools is based on an epidemiological model that looks at which ports a vessel has visited and the local COVID-19 infection rates for the days the vessel was in port. Using these inputs, the mathematical model predicts possible contagion scenarios, such as the risk of a vessel having infected crew on board. 

This work is being led by Xerra’s principal scientist, Dr Dave Kelbe, in collaboration with epidemiologists Professor Nick Wilson and Professor Michael Baker from the University of Otago, who have recently done work estimating the risk of outbreaks of COVID-19 associated with shore leave by merchant ship crews (Wilson et al. 2020)*

Currently, all arriving vessels, and their crew, are treated as high risk, regardless of the vessel’s travel history, time at sea and origin of the crew on board, in order to mitigate the risk of COVID-19 entering through the maritime border. 

“The government’s approach to managing the maritime border is very cautious, which helps give confidence to their elimination strategy,” says Professor Wilson.

“In the future, a ‘traffic light’ approach would allow for a more nuanced approach, where the relative COVID-19 risk of each vessel and its crew is assessed upon arrival, so we can adjust our control measures to suit. To move to this state, it will be of great help to have real-time, automated risk analysis like this to inform decision-making at our ports.”

Xerra’s Dr Kelbe says that the CIAF funding has helped accelerate the research and development for Starboard, enabling the team to build this new capability to quickly meet the needs of government, with the next step being to add crew exchange information to the model.

“We are honoured to be working alongside leading epidemiologists and building relationships with key officials at the Ministry of Health and Customs New Zealand, with hopes that our work will support their extraordinary efforts to secure our maritime borders from cases of COVID-19. We look forward to learning more about how the model and the functionality in Starboard can benefit these agencies at an operational level.”

Xerra will also be using the CIAF funding to conduct new research and development into detecting the unannounced arrival of non-reporting small vessels, or pleasure craft, travelling between the Pacific Islands and Aotearoa New Zealand. Traditionally it has been difficult to know how many of these vessels are arriving, when they are expected to arrive, and what their first port of call will be. We are developing algorithms and using various types of satellite data to predict and detect the location of these vessels and their likely arrival time and location so that our border officials can take appropriate measures. 

We are hopeful our tools can help protect Aotearoa New Zealand and Pacific Island nations from COVID-19 outbreaks arising from the maritime border, including the protection of front-line staff and their whānau. 

The COVID-19 automated risk assessment capability is available through our Starboard platform, which is currently in beta trials with users from various government agencies and non-governmental organisations from Aotearoa New Zealand and the wider Pacific region. 

About Starboard Maritime Intelligence (Starboard)

Starboard is a software platform that provides insights on global maritime activity for government and geospatial intelligence analysts. It helps teams tackle critical environmental and societal challenges—from the detection of illegal fishing to assessing vessels for COVID-19 and biosecurity threats. 

Starboard has been developed with the generous support of the Ministry of Primary Industries, MBIE’s COVID-19 Innovation Acceleration Fund and Regional Research Institute Initiative, and the French Embassy in New Zealand’s Pacific Fund.

*  Wilson N, Blakely T, Baker M, Eichner M. Estimating the Risk of Outbreaks of COVID-19 Associated with Shore Leave by Merchant Ship Crews: Simulation Studies for New Zealand. N Z Med J (in press).

Developing new maritime domain awareness tools for the Pacific region

By Xerra News Cat

With the generous support of 30,000€ through the French Embassy in New Zealand’s Pacific Fund, Xerra has recently completed a project to develop new technologies for maritime domain awareness that could have a significant impact in the Pacific region. 

The objectives of the work were two-fold — (1) apply machine learning algorithms to automate vessel detection based on weather-independent satellite imagery, thus providing near real-time detection of fishing activity across the area of interest, and (2) engage with French Polynesia and France to understand and deliver on the unique maritime needs of French territories in the Pacific, and develop an intuitive, collaborative platform for fisheries management.

The team at Xerra achieved this work through the collaborative development of our Starboard Maritime Intelligence platform with French partners UnseenLabs and Airbus and is now preparing for beta trials with users across the Pacific region. 

Starboard ingests vast volumes of data from multiple sources—including global vessel movements and multiple types of satellite data. These layers are ingested into a real-time geospatial platform and used to detect ‘dark’ vessels, which are not reporting their location. 

Employing algorithms and machine learning models Starboard highlights noteworthy vessel activity associated with illegal fishing practices, such as when two vessels meet at sea. 

In order to identify vessel operators not complying with conservation management measures, databases are ingested from regional fisheries management organisations such as the Western and Central Pacific Fisheries Commission.

This work culminated in two ‘digital’ operations with the Ministry for Primary Industries international fisheries team, where the Xerra team analysed live vessel activity in the high seas, including an area known to be an enclave for illegal fishing activity adjacent to the exclusive economic zones of New Caledonia, Fiji, and Vanuatu. During these operations, we delivered daily analysis reports for southern bluefin tuna — a migratory species of great value to Pacific Island nations. 

As a result of these operations, we were able to quantify the fishing effort in the area, differentiate between vessels who were allowed to fish and those who weren’t, and ultimately detect a dark fleet of vessels with evidence to suggest they were illegally fishing for southern bluefin tuna.

We would like to thank the French Embassy in New Zealand for their support of the Starboard product development and our collaboration with French Collectivities in the Pacific. We look forward to continuing to work with French partners and nations in the Pacific to help build maritime domain awareness in the region.

Xerra joins NASA PACE early adopter programme

By Xerra News Cat

Xerra senior scientist Dr Moritz Lehmann has been accepted to the NASA PACE early adopter programme, along with scientists from across the globe in order to advance research of global ocean colour, biogeochemistry, and ecology. 

Using data from the PACE mission, Dr Lehmann will be able to determine the extent and duration of harmful algal blooms in Aotearoa’s coastal waters and large lakes, in ways that have previously not been possible. 

These blooms affect both commercial and recreational activities, in addition to harming ecological function and ecosystem health. Monitoring the patterns of harmful algal blooms requires an understanding of dispersion and growth dynamics and species distribution. The identification of potentially toxic versus non-toxic algae is possible with space-borne, high spectral resolution data, like that which will be collected by the PACE satellite sensor.  

Working alongside the University of Waikato and Cawthron Institute, this collaboration aims to establish a research project to support routine monitoring of harmful algal blooms, as well as improve alert systems and inform the design of restoration activities.

Dr Lehman says he’s really excited to be involved in the early adopter programme. “It enables us as New Zealand scientists to communicate with NASA on how and why we are using their data. The programme also provides a forum for collaboration with the international scientific community to determine how PACE data can be used for improved monitoring and alert systems to protect the health and livelihoods of New Zealanders.” 

About PACE 

PACE is NASA’s Plankton, Aerosol, Cloud, ocean Ecosystem mission, currently in the design phase of mission development. It is scheduled to launch in 2022, extending and improving NASA’s over 20-year record of satellite observations of global ocean biology, aerosols (tiny particles suspended in the atmosphere), and clouds.

PACE will advance the assessment of ocean health by measuring the distribution of phytoplankton, tiny plants and algae that sustain the marine food web. It will also continue systematic records of key atmospheric variables associated with air quality and Earth’s climate.

PACE’s Ocean Colour Instrument will be the most advanced for observing ocean colour in NASA’s history. Observing chlorophyll from space has a long heritage – the first ocean colour satellite, NASA’s Coastal Zone Color Scanner (CZCS) was launched in 1978. 

PACE represents a leap forward because it will view a very broad spectrum from 350 to 885 nanometer (nm) wavelengths at 5 nm intervals – making it hyperspectral. The range that PACE’s instruments will observe includes the UV (350-400 nm), visible (400-700 nm), and near-infrared (700-885 nm), as well as several shortwave infrared bands. Thus, the OCI will provide an unprecedented view of the ocean without the “blind spots” of previous sensors.

For more information on the PACE science mission, please visit the NASA PACE website, where the above text has been sourced from.

Sunsetting Xerra Gateway

By Xerra News Cat

From 10 July 2020 Xerra Gateway will no longer be available for accessing current and archived Sentinel satellite data from the Copernicus Programme.

Xerra Gateway was a pilot in order to determine if there was sufficient demand for Sentinel products in New Zealand. Unfortunately, the uptake for the pilot wasn’t sufficient to continue this as a stand-alone product.

For continued access to Sentinel data, we recommend visiting Geoscience Australia’s Sentinel Australasia Regional Access data portal.

Xerra still offers a variety of commercial satellite imagery and products from Airbus, Maxar and Planet. We also provide training on how best to utilise EO data in your workflow. 

It’s been our pleasure to offer Xerra Gateway, albeit for a limited time, to our local community of remote sensing specialists and enthusiasts. We appreciate both your interest and use of the service, and any feedback you may have given us to help improve the site—thank you.

Beneath the smoke of bushfires

By Xerra News Cat

By using satellite imagery collected in the infrared part of the spectrum scientists can often trace the fire-fronts in bushfires, despite the thick layers of smoke blanketing the area. That is, in the infrared we can see through the smoke, which can help determine how and where the fires are burning. We expect this is what many of our Australian colleagues are doing at this moment as support to emergency services.

The images supplied here were collected by the European Sentinel-2A satellite on a pass over New South Wales, Australia on January 3rd, and processed by our scientists here at Xerra.

The image below is a ‘normal’ colour mix for the region around Jervis Bay, Nowra and Ulladulla, south of Sydney on the NSW coast. That is, this image is similar to what an astronaut might see (and photograph using a regular camera) from the Space Station.

Sentinel-2A satellite image of part of the NSW coast obtained on January 3rd with a ‘normal’ colour mix of the red, green and blue bands of the visible spectrum. In this image, the smoke obscures the fire-fronts that lie below.

By using an image obtained by the same satellite but at a wavelength of 2.2 microns (in the short-wave infrared [SWIR] part of the electromagnetic spectrum), one sees something quite different, as below.

A SWIR image of the same region as in the preceding image, scaled from black (low intensity) to yellow/orange (high intensity). In the SWIR the sensor ‘sees’ through the clouds and smoke, and detects the radiation being emitted by the active fires.

Clouds obscure our ability to see the actual fires in the visible part of the spectrum, so that all we see is reflected sunlight. Whereas in the infrared, we can not only see through the clouds but also we can see the electromagnetic radiation being emitted by the active fires.

*Data or imagery, such as the Sentinel images above are freely available from Xerra Gateway, for the use of researchers and others in New Zealand.

A new source of Sentinel imagery—Xerra Gateway

By Xerra News Cat

Today marks the launch Xerra Gateway, our New Zealand satellite data repository. Check it out here:

Improving access to Earth observation and satellite data, and developing products and services that deliver insights from this data, helps support evidence-informed decision and policy-making throughout the regions, and has an important role to play in the growth of New Zealand’s space economy.

Xerra Gateway is built in partnership with Geoscience Australia and the European Union’s Copernicus Programme. The site provides local scientists, researchers, and remote sensing and GIS specialists with easy access to Sentinel satellite imagery of New Zealand.

Our have spent time re-designing the user interface, improving both the search and download processes. Although the site is tailored to those in the science and remote sensing communities, the new interface ensures the public and citizen scientists can easily search the comprehensive archive of satellite images over Aotearoa.

The site also boasts faster download speeds, in comparison to other Sentinel data hubs. Dr Moritz Lehmann, our Senior Scientist at Xerra, has used the site regularly throughout its beta phase.

“Xerra Gateway is my first stop when looking for data from Copernicus’s Sentinel satellites,” says Dr Lehmann. “The interface is easy to understand and I like that the large browse images provide an immediate impression of the suitability of the images. One real advantage is that data from Xerra Gateway downloads way faster than from the Copernicus Hub hosted in Europe.”

Dr Lehmann is using the Sentinel images he downloads to monitor New Zealand’s lakes for water colour and the presence of cyanobacteria. This work is vital in helping councils increase the coverage and frequency of lake health monitoring in their region. Currently only 3% of Aotearoa’s lakes are regularly monitored for water quality. We want to help make every environmental monitoring dollar stretch further, and expand water quality monitoring to every lake in New Zealand.

Other applications for Sentinel satellite imagery can include sustainable forest management (deforestation detection, forest type classification and biomass estimation), mapping the colour of the Earth’s surface, measuring wave height, recording ocean and land surface temperatures, and climate monitoring.

Anyone can access the satellite data archive by visiting and creating a free login. From there it is easy to search and download images from the past years, months and days.  Xerra Gateway is regularly updated with new imagery of New Zealand, often within six hours of the Sentinel satellite overpasses.

Welcome to Dave Moskovitz

By Xerra News Cat

We’d like to welcome Dave Moskovitz to the Xerra Board of Directors. Dave started the role in early October and joins the Chair of the Board, Stephen Davies Howard, Maria King, Dr Ian Boddy and Melanie Templeton.

Dave brings a wealth of experience in the startup and entrepreneurial space to the Board, with a background in helping Kiwi entrepreneurs turn their ideas into a reality and enter into the overseas market. Recently Dave has been involved with a number of startups in and beyond the STEM (science, technology, engineering and maths) space. These startups use big data, AI, and visualisation to bring about a better society, while at the same time delivering the strong commercial outcomes that are necessary to create a sustainable business and investment returns. He says, “Helping these Kiwi businesses develop offshore markets has been a key part of this.”

When asked why he chose to apply for the Xerra Board of Directors role, Dave replied, “Xerra’s focus on using Earth observation data to bring about better sustainability for New Zealand and the planet seemed like a natural fit for my vision of the world we could be living in.”

We’re delighted to have Dave on board and look forward to working with him as we drive towards a sustainable future for both our organisation and New Zealand.

Finally, the Spark Needed to Ignite Innovation in Central Otago

By Xerra News Cat

Xerra is the very first company in the country to get commercial access to Spark’s new 5G network. Spark approached Xerra specifically because of the connectivity challenges that have plagued the Earth Observation Institute as it’s tried to establish itself in the Big Data space from its headquarters in Alexandra—a city that until now hasn’t had access to broadband fibre.

“This is a game-changer for us,” says Xerra CEO, Steve Cotter. Since day one, Xerra has explored a variety of options in hopes of securing the connectivity that in-house researchers and engineers require to do their work. Every avenue turned out to be a dead-end until Steve got the phone call from Spark. “We work with large data sets and it could take us four hours to download one image. Now, we can do it in four minutes,” he says. While Xerra is the first to be switched “on” to the 5G network, other Alexandra businesses and organisations will soon follow.

5G and fibre are exactly the kinds of technology, Cotter says, that will enhance the region’s ability to attract people who want to live and work in Central Otago. Until now, many have faced more limited employment choices because of the challenges of getting access to the necessary connectivity. For Xerra, that’s included not just its employees, but also their employees’ partners and spouses who need jobs too, before being able to make the commitment to move. This advancement will open the door to new remote working options, if they can’t find work locally.

Cotter points out that high-speed wireless broadband delivered by 5G and fibre is “the technological spark that’s needed to lay the groundwork for success if you want to achieve grand visions.”

Spark’s rollout of 5G in Alexandra kicks off a regional plan bringing 5G wireless broadband services to 5 other communities by Christmas.

“This is the kind of connectivity required to run a world-class science research institute in regional New Zealand. For us, it means people can enjoy a Central Otago lifestyle but also pursue a rewarding scientific career. And it’s the key to growing greater prosperity in the regions.”

The 5G announcement is also concurrent with the final fibre installations in Alexandra, which is a significant milestone for both Xerra and the local community.

Xerra successful in two joint MBIE Endeavour Fund bids: Forest flows & 3D change detection

By Xerra News Cat

Xerra has secured a couple of slices of a $241 million dollar pie—funding to support what the government refers to as “excellent research proposals that will provide the highest impacts”. Both bids are collaborative efforts spearheaded by partner agencies. They are among 71 projects awarded funding in an announcement on Tuesday, 17 September by Research, Science and Innovation Minister Megan Woods.

One proposal that got the green light is a $1M Smart Ideas project to help develop new 3D-change maps of New Zealand. Xerra’s Principal Scientist, Dr Dave Kelbe, will be supporting the University of Otago, along with GNS Science, Land Information New Zealand and Meridian Energy. The project will produce what Dr Pascal Sirguey of the University of Otago, and the Principal Investigator for the project calls, “unique, previously unavailable, land surface data.” He points out that this will place New Zealand “at the forefront of 3D-change detection”.

Being able to see topographic variations in our environment over time with unprecedented detail and sub-metre accuracy will allow environmental managers to make more informed decisions about managing natural resources in a safe, sustainable, and efficient way.

The other proposal that Xerra will be supporting is the Forest Flows project, a $13.7M Research Programme led by Scion, which also brings together the Universities of Auckland and Waikato, NIWA and international institutions. Its aim is to figure out exactly how planted forests impact our water.

In light of the One Billion Trees Programme and the government’s newly released National Policy Statement for Freshwater Management, this programme will develop a fast and accurate way to measure how much water is used by, evaporates from or flows through planted forests, leading to better management of our natural resources.

Xerra’s scientists will provide remote sensing measurements and data science expertise to help develop 3D spatial water quantity and quality models. These will help maximise New Zealand’s water supply, improve our water quality and ensure regional water security. Data generated will also help protect primary sector productivity, providing critical information to the timber industry.

Xerra CEO Steve Cotter says both projects are squarely in line with Xerra’s mission to provide insights that are a catalyst for change, adding that they also “reflect the high value we place on science collaboration with other institutions.” He adds that it’s a testament to the hard work of the newly appointed Xerra team, to see success with multiple joint Endeavour Fund proposals.

“I’m looking forward to seeing these new collaborative projects deliver the positive impact that we know space-based data and artificial intelligence can achieve.”

For additional information contact:
021 136 7702

Dr Pascal Sirguey
University of Otago