Latest stories of our network
The engine of the ship Afina, our home on the From Kurils with Love expedition, was quiet. The only noise making its way into our cabins came from the sound of waves slapping against the hull of the ship. As I emerged from below deck, I saw it was misty that day. The only sense of direction I had was a vague one- we were somewhere in the North Pacific, a few hundred kilometers northwest of Japan, in a place that you would never have found on a map if not for the likes of Google maps: Tyuleny Island.
The film crew, myself included, scrambled to get ready that morning. We were pushing through the chaos of the end of the trip- exhaustion, scattered gear, and the slight hangover that comes from time spent on a ship with old (and new) friends.
Dr. Vladimir Burkanov, our unexpected guest on the journey, was already drifting into the fog in a zodiac. It was laden with 42-gallon barrels filled of water that would supply the research station on Tyuleny Island.We struggled to catch up with him, but a few minutes later, I was on another zodiac speeding off into the mist towards the island. All around me the heads of dozens, if not hundreds, of northern fur seals snuck out of the water surface. They silently stared at us, curious at the sight of the vessel passing by, before dipping back into the depths.
The smell of nature
Soon after the island came into view. The Tyuleny Island Research Station sat behind the slope of a narrow, boulder filled beach. At first glance I remember thinking that the boulders were moving. And sure enough, they were, but they weren't boulders- almost every corner of open space was covered with sprawling masses of the northern fur seals and Stellar sea lions.
It wasn't long after that I noticed the smell- not an unfamiliar one to me, but… one that seemed stronger than I had experienced before. Much stronger.
It was the smell of not tens, or hundreds, or even thousands of northern fur seals and Stellar sea lions, but tens of thousands. 50.000 of them, to be precise.
If, at this point in the story, you are wondering how and why so many large animals can make a living on an island that doesn't even reach 650 meters at its longest point- you are asking the right question.
The changes in the population of northern fur seals and Stellar sea lions here, along with their behavior and mating habits, are the exact reason Vladimir and his team spend months at the Tyuleny Island research station.
No kitchen, no heating - pure research
As I walked into the Tyuleny Island Research station, a building without heating or a working kitchen, I was surprised to see Vladimir's students and colleagues inside one of the rooms with computer screens dotted with aerial imagery and complex computing software.
The team inside the room was a small one: besides Vladimir and his colleague and the field station leader Ivan Usatov, efforts on Tyuleny are built upon the work of Anya Kirillova, a researcher from Nizhniy Novgorod; Dasha Gerasimova, a veterinary student from Irkutsk, Egor Vasyukov, a student from Kirov, and Sasha Igitov, volunteer from Kirov.
The Challenge: Studying 50.000 marine mammals
Studying such a large population is a daunting task. Simply navigating through the cacophony of sounds and smells while weaving through the moving maze of seal and sea lion bodies was a challenge for us as one-day visitors to the island. As an ocean scientist myself, I couldn't imagine the amount of labor that would be needed to get regular counts of the population here and how it changes on a week-to-week and day-to-day basis. On top of that, the team on the island is a small team with limited resources, supported only by occasional supply runs, making it all seem like an impossible task. Each survey would take days of intense work, and in order to get the best quality of data, this process would need to happen ad infinitum during each field season.
But Vladimir and his team have found a way to survey the populations anywhere from four to six times a day. How?
The technology behind the research
It all started when Vladimir's colleague Ivan taught himself to use U-Net: a type of convolutional neural network, originally made for medical purposes, which is designed to work with limited numbers of images as a training set.
Using U-net alongside existing drone technology, Vladimir and his team can capture aerial imagery suited to specific research questions. In some cases, for example, the team wants counts of Stellar sea lions and northern fur seals by age/sex (pups, juveniles, mature adults). Data related to other behaviors is also captured, like how many males and females have territory, tracking specific individuals with brands or injuries, or estimating body size.
Each of these surveys requires a huge amount of data, and getting the surveys right takes practice. Test flight paths have to be developed in order to find the best altitude, speed, time of day, and image overlap that maximizes the image quality of the drones. Anywhere from one thousand to three thousand images are collected per survey - again, with 4-6 surveys a day. Once the images are all normalized to the same scale and stitched together -often called an orthophoto plan, in technical terms- an application in the statistical programming language R created by Ivan Usatov automatically processes the images and collects the relevant information.
With that, a survey that might take days of labor can now be processed from start to finish in just six hours after the images are collected, all with an error rate in the range of 4-8%.
So what are the implications of this new integration of drone technology into Vladimir's work?
While we chose to integrate technology can be complicated, it became clear that the use of drones and modern computing techniques on Tyuleny has an outsized impact in their capacity to understand marine mammals in the region. With a bit of luck and a lot of effort, the strategic use of technology by the team here may one day help conserve the natural beauty in this tiny corner of the planet.
For many people, art is something very human, as it is creating deep connections and emotions. One of my favorite movie quotes is from "I, Robot":
Detective Del Spooner (Human): Human beings have dreams. Even dogs have dreams, but not you, you are just a machine. An imitation of life. Can a robot write a symphony? Can a robot turn a... canvas into a beautiful masterpiece?
Sonny (Robot): Can you?
We always thought, that no machine could ever create a piece of art that has an impact on us, but as artificial intelligence gets more and more advanced, art does not seem to be something only a real person can create. As a matter of fact, AI is already able to create impressive pieces of art. So, let's dive into the AI age of art with some intriguing artificial creatives.
Becoming the Muse
Finishing the unfinished<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yMzU0ODM1MC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYwMzc3NzkyMX0.wXBKCDRBEwLTNF_t9B7fJ2MmC6aEW4wMBB83UQGGt8Y/img.jpg?width=980" id="3d2d1" class="rm-shortcode" data-rm-shortcode-id="44aa272ae0fde1070a68fb9db48d3ce5" data-rm-shortcode-name="rebelmouse-image" />Photo by Spencer Imbrock on Unsplash<p>Mahler, Beethoven, Schubert, or Bruckner: Each of those composers have symphonies they did not finish in their lifetime. But an international team of experts created an AI that analyzed Beethoven's unfinished tenth symphony and finalized it. Listen to the AI's compositions <a href="https://www.telekom.com/en/company/topic-specials/beethoven-year-2020-special/details/beethoven-s-unfinished-587430" rel="noopener noreferrer dofollow" target="_blank">here</a>. Can you spot which part is from Beethoven and which is from the AI?</p>
Artificial Song<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yMzU0ODM1NS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYxOTExNzcxM30.SNWswU8Y7T2tV7WqZasNhTIClIlCD7hf0mLDLlB7DNo/img.jpg?width=980" id="c4e30" class="rm-shortcode" data-rm-shortcode-id="64dc08de4e5018d845598b573af275a8" data-rm-shortcode-name="rebelmouse-image" />Photo by BRUNO EMMANUELLE on Unsplash<p>Researchers at Zhejiang University in China teamed up with experts from Microsoft and <a href="https://venturebeat.com/2020/07/13/microsofts-ai-generates-voices-that-sing-in-chinese-and-english/" rel="noopener noreferrer dofollow" target="_blank">created an AI that generates voices singing in English and Chinese</a>. If you listen to the voices extracted, they do sound quite artificial, but as soon as <a href="https://speechresearch.github.io/deepsinger/" rel="noopener noreferrer dofollow" target="_blank">DeepSinger</a> synthesizes them and puts them into music, one cannot tell that the songs are artificially created – at least I could not.</p>
Scary Humane<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yMzU0ODM2MS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYxNTg5MjUxMn0.VlNMQALKNFENdSRz-d2aX7n4f5B7WwaZtwSSuFxlipY/img.jpg?width=980" id="80074" class="rm-shortcode" data-rm-shortcode-id="a2611d19d8ed8c9cb5b950cfc1c007b0" data-rm-shortcode-name="rebelmouse-image" />Photo by Markus Spiske on Unsplash<p>In our age of rapidly spreading fake news, we can usually rely on our reason to understand who the author is, where the information comes from, and whether the source is trustworthy. But in 2019 <a href="https://openai.com/" rel="noopener noreferrer dofollow" target="_blank">OpenAI</a> published a text generating AI which creates <a href="https://nerdist.com/article/ai-text-generator-human/" rel="noopener noreferrer dofollow" target="_blank">terrifyingly human texts</a>. Also, a study by Karlstad University in Sweden shows that <a href="https://www.tandfonline.com/doi/abs/10.1080/17512786.2014.883116" rel="noopener noreferrer dofollow" target="_blank">most people cannot tell whether an article is written by a journalist or a machine</a>. That may make it harder to sort out fake news in the future, and would need online platforms to curate information more closely. <a href="https://www.theverge.com/2019/11/7/20953040/openai-text-generation-ai-gpt-2-full-model-release-1-5b-parameters" rel="noopener noreferrer dofollow" target="_blank">THE VERGE</a> collected some examples of AI writing – they may not be perfect, but also not too bad.</p>
Creating Emotions out of Data<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="b94bb61b94fa4e30fb7262800885da60"><iframe type="lazy-iframe" data-runner-src="https://www.youtube.com/embed/I-EIVlHvHRM?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span><p>Last but not least we want to present to you artist <a href="http://refikanadol.com/" rel="noopener noreferrer dofollow" target="_blank">Refik Anadol</a>. By using large collections of data and artificial intelligence he creates fascinating <a href="https://www.artechouse.com/nyc" rel="noopener noreferrer dofollow" target="_blank">installations</a> where spectators can experience data sculptures created out of millions of pictures from different points of view. When people step into the installation they step into an alternate reality: into the <a href="http://refikanadol.com/works/melting-memories/" rel="noopener noreferrer dofollow" target="_blank">dreams of the AI</a>. And though the machine may not have emotions, it portraits it and by that impacts our emotions.</p>
- Tomorrow Unlocked > Street artists on Instagram ›
- Tomorrow Unlocked > Imagine Beyond: Human Augmentation ›
When hearing drones, most of us think of amazing drone photography or videos showing us how spectacular places look from above - or even surveillance drones. But this is just a tiny part of what drones can actually do.
In the first episode of our new web series Young Bright Minds, we talk with the experts from Voliro Airborne Robotics who use drones as hands in the sky to eliminate human risk in hard to reach places, and that also can spray on walls - please don't try it on your neighbor's walls!
- Tomorrow Unlocked > The Dangers of Flying Drones Near Airports ›
- Tomorrow Unlocked > A "catastrophic drone failure" ›