Posts

Helping The Environment Recover With Data Science

  After the Deepwater Horizon oil spill, a question that came up frequently was – how long would it be before the environment recovered? This was a concern both for the ocean surrounding the spill area as well as the marshes and beaches inland where the oil washed up. Not all spills are as bad as the Deepwater Horizon one – but a concern that comes up repeatedly when anything needs to be extracted from the Earth is –   what is the impact on the local environment and how long will it take for it to recover or at least return to a state as close to the original one as possible? This is true whether it’s minerals being extracted or gold or oil and natural gas. The recovery of land after oil and gas wells have been drilled is a question that has been studied for quite a while now. In general, most of the work has looked at individual sites and evaluated how they are doing after the extraction is complete and the system has been shut down, but there are very few studies that have b...

Snippets in Clean Technology and Data Science: Wildlife and Ecosystems

  A fun and exciting area to use data science in clean tech is in monitoring wildlife! This sector uses a combination of computer vision, remote sensing, artificial intelligence among other tools to help us track wildlife across the world. Here are a few examples of the kinds of problems and technologies that are in play these days! First, An interesting   study   came out of California recently, where scientists from the University of Delaware, University of California at Davis and the US Geological Survey partnered to track the movement of waterfowl in the region. My first question when I read the study was – why would people, other than wildlife biologists and conservationists, care about what happened to waterfowl? And it turns out that the answer is really important from the perspective of the agricultural industry as well as from a human health perspective. Looking at how close or how far away waterfowl are from poultry farms can help track the spread of avian influ...

Wildfires, Droughts, Forests and Satellites

  Drought and wildfires always seem to go together! The recent drought in California was accompanied by powerful fires that burnt several million acres of forest, including in the iconic Yosemite National Park.   The question that people often ask whenever there’s news of yet another fire resulting in severe damage to the forests is always –   isn’t there a way to figure out which areas of the forest are most vulnerable to the fires?   And until recently, most rangers and naturalists were estimating that vulnerability based on their experience and years of working in the same forest ecosystem.   Scientists from the University of California, Davis   studied aerial imagery from the forests  in California between the years 2012-2015 to predict the areas where most of the trees were dying, either due to a fire or after a fire had struck. What they found was that the areas that were the worst affected with the highest tree mortality were areas that were bot...

Snippets in Clean Technology and Data Science: Climate

  Data science has been used extensively in building climate models, downscaling climate models to regions, monitoring and evaluating the accuracy of climate models through  paleoclimate data as well as developing methods to mitigate the effects of climate change and develop alternative markets. Today’s post will look at some of the more straightforward uses of data, machine learning and spatial statistics in monitoring carbon emissions as well as building alternative market systems. The first of course is   monitoring and measuring carbon emissions   and emissions of other gases that contribute to the changing climate. Our first example comes from Europe. Researchers in Europe    created a tool to map the 177 regions in 27 countries of the EU and the carbon footprint associated with them. They used a database (EXIOBASE 2.3 multiregional input-output database) with detailed information about the world economy in 2007 and built a model that looked at the dif...

Cooling The City – Green Facades For Mitigating Urban Heat

Anyone who’s ever visited an Indian city in the heat of summer will remember the feeling that the city itself is baking – heat radiates from the pavements, the buildings and there are fewer green areas to mitigate these effects. This is the urban heat island effect – when the city is much hotter than the surrounding areas. Urban heat islands are a common problem and are only going to get worse as the climate warms. This is especially true in countries closer to the equator – summer is hot but is now promising to get even hotter. One of the solutions that people have been looking at is “greening building facades” or more simply – growing plants along the walls of buildings – vertical greening. The advantages of “green building facades” are that the plants help reduce building temperatures through shading by the leaves, reducing the impact of wind and through evapotranspiration. Now, like any other natural system – growing plants vertically means that there are a number of parameters tha...

Snippets in Clean Technology and Data Science: Sustainability Accounting

  Let’s take a look at one of the traditional clean tech sectors –   sustainability accounting . Now, this is a term that’s used in many different contexts, but traditionally, it refers to the use and flow of materials and energy. This could be locally, within a company, regionally for a specific sector across countries or monitoring a specific material over the globe. Most large companies these days track their   metrics on sustainability   –   carbon footprint, water usage, waste, conflict minerals   and so on… These metrics and the associated analyses are typically presented in reports that are one-time downloads or available in obscure places on the web. So anyone who’s interested in tracking changes over space and time for a single company or a group of companies – congratulations! You just agreed to spend a huge amount of time trying to get the data before doing anything with it. Enter the company   ESG Trends . This company was started a few yea...

Concurrent Air Pollution And Heat Waves Make People Sick

Fact – fifteen of the hottest years have come in the last sixteen years. If you are one of the people who is living through the heat waves and wondering if your asthma is really getting worse or if it’s just your imagination – well congratulations! You’re not alone and you are not imagining things. Scientists at the   University of California, Irvine    wanted to understand what happens to the air pollutants that trigger human health problems like asthma when heat waves occur simultaneously. In other words, if there is already air pollution does having a heat wave at the same time make the pollution worse? And if it does get worse, how badly does it affect people’s health?   In order to answer these questions, they overlaid detailed air pollution maps of the United States and Canada with meterological models and data about heat waves over a 15 year time period. The data was on a very fine 1 degree grid. What they found was that having both a heat wave and existing po...

Snippets in Clean Technology and Data Science: Water

  Today, let’s look at some of the ways in which sensors, machine learning and other data science tools are helping solve problems in the water sector Water conservation   is one of the largest components of the water sector. And with the droughts hitting California, New South Wales and South Africa recently, there’s been a lot of focus on education and changing people’s behavior through information.  So how do we make it easy for people to do their best to minimize water use?   Companies and organizations have tried several different approaches – public education programs about water use being one such example. Another being the water comparison report that water companies in California started sending out to their customers with the monthly bill. It’s a short summary that shows how your water usage compares with your neighbors and how much water you have used against your allocation. This is a fairly straightforward use of data science – it uses a nearest neighbor ...

Snippets in Clean Technology and Data Science: Agriculture and Food

  In today’s post, we’ll take a look at a few problems in Agriculture and Food that are being solved using machine learning, computer vision, social networks and satellite data among other data science tools. What do social networks, sensors, food and farms have in common? Social media immediately makes us think about Facebook, Snapchat, Instagram, Whatsapp, Google and all the different ways in which we human beings connect with each other today. All these apps use Graph and Network Theory to understand how people may be connected to each other, the links between them and how strong or weak those connections are. Reid Hoffman of LinkedIn famously said that “we’re all six weak connections apart from each other” and in today’s connected world, that number looks like it’s getting smaller and smaller. So what would social media have in common with agriculture? First, there’s always the way in which farmers and workers interact and connect with each other.   Several startups l...

Snippets in Clean Tech and Data Science

  Over the next few months, we’re going to take a quick look at examples of problems in clean technology where data science is used to create solutions. This is our “snippets series” for the year and an introduction for folks who are interested in a flavor of what data science and clean tech can do together. This series of posts will focus on several clean tech sectors – starting with the Agriculture and Food sector.

Where Are The Clean Tech and Data Science Startups?

Image
  An interesting place to look at how the ecoinformatics market is evolving is to take a look at the startup scene in this space. What’s really interesting about the clean tech and big data space is that innovation happens at all levels – startups, national and state government institutions, cities, large companies, non-profit organizations, just to name a few. People and organizations are working to solve problems at different scales and that drives innovative solutions in all the different clean tech sectors. For example, the Nature Conservancy is doing some really interesting work in looking at how remote sensing and machine learning can be applied to wildlife and conservation. Similarly, cities in California are experimenting with smart meters and social media to improve water conservation.   However, let’s look at startups in the space as surrogates for estimating the market. And as expected, a picture emerges of a few sectors that are being heavily funded. The   Cle...

An example marketplace: The Multi-Billion Dollar Investment Market for Conservation

Image
  Here we’re going to take a look at one of the smaller sectors in clean tech and look at how data science is making a huge impact. This is just an example of how the market is likely to evolve for the ecoinformatics sector.   The environment has often been seen as nothing more than an unlimited source of materials that are then turned into useful products that human beings can use. While this viewpoint was challenged in the latter half of the 20 th century, there still remains a sense that the environment is more of an after thought for business rather than something that has value and contributes to a business.   So it’s really interesting, especially in our current climate, to see how investing in conservation and ecosystems has performed. The   Ecosystem Marketplace    put out a report showing that   private investment in conservation has topped $8 billion globally  in 2016 and that   investors are expecting a rate of return of at least 5...

How Big is the Clean Tech and Data Science Market?

Image
  This month we'll be talking about the market for Ecoinformatics or the intersection between Clean Tech and Data Science! To start with, let's look at some numbers for each sector independently. The clean technology market size has been variously estimated at between   2 and 6 trillion dollars   over the last decade. A recent study published by the World Bank showed that the market size in   2012   was estimated at approximately   $5.5 trillion . The main sectors are shown below (by percentage). In short, energy (solar, wind, energy efficiency, alternative fuels), agriculture and water make up the largest part of the clean tech scene with energy being the dominant player at this time. Each of these sectors is a multi-billion dollar sector in itself, so it isn't hard to see that data science use cases for each of these sectors will also constitute a multi-million dollar market at the least, if not more.   The market size for data science is harder to e...

Clean Technology Meets Data Science 101: Part 2

  The Harvard Business Review   called the job of a Data Scientist “the sexiest job of the 21 st century”. It’s a field that been booming in the last five years or so, with applications in multiple sectors – from finance to health to computer science to space and more recently to clean technology. Data Science or Big Data   as it’s sometimes being called is a relatively new term that refers to processes and methods to generate, process and develop insights from data. With more people coming online these days and generating large volumes of data, we’ve had to use methods and techniques from a wide range of disciplines to handle the speed, volume and variety of the data and understand what the data are telling us. That’s where the whole concept of “Big Data” or Data Science has come about – it’s a multi-disciplinary field that uses a basket of methods and tools from different fields, especially statistics and machine learning. Some of the topics I talk about in my list belo...

Clean Technology meets Data Science 101: Part 1

  Clean Technology   was created as a “catch – all” term for several different fields that study and solve problems impacting the Earth and humanity’s ability to live sustainably on the planet. The fields of study range from environmental engineering, where systems to solve pollution in the environment are developed, to urban planning which includes designing sustainable cities and the infrastructure that powers them, to material science where researchers create new materials that can be used with less impact on the environment in extracting and disposing of them, to ecology which encompasses biodiversity, wildlife preservation and the study of the interactions between the Earth’s systems and human behavior. All these fields developed as people grew interested in solving particular aspects of environmental problems. In many ways, they represent different ways of looking at and solving problems that affect the same system. As an example, if we were to look at water as a system ...