Quantcast
Channel: CARTO Blog
Viewing all 820 articles
Browse latest View live

The Data Observatory's reach expands to England & Wales

$
0
0
England & Wales


We are proud to announce the availability of demographic data for England and Wales from the Office for National Statistics in the United Kingdom.

With much focus right now on the Brexit results and what they will mean to the people, we felt it was an important time to make this data available in the Data Observatory. The release represents some of the richest demographic data available in the area and it is now easy to access and blend with your own data.

In England and Wales, the Data Observatory now includes:

  • Population and general demographics (age, gender, etc.)
  • Occupation and economic involvement
  • (In Wales) health characteristics
  • Languages spoken
  • Race & ethnicity
  • Religion

We’ve already had the opportunity to use the release to enrich data in some of our analysis projects. Take a look.

Twitter anticipates Brexit

In this dashboard, it’s possible to see which segments of the UK population tweeted for or against Brexit. Segments are based off the same demographic information now in the Observatory:

Mapping Brexit results

In this dashboard, the results of the Brexit vote can be drilled down alongside a subset of demograhpic characteristics:

Discover how the Data Observatory enhances your location-data through advanced analysis methods in our recorded webinar. Watch it as many times as you need to!

Happy data mapping!


Connect with CartoDB in July!

$
0
0
July's events

CartoDB is more dedicated than ever to bringing web-based mapping solutions and advanced analytics to your geospatial data in the most intuitive and insightful way possible. We love engaging with the many communities around the world that we are proud to be a part of, so we are hitting the road to collaborate, educate and create! Whether you are on the East Coast or the West Coast of the US, we hope to see you at one of the many exciting events happening in July.

CartoDB will be participating in, and sponsoring, Maps Camp on July 9th in New York City at the United Nation Headquarters. The event will be a fascinating opportunity to engage with over 6,000 participants from all over the world and discover how open source technology can benefit the mapping/GIS world and vice versa.

If you can’t make it to Maps Camp, or if you just can’t get enough of open source technology solutions, be sure not to miss the Data Base.Camp conference on July 10th, also held at the United Nations Headquarters (NYC). Developers from open source associations will be present, along with many brilliant minds from academic institutions and private technology companies, all of whom are eager to share their knowledge and expertise with you.

Javier de la Torre, CEO and co-founder of CartoDB, will give a talk at 5:00 p.m. This will be a great way to learn more about our company, our constantly improving product, and all the exciting things that lay ahead for us, so don’t miss out!

In true New York City summer fashion, join us for free beer and food at Brooklyn’s Super Meetup on July 20th. During the event, which CartoDB is sponsoring, you can get to know more about the local tech community, startups and entrepreneurial companies. You will have the chance to meet new user groups, organizations and thought leaders so you can share your tech savvy knowledge and resources, all while expanding your networks.

We got love for the West Coast, and, of course, Maps! CartoDB will travel to Seattle,Washington to attend SOTM US, also known as State of the Map US, where we are proud to be one of the many great sponsors. Come soak in the beauty of maps in this great city! The event will be held at Seattle University on Capitol Hill on July 23rd.

Meet other mappers and learn how to work with OpenStreetMap and its newest developments. There will be tons of talks, workshops, hacking, mapping activities and meetings to make it well worth your while!

We hope you are as excited as we are to take part in all these awesome events, see you there!

Happy data mapping!

Introducing CARTO Builder: A new way to analyze and visualize location data

$
0
0
CARTO Builder

Today we are excited to showcase and open the beta program for our new product—CARTO Builder. We’ve been working really hard on rethinking location data analysis techniques and have come up with some exciting new concepts that we believe will make them widely more accessible. But before the big reveal, we’d like to touch on the background to this new product.

In 2012 we launched CartoDB with the goal of providing a set of tools and APIs that would allow for the easier development of spatial applications on a user experience-focused platform—location applications did not have to look like old GIS desktop tools migrated to the web, and developers did not need to be spatial database experts to work with maps on the web. At the same time, we provided users with an accessible tool, the CartoDB Editor, for creating maps on the web. This successfully enabled data analysts and non-developers to publish stories with location data.

Today, we are looking at going one level deeper to make Location Intelligence (LI) more accessible. We think this step is so big that we are taking the opportunity to rebrand the company and call ourselves CARTO; we are dropping the DB because we are not a database, we are an LI platform!

Universalizing LI starts with enabling spatial analysis without having to learn SQL, code, or complex model building. Our new language for spatial analysis will make discovering key insights a fundamental skill for data analysts.

To put insights into action we have made them accessible to organizations; we’re doing so by adding business intelligence (BI) capabilities to widget-based applications. With CARTO Builder, you can now create and share full exploration and analysis applications without having to write a single line of code.

CARTO Builder

Today we are opening the beta program for CARTO Builder. You can request access by filling out this short form.

To ensure a smooth transition from the existing CartoDB Editor to the new CARTO Builder, we’ll be rolling it out in progressive phases over the summer. Expect to see some video tutorials and demos which will highlight the functionalities and power of this new technology.

We can’t wait to get your feedback and see what applications get built with it!

The CARTO team

Taking a look at NBC's realtime Zika dashboard created with CARTO Builder

$
0
0

The Zika virus has been around for over 50 years but it wasn’t until this year that the World Health Organization declared it a Public Health Emergency of International Concern, as the virus continues to spread to new areas.

Recently, NBC Washington published a map of real time Zika cases in the United States, built with CARTO’s new Builder! This visualization is one of the first applications of our new technology for providing people with a clear and accessible view into a real-life situation. With CARTO Builder, it is our hope that media, businesses, and citizens are empowered to quickly and easily perform analysis to tell important stories while discovering new insight within their data.

How does CARTO Builder enable this level of interactive design? Using the NBC Washington map, let’s take a look at some of CARTO Builder’s unique features that transform this visualization into an exceptionally helpful piece of location-based data analysis.

One of the most prominent features you will notice right away is the interactive dashboard on the right side that allows for a granular level of analysis. In moments, anyone can use the Builder’s user interface to create fully equipped dashboards with no coding required.

zikawidgets

Using dashboard widgets, the real time Zika map enables storytelling that empowers users to understand and indicate patterns over time, to catch an accurate glimpse into a very critical and important situation.

The widgets are one of CARTO Builder’s most easy to implement and intuitive features. You can select from a wide variety of widgets out of the box. Everything from mathematical formulas, to categorical and histogram selectors, to time series sliders, allowing for versatility and ease in dashboard creation.

builderinterface

Once widgets are in place, the Builder allows users to quickly position and modify the widgets themselves. In just a few clicks users are able to change texts, positioning, aggregation methods, and a variety of other variables that make the Builder’s dashboard look and feel as sophisticated as its analysis.

buildercustomization

Another notable element of CARTO Builder is it’s ability to remain dynamic when working with real time data. We wanted to focus on experience and make the interface intuitive, but also increasingly powerful for data analysis. While CARTO Builder makes complex analysis and design simple, we’ve retained the advanced SQL and CartoCSS functionalities available from the Editor and improved the coding interface.

expertmode

The data we used in creating the map is directly synced with the Center for Disease Control. Because of this, it was essential for us to modify the data on the fly as it came, so that formatting and design could remain consistent as the case numbers grew. With CARTO Builder, we were able to automate both how the data was presented, and how it populated on the map in real time.

We hope you enjoyed taking a look into CARTO Builder and how it’s being used and stay tuned for more news and interesting applications.

Happy data analysis!

Story Spelunking in Spain Using the Data Observatory

$
0
0
How many cars per person?

The Data Observatory keeps on growing! After our initial release, which included the American Community Survey in the United States and the Spanish Census, and later demographic data from the U.K., we’ve leveraged local economic indicators from CaixaBank to vastly expand the scope of the Data Observatory.

We asked some colleagues in Madrid to play with the new data, here’s what they found:

Just a few SQL statements can bring the data into your CARTO map. In addition to the demographic and housing measures that were already present in the Data Observatory (population, education level, etc.) there is now a suite of economic measures available, such as:

  • Number of businesses
  • Type of business (industrial, retail, wholesale etc.)
  • Further detail on those businesses (manufacturing, supermarket, mining, etc.)
  • Number of vehicles registered (automobile, bus, trucks and vans, etc.)

These can be easily normalized against existing measures in Spain, as well as mixed with your own data.

A quick dashboard immediately reveals something strange.

While most municipalities in Madrid have fewer cars than people, Robledo de Chavela and Colmenar de Arroyo, on the western edge of the city, possess fewer than 5,000 people, but over 100,000 cars! With over 17 cars per person, they immediately pop as major outliers on the map.

A Google search tells us that Robledo de Chavela is a“tax haven” for cars.

With hundreds of measures in Spain and hundreds more in the U.S., what stories do you think you can find in the Data Observatory?

El Diario visualized the June 26, 2016 Spanish general elections to discover which political parties received the most votes municipality by municipality based on voting totals. Now imagine combining that data analysis with the Data Observatory’s economic measures to gain imperative insights on what a high or low voter turnout means for economic resources region by region.

Continuing our analysis of Colemenar de Arroyo and Robledo de Chavela, we now know that less than 50% of their population votes but are disproportionately exempt from vehicular taxes.

Discover how the Data Observatory enhances your location-data through advanced analysis methods in our recorded webinar. Watch it as many times as you need to!

Happy data analyzing!

Building a Great Collection of Indoor Maps with Micello

$
0
0
Indoor Maps with Micello

In previous posts, we covered how the Mobile SDK can be used for indoor mapping. We really like indoor mapping because it is a unique way to visualize nontraditional geographic spaces like conferences, hospitals, and museums. A great example of this is the L.A. Times interactive graphic that charts every shot Kobe Bryant has ever made on the basketball court.

As of lately, we’ve done some specific integrations with Micello, an award-winning company that specializes in building the world’s largest collection of indoor maps. Specifically, we used their data collection on public venues like shopping malls and airports for a mobile app.

To use Micello, register and request permission to access their Data API, which gives some useful metadata and GeoJSON for different floors in geographical coordinates. For our application we requested a specific venue – a large shopping mall in California. Be sure to follow Micello usage terms like adding attribution to the map view when using their data!

Here, we have an indoor plan from Micello:

Indoor Maps with Micello

Our Mobile SDK has direct GeoJSON loading methods, but we prefer to consume the data via the CARTO platform because it offers several advantages:

  • CARTO converts data to vector tiles for fast and beautiful rendering when the data amount is very large.
  • CARTO Engine has great APIs for native mobile SDK and for the web.
  • CARTO Builder provides a nice preview of data in map and tabular forms, as well as Turbo-Carto, a pre-processor to style maps, with styling changes applied to mobile devices automatically.
  • You can also use business intelligence functionalities to reveal location patterns of people at your venue or event. CARTO’s business intelligence capabilities are especially useful if you are collecting data using sensors.

For this indoor map, we used a simple data converter script to combine data from different floors and different object attributes to a single table. Output of the script is also GeoJSON, so it can be easily imported into CARTO.

This is how that same map looks in our new CARTO Builder, before proper styling:

Indoor Maps with Micello

You can do some styling to make your visualization look nicer, group floors to different layers, and add layers for labels. A good thing is that the data structure is the same for different venues, so styling work can be recycled.

We ended up with the following visualization:

Indoor Maps with Micello

Which can be extended to a 3D building visualization with simple, standard CartoCSS:

Indoor Maps with Micello

We love creating new ways to visualize various types of spaces, whether traditionally geographic or indoors, and the CARTO Mobile SDK is a great resource to use when considering future spaces and how you can bring maps to your consumers and clients online and offline!

Learn about these and many other Mobile SDK features in our recorded webinar on applying CARTO for native applications, offline maps, 3D overlays, and indoor map use cases. Watch Getting Started with CARTO’s Mobile SDK as many times as you need to!


Happy indoor mapping with CARTO!

Three Measures in the Data Observatory Worth Exploring

$
0
0

We are making so many new measures available through the Data Observatory that we just had to highlight some interesting ones.

1. US population with a Master’s Degree

dominant degree The supply and demand ratio for PhDs has gone crazy in recent years. At the same time there are alternative voices that are doubting the utility of higher education for many types of people. We’re not sure what sort of effect these types of stories will have over the long-run. But for sure, we can identify populations worth keeping an eye on. Here’s one for example, the population count that holds a Master’s Degree.

Grab some geometries

Here we will grab an area around Baltimore defined by a custom bounding box and insert them into an empty table we created in our CARTO dashboard. We are using the nice clipped geometries released previously.

INSERTINTO<mytablename>(the_geom,name)SELECT*FROMOBS_GetBoundariesByGeometry(st_makeenvelope(-76.89468383789062,39.050118705681825,-75.99655151367188,39.53529197854428,4326),'us.census.tiger.block_group_clipped')Asm(the_geom,geoid);

Add some data

Next, we’ll add a numeric column called, masters_degree and populate it with values from the Data Observatory. We can request the data in two ways, raw counts,

UPDATE<mytablename>SETmasters_degree=OBS_GetMeasureByID(name,'us.census.acs.B15003023','us.census.tiger.block_group_clipped','2010 - 2014')

Or normalize it on the fly with Population over 25.

UPDATE<mytablename>SETmasters_degree=OBS_GetMeasureByID(name,'us.census.acs.B15003023','us.census.tiger.block_group_clipped','2010 - 2014')/NULLIF(OBS_GetMeasureByID(name,'us.census.acs.B15003001','us.census.tiger.block_group_clipped','2010 - 2014'),0);

2. London area European population born outside the UK and Ireland

born outside UK With the Brexit vote come and gone, a lot of people are digging into the data to better understand how it came to be and what impacts are coming. The Data Observatory is full of measures to help. Here is one that is particularly interesting, Population born in Europe but outside of the UK or Ireland.

Get the geoms

INSERTINTO<mytablename>(the_geom,name)SELECT*FROMOBS_GetBoundariesByGeometry(st_makeenvelope(-0.5912017822265625,51.28854705640744,0.3069305419921875,51.678942096371244,4326),'uk.cdrc.the_geom')Asm(the_geom,geoid);

Add some data

Here, we are normalizing the value on the fly with the total population in each area.

UPDATE<mytablename>SETborn_europe_outside_uk_ireland=OBS_GetMeasureByID(name,'uk.ons.LC2205EW0091','uk.cdrc.the_geom','2011')/NULLIF(OBS_GetMeasureByID(name,'uk.ons.LC2102EW0001','uk.cdrc.the_geom','2011'),0);

3. Spaniards age 35 through 39

age in spain This is an interesting Measure for a number of reasons. Age data in Spain is of particular interest. While the life expectancy grows the predominant age groups get younger. If you look at the map above, you find that cities are young, while the surrounding country is aging. We like to share this map so that we can remind the CARTO’ers in Madrid to go visit their parents. If we had to pick one Measure from Spain though, the 35 through 39 year old group has got to be it. It’s one of the most populous age bins, but is slowly losing the lead to the 30-34 group. Go find out where these people are.

For Data Observatory users, this is how you’ll add a column that counts the number of Spanish people from 35 through 35 in an area (or a rate for a point).

Get the geoms

INSERTINTO<mytablename>(the_geom,name)SELECT*FROMOBS_GetBoundariesByGeometry(st_makeenvelope(-3.8960266113281254,40.329795743702064,-3.44696044921875,40.56832825339617,4326),'es.ine.the_geom')Asm(the_geom,geoid);

Add some data

Again, normalizing on the fly with the total population of the area.

UPDATE<mytablename>SETpop_35_39=OBS_GetMeasureByID(name,'es.ine.pop_35_39','es.ine.the_geom','2015')/NULLIF(OBS_GetMeasureByID(name,'es.ine.t1_1','es.ine.the_geom','2015'),0);

More

Learn more about all the measures, boundaries, and discovery methods in the Data Observatory over on our documentation page or by watching our webinar!

Happy data analyzing!

Effects of Overfishing, Made Better with Location

$
0
0
Illegal Fishing

CARTO has an extensive history with working alongside non-profits and non-governmental organizations to provide insights to better serve humanity and the world. Recently, several NGOs and different environmental organizations like FishSpektrum, a big data project focused on improving knowledge on fishery activity around the world, have been working hard to bring awareness about a global problem affecting humanity, especially in Western Africa: overfishing.

The countries comprising this region have some of the richest areas of fishing waters where many commercial fishing vessels supply markets in Asia and Europe. However, it has produced critical social, economic, and human consequences, especially to artisanal fishing people.

International efforts started to monitor and report overfishing and illegal fishing activities to avoid the complete extinction of West Africa’s fishing population. Their efforts helped mediate the loss of a vital source of protein for West Africans and opportunities left for regional production and trade.

Despite the cautions that were implemented, illegal, unreported, and unregulated (IUU) fishing is at the center of the problem.

To have a clear image of the big impact of these fishing practices movement of 35 reefer ships in 2013 was represented using the CARTO platform based on FishSpektrum databases – one of the world’s largest fishing vessel tracking resources.

By using this interactive visualization you can check the itinerary of each vessel, the stops it makes, and the trips it fulfills. Also, the visualization emphasizes areas of transhipment and displays catches from small fishing boats to reefer ships.

You’ll notice that each orange dot shows a point where a boat has emitted a signal, where an elevated number of signals turns into a hotspot represented by a circle. This means that at these specific places the ship has either switched off its engine or has reduced its cruising speed to a maximum of 1 knot, the equivalent of one nautical mile per hour.

A high density of hotspots and a variable track pattern reveals that vessels are fixated on a particular area and are focused on specific transhipment practices.

CARTO’s location intelligence helps indicate where there are IUU routes and where fishing may occur, so that they can be more controlled to assure the correct activity on the pathways of the ocean’s water, avoiding the possible extinction of species.

Ending IUU fishing and developing strong national and regional fishery sectors can generate multiple benefits and sustainable development. We hope to continue to see positive changes towards getting this crisis solved soon.

Happy data analyzing!


The Data Observatory welcomes Mexico!

$
0
0

We’re thrilled to announce that the Data Observatory is welcoming Mexico into the fold with an impressive array of demographic data from the Mexican Census. This new data is specific to the block level in metropolitan areas!

With over 300 measures, Mexico’s census is one of the richest in the Observatory. In addition to bread and butter data for normalization like population, households, and dwellings, this census contains detailed information about household access to amenities from running water to computers.

Using the new Carto Builder, we put together a dashboard in just a few minutes to take a look at Mexico’s census at its most detailed, at the block level in Mexico City.

In particular, we were curious about transit: New York City and Mexico City are comparable cities, with 8.5 million and 8.9 million people in their respective urban areas. Even the surrounding metropolitan areas are comparable, comprising about twenty million each, including the cities. New York City’s subway system moves about 1.8 million people per day; Mexico City’s, 1.7 million.

New York City is remarkable in the US for relatively low rates of car ownership, made possible by that public transport. Mexico City is currently in the midst of a pollution crisis, which is driven in large part by auto emissions.

Many people in New York choose not to have a car because they don’t need one to get where they need to go. Taking a look at Mexico City, it looks like different factors are in play.

Using the histograms and filtering features of the Builder, we could quickly see that blocks within a few hundred meters of metro lines, suburban railway, or Metrobús did not show lower rates of car/van ownership:

Filtering by distance to metro

Blocks with high population density didn’t have more car-free households, either.

Filtering by density

While the census in Mexico does not keep track of household incomes, there is information about certain amenities – in particular, computer ownership – that could be considered a proxy for wealth.

Filtering for areas with high rates of computer ownership quickly reveals a direct relationship to car ownership, meaning that having the money to own a car is a much greater incentive than the requirement to have one because of poor access to transit.

Filtering by car/van ownership

Using very similar measures from the 2014 US American Community Survey (ACS), we put together an equivalent dashboard for New York City.

The similarities of scale in households and population are immediately striking. Experiment with filtering by proximity to transit and household density, though, and you’ll see a starkly different pattern than in Mexico City: areas near trains and with high density have much lower rates of car ownership, even if they’re wealthy.

Happy data analyzing!

Anti-Eviction Mapping Project and CARTO Expose Realities of Gentrification and Evictions in San Francisco

$
0
0

San Francisco has long been at the forefront of the discussion about the impact gentrification and the changing economic and demographic landscapes have on cities and the people who live there. CARTO has partnered with San Fransisco-based Anti-Eviction Mapping Project in order to analyze the data trends in rapid gentrification and the eviction of local populations.

Recently, this partnership produced an insightful map which was published in Fastco Design, demonstrating how a growing tech industry is leading to an increased demand for housing, resulting in an increase in evictions. Understanding causal relationships at play is crucial while advocating for policy that can protect the people who feel the intended and unintended consequences of a changing city.

With this analysis, we used CARTO’s Data Observatory to augment the data provided to us by AEMP.

The first steps we took were to take the locations of each eviction in 2015 and aggregate them into the census tracts that they fell within, making sure to sum over the number of evictions at specific locations. The Data Observatory was crucial here because it allowed us to easily get the census tract boundaries only for San Francisco. Aggregating points into the Census boundaries, we got the counts of evictions by census tract.

Our next step was to give those counts more context by dividing by the number of households in each census tract from the American Community Survey. Using the CARTO Builder again, those values can be retrieved by adding an analysis step to enrich from the Data Observatory. Dividing our eviction counts by the number of households over 10,000 gives us a solid metric for comparing eviction rates in different census tracts: number of evictions per 10,000 households.

Anti-Eviction Mapping

Now that we have a solid metric for analysis, we can start adding additional factors to provide a richer context. One of our favorite datasets is of demographic segmentation produced by Spielman and Singleton. It is a great dataset for enrichment because it distills much of the complexity of the demographic variables down into human-readable descriptions of the underlying demographic information at different locations. Read more about demographic segments in Stuart’s blog post.

Finally, adding Zillow Rental Estimates gives us a good metric for comparing different parts of San Francisco. Specifically, we can explore how eviction rates compare above and below the median rent for a one bedroom apartment, which is around $3300 for 2016. I threw on some of the CARTO Builder widgets for exploring the data dynamically. Using the Zillow data for the filtering, and looking at the results in the widget I made for the segmentation categories.

Robust and diverse data sources are crucial in understanding the full extent of any problem. Visualizing this data allows for meaningful analysis that can help guide policy and improve advocacy efforts by quite literally putting people on the map who do not have much visibility. The CARTO Builder and the Data Observatory make this process intuitive and easy while producing meaningful analysis. Request your access today and get started with CARTO!

Happy data analyzing!

New Academy Lesson: How to Choose Map Colors, Part 2

$
0
0
Map Colors

Learn how to create beautiful, informative map palettes step-by-step in our new Map Academy Intermediate Design lesson: How to Choose Map Colors, Part 2.

Color is extremely important in cartography, because relationships between your map colors give your features meaning. They tell the story of your data…or obscure it if not used wisely.

Our last color lesson demonstrated how to choose colors and adjust them for legibility. Now we’ll show you how to put those colors together into the right kind of palette for your map, like in the one above made by CARTO users The International Federation of Red Cross and Red Crescent Societies.

How to Choose Map Colors, Part 2 explains what sequential, divergent, and qualitative palettes are, and when to use them. You’ll also learn more advanced CartoCSS tricks like these to create your own color schemes:

spin(#da0057,225);
Color Palette Step 1
mix(#da0057,#ccc,66%);
Color Palette Step 2

We hope you find the new lesson useful. If you have feedback on this lesson or want to suggest another, please let us know at support@carto.com.

Happy data analyzing!

Announcing Batch Queries on the SQL API

$
0
0
Batch Queries

During the last few months, to create a more compelling platform and provide all the necessary functionality for the new Builder, we’ve made some additions to our Engine. Before we began working on those additions, we learned from our clients, users, and partners how they could best leverage the Engine to accelerate and improve their development workflows.

As most of you have experienced, some geospatial operations, such as spatial intersections or calculating a convex hull, have long-running CPU processing times. Implementing those methods using the synchronous SQL API had some caveats, like having to block your application’s UI.

Today, we’re happy to announce the addition of Batch Queries in our existing SQL API. This will allow you to run queries on your data in CARTO in an asynchronous way.

Quick intro to the Batch Queries of the SQL API

Creating a Batch job in the SQL API is as simple as: ​

curl-XPOST-H"Content-Type: application/json"-d'{"query": "CREATE TABLE world_airports AS SELECT a.cartodb_id, a.the_geom, a.the_geom_webmercator, a.name airport, b.name country FROM world_borders b JOIN airports a ON ST_Contains(b.the_geom, a.the_geom)"
}'"http://{username}.carto.com/api/v2/sql/job?api_key={your_api_key}”

After creating a job, you will be able to call the API to get information about its execution. You will be able to discern whether a job is waiting to be executed (pending), running, done, failed, or canceled. Getting the information about a job is as simple as:

curl-XGET"http://{username}.carto.com/api/v2/sql/job/{job_id}?api_key={your_api_key}"

If you check the complete documentation you will see that you can also get a list of all your jobs and explicitly canceling or updating a job.​

Chaining SQL Queries to automate workflows

Automate Workflows

Another thing we noticed, is that applying several queries sequentially was a very common practice when working on complex geospatial applications. Part of the magic behind the Batch Queries on the SQL API is here to fix that. From now on, create chains of queries as part of a single job that canl be executed sequentially.

curl-XPOST-H"Content-Type: application/json"-d'{"query": ["CREATE TABLE world_airports AS SELECT a.cartodb_id, a.the_geom, a.the_geom_webmercator, a.name airport, b.name country FROM world_borders b JOIN airports a ON ST_Contains(b.the_geom, a.the_geom)","DROP TABLE airports","ALTER TABLE world_airports RENAME TO airports"
  ]
}'"http://{username}.carto.com/api/v2/sql/job?api_key={your_api_key}"

You’ll also notice in the documentation that you can define ‘on error’ and ‘on success’ fallbacks for each of your queries within a job. This will allow you to specify a new location to store the previously updated data, for example.

Batch Queries in the SQL API as part of the CARTO Platform

Although we use Batch Queries in several areas of the platform, such as the Data-services API or the new Builder, it’s the soon to be released Analysis API, which will make the most intensive usage of Batch Queries. Each Analysis workflow in the Builder defines a job in the SQL API. Isn’t that cool?

Now that we are working full throttle on all these new capabilities of the platform, we would love to hear your ideas on how to leverage this new functionality for your projects as well as your feedback on the API itself.

Happy querying!

Guest Post—Analyzing Agricultural Policy With Farmland Monitoring Project

$
0
0
Post—Analyzing Agricultural Policy

CARTO’s Grants For Good Program is excited to share the great work being done by our grantee, Farmland Monitoring Project. It is our pleasure to introduce Adam Calo, PhD student at UC Berkeley specializing in agricultural policy in California, and Farmland Monitoring Project team member. In this guest post Adam tells us about his project and the mapping process with CARTO.

After interviews with farmers in the California Central Coast, I decided to focus my research on the theme of land access for small scale and beginning farmers. I was originally fascinated by the ecology of agriculture, but after talking to tenant farmers in California I recognized the need to deal with social and political constraints on farmer’s autonomy. Chief among those is the issue of a lack of secure land access.

I wanted to see how promising and more accessible information technologies might interact with this issue of farmland access. Could participatory mapping tools match farmers to available land? And could open mapping platforms bring to the fore key information about land tenure in a critical agricultural region?

These questions brought forth the Farmland Monitoring Project (FMP) and CARTO quickly filled a central role in the project’s main web application. Agriculture’s administrative dynamic relies on land ownership parcels, zoning laws, legal boundaries that indicate, restrict, or incentivize agriculture. In terms of data, these can be thought of administrative boundaries, water district zones, and ownership parcels. A useful mapping tool for farmland access should both represent official data and allow for farmers, landowners and other actors in the food system to submit their own assessments about available land and existing farms. Here’s how we set out to do this, using CARTO as a central piece.

First we go out into the wild and locate public datasets like parcel data from the county assessor. We clean them using ArcGIS as best as possible then import them into CARTO. Removing urban parcel (very tiny) was really helpful in getting the datasets to an appropriate size with an ability to render quickly. There we use the SQL and Postgres functionality embedded in CARTO to make subsets of data and join data layers where appropriate. In doing so, we were able to make a contiguous parcel map of three adjacent counties with ownership information attached.

We then use CARTO.js to embed the data in our custom application. At this point, my skills as an amateur map scientist have been adequate, but to host a custom application a PhD student in the UC Berkeley School of Information, Seongtaek Lim, lent his support. He decided to use Django to support the application, so that the tool could be managed by someone with my level of expertise through built in controls in the admin panel. The main customizable feature needed was to allow individuals, like farmers, landowners, or agricultural professionals to submit their own queries upon the data we have aggregated.

Next, we need to allow for citizen monitoring of farmland access. This meant the ability to capture near-real time submissions from mobile devices. For this, we turned to Ona.io, a mobile data collection platform, and a bit of our own tools to automatically pass new submissions to CARTO layers.

The creation of a technical intervention seems a little backward. But, there is a lot of good evidence out there that when a group monitors a resource (like suitable farmland) the same group is likely to take political action to safeguard that resource. My brief exploration into the world of farmland investment has shown that powerful speculators have been readily monitoring agricultural land for some time. Perhaps the FMP can open the door for a more open farmland monitoring process.

The FMP has two main features: the ‘map’ application is a tool for running custom queries about agricultural land in a select California region. The mapbook page is a series of map stories that explore land access more broadly. There are plenty of maps there and more to come!

Happy data mapping!

Mapping for a Cause: the Telefónica Yamaha Globalrider Fundraiser

$
0
0
Global Rider route

On May 27, 2016 Telefónica and Yamaha kicked off Globalrider, the world’s first ride-around-the-world fundraiser on a motorcycle where both the rider and bike remain fully connected along the 22,990-mile route of the eighty-day race.

Its chief architect and solo rider is Hugo Scagnetti, a Telefónica employee whose bold promise was the catalyst of the collaborative endeavor that allowed him to begin his eastward journey from Madrid seventy-four days ago.

After an injury caused by avascular necrosis resulted in his inability to take steps without crutches, Mr. Scagnetti vowed that if he could ever walk again without them, he would circumvent the world to raise funds for stem cell research in tissue regeneration for young children—the population typically affected by avascular necrosis of the proximal femoral epiphysis and growth plate, otherwise known as Legg-Calve-Perthes disease.

CARTO is honored to be a part of Mr. Scagnetti’s adventure for charity.

Harnessing the data compiled by the technology on his motorcycle, CARTO has been providing public, real-time tracking of Mr. Scagnetti’s location throughout the expedition. But in addition to giving visibility to his whereabouts we have also been mapping—literally—the real-time changes in Mr. Scagnetti’s heart rate, braking and acceleration patterns, speed, and even surroundings, via the visualizations of the alterations in the CO2 levels (ppm) of the continuously-changing environment he has so far ridden through.

With this project CARTO is lifting the static and variant data collected on a motorcycle travelling around the world and visualizing it against geolocation to give new meaning and context to the numbers this data represents.

To follow the remaining portion of Mr. Scagnetti’s trip or to explore historical data of its completed segments, please visit the official page, where you may also, if you wish, make a PayPal donation to the research team of the Hematology Division at Hospital Universitario Puerta de Hierro de Majadahonda and to the Traumatology Division of Hospital Universitario La Paz in Madrid, the two beneficiary institutions of this fundraiser.

We wish Mr. Scagnetti the very best of luck on the final leg of his extraordinary journey, and look forward to welcoming him home to Madrid.

Happy Analyzing!

Going to FOSS4G in Bonn, Germany? Come check out the latest and greatest with CARTO!

$
0
0
view of Bonn

Each year the open source geo-lovers at CARTO (which is pretty much everyone) sets their sights to FOSS4G as a landmark event to not only share how we’re impacting the world of free and open source software for geospatial, but to also connect and learn with our fellow geo-aficionados.

This year’s edition in Bonn, Germany is especially meaningful for CARTO, as we’ve been quite busy doing things like acquiring a mobile mapping company, pushing the boundaries of open source spatial design, and developing what we consider to be the next big thing in open source location technology with CARTO Builder.

While FOSS4G will certainly be a whirlwind, there will be quite a few opportunties to connect with us, make new friends, and learn a ton. For starters, come check out our booth, where we’ll be demoing nonstop and dorking out on open spatial analysis. Stay tuned to Twitter for a booth number in the near future. We also have some talks and in-depth workshops worth checking out that will certainly blow some minds.

Workshops and presentations

Building Dynamic Maps with CARTO

This 4 hour intensive hands-on workshop presented by Santiago Giraldo, will focus on creating beautiful, interactive, and sharable spatial analysis for the web. While this session does not require any technical skills, participants will quickly learn the fundamentals of making maps in CARTO Builder, and progress into advanced analysis and design workflows.

When: Monday August 22nd 9AM-1PM
Where:Gustav-Stresemann-Institut e.V

Publish your Geodata in Online/Offline Mobile Apps

This session, presented by Jaak Laineste will introduce how to create a basic mobile GIS application with your own vector map data, using FOSS tools like CARTO, OGR/GDAL, etc. Participants will create basic a “hello map” app for Android using CARTO Mobile SDK, learn some advanced tricks for nice and fast visualizations and interactions, and learn how to make everything work offline. While this workshop is done with Android, the Mobile SDK is available also for iOS and Xamarin/.NET platforms, where 95% of the principles are the same.

When: Monday August 22nd 1PM-6PM
Where:Gustav-Stresemann-Institut e.V

Command Line Geography

This session, presented by Erik Escoffier, will show how our beloved shell can fit into the workflow of the modern cartographer in the most surprising ways, and we will generate maps in the least expected places (your terminal, your desktop, your IDE…). This session will use CARTO Engine, along with the CARTO Node client, SQL and PostGIS, plus a host of other open source libraries (GDAL, CSVKit, Yeoman…), to be showcased as the “survival kit” for the hurried but demanding mapper.

When: Thursday August 25nd 10AM-10:30AM
Where: Bonn Room

Challenge Solving Mapping

This session, presented by Santiago Giraldo, will draw from personal experiences working with open source projects and technologies at CARTO, this talk will dive deep into both decision making use-cases in solving environmental, humanitarian, urban and business/economic challenges at all scales; and offer insight into the future of open source location intelligence.

When: Friday August 26nd 2:30PM-3PM
Where: Tunnel

With so many great things lined up, were looking forward to a phenomenal week with the FOSS4G community. From the pre-conference to the pub crawls, make sure to connect with us!

Happy data mapping & analyzing!


Pokémon GO is All About Location Intelligence

$
0
0

Pokémon GO is Apple’s most downloaded app in a first week ever, and reached an estimated 100M Android downloads from the Google Play Store as of three days ago.

In this game, where users try to “catch” different Pokémon types by walking around their local neighborhoods—or by traveling to the locations that host specific species—the Points of Interest (POIs) are distributed around the world based on user-created location data previously generated by the players of a game called Ingress, an earlier real-world exploration game built by Niantic, Inc., the software company behind Pokémon GO.

Since I first heard about the app and the game’s dynamics, I’ve been following its astronomical rise in popularity and thinking about how such a cultural phenomenon could be leveraged together with location intelligence (LI) to make better decisions. With a few simple analyses, I’ve found that quite a bit can be done—and the good news is that all of these improvements are applicable to many other use cases.

But first, returning to Pokémon:

What does LI have to do with helping me find a Pikachu?

The cartoon creatures that surface in Pokémon GO, like living beings, thrive in the habitats that correspond to their attributes and behaviors. Pikachu, a rodent Pokémon, flourishes in forests and woodlands; Squirtle, which resembles a light blue turtle, pops up near docks, canals, or harbors. Identifying the physical features of a location where these creatures reside is a task particularly well-suited to an LI platform. Finding green area hotspots, or detecting the dock that’s closest to a particular location are simple analyses that can be completed in minutes.

How can LI be used to automate the release of many Pikachus?

A simple SQL query would let you place Pikachus directly in a polygon defined by the boundaries of a forest—without the need to rely on user-generated location data.

Distributions of various Pokémon could also be improved using third-party data sources like the CARTO Data Observatory: more Pokémon could be positioned where the population is younger, to attract physically ambitious gamers; in high-commuter regions, to heighten player interaction; and most important, in less affluent areas, to allow people in lower-income or majority-minority communities to participate meaningfully in the game.

Using LI to Advertise with Pokémon GO, for Just $2 an Hour

Pokémon GO could generate loads of business oportunities with the insights provided through LI. 100,000,000 downloads represents A LOT of people.

It’s enough digital footprint data to drive some major decisions, and advertisers have the added benefit of knowing that most who have chosen to download Pokémon GO share a common characteristic: they are curious about video games, among other things. But while access to this digital footprint data is not likely to become public anytime soon, the Lure Modules, which allow you to attract Pokémon to a PokéStop for a limited amount of time, could easily be used to attract players to businesses.

Imagine that you know the closest path between a metro station and a POI that drives Pokémon GO user traffic. By identifying the PokéStops between your business and the closest metro stations, and then purchasing some Lure Modules, you could easily target your advertising to attract customers to your business. Lure Modules currently cost $1 every 30 minutes; an hour of hotspot for Pokémon GO users, for $2 an hour? Doesn’t that sound like an investment worth trying?

Making better cities

In every major city in the world, there is a segment of residents (and visitors!) playing Pokémon GO at any given moment. Active players move around these cities and end up meeting other players who share their interest in this game. As the density of Pokémon GO players is higher where there are PokéStops, Pokémon, or Gyms, rearranging their distribution could help cities create new public spaces or even new communities. Lower-income areas, for example, could be “promoted” with the addition of Pokémon POIs—and identifying these communities can be done in a just a few minutes on CARTO.

The map above allows you to explore demographic values related to the distributions of Gyms, PokéStops, and Pokémon by census tract.

Understanding Location Data by Democratizing Access to It

The Pokémon GO phenomenon clearly shows how key location is becoming to the industries driven by data analysis. The rapid adoption of mobile applications, together with the fact that there is always a location component to mobile phones, massively change the rules of the game. There’s just no better way to analyze the social impact of Pokémon GO—or to understand how you can employ the app to advance your business interests—than through the use of an LI platform.

And location-based augmented reality games, or pure location based applications are merely the tip of the iceberg. Making decisions based on a thorough understanding of location data is helping companies disrupt their markets, and what is today’s tool for disruption may be tomorrow’s trump card.

Collecting all the data that comes embedded with any mobile app is just part of the story, however—it’s also fundamental to unpack this data by empowering the business units within companies to analyze, predict, and discover the insights behind the mapped visualizations of geolocations. And who knows? You might just come across a Dragonite in the process.

Happy data mapping!

Join us for the Hackathon for Natural Disaster Management, in Quito!

$
0
0

CARTO is going to Ecuador! On September 2nd we will be participating in the Hackathon for Natural Disaster Management in Quito, Ecuador. The hackathon’s mission is to use data and geospatial technology to create innovative solutions to disaster risk management challenges and humanitarian response plans with a focus on volcanic eruptions, earthquakes and floods. The event is an initiative born from the Mayor’s Office of Quito, the Laboratory for Innovation of Quito and the Inter-American Development Bank’s Knowledge and Learning Department.

Cities like Quito are leveraging technology to arm themselves with as much information as possible about the risks associated with earthquakes, floods, fires, volcanic eruptions, tsunamis or a rising sea level. Geospatial technology is a crucial component to creating sustainable and practical strategies to respond quickly, effectively and comprehensively when the unthinkable happens.

In April of 2016 Ecuador suffered a devastating earthquake measuring 7.8 on the richer scale, killing hundreds of people and destroying millions of dollars in infrastructure. Following the disaster, CARTO hosted a humanitarian mapping session with Humanitarian OpenStreet Map to contribute to a post-earthquake map of earthquake-affected regions, using satellite imagery to assess damage. Humanitarian agencies use this information to inform their response. Located on one of the most active fault lines in the world, in the Andean region of South America, Ecuador has experienced just over 100 earthquakes in the last year alone, although many of these earthquakes occur so deep that they are not felt.

Ecuador also faces the threat of volcanic eruptions. Just 30 miles south of Quito is the world’s most closely monitored volcano, Cotopaxi. Last year, after 138 years of inactivity, Cotopaxi began showing signs of erupting. Five explosions were reported along with a plume of ash five kilometers long shooting into the air. Many small towns, agricultural land and the country’s capital face serious health risks, safety concerns, and severe economic difficulties in the event of an eruption.

The hackathon brings together the private sector, local government, nonprofits, the tech community, and international development institutions. Data, personnel, logistical and technical support are also being provided by event collaborators like Telefónica, #MappingEcuador, YoVeoVeo, and The National System for Information Management of Rural territories and technological infrastructure.

Prizes include $10,000 for first place overall to facilitate the real life implementation of designs and projects submitted during the hackathon. To show our support the best visualization using CARTO technology will win a 6-month CARTO enterprise account, empowering winners to make their projects become reality!

CARTO has already proven to be a valuable tool for projects that monitor fires in brazil, monitor global deforestation, predict correlative trends between mining and natural disasters in Indonesia, and assess the impact of an earthquake in Nepal.

We can’t wait to see what we can accomplish together in Quito. Stay tuned as we will be sharing some of our favorite projects.

If you are in Quito, we encourage you to participate in this fascinating two-day hackathon. See you there!

Happy data mapping, amigos!

CARTO welcomes some new members to our Sales team in North America!

$
0
0

Our Sales team in North America continues to grow quickly, and we’re excited to welcome some new faces with Brigitte Boyles, Tony Ferreira, Joe Pringle, Danny Sheehan, and Bryan Spiro to the CARTO family. Here’s a little more about them…

   Brigitte Boyles 

Brigitte Boyles

Account Executive

Brigitte joins the CARTO team in Atlanta, GA. In addition to her background in direct sales, Brigitte has also built out a UK office and ran her own investment company.

“CARTO is a fascinating technology in niche market, yet also with vast applicability. I also am very big on ‘the family/team’ at CARTO. It is not one isolated good idea, or brilliant company that guarantees success - it is the collaboration of a focused group.”

When not working, Brigitte loves to hike in the woods of northern Georgia, and spending plenty of time with family.


 
   Tony 

Tony Ferreira

Sales - Latin America

Tony joins the CARTO sales team and is our first employee in south Florida. Tony is focusing on boosting our sales in Latin America and comes to us from Qlik, where he spent the past 10+ years focused on building out their LATAM market.

“I was attracted to CARTO by their vision of the Location Intelligence market segment and the disruptive nature of their technology. I wanted to be part of the team that feels empowered to create the definition of such a market and feels (at a personal level) the responsibility for democratizing maps for the society at large.”

He will spearhead our first efforts in Latin America and we’re excited to have him join the team!


 
   Joe Pringle 

Joe Pringle

Partner Manager - North America

Joe comes to us from Socrata, a software company that designs SaaS data solutions for government institutions around the world. Joe will manage our partner relationships in North America as part of our Sales team in our Washington, DC office.

“My passion is helping large, complex organizations get more value out of their data to make better decisions, improve performance, and increase impact. And I have always loved maps, so CARTO is the perfect place for me.”


 
   Danny Sheehan 

Danny Sheehan

Customer Success Manager

Danny joins our NA Sales focusing on bringing new customers onboard. Previously he was at Columbia University, where he was a Senior GIS Analyst, working to enhance the GIS infrastructure and promote GIS and spatial analysis in teaching and research throughout the institution.

“Along with being able to work with a diverse and super interesting group of colleagues, who have a strong commitment to open-source and are passionate about democratizing spatial analysis and web mapping, being able to work with and learn more about the CARTO platform is what most excites me about working at CARTO!”


 
   Bryan Spiro 

Bryan Spiro

Senior Account Executive

Bryan joins us from IBM where he was selling analytics tools and data platforms and has also worked for other companies such as Logi Analytics and Cognos. He will join our North American Sales team and work out of our Washington, DC. office.

“I am excited to be part of the team that introduces our company and our technology to new clients. There are endless opportunities for us to help clients create value; so each day we will discover new ways to help our clients which in turn will grow our business.”

We’re very excited to have Tony, Brigitte, Joe, Danny, and Bryan drive our Sales efforts from the US!

PS: We are hiring!

Happy data mapping!

Excited for SXSW 2017? Vote for our CARTO-inspired submissions for Interactive!

$
0
0

It’s that time of year again! As professionals and technology lovers from across the world flock to Austin, TX for what has become the largest and most prolific event in music, film, and interactive technology, at CARTO we’re focused in on next year’s event to bring our brand of innovation and thought leadership front and center.

This year we’re coming in full force with panels and talks that really seek to push the boundaries of geospatial in interactive design. Be sure to vote for all three of our proposals - mapping, design, and analysis goodness guaranteed!

Today it is a great pleasure to announce our SXSW Interactive PanelPicker submissions for 2017!

Eye in the Sky: Turning Satellite Data into Cash

Our CEO, Javier de la Torre will be exploring the business of how we turn satellite data into meaningful insight. Along with Will Mashal, CEO at Planet Labs, and Mark Johnson, CEO at Descartes Labs, this panel will dive deep into the various ways companies and innovators have revolutionized an industry.

This session explores the business of satellite imagery–from players sending satellites into space to those making sense of data coming down to those turning the data into maps sensible to the human eye. We’ll explore ways businesses use imagery from thousands of miles up to solve real-world problems, while illuminating lesser known ways this data could help make businesses smarter.

Multi-Dimensional Mapping: Storytelling & Analysis

Yours truly, Santiago Giraldo Anduaga, will focus on how maps and analysis give us insights and narrative into varied dimensions of our past, present, and future. We will explore analysis and design in modern web mapping applications built with Javascript and open source projects including CartoCSS, PostgreSQL, and D3.JS.

Open Geo in the Age of Pokémon Go

Our Head of Research and Data, Stuart Lynn, will join Jeffrey Meisel from the US Census, Alyssa Wright from Mapzen, and Levi Wol from the University of Chicago to dive deep into current geospatial trends and what they mean for contemporary designers, scientists, and communities.

Pokemon Go, the game that has users all over the world searching for virtual pocket monsters, has been a runaway success. Beyond augmented reality, Pokemon Go is the first game of its scale that relies so fundamentally on geospatial technology.

The panel will bring together experts from the US Census Bureau, developers of open source location services, statisticians who mine geospatial data and designers of tools that allow the public to analyze geospatial data sources to ask: could it have been built on top of open source software and data? If so how could the massive amounts of data produced be used to for public good? What insights would it afford researchers of our shared environments?

How can you vote?

  • Log in - If you don’t have a SXSW account, sign up
  • Search and select CARTO’s panels using the above links
  • Start voting by clicking the “thumbs up” button!

Voting is open until September 2, 2016!

Happy data mapping and see you in Austin!

Using Builder for Creating Data-driven Point Maps

$
0
0

Just a few weeks ago, we started giving access to the new CARTO Builder to people on our early access list. There have been some articles and positive reactions about it (Thanks!), so we wanted to share with you some things you can do with CARTO Builder.

The new Builder focuses on making your maps more actionable. It is an all-in-one data visualization, data exploration tool, and analysis workflow in an easy-to-use, and carefully made, user interface.

Point maps

Even though the UI is quite different from the Editor, creating a visualization like a Bubble map –a map where you change the size of the different points depending on a value– is as easy as before. You just need to have a numeric column in your data, and change the size of the different points depending on the value. To do so:

  • Click on the Layer name
  • Click on the Style tab
  • Click on the point-size number
  • Click on BY VALUE
  • Select your desired column

If you want to customize your map further, you can change the quantification method for your ramp in the same component.

If you want to know more about how this works behind the scenes, check out the CartoCSS panel and Turbo-Carto repo.

Keep an eye on the blog to stay up-to-date on the coolest features of the new Builder!

Viewing all 820 articles
Browse latest View live