Map Maker for carto-masochists, part 1

I originally wrote the following approximately two weeks ago and it has been lingering as a Draft until now. I decided to wait until the start of the Esri International User Conference to publish this post. The UC has several events planned for their community mapping offerings, here’s my take on how Google’s approach has been less than impressive. Part 2 to follow available here.

Way, way back in March of 2010, I contacted Google through their Map Content Partners form to submit Rowan University’s GIS data to be included on Google Maps. I heard nothing from them – not even an automated response – for several months. In August of 2010, someone in Administration noticed that Google had relabeled Rowan University as Glassboro State College, a name not used since 1992. I was instructed to try and remedy this as soon as possible. I explained that Google had given me the cold shoulder, but I would try some different avenues. The “report a problem” feature in Google Maps did get “Glassboro State College” off the map, but Rowan remained a featureless blotch within Glassboro.

After giving up on contributing data to Google Maps, I was finally contacted by “Brandon” from the Cities in 3D Team. Brandon requested a sample of the data for review. “Finally!” I thought, “now I can submit our data for Google Maps!” I’ll admit, I got excited. In hindsight, the excitement was premature and irrational. OpenStreetMap has been updated to reflect the campus since June of 2009, when I used my Export to OSM script to dump the facilities data into .osm files. I should be focusing my efforts on a custom, Mapnik-rendered set of OSM tiles that look good on top of aerials, a “Google Maps Hybrid” layer of my own. I can then sandwich in custom tiles instead of overlaying my data on top of the annotation. (Compare anno-on-top to data-on-top.)

Anyway, I eagerly await word back from Google that our data will appear on Google Maps. The notice I receive was far from what I wanted to hear. Instead of accepting the data, I’m instructed that due to the small number of objects to be added, I should use Google Map Maker instead. I was pissed.

I find Google Map Maker to be an incredible disappointment on two major fronts; first, I refused to use the service as I felt Google was in the wrong for keeping VGI-sourced base map data under lock and key. The second, which I will elaborate upon tomorrow, involves the Map Maker tool itself. For a company such as “do no evil” Google to create a framework where users can volunteer time to build its GIS repository with no compensation – not even data retrieval – I find completely unconscionable. Compare their data download form with getting data from OpenStreetMap. To non-techies, OSM’s XML format might be intimidating, but it’s data – no forms to fill out or licenses to sign. Sure, it’s not a shapefile… but you can get them too, without signing any agreement. I loved hearing how a group of OSM mappers hijacked a Google Mapping Party (the concept itself lifted from OSM) and got the assembled group to work on OSM. Many others have asked “why Google, why not OSM?” The common thread to most Map Maker criticism and OpenStreetMap’s major issue with Map Maker is regarding access to the data that has been contributed. Why make data created of the third world (and likely by individuals in the third world) a for-sale product for a first world company? Even within your own neighborhood, why volunteer your time if you can’t reap most of the benefits?

Back from ideology to practicality, I wanted the University on Google, solely because Google is the new Mapquest; it’s the go-to map service for the average person. (Quick aside, Mapquest has Rowan University completely mapped out through its OSM-sourced open.mapquest.com.) Brandon’s earlier suggestion of Map Maker wasn’t acceptable because of my open-access advocacy leanings, it was out of time constraints. “You want me to redraw everything?” That wasn’t going to happen and I let Brandon know:

Brandon,

Thanks for the info. My major concern has been getting an “official” set of data on to Google Maps. When Google switched to their own data and pulled place names from GNIS, Rowan University reverted to Glassboro State College, a name last used in 1992. As “the map guy” for the University, I was asked by several offices within Rowan to “fix Google.” While reporting the antiquated name as a problem did get “Rowan University” restored on Google Maps, it brought the lack of campus data on Google to the attention of many in the University community. It has been frustrating for me, as I have attempted to contact Google to provide official data for use on Maps for a considerable time, while also attempting to squash bugs in the Google Maps data on our campus. Being a University, there have been “creative” additions to the campus on Google Maps, such as the fact that one of our largest academic buildings appeared as a Bed and Breakfast for about a month.

I would like to provide Google with a set of data out of our Facilities GIS DB that is the same source for our printed campus maps. The previously sent data, reformatted to match your requested schema, is from either survey data or from a 3″ planimetric image. The address information included in this layer matches Gloucester County’s 911 data. This is as official as it gets.

Google Map Maker is not a viable option for me. The data for Rowan University that is available through OpenStreetMap  was generated through an export utility that I wrote. It is the same source as I emailed you previously, except that it dates from the summer of 2009. Very little of what is on OSM was hand redrawn. Not only would it be a considerable time sink for me, the tools in Map Maker would not be able to reproduce the high quality data that already exists.

Through the Geovisualization course I teach, we are offering students the opportunity to build SketchUp models of the campus as a final project. Several of the buildings have been completed and I will be uploading them soon. The entire campus is not complete, so if you would like a shapefile with extrusion data, I’d be happy to resubmit the data with those additional attributes.

Again, I would like to thank you for taking the time to respond to me. I understand that the Cities in 3D team might not have the 2D maps as their major focus, but if you could direct my request to the correct group, I would be incredibly grateful. I initially filled out the Data Provider form in March 2010 and have resubmitted the form several times after receiving no response. I even pestered Ed Parsons over Twitter to no avail. So, I am truly appreciative of your assistance in this issue.

Thanks,
John

Brandon responded with two points that made me bristle. First, Rowan was too small for Google: “the number of buildings on campus provide a relatively low priority for Google.” This is a 215 acre campus with 50+ structures, it’s not huge, but it’s also not insignificant. Second, I was encouraged “to do as much as you can on your own, or as part of
your class with the students help.” No one volunteers my cheap labor for projects other than me, buddy.

Through the reconfiguration of our program offerings, Geography and Environmental Studies students are required to have an internship or directed study as part of their capstone research experience. I was able to find a student that really excelled at contributing to OpenStreetMap and asked him if he would be interested in working on updating three map services: Google (via Map Maker), OpenStreetMap (via JOSM) and ESRI’s Community Base Map via (ArcInfo for Advanced Desktops). He agreed and began working on updating Google Maps. I finally bit the bullet, signed into Map Maker and started working with him on some of the edits.

Tomorrow, how Map Maker can only make bad maps.

Posted in Data, ESRI, Google, Google Maps, OpenStreetMap, Technology, Uncategorized, Web Mapping | Tagged , , | 5 Comments

ArcGIS: strong enough for Server, pH balanced for Desktop

James Fee pointed out how ArcGIS is undergoing minor rewording as part of the changes coming to the software at version 10.1.

Those were the good ol' days

One thing to note is that the ArcView license level is now Basic, while the ArcEditor level is Standard. While this brings ArcGIS (for) Desktop in line with the terminology used to describe current ArcGIS Server licensing (Basic, Standard, Advanced), something about ArcEditor being Standard strikes me odd. Perhaps it’s part of being in academia too long, but it seems like ArcEditor isn’t a big seller for ESRI. To me, those looking for the additional functionality over what is offered with ArcView would opt for ArcInfo, completely bypassing Editor. Also, we have (almost) always had ArcInfo licenses for the computer labs, while the Educational Time-out discs provided to students would have the ArcView level license. This two-level mentality must resonate with more people than just me. A recent change is that the last time I requested discs for ArcGIS 9 at the beginning of 2011, ESRI sent us 9.3 ArcEditor-level educational discs. And the ArcGIS 10 education discs I recently received are ArcInfo level. So is ArcView going to be phased out as the “entry-level” ArcGIS? And is ArcEditor ArcGIS for Desktop Standard going to see a decrease in price?

While I personally will miss the quirkiness of ESRI’s licensing terminology, I can see why it is being done. The progression of Basic, Standard, Advanced is clear while View, Editor, Info is not. Especially with the fact that some people are still using ArcView 3 (uninstall, already!) which is completely distinct from the ArcMap program in ArcGIS (for Desktop) 8.x and later.

What’s still unanswered for me is what happens to some of the other “ArcGIS” products. ArcPad? ArcGIS Explorer? ArcReader? They don’t get fancy new names?

Posted in ESRI, In the News | Tagged , , , , , | 2 Comments

Back to the New Normal

It’s been a while since I last posted to the ol’ Blog. After I returned from the DevSummit in March, my free time dwindled down to nothing. The end of the spring semester has been a whirlwind of activity; developing an online course, tackling several research projects, presenting at the National Guard’s CFMO University, and the usual end of the semester tasks like grading, projects, etc. Now that the semester is over and I’m a little more free to tackle projects, I hope that I’ll be able to blog some more about GIS in New Jersey. I’m still going to be busy; we have two faculty members to replace and even more students in our GIS courses, but I think summer will be a good time for me to refocus on programming and developing our GeoLab into a more robust research lab.

One interesting project that has popped up recently is NJ’s Broadband Map. You can dig through the data to find which areas of the State are served with broadband Internet. I think the color scheme needs to be rethought, as dark green to light purple is better suited to divergent or bimodal data, not to a linear progression of 1 to 8 broadband providers.

I’ll be at the ESRI DevMeetup tonight in Philadelphia, giving a lightning talk on the Land Change Viewer app I developed. Next week at the NJGF, I’ll give a 5 minute talk on the ArcGIS license monitor application I’m writing. I’ve got a couple other tidbits in the pipeline and hopefully I’ll be able to share them here in the next few weeks.

Posted in Technology, Tools and Scripts, Updates, Web Mapping | Tagged , , , | Leave a comment

Some thoughts on the ESRI DevSummit

Geography Word Cloud BannerI’m back from the sixth ESRI DevSummit. It was a great event full of informative sessions, socializing and networking. This was one of the first conferences in a while where I did not participate more than simply attending. The DevSummit is truly for devoted developers and while I do some development, it’s nowhere near what I could call full time. Many of the user presentations were incredible displays of GIS geekery and I’m still in awe with what some people are doing with the software. Continue reading

Posted in Conferences, ESRI, Events, Technology | Tagged , , , , , , | 5 Comments

March Madness

Back in January, I had every intention of updating this weekly, but once the semester starts, all bets were off.

It’s been a crazy few weeks, juggling several research projects, two classes and compiling everything needed for my recontracting at Rowan. The last two weeks have been especially tasking; even without the occasional curve ball, I still lacked the hours in the day to get everything done. I need a break, but before that can occur, I need all the boxes checked on my to-do list. Tomorrow and Friday are going to be a blur of activity in attempt to get everything wrapped up by the week’s end.

Next week, I’m fortunate to be heading out to Palm Springs for the ESRI DevSummit. I’m really looking forward to learning more about the latest web mapping technologies. When it comes to server-side GIS, the Windows/.Net-based “ESRI Stack” is still a little foreign to me and it’ll be good to see how I could incorporate some ArcGIS-based technologies into my open source-based map services.

I’m also hoping to meet up with a few GIS folks I’ve followed on Twitter. While individuals at ESRI have been incredibly helpful with specific issues, I’ve found their online documentation to be lacking. There are several ESRI staff and third-party developers whose blog posts about an issue or a technology have clarified things for me and I’d like to let them know that in person.

Also, the DevSummit is the week before Spring Break. I’m not one to cancel class, so I’ve put materials online for my students and will likely Skype back in during class time. The question is, do I video call from my hotel room or do I conduct class poolside under a clear blue sky? Decisions, decisions.

Posted in Conferences, Events, Technology, Tools and Scripts, Web Mapping | Tagged , , , | 1 Comment

Thoughts on the start of the Spring Semester

Today marks the beginning of the Spring Semester. For many students, this will be their last semester at Rowan University. For me, I’ll be teaching GIS II, which is mostly upperclassmen, and Intro to Mapping and GIS, which is more mixed, but often filled with freshmen. I know most of my GIS II students by now; all of the Intro to Mapping students are brand new faces. One big change this semester is that I’m in the Pilot Group for the University’s move to the newest version of Blackboard. I’ve been rewriting my materials so that more of the course is available through the web. In doing so, I’m putting more of my materials out there on the web for anyone to use, provided they comply with the Creative Commons license. While most of my presentations have been available online for anyone to view, the class materials have been a somewhat different story; if I’ve put them online, it was only on my university web page and not a service like SlideShare. I feel more reserved about posting classroom materials online for two main reasons. Continue reading

Posted in Teaching, Technology | Tagged , , | 3 Comments

2cm Photography of the Ongoing Flooding in Queensland

NearMap has released an interactive map showing the imagery acquired this week of the flooding around Brisbane. 2cm imagery, less than a week old, available around the world through the internet. Pretty soon, laughing about how some fools think the images on Google Maps are real-time will be a thing of the past.

More on NearMap from Slashgeo.

Posted in Aerial Photography, In the News, Technology | Tagged , , , , | Leave a comment

Dangerous Cartography

Palin's target mapBack in March of 2010, Sarah Palin’s PAC released a map of “democratic targets” she would like to see out of office. The map, depicted at right, used gunsights to highlight where the representatives she wants gone are located.

Sadly, today someone shot one of the representatives on Palin’s map. CNN is reporting that Representative Gabrielle Giffords is in surgery; Fox News already listed her as deceased. (Perhaps it was wishful thinking on their part.)

While politics in the US has a long history of unpleasantness, from childish chanting over impropriety to fights and even severe beatings on the floor of the Capitol, I’m still shocked that one party would go so far to imply assassination as part of political fundraising.

I hope Rep. Giffords makes a speedy, complete recovery.

Update: Video of Giffords commenting on the map above and the vandalism and threats it brought. “Sarah Palin has the crosshairs of a gun sight over our district and when people do that, they’ve gotta realize there are consequences to that action.”

Posted in Government, In the News | Tagged , , , | 4 Comments

Repetitive tasks are what computers do best.

James Fee recently noted that 2011 will be the year of scripting GIS tasks using Python. I’d like to share a few thoughts I had while reading his writeup.

Back in 2003, when I was learning GIS using ArcGIS 8, I wanted to put together a map of lottery winners in New Jersey by ZIP code. (I’ve since recreated the map as a set of interactive web maps.) I wrote a quick and dirty script in Perl that hit the State Lottery’s website and downloaded the number of winners in each ZIP code. After I came out of “the zone” and watched the script work away, I thought, “why can’t I do that with ArcGIS?” I wasn’t going to manually type in each ZIP code and insert my findings into a table. Considering it was a “let’s see if I can do it” project, I would have likely lost interest before getting all of my data. I knew better than to go the data-entry route and wrote a script to do it for me. Repetitive, mindless tasks are what computers do best – I was able to have it gather data (tedious, but necessary) to allow me to make the maps (the fun part) in an afternoon. Being able to automate some of the tedious aspects of GIS would be a blessing.

Continue reading

Posted in ESRI, Technology, Uncategorized | Tagged , , , , , | Leave a comment

High Expectations for Barnes & Nobles in Glassboro

It’s only the third day and Barnes and Nobles is starting to disappoint me. I understand that they just opened, but I feel that the disappointments are only going to continue. The selection of books is minimal; on par with or less than the regular selection at the Deptford store. Being “faculty,” I will be able to request that they stock a few extra copies of books I “recommend” (not require) but these books will not be in the general circulation; they will be upstairs with the rest of the textbooks. The Art (and thus Architecture) section is undersized, as well as the Social Sciences/Cultural Studies. This means that Geography and Planning books have a very small, blink-and-miss-it section of shelf in the general circulation.

Currently, the wifi in the Cafe section does not work, so when this is posted, it will be later, from on campus. This should, I hope, only be a temporary inconvenience. Last night, on their second day open, I stopped by at 9:30 after grocery shopping. They were closed. The Cafe, while able to be open for a longer period than the main store, is not. Both the bookstore and the cafe are going to close at the same time, 9pm. This is an incredible disappointment. I also found from the Cafe staff this morning that there are no currently no plans to change the arrangement, even though I heard B&N staff inform the police (during a walkthrough on opening day) that the cafe can be open later. I know “can” and “will” are two very different words, but my hopes are diminishing.

Maybe I have to wait for more of the Rowan Boulevard project to be completed. After all, this B&N is the only commercial building on the street. From where I sit, I can see work proceed on the mixed use “A-1″ building, which will hopefully generate more of a street life on Rowan Boulevard. I still have high hopes for the project overall, but even after it is complete, if Glassboro’s going to roll up the streets at 9pm, the only incentive I have to live in the ‘Boro is that I’m within biking distance of Rowan.

Posted in Events, In the News | Tagged , , , | Leave a comment